[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:12:19.040695 18407 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.249.254:35783
I20260709 12:12:19.042418 18407 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:12:19.043560 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:19.063040 18413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:19.063009 18414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:19.064064 18416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:19.065290 18407 server_base.cc:1061] running on GCE node
I20260709 12:12:20.331457 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:20.331728 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:20.332011 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599140331980 us; error 0 us; skew 500 ppm
I20260709 12:12:20.333016 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:20.339994 18407 webserver.cc:533] Webserver started at http://127.17.249.254:38627/ using document root <none> and password file <none>
I20260709 12:12:20.340991 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:20.341245 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:20.341743 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:20.348119 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/master-0-root/instance:
uuid: "e226176d4cd1420384f2495d2ab3aef9"
format_stamp: "Formatted at 2026-07-09 12:12:20 on dist-test-slave-7mcn"
I20260709 12:12:20.357810 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:12:20.364152 18422 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:20.365805 18407 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:12:20.366333 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/master-0-root
uuid: "e226176d4cd1420384f2495d2ab3aef9"
format_stamp: "Formatted at 2026-07-09 12:12:20 on dist-test-slave-7mcn"
I20260709 12:12:20.366747 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:20.428977 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:20.431120 18407 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:12:20.431757 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:20.517902 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.254:35783
I20260709 12:12:20.518052 18473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.254:35783 every 8 connection(s)
I20260709 12:12:20.527774 18474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:20.556084 18474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9: Bootstrap starting.
I20260709 12:12:20.566890 18474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:20.569626 18474 log.cc:826] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9: Log is configured to *not* fsync() on all Append() calls
I20260709 12:12:20.576363 18474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9: No bootstrap required, opened a new log
I20260709 12:12:20.603127 18474 raft_consensus.cc:359] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e226176d4cd1420384f2495d2ab3aef9" member_type: VOTER }
I20260709 12:12:20.603955 18474 raft_consensus.cc:385] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:20.604246 18474 raft_consensus.cc:740] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e226176d4cd1420384f2495d2ab3aef9, State: Initialized, Role: FOLLOWER
I20260709 12:12:20.605340 18474 consensus_queue.cc:260] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e226176d4cd1420384f2495d2ab3aef9" member_type: VOTER }
I20260709 12:12:20.605933 18474 raft_consensus.cc:399] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:20.606277 18474 raft_consensus.cc:493] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:20.606669 18474 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:20.612684 18474 raft_consensus.cc:515] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e226176d4cd1420384f2495d2ab3aef9" member_type: VOTER }
I20260709 12:12:20.613696 18474 leader_election.cc:304] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e226176d4cd1420384f2495d2ab3aef9; no voters: 
I20260709 12:12:20.615947 18474 leader_election.cc:290] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:20.616431 18477 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:20.619505 18477 raft_consensus.cc:697] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [term 1 LEADER]: Becoming Leader. State: Replica: e226176d4cd1420384f2495d2ab3aef9, State: Running, Role: LEADER
I20260709 12:12:20.620639 18477 consensus_queue.cc:237] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e226176d4cd1420384f2495d2ab3aef9" member_type: VOTER }
I20260709 12:12:20.621970 18474 sys_catalog.cc:565] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:20.637403 18479 sys_catalog.cc:455] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e226176d4cd1420384f2495d2ab3aef9. Latest consensus state: current_term: 1 leader_uuid: "e226176d4cd1420384f2495d2ab3aef9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e226176d4cd1420384f2495d2ab3aef9" member_type: VOTER } }
I20260709 12:12:20.637813 18478 sys_catalog.cc:455] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e226176d4cd1420384f2495d2ab3aef9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e226176d4cd1420384f2495d2ab3aef9" member_type: VOTER } }
I20260709 12:12:20.638792 18478 sys_catalog.cc:458] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:20.638656 18479 sys_catalog.cc:458] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:20.642014 18487 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:20.657979 18487 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:20.662027 18407 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:20.678764 18487 catalog_manager.cc:1383] Generated new cluster ID: 6927bf23efe04c159da209b72292b2b4
I20260709 12:12:20.679179 18487 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:20.703384 18487 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:20.705693 18487 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:20.735321 18487 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9: Generated new TSK 0
I20260709 12:12:20.736450 18487 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:20.794641 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:20.807662 18496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:20.809573 18497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:20.817104 18407 server_base.cc:1061] running on GCE node
W20260709 12:12:20.817904 18499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:20.819272 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:20.819490 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:20.819710 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599140819689 us; error 0 us; skew 500 ppm
I20260709 12:12:20.820436 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:20.826254 18407 webserver.cc:533] Webserver started at http://127.17.249.193:34365/ using document root <none> and password file <none>
I20260709 12:12:20.827023 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:20.827260 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:20.827605 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:20.828986 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-0-root/instance:
uuid: "8683cb3284784fef81af120ce39d5e51"
format_stamp: "Formatted at 2026-07-09 12:12:20 on dist-test-slave-7mcn"
I20260709 12:12:20.836426 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:20.842177 18504 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:20.843519 18407 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.002s
I20260709 12:12:20.843924 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-0-root
uuid: "8683cb3284784fef81af120ce39d5e51"
format_stamp: "Formatted at 2026-07-09 12:12:20 on dist-test-slave-7mcn"
I20260709 12:12:20.844375 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:20.867190 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:20.868994 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:20.872236 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:20.878342 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:20.878626 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:20.879092 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:20.879276 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:21.014513 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.193:41915
I20260709 12:12:21.014676 18566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.193:41915 every 8 connection(s)
I20260709 12:12:21.023774 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:21.041371 18571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:21.043459 18572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:21.055292 18407 server_base.cc:1061] running on GCE node
W20260709 12:12:21.057083 18574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:21.058204 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:21.058411 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:21.058535 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599141058524 us; error 0 us; skew 500 ppm
I20260709 12:12:21.059242 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:21.060702 18567 heartbeater.cc:344] Connected to a master server at 127.17.249.254:35783
I20260709 12:12:21.061370 18567 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:21.062983 18567 heartbeater.cc:507] Master 127.17.249.254:35783 requested a full tablet report, sending...
I20260709 12:12:21.067536 18407 webserver.cc:533] Webserver started at http://127.17.249.194:38475/ using document root <none> and password file <none>
I20260709 12:12:21.067853 18439 ts_manager.cc:194] Registered new tserver with Master: 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915)
I20260709 12:12:21.068164 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:21.068701 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:21.069164 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:21.070477 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-1-root/instance:
uuid: "b7647311c5df4756a2d5e112021c8512"
format_stamp: "Formatted at 2026-07-09 12:12:21 on dist-test-slave-7mcn"
I20260709 12:12:21.072027 18439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58344
I20260709 12:12:21.076709 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:21.081307 18579 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:21.082363 18407 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:12:21.082717 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-1-root
uuid: "b7647311c5df4756a2d5e112021c8512"
format_stamp: "Formatted at 2026-07-09 12:12:21 on dist-test-slave-7mcn"
I20260709 12:12:21.083132 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:21.112268 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:21.113651 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:21.116030 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:21.119606 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:21.119844 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:21.120105 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:21.120276 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:21.227200 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.194:35619
I20260709 12:12:21.227365 18641 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.194:35619 every 8 connection(s)
I20260709 12:12:21.235986 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:21.243579 18645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:21.251504 18646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:21.253343 18642 heartbeater.cc:344] Connected to a master server at 127.17.249.254:35783
I20260709 12:12:21.254024 18642 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:21.254948 18642 heartbeater.cc:507] Master 127.17.249.254:35783 requested a full tablet report, sending...
W20260709 12:12:21.257684 18648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:21.257920 18439 ts_manager.cc:194] Registered new tserver with Master: b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:21.259284 18407 server_base.cc:1061] running on GCE node
I20260709 12:12:21.260288 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:21.260530 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:21.260422 18439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58358
I20260709 12:12:21.260916 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599141260873 us; error 0 us; skew 500 ppm
I20260709 12:12:21.261557 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:21.265933 18407 webserver.cc:533] Webserver started at http://127.17.249.195:39579/ using document root <none> and password file <none>
I20260709 12:12:21.266489 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:21.266700 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:21.267071 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:21.268249 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-2-root/instance:
uuid: "50b49485ef1b42068695f8e0ed8a3606"
format_stamp: "Formatted at 2026-07-09 12:12:21 on dist-test-slave-7mcn"
I20260709 12:12:21.273722 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:12:21.278821 18653 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:21.280078 18407 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:12:21.280534 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-2-root
uuid: "50b49485ef1b42068695f8e0ed8a3606"
format_stamp: "Formatted at 2026-07-09 12:12:21 on dist-test-slave-7mcn"
I20260709 12:12:21.280889 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599138854584-18407-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:21.300670 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:21.302423 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:21.305097 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:21.309418 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:21.309731 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:21.310065 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:21.310213 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:21.428421 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.195:43979
I20260709 12:12:21.428705 18715 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.195:43979 every 8 connection(s)
I20260709 12:12:21.449759 18716 heartbeater.cc:344] Connected to a master server at 127.17.249.254:35783
I20260709 12:12:21.450270 18716 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:21.451399 18716 heartbeater.cc:507] Master 127.17.249.254:35783 requested a full tablet report, sending...
I20260709 12:12:21.453974 18439 ts_manager.cc:194] Registered new tserver with Master: 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:21.454099 18407 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017696258s
I20260709 12:12:21.455824 18439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58366
I20260709 12:12:21.520170 18439 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58374:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:21.524618 18439 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 12:12:21.648138 18486 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:21.658226 18607 tablet_service.cc:1511] Processing CreateTablet for tablet 35af2dcd4cd04070808d3d78fc5a40b3 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:21.660097 18605 tablet_service.cc:1511] Processing CreateTablet for tablet e2c55d36760f4b02a71a21572418ec9c (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:21.660475 18607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35af2dcd4cd04070808d3d78fc5a40b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.661603 18605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c55d36760f4b02a71a21572418ec9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.658383 18606 tablet_service.cc:1511] Processing CreateTablet for tablet 91a22cb623e847d09518e9e0f2fdb9ba (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:21.663856 18606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a22cb623e847d09518e9e0f2fdb9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.672757 18532 tablet_service.cc:1511] Processing CreateTablet for tablet 35af2dcd4cd04070808d3d78fc5a40b3 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:21.673753 18531 tablet_service.cc:1511] Processing CreateTablet for tablet 91a22cb623e847d09518e9e0f2fdb9ba (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:21.674510 18532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35af2dcd4cd04070808d3d78fc5a40b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.675235 18531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a22cb623e847d09518e9e0f2fdb9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.679126 18529 tablet_service.cc:1511] Processing CreateTablet for tablet 11e449fe6895497ca5bc524b2cf40381 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:21.680742 18529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e449fe6895497ca5bc524b2cf40381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.683642 18530 tablet_service.cc:1511] Processing CreateTablet for tablet e2c55d36760f4b02a71a21572418ec9c (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:21.685184 18530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c55d36760f4b02a71a21572418ec9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.687143 18604 tablet_service.cc:1511] Processing CreateTablet for tablet 11e449fe6895497ca5bc524b2cf40381 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:21.688668 18604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e449fe6895497ca5bc524b2cf40381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.688210 18603 tablet_service.cc:1511] Processing CreateTablet for tablet 49d13c214ec3462a90d8f75264011372 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:12:21.690260 18603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d13c214ec3462a90d8f75264011372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.697773 18528 tablet_service.cc:1511] Processing CreateTablet for tablet 49d13c214ec3462a90d8f75264011372 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:12:21.719739 18527 tablet_service.cc:1511] Processing CreateTablet for tablet 515aa89b6083412fbb678d19240cfb85 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:21.721797 18527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 515aa89b6083412fbb678d19240cfb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.725593 18528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d13c214ec3462a90d8f75264011372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.731251 18602 tablet_service.cc:1511] Processing CreateTablet for tablet 515aa89b6083412fbb678d19240cfb85 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:21.733625 18602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 515aa89b6083412fbb678d19240cfb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.750217 18526 tablet_service.cc:1511] Processing CreateTablet for tablet 04f44e0740d54053833a5c24f22bf38f (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:21.756772 18681 tablet_service.cc:1511] Processing CreateTablet for tablet 35af2dcd4cd04070808d3d78fc5a40b3 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:21.758396 18681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35af2dcd4cd04070808d3d78fc5a40b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.760208 18680 tablet_service.cc:1511] Processing CreateTablet for tablet 91a22cb623e847d09518e9e0f2fdb9ba (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:21.762012 18680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a22cb623e847d09518e9e0f2fdb9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.763559 18734 tablet_bootstrap.cc:492] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51: Bootstrap starting.
I20260709 12:12:21.778520 18601 tablet_service.cc:1511] Processing CreateTablet for tablet 04f44e0740d54053833a5c24f22bf38f (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:21.776245 18526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f44e0740d54053833a5c24f22bf38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.764361 18679 tablet_service.cc:1511] Processing CreateTablet for tablet e2c55d36760f4b02a71a21572418ec9c (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:21.791157 18678 tablet_service.cc:1511] Processing CreateTablet for tablet 11e449fe6895497ca5bc524b2cf40381 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:21.774065 18677 tablet_service.cc:1511] Processing CreateTablet for tablet 49d13c214ec3462a90d8f75264011372 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:12:21.796507 18601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f44e0740d54053833a5c24f22bf38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.799983 18676 tablet_service.cc:1511] Processing CreateTablet for tablet 515aa89b6083412fbb678d19240cfb85 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:21.800282 18678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e449fe6895497ca5bc524b2cf40381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.812394 18676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 515aa89b6083412fbb678d19240cfb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.818116 18675 tablet_service.cc:1511] Processing CreateTablet for tablet 04f44e0740d54053833a5c24f22bf38f (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:21.843678 18735 tablet_bootstrap.cc:492] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512: Bootstrap starting.
I20260709 12:12:21.847822 18679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c55d36760f4b02a71a21572418ec9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.850234 18675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f44e0740d54053833a5c24f22bf38f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.858532 18532 tablet_service.cc:1511] Processing CreateTablet for tablet 165f73119613475ca0dcd63be023aa10 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:21.859318 18603 tablet_service.cc:1511] Processing CreateTablet for tablet 165f73119613475ca0dcd63be023aa10 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:21.860240 18532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165f73119613475ca0dcd63be023aa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.862032 18603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165f73119613475ca0dcd63be023aa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.876629 18674 tablet_service.cc:1511] Processing CreateTablet for tablet 165f73119613475ca0dcd63be023aa10 (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:21.884922 18677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d13c214ec3462a90d8f75264011372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.903893 18674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165f73119613475ca0dcd63be023aa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.993979 18531 tablet_service.cc:1511] Processing CreateTablet for tablet f1c8b362cf37450dafcfc8a70b5fed9a (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:21.995783 18531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c8b362cf37450dafcfc8a70b5fed9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:22.015668 18734 tablet_bootstrap.cc:654] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.040895 18601 tablet_service.cc:1511] Processing CreateTablet for tablet f1c8b362cf37450dafcfc8a70b5fed9a (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:22.042539 18601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c8b362cf37450dafcfc8a70b5fed9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:22.049222 18673 tablet_service.cc:1511] Processing CreateTablet for tablet f1c8b362cf37450dafcfc8a70b5fed9a (DEFAULT_TABLE table=test-workload [id=f9e65dcc644b49d3bb3b8487f4942f09]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:22.051045 18673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c8b362cf37450dafcfc8a70b5fed9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:22.077196 18567 heartbeater.cc:499] Master 127.17.249.254:35783 was elected leader, sending a full tablet report...
I20260709 12:12:22.073071 18735 tablet_bootstrap.cc:654] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.088064 18736 tablet_bootstrap.cc:492] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606: Bootstrap starting.
I20260709 12:12:22.124078 18734 tablet_bootstrap.cc:492] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51: No bootstrap required, opened a new log
I20260709 12:12:22.124912 18734 ts_tablet_manager.cc:1403] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51: Time spent bootstrapping tablet: real 0.362s	user 0.015s	sys 0.020s
I20260709 12:12:22.129186 18735 tablet_bootstrap.cc:492] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512: No bootstrap required, opened a new log
I20260709 12:12:22.130072 18735 ts_tablet_manager.cc:1403] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512: Time spent bootstrapping tablet: real 0.323s	user 0.009s	sys 0.011s
I20260709 12:12:22.140805 18736 tablet_bootstrap.cc:654] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.140334 18734 raft_consensus.cc:359] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:22.143632 18734 raft_consensus.cc:385] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.144158 18734 raft_consensus.cc:740] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.145176 18734 consensus_queue.cc:260] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:22.147864 18735 raft_consensus.cc:359] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:22.148710 18735 raft_consensus.cc:385] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.149024 18735 raft_consensus.cc:740] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.149791 18735 consensus_queue.cc:260] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:22.156404 18736 tablet_bootstrap.cc:492] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606: No bootstrap required, opened a new log
I20260709 12:12:22.156522 18735 ts_tablet_manager.cc:1434] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 12:12:22.157472 18736 ts_tablet_manager.cc:1403] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.004s
I20260709 12:12:22.158241 18642 heartbeater.cc:499] Master 127.17.249.254:35783 was elected leader, sending a full tablet report...
I20260709 12:12:22.162737 18736 raft_consensus.cc:359] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.164067 18736 raft_consensus.cc:385] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.164497 18736 raft_consensus.cc:740] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.165916 18736 consensus_queue.cc:260] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.171979 18735 tablet_bootstrap.cc:492] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512: Bootstrap starting.
I20260709 12:12:22.180707 18734 ts_tablet_manager.cc:1434] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51: Time spent starting tablet: real 0.055s	user 0.015s	sys 0.026s
I20260709 12:12:22.182260 18734 tablet_bootstrap.cc:492] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51: Bootstrap starting.
I20260709 12:12:22.183274 18716 heartbeater.cc:499] Master 127.17.249.254:35783 was elected leader, sending a full tablet report...
I20260709 12:12:22.189893 18736 ts_tablet_manager.cc:1434] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606: Time spent starting tablet: real 0.032s	user 0.014s	sys 0.000s
W20260709 12:12:22.190424 18717 tablet.cc:2406] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:22.191256 18734 tablet_bootstrap.cc:654] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.191329 18736 tablet_bootstrap.cc:492] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606: Bootstrap starting.
I20260709 12:12:22.195525 18735 tablet_bootstrap.cc:654] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.205631 18736 tablet_bootstrap.cc:654] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.209690 18734 tablet_bootstrap.cc:492] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51: No bootstrap required, opened a new log
I20260709 12:12:22.210389 18734 ts_tablet_manager.cc:1403] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51: Time spent bootstrapping tablet: real 0.028s	user 0.000s	sys 0.015s
I20260709 12:12:22.213816 18734 raft_consensus.cc:359] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.214967 18734 raft_consensus.cc:385] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.215363 18734 raft_consensus.cc:740] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.219214 18734 consensus_queue.cc:260] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.220654 18736 tablet_bootstrap.cc:492] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606: No bootstrap required, opened a new log
I20260709 12:12:22.221287 18736 ts_tablet_manager.cc:1403] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.008s
I20260709 12:12:22.224344 18734 ts_tablet_manager.cc:1434] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:12:22.227217 18734 tablet_bootstrap.cc:492] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51: Bootstrap starting.
I20260709 12:12:22.226697 18736 raft_consensus.cc:359] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.227680 18736 raft_consensus.cc:385] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.228041 18736 raft_consensus.cc:740] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.229245 18735 tablet_bootstrap.cc:492] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512: No bootstrap required, opened a new log
I20260709 12:12:22.231324 18735 ts_tablet_manager.cc:1403] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.018s
I20260709 12:12:22.233045 18739 raft_consensus.cc:493] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.233613 18739 raft_consensus.cc:515] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:22.235088 18735 raft_consensus.cc:359] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.235920 18735 raft_consensus.cc:385] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.236297 18735 raft_consensus.cc:740] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.237463 18739 leader_election.cc:290] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:22.237150 18735 consensus_queue.cc:260] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.229096 18736 consensus_queue.cc:260] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.239918 18736 ts_tablet_manager.cc:1434] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.007s
I20260709 12:12:22.241066 18736 tablet_bootstrap.cc:492] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606: Bootstrap starting.
I20260709 12:12:22.249992 18736 tablet_bootstrap.cc:654] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.252882 18735 ts_tablet_manager.cc:1434] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:12:22.254194 18735 tablet_bootstrap.cc:492] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512: Bootstrap starting.
I20260709 12:12:22.259162 18734 tablet_bootstrap.cc:654] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.267367 18735 tablet_bootstrap.cc:654] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.276690 18735 tablet_bootstrap.cc:492] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512: No bootstrap required, opened a new log
I20260709 12:12:22.277300 18735 ts_tablet_manager.cc:1403] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:12:22.282343 18736 tablet_bootstrap.cc:492] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606: No bootstrap required, opened a new log
I20260709 12:12:22.283130 18736 ts_tablet_manager.cc:1403] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606: Time spent bootstrapping tablet: real 0.042s	user 0.003s	sys 0.015s
I20260709 12:12:22.287696 18735 raft_consensus.cc:359] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.289641 18735 raft_consensus.cc:385] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.290037 18735 raft_consensus.cc:740] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.291915 18735 consensus_queue.cc:260] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.292595 18736 raft_consensus.cc:359] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:22.296403 18736 raft_consensus.cc:385] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.299871 18735 ts_tablet_manager.cc:1434] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 12:12:22.301216 18735 tablet_bootstrap.cc:492] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512: Bootstrap starting.
I20260709 12:12:22.298514 18736 raft_consensus.cc:740] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.306702 18734 tablet_bootstrap.cc:492] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51: No bootstrap required, opened a new log
I20260709 12:12:22.307274 18734 ts_tablet_manager.cc:1403] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.004s
I20260709 12:12:22.304031 18736 consensus_queue.cc:260] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:22.317018 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:22.319983 18736 ts_tablet_manager.cc:1434] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.001s
I20260709 12:12:22.320063 18691 raft_consensus.cc:2468] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 0.
I20260709 12:12:22.323477 18736 tablet_bootstrap.cc:492] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606: Bootstrap starting.
I20260709 12:12:22.323259 18508 leader_election.cc:304] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51; no voters: 
I20260709 12:12:22.322572 18734 raft_consensus.cc:359] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.324255 18734 raft_consensus.cc:385] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.324605 18739 raft_consensus.cc:2804] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.324781 18734 raft_consensus.cc:740] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.325101 18739 raft_consensus.cc:493] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.328955 18739 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.329236 18734 consensus_queue.cc:260] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.335687 18735 tablet_bootstrap.cc:654] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.336584 18736 tablet_bootstrap.cc:654] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.336918 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:22.338562 18617 raft_consensus.cc:2468] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 0.
I20260709 12:12:22.342052 18734 ts_tablet_manager.cc:1434] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.010s
I20260709 12:12:22.343350 18734 tablet_bootstrap.cc:492] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51: Bootstrap starting.
I20260709 12:12:22.343874 18752 raft_consensus.cc:493] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.344475 18752 raft_consensus.cc:515] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.347334 18752 leader_election.cc:290] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:22.348379 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:22.349300 18617 raft_consensus.cc:2468] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 0.
I20260709 12:12:22.349946 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:22.351900 18691 raft_consensus.cc:2468] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 0.
I20260709 12:12:22.353816 18505 leader_election.cc:304] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:22.356115 18752 raft_consensus.cc:2804] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.357388 18752 raft_consensus.cc:493] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.359404 18752 raft_consensus.cc:3060] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.357812 18739 raft_consensus.cc:515] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:22.371510 18739 leader_election.cc:290] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 election: Requested vote from peers 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:22.372036 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:22.373042 18691 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.377378 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:22.378643 18617 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.386070 18734 tablet_bootstrap.cc:654] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.387893 18735 tablet_bootstrap.cc:492] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512: No bootstrap required, opened a new log
I20260709 12:12:22.389775 18735 ts_tablet_manager.cc:1403] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.033s
I20260709 12:12:22.389829 18736 tablet_bootstrap.cc:492] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606: No bootstrap required, opened a new log
I20260709 12:12:22.394011 18736 ts_tablet_manager.cc:1403] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.016s
I20260709 12:12:22.395108 18691 raft_consensus.cc:2468] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 1.
I20260709 12:12:22.396504 18508 leader_election.cc:304] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51; no voters: 
I20260709 12:12:22.397621 18739 raft_consensus.cc:2804] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.396728 18735 raft_consensus.cc:359] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.397807 18736 raft_consensus.cc:359] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.399251 18735 raft_consensus.cc:385] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.401131 18736 raft_consensus.cc:385] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.401285 18735 raft_consensus.cc:740] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.401648 18736 raft_consensus.cc:740] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.401901 18617 raft_consensus.cc:2468] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 1.
I20260709 12:12:22.403091 18736 consensus_queue.cc:260] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.402769 18735 consensus_queue.cc:260] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.410723 18735 ts_tablet_manager.cc:1434] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 12:12:22.411962 18735 tablet_bootstrap.cc:492] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512: Bootstrap starting.
I20260709 12:12:22.413806 18742 raft_consensus.cc:493] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.412982 18739 raft_consensus.cc:697] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Becoming Leader. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:22.414547 18742 raft_consensus.cc:515] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.415143 18739 consensus_queue.cc:237] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:22.422755 18752 raft_consensus.cc:515] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.420019 18742 leader_election.cc:290] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:22.430869 18736 ts_tablet_manager.cc:1434] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 12:12:22.431823 18735 tablet_bootstrap.cc:654] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.435233 18736 tablet_bootstrap.cc:492] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606: Bootstrap starting.
I20260709 12:12:22.439980 18752 leader_election.cc:290] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 election: Requested vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:22.441210 18734 tablet_bootstrap.cc:492] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51: No bootstrap required, opened a new log
I20260709 12:12:22.441850 18734 ts_tablet_manager.cc:1403] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.009s
I20260709 12:12:22.441948 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:22.442745 18617 raft_consensus.cc:3060] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.442673 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:22.443563 18691 raft_consensus.cc:3060] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.459438 18617 raft_consensus.cc:2468] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 1.
I20260709 12:12:22.460423 18691 raft_consensus.cc:2468] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 1.
I20260709 12:12:22.460990 18505 leader_election.cc:304] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:22.462138 18752 raft_consensus.cc:2804] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.463142 18752 raft_consensus.cc:697] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Becoming Leader. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:22.466012 18734 raft_consensus.cc:359] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.468545 18752 consensus_queue.cc:237] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.468571 18734 raft_consensus.cc:385] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.478219 18734 raft_consensus.cc:740] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.479398 18734 consensus_queue.cc:260] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.490272 18734 ts_tablet_manager.cc:1434] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.001s
I20260709 12:12:22.491916 18755 raft_consensus.cc:493] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.492715 18755 raft_consensus.cc:515] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.493894 18736 tablet_bootstrap.cc:654] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.497411 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:22.498437 18617 raft_consensus.cc:2468] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 0.
I20260709 12:12:22.500345 18505 leader_election.cc:304] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:22.502821 18755 leader_election.cc:290] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:22.503656 18755 raft_consensus.cc:2804] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.504146 18755 raft_consensus.cc:493] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.504272 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:22.504627 18755 raft_consensus.cc:3060] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:22.506325 18508 leader_election.cc:343] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.510494 18734 tablet_bootstrap.cc:492] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51: Bootstrap starting.
I20260709 12:12:22.530524 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:22.536427 18617 raft_consensus.cc:2468] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 0.
I20260709 12:12:22.539880 18654 leader_election.cc:304] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:22.535181 18437 catalog_manager.cc:5697] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8683cb3284784fef81af120ce39d5e51 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "8683cb3284784fef81af120ce39d5e51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.541147 18742 raft_consensus.cc:2804] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.541316 18735 tablet_bootstrap.cc:492] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512: No bootstrap required, opened a new log
I20260709 12:12:22.541585 18742 raft_consensus.cc:493] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.541877 18735 ts_tablet_manager.cc:1403] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512: Time spent bootstrapping tablet: real 0.130s	user 0.025s	sys 0.036s
I20260709 12:12:22.541919 18742 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.544638 18755 raft_consensus.cc:515] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.548846 18735 raft_consensus.cc:359] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.553040 18735 raft_consensus.cc:385] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.553565 18735 raft_consensus.cc:740] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.554757 18735 consensus_queue.cc:260] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.558709 18736 tablet_bootstrap.cc:492] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606: No bootstrap required, opened a new log
I20260709 12:12:22.559584 18736 ts_tablet_manager.cc:1403] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606: Time spent bootstrapping tablet: real 0.128s	user 0.021s	sys 0.002s
I20260709 12:12:22.558552 18742 raft_consensus.cc:515] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.563807 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:22.566080 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:22.566641 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:22.567219 18617 raft_consensus.cc:3060] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:22.567703 18508 leader_election.cc:343] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.565413 18755 leader_election.cc:290] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 election: Requested vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:22.568133 18736 raft_consensus.cc:359] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.570410 18736 raft_consensus.cc:385] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.570675 18735 ts_tablet_manager.cc:1434] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.009s
W20260709 12:12:22.570465 18655 leader_election.cc:343] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.572144 18735 tablet_bootstrap.cc:492] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512: Bootstrap starting.
I20260709 12:12:22.576437 18734 tablet_bootstrap.cc:654] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.575700 18736 raft_consensus.cc:740] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.578722 18741 raft_consensus.cc:493] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.579581 18741 raft_consensus.cc:515] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.584509 18742 leader_election.cc:290] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:22.585773 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:22.586331 18616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:22.585848 18735 tablet_bootstrap.cc:654] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.581477 18617 raft_consensus.cc:2468] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 1.
I20260709 12:12:22.587986 18616 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.591061 18741 leader_election.cc:290] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
W20260709 12:12:22.587977 18655 leader_election.cc:343] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.590869 18505 leader_election.cc:304] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 50b49485ef1b42068695f8e0ed8a3606
I20260709 12:12:22.593762 18755 raft_consensus.cc:2804] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.604369 18755 raft_consensus.cc:697] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Becoming Leader. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:22.587594 18736 consensus_queue.cc:260] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.608783 18736 ts_tablet_manager.cc:1434] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.007s
I20260709 12:12:22.612105 18736 tablet_bootstrap.cc:492] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606: Bootstrap starting.
I20260709 12:12:22.616477 18755 consensus_queue.cc:237] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.636395 18734 tablet_bootstrap.cc:492] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51: No bootstrap required, opened a new log
I20260709 12:12:22.632411 18616 raft_consensus.cc:2468] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 1.
I20260709 12:12:22.638023 18734 ts_tablet_manager.cc:1403] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51: Time spent bootstrapping tablet: real 0.128s	user 0.022s	sys 0.010s
I20260709 12:12:22.640995 18735 tablet_bootstrap.cc:492] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512: No bootstrap required, opened a new log
I20260709 12:12:22.640658 18654 leader_election.cc:304] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512; no voters: 8683cb3284784fef81af120ce39d5e51
I20260709 12:12:22.643512 18742 raft_consensus.cc:2804] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.647332 18735 ts_tablet_manager.cc:1403] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.007s
I20260709 12:12:22.648672 18734 raft_consensus.cc:359] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.650578 18734 raft_consensus.cc:385] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:22.653517 18486 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:22.652016 18742 raft_consensus.cc:697] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 LEADER]: Becoming Leader. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Running, Role: LEADER
I20260709 12:12:22.651738 18734 raft_consensus.cc:740] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.652107 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
W20260709 12:12:22.656898 18581 leader_election.cc:343] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.657254 18742 consensus_queue.cc:237] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.660105 18734 consensus_queue.cc:260] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.663853 18735 raft_consensus.cc:359] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.664856 18734 ts_tablet_manager.cc:1434] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:12:22.666139 18736 tablet_bootstrap.cc:654] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.669682 18735 raft_consensus.cc:385] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.670439 18735 raft_consensus.cc:740] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.671754 18735 consensus_queue.cc:260] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.669497 18734 tablet_bootstrap.cc:492] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51: Bootstrap starting.
I20260709 12:12:22.674834 18735 ts_tablet_manager.cc:1434] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 12:12:22.676030 18735 tablet_bootstrap.cc:492] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512: Bootstrap starting.
I20260709 12:12:22.686475 18735 tablet_bootstrap.cc:654] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.692258 18439 catalog_manager.cc:5697] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "50b49485ef1b42068695f8e0ed8a3606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.704501 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:22.705381 18691 raft_consensus.cc:2468] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 0.
I20260709 12:12:22.708153 18583 leader_election.cc:304] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512; no voters: 8683cb3284784fef81af120ce39d5e51
I20260709 12:12:22.709669 18741 raft_consensus.cc:2804] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.710139 18741 raft_consensus.cc:493] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.710559 18741 raft_consensus.cc:3060] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.710359 18438 catalog_manager.cc:5697] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8683cb3284784fef81af120ce39d5e51 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "8683cb3284784fef81af120ce39d5e51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:22.711849 18735 tablet_bootstrap.cc:492] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512: No bootstrap required, opened a new log
I20260709 12:12:22.712369 18735 ts_tablet_manager.cc:1403] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.007s
I20260709 12:12:22.715418 18438 catalog_manager.cc:5697] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8683cb3284784fef81af120ce39d5e51 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "8683cb3284784fef81af120ce39d5e51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:22.716409 18735 raft_consensus.cc:359] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.718830 18735 raft_consensus.cc:385] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.719496 18735 raft_consensus.cc:740] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.719801 18741 raft_consensus.cc:515] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.720403 18735 consensus_queue.cc:260] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.723814 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:22.725956 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
W20260709 12:12:22.726329 18581 leader_election.cc:343] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.726760 18691 raft_consensus.cc:3060] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.729681 18741 leader_election.cc:290] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:22.736742 18734 tablet_bootstrap.cc:654] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.732347 18735 ts_tablet_manager.cc:1434] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:12:22.741681 18736 tablet_bootstrap.cc:492] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606: No bootstrap required, opened a new log
I20260709 12:12:22.746860 18691 raft_consensus.cc:2468] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 1.
I20260709 12:12:22.747469 18736 ts_tablet_manager.cc:1403] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.006s
I20260709 12:12:22.742358 18735 tablet_bootstrap.cc:492] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512: Bootstrap starting.
I20260709 12:12:22.748376 18583 leader_election.cc:304] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512; no voters: 8683cb3284784fef81af120ce39d5e51
I20260709 12:12:22.749863 18741 raft_consensus.cc:2804] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.750432 18741 raft_consensus.cc:697] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:22.751616 18741 consensus_queue.cc:237] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.758245 18735 tablet_bootstrap.cc:654] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.762070 18736 raft_consensus.cc:359] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.763221 18736 raft_consensus.cc:385] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.763672 18736 raft_consensus.cc:740] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.764873 18736 consensus_queue.cc:260] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.771844 18735 tablet_bootstrap.cc:492] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512: No bootstrap required, opened a new log
I20260709 12:12:22.772416 18735 ts_tablet_manager.cc:1403] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.008s
I20260709 12:12:22.773156 18736 ts_tablet_manager.cc:1434] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:12:22.774324 18736 tablet_bootstrap.cc:492] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606: Bootstrap starting.
I20260709 12:12:22.775652 18735 raft_consensus.cc:359] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.776458 18735 raft_consensus.cc:385] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.776783 18735 raft_consensus.cc:740] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.778224 18735 consensus_queue.cc:260] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.785356 18734 tablet_bootstrap.cc:492] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51: No bootstrap required, opened a new log
I20260709 12:12:22.782830 18438 catalog_manager.cc:5697] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:22.785975 18734 ts_tablet_manager.cc:1403] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51: Time spent bootstrapping tablet: real 0.117s	user 0.023s	sys 0.016s
I20260709 12:12:22.787904 18736 tablet_bootstrap.cc:654] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.788057 18735 ts_tablet_manager.cc:1434] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:12:22.789157 18735 tablet_bootstrap.cc:492] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512: Bootstrap starting.
I20260709 12:12:22.790650 18734 raft_consensus.cc:359] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.791576 18734 raft_consensus.cc:385] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.791918 18734 raft_consensus.cc:740] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.792871 18734 consensus_queue.cc:260] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.801496 18735 tablet_bootstrap.cc:654] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.819696 18734 ts_tablet_manager.cc:1434] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.005s
I20260709 12:12:22.820138 18741 raft_consensus.cc:493] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.821120 18741 raft_consensus.cc:515] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.823905 18778 raft_consensus.cc:493] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.824522 18778 raft_consensus.cc:515] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.825405 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:22.826057 18542 raft_consensus.cc:2468] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 0.
I20260709 12:12:22.826751 18778 leader_election.cc:290] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:22.828531 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:22.824540 18741 leader_election.cc:290] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:22.828997 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165f73119613475ca0dcd63be023aa10" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:22.832047 18690 raft_consensus.cc:2468] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 0.
I20260709 12:12:22.827716 18581 leader_election.cc:304] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
W20260709 12:12:22.834448 18583 leader_election.cc:343] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.834744 18734 tablet_bootstrap.cc:492] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51: Bootstrap starting.
I20260709 12:12:22.835480 18583 leader_election.cc:304] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:22.828445 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165f73119613475ca0dcd63be023aa10" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:22.836227 18778 raft_consensus.cc:2804] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.836522 18542 raft_consensus.cc:2468] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 0.
I20260709 12:12:22.836724 18778 raft_consensus.cc:493] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.837071 18778 raft_consensus.cc:3060] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.838384 18741 raft_consensus.cc:2804] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:22.838838 18741 raft_consensus.cc:493] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.839250 18741 raft_consensus.cc:3060] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.854246 18734 tablet_bootstrap.cc:654] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.855329 18741 raft_consensus.cc:515] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.855219 18778 raft_consensus.cc:515] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.858392 18778 leader_election.cc:290] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:22.859054 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
W20260709 12:12:22.863960 18583 leader_election.cc:343] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:22.864621 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:22.865651 18542 raft_consensus.cc:3060] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.866809 18741 leader_election.cc:290] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:22.867128 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165f73119613475ca0dcd63be023aa10" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:22.867938 18541 raft_consensus.cc:3060] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.868885 18735 tablet_bootstrap.cc:492] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512: No bootstrap required, opened a new log
I20260709 12:12:22.869396 18735 ts_tablet_manager.cc:1403] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.023s
I20260709 12:12:22.871148 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "165f73119613475ca0dcd63be023aa10" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:22.872077 18690 raft_consensus.cc:3060] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:22.875828 18735 raft_consensus.cc:359] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.876562 18735 raft_consensus.cc:385] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.876763 18736 tablet_bootstrap.cc:492] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606: No bootstrap required, opened a new log
I20260709 12:12:22.877532 18736 ts_tablet_manager.cc:1403] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606: Time spent bootstrapping tablet: real 0.103s	user 0.024s	sys 0.051s
I20260709 12:12:22.876824 18735 raft_consensus.cc:740] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.881963 18542 raft_consensus.cc:2468] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 1.
I20260709 12:12:22.884606 18581 leader_election.cc:304] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 50b49485ef1b42068695f8e0ed8a3606
I20260709 12:12:22.885056 18735 consensus_queue.cc:260] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.887662 18741 raft_consensus.cc:2804] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.888898 18735 ts_tablet_manager.cc:1434] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:12:22.888988 18541 raft_consensus.cc:2468] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 1.
I20260709 12:12:22.890440 18581 leader_election.cc:304] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:22.891430 18778 raft_consensus.cc:2804] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:22.890445 18741 raft_consensus.cc:697] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:22.895071 18690 raft_consensus.cc:2468] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 1.
I20260709 12:12:22.889101 18736 raft_consensus.cc:359] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.898030 18736 raft_consensus.cc:385] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.899030 18736 raft_consensus.cc:740] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.900018 18736 consensus_queue.cc:260] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.896158 18741 consensus_queue.cc:237] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.902820 18736 ts_tablet_manager.cc:1434] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.002s
I20260709 12:12:22.904027 18736 tablet_bootstrap.cc:492] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606: Bootstrap starting.
I20260709 12:12:22.904089 18763 consensus_queue.cc:1048] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:22.898531 18778 raft_consensus.cc:697] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:22.908892 18778 consensus_queue.cc:237] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.909827 18734 tablet_bootstrap.cc:492] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51: No bootstrap required, opened a new log
I20260709 12:12:22.910499 18734 ts_tablet_manager.cc:1403] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.011s
I20260709 12:12:22.913978 18752 consensus_queue.cc:1048] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:22.914158 18734 raft_consensus.cc:359] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.924014 18734 raft_consensus.cc:385] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.924968 18734 raft_consensus.cc:740] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.927237 18736 tablet_bootstrap.cc:654] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.934016 18734 consensus_queue.cc:260] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.938359 18734 ts_tablet_manager.cc:1434] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:12:22.944644 18736 tablet_bootstrap.cc:492] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606: No bootstrap required, opened a new log
I20260709 12:12:22.945292 18736 ts_tablet_manager.cc:1403] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.008s
I20260709 12:12:22.945819 18734 tablet_bootstrap.cc:492] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51: Bootstrap starting.
I20260709 12:12:22.948515 18736 raft_consensus.cc:359] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.949340 18736 raft_consensus.cc:385] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.949651 18736 raft_consensus.cc:740] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.950570 18736 consensus_queue.cc:260] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.953465 18736 ts_tablet_manager.cc:1434] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:12:22.954698 18736 tablet_bootstrap.cc:492] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606: Bootstrap starting.
I20260709 12:12:22.963236 18736 tablet_bootstrap.cc:654] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.968118 18734 tablet_bootstrap.cc:654] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:22.971400 18752 consensus_queue.cc:1048] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:22.982981 18752 consensus_queue.cc:1048] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:22.985298 18438 catalog_manager.cc:5697] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:22.987767 18736 tablet_bootstrap.cc:492] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606: No bootstrap required, opened a new log
I20260709 12:12:22.988299 18736 ts_tablet_manager.cc:1403] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.011s
I20260709 12:12:22.988189 18438 catalog_manager.cc:5697] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:22.991878 18736 raft_consensus.cc:359] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:22.997438 18736 raft_consensus.cc:385] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:22.997840 18736 raft_consensus.cc:740] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Initialized, Role: FOLLOWER
I20260709 12:12:22.999356 18736 consensus_queue.cc:260] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.002641 18736 ts_tablet_manager.cc:1434] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:12:23.048036 18734 tablet_bootstrap.cc:492] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51: No bootstrap required, opened a new log
I20260709 12:12:23.048707 18734 ts_tablet_manager.cc:1403] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51: Time spent bootstrapping tablet: real 0.109s	user 0.024s	sys 0.040s
I20260709 12:12:23.053030 18734 raft_consensus.cc:359] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.053905 18734 raft_consensus.cc:385] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:23.054276 18734 raft_consensus.cc:740] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Initialized, Role: FOLLOWER
I20260709 12:12:23.055883 18734 consensus_queue.cc:260] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.058085 18734 ts_tablet_manager.cc:1434] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 12:12:23.058957 18742 raft_consensus.cc:493] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.059329 18734 tablet_bootstrap.cc:492] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51: Bootstrap starting.
I20260709 12:12:23.059610 18742 raft_consensus.cc:515] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.061852 18742 leader_election.cc:290] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:23.063839 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:23.064764 18541 raft_consensus.cc:2393] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50b49485ef1b42068695f8e0ed8a3606 in current term 1: Already voted for candidate b7647311c5df4756a2d5e112021c8512 in this term.
I20260709 12:12:23.066593 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:23.069768 18655 leader_election.cc:304] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606; no voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512
I20260709 12:12:23.070537 18742 raft_consensus.cc:3060] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.073195 18734 tablet_bootstrap.cc:654] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:23.078110 18742 raft_consensus.cc:2749] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:23.078820 18734 tablet_bootstrap.cc:492] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51: No bootstrap required, opened a new log
I20260709 12:12:23.079355 18734 ts_tablet_manager.cc:1403] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 12:12:23.081960 18734 raft_consensus.cc:359] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.082662 18734 raft_consensus.cc:385] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:23.082984 18734 raft_consensus.cc:740] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Initialized, Role: FOLLOWER
I20260709 12:12:23.083624 18734 consensus_queue.cc:260] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.085994 18734 ts_tablet_manager.cc:1434] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:23.174165 18741 raft_consensus.cc:493] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.174760 18741 raft_consensus.cc:515] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.176749 18741 leader_election.cc:290] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:23.177948 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:23.178179 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:23.178594 18541 raft_consensus.cc:2468] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 0.
I20260709 12:12:23.179005 18690 raft_consensus.cc:2468] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 0.
I20260709 12:12:23.179867 18581 leader_election.cc:304] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:23.180794 18741 raft_consensus.cc:2804] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:23.181195 18741 raft_consensus.cc:493] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.181530 18741 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.188459 18741 raft_consensus.cc:515] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.191184 18741 leader_election.cc:290] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:23.192694 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:23.192585 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:23.193488 18541 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.193502 18690 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.202661 18541 raft_consensus.cc:2468] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 1.
I20260709 12:12:23.204385 18581 leader_election.cc:304] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:23.205274 18741 raft_consensus.cc:2804] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:23.205647 18690 raft_consensus.cc:2468] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 1.
I20260709 12:12:23.205775 18741 raft_consensus.cc:697] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:23.207453 18741 consensus_queue.cc:237] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.210930 18690 raft_consensus.cc:3060] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.213814 18755 raft_consensus.cc:493] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.214594 18755 raft_consensus.cc:515] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.213897 18541 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.218930 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:23.219709 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:23.220597 18691 raft_consensus.cc:2393] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8683cb3284784fef81af120ce39d5e51 in current term 1: Already voted for candidate b7647311c5df4756a2d5e112021c8512 in this term.
I20260709 12:12:23.221894 18508 leader_election.cc:304] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51; no voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512
I20260709 12:12:23.222980 18752 raft_consensus.cc:3060] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.224726 18742 raft_consensus.cc:493] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.225296 18742 raft_consensus.cc:515] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.227742 18742 leader_election.cc:290] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:23.228286 18755 leader_election.cc:290] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:23.229717 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c8b362cf37450dafcfc8a70b5fed9a" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:23.230449 18542 raft_consensus.cc:2468] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 0.
I20260709 12:12:23.232896 18655 leader_election.cc:304] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51; no voters: 
I20260709 12:12:23.232376 18438 catalog_manager.cc:5697] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.234401 18739 consensus_queue.cc:1048] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:23.236057 18739 consensus_queue.cc:1048] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:23.237838 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c8b362cf37450dafcfc8a70b5fed9a" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:23.238646 18615 raft_consensus.cc:2468] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 0.
I20260709 12:12:23.239006 18742 raft_consensus.cc:2804] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:23.239413 18742 raft_consensus.cc:493] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.239778 18742 raft_consensus.cc:3060] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.247480 18742 raft_consensus.cc:515] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.251209 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c8b362cf37450dafcfc8a70b5fed9a" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:23.251897 18617 raft_consensus.cc:3060] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.259411 18617 raft_consensus.cc:2468] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 1.
I20260709 12:12:23.260819 18654 leader_election.cc:304] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:23.260926 18752 raft_consensus.cc:2749] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:23.261931 18742 leader_election.cc:290] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 1 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:23.262609 18742 consensus_queue.cc:1048] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.265523 18752 raft_consensus.cc:493] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.266113 18752 raft_consensus.cc:515] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.268179 18741 consensus_queue.cc:1048] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.269251 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:23.269968 18617 raft_consensus.cc:2468] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 1.
I20260709 12:12:23.271108 18505 leader_election.cc:304] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:23.272469 18739 raft_consensus.cc:2804] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:23.272873 18739 raft_consensus.cc:493] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.273231 18739 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.273485 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c8b362cf37450dafcfc8a70b5fed9a" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:23.274224 18542 raft_consensus.cc:3060] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:23.293805 18803 raft_consensus.cc:2804] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:23.294898 18803 raft_consensus.cc:697] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 1 LEADER]: Becoming Leader. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Running, Role: LEADER
I20260709 12:12:23.297955 18542 raft_consensus.cc:2468] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 1.
I20260709 12:12:23.299870 18803 consensus_queue.cc:237] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.301676 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:23.301052 18752 leader_election.cc:290] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:23.307385 18741 consensus_queue.cc:1048] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.294363 18739 raft_consensus.cc:515] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.325273 18785 consensus_queue.cc:1048] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.330199 18541 raft_consensus.cc:1240] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Rejecting Update request from peer 50b49485ef1b42068695f8e0ed8a3606 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:12:23.331081 18739 leader_election.cc:290] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 election: Requested vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:23.333509 18689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:23.335665 18802 consensus_queue.cc:1059] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.337833 18805 raft_consensus.cc:3055] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:23.338405 18805 raft_consensus.cc:740] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Running, Role: LEADER
I20260709 12:12:23.340075 18805 consensus_queue.cc:260] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.341766 18805 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.344215 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:23.345006 18615 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.356804 18615 raft_consensus.cc:2468] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 2.
I20260709 12:12:23.367938 18785 consensus_queue.cc:1048] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.380903 18813 consensus_queue.cc:1048] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.394692 18615 raft_consensus.cc:1240] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Rejecting Update request from peer 50b49485ef1b42068695f8e0ed8a3606 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:23.415792 18742 raft_consensus.cc:493] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8683cb3284784fef81af120ce39d5e51)
I20260709 12:12:23.420262 18742 raft_consensus.cc:515] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.421342 18505 leader_election.cc:304] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 50b49485ef1b42068695f8e0ed8a3606
I20260709 12:12:23.423381 18739 raft_consensus.cc:2804] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:23.424347 18739 raft_consensus.cc:697] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Becoming Leader. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:23.425235 18739 consensus_queue.cc:237] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.429198 18785 consensus_queue.cc:1048] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.433241 18439 catalog_manager.cc:5697] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "50b49485ef1b42068695f8e0ed8a3606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:23.434988 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:23.460793 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:23.463438 18654 leader_election.cc:304] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606; no voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512
I20260709 12:12:23.466990 18742 leader_election.cc:290] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:23.468502 18742 raft_consensus.cc:2749] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:23.503042 18439 catalog_manager.cc:5697] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 reported cstate change: term changed from 1 to 2, leader changed from 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195) to 8683cb3284784fef81af120ce39d5e51 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "8683cb3284784fef81af120ce39d5e51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.589709 18615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
mode: GRACEFUL
new_leader_uuid: "8683cb3284784fef81af120ce39d5e51"
 from {username='slave'} at 127.0.0.1:39256
I20260709 12:12:23.590498 18615 raft_consensus.cc:606] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Received request to transfer leadership to TS 8683cb3284784fef81af120ce39d5e51
I20260709 12:12:23.608471 18542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d13c214ec3462a90d8f75264011372"
dest_uuid: "8683cb3284784fef81af120ce39d5e51"
mode: GRACEFUL
new_leader_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:44052
I20260709 12:12:23.609193 18542 raft_consensus.cc:606] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Received request to transfer leadership to TS b7647311c5df4756a2d5e112021c8512
I20260709 12:12:23.613554 18741 consensus_queue.cc:1048] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:23.630316 18785 consensus_queue.cc:1048] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.825246 18815 raft_consensus.cc:993] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512: : Instructing follower 8683cb3284784fef81af120ce39d5e51 to start an election
I20260709 12:12:23.825809 18815 raft_consensus.cc:1081] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Signalling peer 8683cb3284784fef81af120ce39d5e51 to start an election
I20260709 12:12:23.828040 18542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381"
dest_uuid: "8683cb3284784fef81af120ce39d5e51"
 from {username='slave'} at 127.0.0.1:44044
I20260709 12:12:23.828684 18542 raft_consensus.cc:493] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:23.829070 18542 raft_consensus.cc:3060] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.835470 18803 consensus_queue.cc:1048] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.836674 18542 raft_consensus.cc:515] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.840826 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:23.841145 18542 leader_election.cc:290] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 election: Requested vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:23.841612 18617 raft_consensus.cc:3055] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:23.842041 18617 raft_consensus.cc:740] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:23.842702 18689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:23.843459 18689 raft_consensus.cc:3060] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.843096 18617 consensus_queue.cc:260] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.845486 18617 raft_consensus.cc:3060] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:23.849012 18803 consensus_queue.cc:1048] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.854920 18617 raft_consensus.cc:2468] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 2.
I20260709 12:12:23.856520 18505 leader_election.cc:304] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:23.857528 18755 raft_consensus.cc:2804] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:23.858081 18755 raft_consensus.cc:697] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Becoming Leader. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:23.860566 18755 consensus_queue.cc:237] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.865356 18689 raft_consensus.cc:2468] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 2.
I20260709 12:12:23.869596 18438 catalog_manager.cc:5697] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 reported cstate change: term changed from 1 to 2, leader changed from b7647311c5df4756a2d5e112021c8512 (127.17.249.194) to 8683cb3284784fef81af120ce39d5e51 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "8683cb3284784fef81af120ce39d5e51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.889130 18617 raft_consensus.cc:1275] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Refusing update from remote peer 8683cb3284784fef81af120ce39d5e51: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:23.892046 18755 consensus_queue.cc:1048] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:23.917582 18755 raft_consensus.cc:993] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51: : Instructing follower b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:23.918066 18755 raft_consensus.cc:1081] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Signalling peer b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:23.921227 18615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49d13c214ec3462a90d8f75264011372"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:39244
I20260709 12:12:23.926822 18689 raft_consensus.cc:1275] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Refusing update from remote peer 8683cb3284784fef81af120ce39d5e51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:12:23.927361 18689 pending_rounds.cc:85] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606: Aborting all ops after (but not including) 0
I20260709 12:12:23.923323 18615 raft_consensus.cc:493] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:23.927743 18689 pending_rounds.cc:107] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:12:23.929075 18615 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:23.929253 18689 raft_consensus.cc:2889] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:23.935609 18755 consensus_queue.cc:1048] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:23.937573 18615 raft_consensus.cc:515] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.943091 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:23.943773 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:23.944061 18542 raft_consensus.cc:3055] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:23.944648 18542 raft_consensus.cc:740] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:23.946139 18615 leader_election.cc:290] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 3 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:23.945868 18542 consensus_queue.cc:260] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.948341 18542 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:23.957499 18542 raft_consensus.cc:2468] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 3.
I20260709 12:12:23.959196 18581 leader_election.cc:304] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 50b49485ef1b42068695f8e0ed8a3606
I20260709 12:12:23.960520 18741 raft_consensus.cc:2804] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:23.961045 18741 raft_consensus.cc:697] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:23.962006 18741 consensus_queue.cc:237] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:23.976858 18436 catalog_manager.cc:5697] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 2 to 3, leader changed from 8683cb3284784fef81af120ce39d5e51 (127.17.249.193) to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:24.342052 18615 raft_consensus.cc:1275] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Refusing update from remote peer 8683cb3284784fef81af120ce39d5e51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:24.343801 18755 consensus_queue.cc:1048] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:24.347028 18542 raft_consensus.cc:1275] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:24.348647 18741 consensus_queue.cc:1048] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:24.356374 18690 raft_consensus.cc:1275] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Refusing update from remote peer 8683cb3284784fef81af120ce39d5e51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:24.359222 18755 consensus_queue.cc:1048] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:24.363466 18690 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:24.372665 18690 raft_consensus.cc:1275] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:24.374202 18815 consensus_queue.cc:1048] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:26.299671 18834 raft_consensus.cc:493] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50b49485ef1b42068695f8e0ed8a3606)
I20260709 12:12:26.300305 18834 raft_consensus.cc:515] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:26.303905 18834 leader_election.cc:290] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:26.333035 18837 raft_consensus.cc:493] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8683cb3284784fef81af120ce39d5e51)
I20260709 12:12:26.333592 18837 raft_consensus.cc:515] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:26.334321 18838 raft_consensus.cc:493] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7647311c5df4756a2d5e112021c8512)
I20260709 12:12:26.336089 18837 leader_election.cc:290] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915)
I20260709 12:12:26.335216 18838 raft_consensus.cc:515] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:26.338797 18838 leader_election.cc:290] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:26.341645 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:26.342528 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:26.344931 18840 raft_consensus.cc:493] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 50b49485ef1b42068695f8e0ed8a3606)
I20260709 12:12:26.345608 18840 raft_consensus.cc:515] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:26.348121 18840 leader_election.cc:290] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:26.349598 18840 raft_consensus.cc:493] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8683cb3284784fef81af120ce39d5e51)
I20260709 12:12:26.350116 18840 raft_consensus.cc:515] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:26.351820 18839 raft_consensus.cc:493] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7647311c5df4756a2d5e112021c8512)
I20260709 12:12:26.352367 18839 raft_consensus.cc:515] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:26.355113 18839 leader_election.cc:290] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:26.357242 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:26.357419 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:26.358233 18615 raft_consensus.cc:2468] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 1.
I20260709 12:12:26.360078 18840 leader_election.cc:290] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979), 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915)
I20260709 12:12:26.360054 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:26.364148 18837 raft_consensus.cc:493] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7647311c5df4756a2d5e112021c8512)
I20260709 12:12:26.364804 18837 raft_consensus.cc:515] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:26.367100 18837 leader_election.cc:290] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:26.369118 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:26.371472 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:26.372478 18654 leader_election.cc:304] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512; no voters: 8683cb3284784fef81af120ce39d5e51
I20260709 12:12:26.374047 18654 leader_election.cc:304] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606; no voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512
I20260709 12:12:26.374970 18614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c8b362cf37450dafcfc8a70b5fed9a" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:26.375722 18838 raft_consensus.cc:2804] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:26.376312 18838 raft_consensus.cc:493] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8683cb3284784fef81af120ce39d5e51)
I20260709 12:12:26.376685 18838 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:26.370484 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:26.380023 18837 raft_consensus.cc:2749] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:26.380188 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c8b362cf37450dafcfc8a70b5fed9a" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:26.376703 18688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c8b362cf37450dafcfc8a70b5fed9a" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:26.384421 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:26.385880 18687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:26.387341 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c8b362cf37450dafcfc8a70b5fed9a" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:26.402585 18508 leader_election.cc:304] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51; no voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512
I20260709 12:12:26.402571 18583 leader_election.cc:304] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7647311c5df4756a2d5e112021c8512; no voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51
I20260709 12:12:26.403692 18842 raft_consensus.cc:2749] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:26.404457 18835 raft_consensus.cc:2749] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:26.405902 18581 leader_election.cc:304] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7647311c5df4756a2d5e112021c8512; no voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51
I20260709 12:12:26.406889 18844 raft_consensus.cc:2749] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:26.392719 18838 raft_consensus.cc:515] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:26.412230 18654 leader_election.cc:304] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606; no voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512
I20260709 12:12:26.412850 18838 leader_election.cc:290] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 election: Requested vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915)
I20260709 12:12:26.413334 18845 raft_consensus.cc:2749] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:26.413614 18654 leader_election.cc:304] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606; no voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512
I20260709 12:12:26.414534 18845 raft_consensus.cc:2749] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:12:26.414417 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:26.416535 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:26.418643 18654 leader_election.cc:304] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606; no voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512
I20260709 12:12:26.419449 18845 raft_consensus.cc:2749] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:26.511806 18835 raft_consensus.cc:493] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7647311c5df4756a2d5e112021c8512)
I20260709 12:12:26.512501 18835 raft_consensus.cc:515] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:26.514462 18835 leader_election.cc:290] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:26.515694 18689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:26.515782 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:26.517433 18508 leader_election.cc:304] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51; no voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512
I20260709 12:12:26.518116 18835 raft_consensus.cc:2749] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:26.889983 18689 raft_consensus.cc:1240] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Rejecting Update request from peer 8683cb3284784fef81af120ce39d5e51 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:26.891755 18835 consensus_queue.cc:1059] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:26.892814 18836 raft_consensus.cc:3055] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:26.893160 18836 raft_consensus.cc:740] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:26.893926 18836 consensus_queue.cc:260] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:26.895102 18836 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:26.919883 18638 debug-util.cc:398] Leaking SignalData structure 0x7b080012a060 after lost signal to thread 18410
W20260709 12:12:26.920925 18638 debug-util.cc:398] Leaking SignalData structure 0x7b080012a740 after lost signal to thread 18473
W20260709 12:12:26.921754 18638 debug-util.cc:398] Leaking SignalData structure 0x7b0800041de0 after lost signal to thread 18566
W20260709 12:12:26.922452 18638 debug-util.cc:398] Leaking SignalData structure 0x7b0800092ea0 after lost signal to thread 18641
W20260709 12:12:26.923331 18638 debug-util.cc:398] Leaking SignalData structure 0x7b080008a700 after lost signal to thread 18715
I20260709 12:12:27.303889 18407 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:12:27.304981 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:27.329754 18615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
mode: GRACEFUL
new_leader_uuid: "50b49485ef1b42068695f8e0ed8a3606"
 from {username='slave'} at 127.0.0.1:39268
I20260709 12:12:27.330541 18615 raft_consensus.cc:606] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Received request to transfer leadership to TS 50b49485ef1b42068695f8e0ed8a3606
I20260709 12:12:27.352489 18542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3"
dest_uuid: "8683cb3284784fef81af120ce39d5e51"
mode: GRACEFUL
new_leader_uuid: "50b49485ef1b42068695f8e0ed8a3606"
 from {username='slave'} at 127.0.0.1:44062
I20260709 12:12:27.353200 18542 raft_consensus.cc:606] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Received request to transfer leadership to TS 50b49485ef1b42068695f8e0ed8a3606
I20260709 12:12:27.353549 18542 raft_consensus.cc:614] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:27.355284 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:27.356163 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:27.414896 18850 raft_consensus.cc:993] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512: : Instructing follower 50b49485ef1b42068695f8e0ed8a3606 to start an election
I20260709 12:12:27.415611 18844 raft_consensus.cc:1081] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Signalling peer 50b49485ef1b42068695f8e0ed8a3606 to start an election
I20260709 12:12:27.418947 18689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f"
dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
 from {username='slave'} at 127.0.0.1:53408
I20260709 12:12:27.419843 18689 raft_consensus.cc:493] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:27.420361 18689 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.430305 18689 raft_consensus.cc:515] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:27.433723 18689 leader_election.cc:290] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:27.435196 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:27.435479 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:27.435886 18542 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.436008 18615 raft_consensus.cc:3055] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:27.436353 18615 raft_consensus.cc:740] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:27.437201 18615 consensus_queue.cc:260] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:27.438369 18615 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.443863 18542 raft_consensus.cc:2468] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 2.
I20260709 12:12:27.445149 18615 raft_consensus.cc:2468] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 2.
I20260709 12:12:27.445417 18655 leader_election.cc:304] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51; no voters: 
I20260709 12:12:27.446273 18845 raft_consensus.cc:2804] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:27.447791 18845 raft_consensus.cc:697] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 2 LEADER]: Becoming Leader. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Running, Role: LEADER
I20260709 12:12:27.448601 18845 consensus_queue.cc:237] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:27.459210 18439 catalog_manager.cc:5697] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 reported cstate change: term changed from 1 to 2, leader changed from b7647311c5df4756a2d5e112021c8512 (127.17.249.194) to 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "50b49485ef1b42068695f8e0ed8a3606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.941785 18542 raft_consensus.cc:1275] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Refusing update from remote peer 50b49485ef1b42068695f8e0ed8a3606: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:27.944061 18845 consensus_queue.cc:1048] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:27.975630 18615 raft_consensus.cc:1275] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Refusing update from remote peer 50b49485ef1b42068695f8e0ed8a3606: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:27.983779 18845 consensus_queue.cc:1048] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.206475 18844 raft_consensus.cc:493] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8683cb3284784fef81af120ce39d5e51)
I20260709 12:12:28.207063 18844 raft_consensus.cc:515] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:28.209266 18844 leader_election.cc:290] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979), 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915)
I20260709 12:12:28.210667 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:28.211068 18689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606" is_pre_election: true
I20260709 12:12:28.211612 18542 raft_consensus.cc:2468] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 2.
I20260709 12:12:28.212172 18689 raft_consensus.cc:2393] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7647311c5df4756a2d5e112021c8512 in current term 2: Already voted for candidate 50b49485ef1b42068695f8e0ed8a3606 in this term.
I20260709 12:12:28.213281 18581 leader_election.cc:304] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:28.214362 18844 raft_consensus.cc:2804] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:28.214919 18844 raft_consensus.cc:493] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8683cb3284784fef81af120ce39d5e51)
I20260709 12:12:28.215368 18844 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.226352 18844 raft_consensus.cc:515] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:28.229019 18844 leader_election.cc:290] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 election: Requested vote from peers 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979), 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915)
I20260709 12:12:28.229805 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:28.229626 18689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:28.235385 18542 raft_consensus.cc:2468] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 2.
I20260709 12:12:28.235679 18689 raft_consensus.cc:2393] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7647311c5df4756a2d5e112021c8512 in current term 2: Already voted for candidate 50b49485ef1b42068695f8e0ed8a3606 in this term.
I20260709 12:12:28.236642 18581 leader_election.cc:304] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:28.237406 18844 raft_consensus.cc:2804] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:28.237933 18844 raft_consensus.cc:697] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:28.238747 18844 consensus_queue.cc:237] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:28.249994 18436 catalog_manager.cc:5697] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 1 to 2, leader changed from 8683cb3284784fef81af120ce39d5e51 (127.17.249.193) to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.357452 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:28.366501 18615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d13c214ec3462a90d8f75264011372"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
mode: GRACEFUL
new_leader_uuid: "50b49485ef1b42068695f8e0ed8a3606"
 from {username='slave'} at 127.0.0.1:39268
I20260709 12:12:28.367316 18615 raft_consensus.cc:606] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Received request to transfer leadership to TS 50b49485ef1b42068695f8e0ed8a3606
I20260709 12:12:28.368705 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:12:28.369235 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:28.539422 18845 raft_consensus.cc:493] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.540035 18845 raft_consensus.cc:515] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:28.542138 18845 leader_election.cc:290] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915)
I20260709 12:12:28.543267 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512" is_pre_election: true
I20260709 12:12:28.543732 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51" is_pre_election: true
I20260709 12:12:28.544538 18541 raft_consensus.cc:2468] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 2.
I20260709 12:12:28.545804 18655 leader_election.cc:304] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51; no voters: b7647311c5df4756a2d5e112021c8512
I20260709 12:12:28.546855 18845 raft_consensus.cc:2804] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:28.547333 18845 raft_consensus.cc:493] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.547716 18845 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:28.553736 18845 raft_consensus.cc:515] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:28.555596 18845 leader_election.cc:290] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 3 election: Requested vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915)
I20260709 12:12:28.556883 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:28.557147 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:28.558029 18541 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:28.567008 18541 raft_consensus.cc:2468] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 3.
I20260709 12:12:28.568852 18655 leader_election.cc:304] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51; no voters: b7647311c5df4756a2d5e112021c8512
I20260709 12:12:28.570024 18845 raft_consensus.cc:2804] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:28.570575 18845 raft_consensus.cc:697] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 LEADER]: Becoming Leader. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Running, Role: LEADER
I20260709 12:12:28.571406 18845 consensus_queue.cc:237] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:28.580423 18436 catalog_manager.cc:5697] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 reported cstate change: term changed from 2 to 3, leader changed from b7647311c5df4756a2d5e112021c8512 (127.17.249.194) to 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195). New cstate: current_term: 3 leader_uuid: "50b49485ef1b42068695f8e0ed8a3606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.743126 18844 raft_consensus.cc:993] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512: : Instructing follower 50b49485ef1b42068695f8e0ed8a3606 to start an election
I20260709 12:12:28.743690 18850 raft_consensus.cc:1081] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Signalling peer 50b49485ef1b42068695f8e0ed8a3606 to start an election
I20260709 12:12:28.745761 18689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49d13c214ec3462a90d8f75264011372"
dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
 from {username='slave'} at 127.0.0.1:53408
I20260709 12:12:28.746328 18689 raft_consensus.cc:493] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.746654 18689 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:28.752880 18689 raft_consensus.cc:515] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:28.754758 18689 leader_election.cc:290] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 4 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:28.756008 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:28.755980 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:28.756852 18615 raft_consensus.cc:3055] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:28.757004 18541 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:28.757218 18615 raft_consensus.cc:740] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:28.758102 18615 consensus_queue.cc:260] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:28.759241 18615 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:28.760706 18542 raft_consensus.cc:1240] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Rejecting Update request from peer b7647311c5df4756a2d5e112021c8512 for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:28.762161 18850 consensus_queue.cc:1059] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:28.763151 18844 raft_consensus.cc:3055] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:28.763525 18844 raft_consensus.cc:740] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:28.764338 18844 consensus_queue.cc:260] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:28.765726 18844 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:28.767896 18615 raft_consensus.cc:2468] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 4.
I20260709 12:12:28.768086 18541 raft_consensus.cc:2468] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 4.
I20260709 12:12:28.769454 18654 leader_election.cc:304] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:28.770431 18845 raft_consensus.cc:2804] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:28.771046 18845 raft_consensus.cc:697] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 LEADER]: Becoming Leader. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Running, Role: LEADER
I20260709 12:12:28.772001 18845 consensus_queue.cc:237] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:28.781538 18436 catalog_manager.cc:5697] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 reported cstate change: term changed from 3 to 4, leader changed from b7647311c5df4756a2d5e112021c8512 (127.17.249.194) to 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195). New cstate: current_term: 4 leader_uuid: "50b49485ef1b42068695f8e0ed8a3606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:28.964653 18541 raft_consensus.cc:1275] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Refusing update from remote peer 50b49485ef1b42068695f8e0ed8a3606: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:28.966190 18845 consensus_queue.cc:1048] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:28.997777 18615 raft_consensus.cc:1275] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Refusing update from remote peer 50b49485ef1b42068695f8e0ed8a3606: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:12:28.998250 18615 pending_rounds.cc:85] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512: Aborting all ops after (but not including) 1
I20260709 12:12:28.998522 18615 pending_rounds.cc:107] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:12:28.998772 18615 raft_consensus.cc:2889] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:29.000252 18861 consensus_queue.cc:1048] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:29.289341 18615 raft_consensus.cc:1275] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 4 FOLLOWER]: Refusing update from remote peer 50b49485ef1b42068695f8e0ed8a3606: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:29.292253 18861 consensus_queue.cc:1048] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:29.309753 18542 raft_consensus.cc:1275] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 4 FOLLOWER]: Refusing update from remote peer 50b49485ef1b42068695f8e0ed8a3606: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:29.311806 18845 consensus_queue.cc:1048] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:29.370684 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:29.406579 18689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3"
dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
mode: GRACEFUL
new_leader_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:53418
I20260709 12:12:29.407451 18689 raft_consensus.cc:606] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 LEADER]: Received request to transfer leadership to TS b7647311c5df4756a2d5e112021c8512
I20260709 12:12:29.409315 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:12:29.410147 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:29.439311 18874 raft_consensus.cc:993] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606: : Instructing follower b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:29.440277 18861 raft_consensus.cc:1081] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 LEADER]: Signalling peer b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:29.442818 18615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:39246
I20260709 12:12:29.443629 18615 raft_consensus.cc:493] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:29.444101 18615 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:29.451704 18615 raft_consensus.cc:515] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:29.453886 18615 leader_election.cc:290] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 4 election: Requested vote from peers 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979), 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915)
I20260709 12:12:29.456252 18542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:29.455777 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35af2dcd4cd04070808d3d78fc5a40b3" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:29.457584 18542 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:29.458074 18690 raft_consensus.cc:3055] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:29.458591 18690 raft_consensus.cc:740] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Running, Role: LEADER
I20260709 12:12:29.460517 18690 consensus_queue.cc:260] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:29.465162 18690 raft_consensus.cc:3060] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:29.469134 18542 raft_consensus.cc:2468] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 4.
I20260709 12:12:29.470909 18581 leader_election.cc:304] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:29.472183 18844 raft_consensus.cc:2804] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:29.474362 18844 raft_consensus.cc:697] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 4 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:29.476541 18844 consensus_queue.cc:237] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } }
I20260709 12:12:29.478878 18690 raft_consensus.cc:2468] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 4.
I20260709 12:12:29.487023 18436 catalog_manager.cc:5697] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 3 to 4, leader changed from 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195) to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 4 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.884195 18542 raft_consensus.cc:1275] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 4 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:29.885859 18844 consensus_queue.cc:1048] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:29.896564 18690 raft_consensus.cc:1275] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:29.899842 18844 consensus_queue.cc:1048] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:30.411634 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:30.417616 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:30.418110 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:31.419275 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:31.425266 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:31.425698 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:32.427084 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:32.433255 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:32.433878 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:33.435127 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:33.440567 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:33.441095 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:34.442188 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:34.447652 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:34.448189 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:35.449263 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:35.454545 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:35.455116 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:36.456261 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:36.461549 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:36.462093 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:37.499471 18407 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:12:37.509552 18541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba"
dest_uuid: "8683cb3284784fef81af120ce39d5e51"
mode: GRACEFUL
new_leader_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:44052
I20260709 12:12:37.510135 18541 raft_consensus.cc:606] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Received request to transfer leadership to TS b7647311c5df4756a2d5e112021c8512
I20260709 12:12:37.517585 18541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c"
dest_uuid: "8683cb3284784fef81af120ce39d5e51"
mode: GRACEFUL
new_leader_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:44052
I20260709 12:12:37.518195 18541 raft_consensus.cc:606] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Received request to transfer leadership to TS b7647311c5df4756a2d5e112021c8512
I20260709 12:12:37.524744 18541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381"
dest_uuid: "8683cb3284784fef81af120ce39d5e51"
mode: GRACEFUL
new_leader_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:44052
I20260709 12:12:37.525334 18541 raft_consensus.cc:606] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Received request to transfer leadership to TS b7647311c5df4756a2d5e112021c8512
I20260709 12:12:37.528870 18897 raft_consensus.cc:993] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51: : Instructing follower b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:37.529373 18881 raft_consensus.cc:1081] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Signalling peer b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:37.531502 18616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:39244
I20260709 12:12:37.532335 18616 raft_consensus.cc:493] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:37.532851 18616 raft_consensus.cc:3060] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:37.543164 18616 raft_consensus.cc:515] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.545735 18616 leader_election.cc:290] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 3 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:37.546710 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:37.547422 18690 raft_consensus.cc:3060] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:37.546710 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e449fe6895497ca5bc524b2cf40381" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:37.549661 18541 raft_consensus.cc:3055] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:37.550036 18541 raft_consensus.cc:740] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:37.550928 18541 consensus_queue.cc:260] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.552345 18541 raft_consensus.cc:3060] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:37.554104 18690 raft_consensus.cc:2468] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 3.
I20260709 12:12:37.555861 18583 leader_election.cc:304] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:37.556365 18690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d13c214ec3462a90d8f75264011372"
dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
mode: GRACEFUL
new_leader_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:34318
I20260709 12:12:37.556897 18890 raft_consensus.cc:2804] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:37.557241 18690 raft_consensus.cc:606] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 LEADER]: Received request to transfer leadership to TS b7647311c5df4756a2d5e112021c8512
I20260709 12:12:37.558221 18890 raft_consensus.cc:697] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:37.559283 18890 consensus_queue.cc:237] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.560001 18541 raft_consensus.cc:2468] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 3.
I20260709 12:12:37.568395 18439 catalog_manager.cc:5697] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 2 to 3, leader changed from 8683cb3284784fef81af120ce39d5e51 (127.17.249.193) to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:37.570895 18690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f"
dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
mode: GRACEFUL
new_leader_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:34318
I20260709 12:12:37.571522 18690 raft_consensus.cc:606] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 2 LEADER]: Received request to transfer leadership to TS b7647311c5df4756a2d5e112021c8512
I20260709 12:12:37.704245 18861 raft_consensus.cc:993] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606: : Instructing follower b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:37.704790 18861 raft_consensus.cc:1081] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 LEADER]: Signalling peer b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:37.706629 18616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49d13c214ec3462a90d8f75264011372"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:39246
I20260709 12:12:37.707226 18616 raft_consensus.cc:493] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:37.707551 18616 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:37.713559 18616 raft_consensus.cc:515] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.716158 18616 leader_election.cc:290] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 5 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:37.717237 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:37.717514 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:37.717800 18541 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:37.718142 18690 raft_consensus.cc:3055] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:37.718429 18690 raft_consensus.cc:740] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Running, Role: LEADER
I20260709 12:12:37.719087 18690 consensus_queue.cc:260] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.720027 18690 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:37.722445 18541 raft_consensus.cc:2468] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 5.
I20260709 12:12:37.723718 18581 leader_election.cc:304] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:37.724426 18890 raft_consensus.cc:2804] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:37.724843 18890 raft_consensus.cc:697] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 5 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:37.725417 18690 raft_consensus.cc:2468] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 5.
I20260709 12:12:37.725617 18890 consensus_queue.cc:237] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.733088 18439 catalog_manager.cc:5697] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 4 to 5, leader changed from 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195) to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 5 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:37.844638 18897 raft_consensus.cc:993] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51: : Instructing follower b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:37.845314 18897 raft_consensus.cc:1081] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Signalling peer b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:37.847299 18616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:39244
I20260709 12:12:37.847940 18616 raft_consensus.cc:493] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:37.848308 18616 raft_consensus.cc:3060] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.854476 18616 raft_consensus.cc:515] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.856740 18616 leader_election.cc:290] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:37.858083 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:37.858188 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:37.858777 18690 raft_consensus.cc:3060] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.858961 18541 raft_consensus.cc:3055] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:37.859508 18541 raft_consensus.cc:740] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:37.860370 18541 consensus_queue.cc:260] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.861337 18541 raft_consensus.cc:3060] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.865352 18690 raft_consensus.cc:2468] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 2.
I20260709 12:12:37.866612 18583 leader_election.cc:304] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:37.867342 18541 raft_consensus.cc:2468] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 2.
I20260709 12:12:37.867482 18890 raft_consensus.cc:2804] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.869935 18890 raft_consensus.cc:697] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:37.870829 18890 consensus_queue.cc:237] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.878691 18439 catalog_manager.cc:5697] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 1 to 2, leader changed from 8683cb3284784fef81af120ce39d5e51 (127.17.249.193) to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:37.940155 18690 raft_consensus.cc:1275] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:37.941550 18890 consensus_queue.cc:1048] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:37.948290 18861 raft_consensus.cc:993] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606: : Instructing follower b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:37.948827 18861 raft_consensus.cc:1081] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 2 LEADER]: Signalling peer b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:37.950932 18616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:39246
I20260709 12:12:37.951556 18616 raft_consensus.cc:493] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:37.951947 18616 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:37.955721 18541 raft_consensus.cc:1275] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:37.957875 18890 consensus_queue.cc:1048] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:37.972144 18616 raft_consensus.cc:515] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.975090 18616 leader_election.cc:290] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 3 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:37.979460 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:37.980209 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:37.980851 18541 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:37.981135 18690 raft_consensus.cc:3055] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:37.981535 18690 raft_consensus.cc:740] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Running, Role: LEADER
I20260709 12:12:37.982501 18690 consensus_queue.cc:260] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.983879 18690 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:37.988456 18541 raft_consensus.cc:2468] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 3.
I20260709 12:12:37.988760 18881 raft_consensus.cc:993] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51: : Instructing follower b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:37.989326 18897 raft_consensus.cc:1081] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Signalling peer b7647311c5df4756a2d5e112021c8512 to start an election
I20260709 12:12:37.989847 18581 leader_election.cc:304] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8683cb3284784fef81af120ce39d5e51, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:37.991305 18908 raft_consensus.cc:2804] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:37.991575 18616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
 from {username='slave'} at 127.0.0.1:39244
I20260709 12:12:37.991784 18908 raft_consensus.cc:697] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:37.991581 18690 raft_consensus.cc:2468] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 3.
I20260709 12:12:37.992372 18616 raft_consensus.cc:493] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:37.992830 18616 raft_consensus.cc:3060] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.992822 18908 consensus_queue.cc:237] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:37.999315 18616 raft_consensus.cc:515] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:38.001699 18616 leader_election.cc:290] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:38.002579 18541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:38.002897 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba" candidate_uuid: "b7647311c5df4756a2d5e112021c8512" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:38.003340 18541 raft_consensus.cc:3055] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:38.003539 18690 raft_consensus.cc:3060] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:38.003698 18541 raft_consensus.cc:740] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:38.003067 18439 catalog_manager.cc:5697] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 2 to 3, leader changed from 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195) to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:38.004649 18541 consensus_queue.cc:260] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:38.005596 18541 raft_consensus.cc:3060] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:38.010432 18690 raft_consensus.cc:2468] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 2.
I20260709 12:12:38.011819 18583 leader_election.cc:304] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, b7647311c5df4756a2d5e112021c8512; no voters: 
I20260709 12:12:38.012058 18541 raft_consensus.cc:2468] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7647311c5df4756a2d5e112021c8512 in term 2.
I20260709 12:12:38.012709 18908 raft_consensus.cc:2804] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:38.013283 18908 raft_consensus.cc:697] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Becoming Leader. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:38.014358 18908 consensus_queue.cc:237] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:38.023285 18439 catalog_manager.cc:5697] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 reported cstate change: term changed from 1 to 2, leader changed from 8683cb3284784fef81af120ce39d5e51 (127.17.249.193) to b7647311c5df4756a2d5e112021c8512 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "b7647311c5df4756a2d5e112021c8512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:38.122300 18541 raft_consensus.cc:1275] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 5 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:12:38.123852 18890 consensus_queue.cc:1048] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:38.134936 18689 raft_consensus.cc:1275] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 5 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:12:38.136802 18890 consensus_queue.cc:1048] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:38.365921 18541 raft_consensus.cc:1275] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.367703 18890 consensus_queue.cc:1048] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.380326 18690 raft_consensus.cc:1275] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.381708 18890 consensus_queue.cc:1048] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.394269 18690 raft_consensus.cc:1275] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:38.395813 18890 consensus_queue.cc:1048] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:38.406713 18541 raft_consensus.cc:1275] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:38.408427 18890 consensus_queue.cc:1048] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:38.476945 18690 raft_consensus.cc:1275] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.478519 18890 consensus_queue.cc:1048] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:38.488983 18541 raft_consensus.cc:1275] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Refusing update from remote peer b7647311c5df4756a2d5e112021c8512: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.491724 18920 consensus_queue.cc:1048] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:40.625352 18407 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:12:40.626438 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:40.634359 18616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
mode: GRACEFUL
new_leader_uuid: "8683cb3284784fef81af120ce39d5e51"
 from {username='slave'} at 127.0.0.1:39268
I20260709 12:12:40.635336 18616 raft_consensus.cc:606] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Received request to transfer leadership to TS 8683cb3284784fef81af120ce39d5e51
I20260709 12:12:40.638473 18616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d13c214ec3462a90d8f75264011372"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
mode: GRACEFUL
new_leader_uuid: "50b49485ef1b42068695f8e0ed8a3606"
 from {username='slave'} at 127.0.0.1:39268
I20260709 12:12:40.639133 18616 raft_consensus.cc:606] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 5 LEADER]: Received request to transfer leadership to TS 50b49485ef1b42068695f8e0ed8a3606
I20260709 12:12:40.641955 18616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
mode: GRACEFUL
new_leader_uuid: "8683cb3284784fef81af120ce39d5e51"
 from {username='slave'} at 127.0.0.1:39268
I20260709 12:12:40.642647 18616 raft_consensus.cc:606] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Received request to transfer leadership to TS 8683cb3284784fef81af120ce39d5e51
I20260709 12:12:40.646370 18616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
mode: GRACEFUL
new_leader_uuid: "50b49485ef1b42068695f8e0ed8a3606"
 from {username='slave'} at 127.0.0.1:39268
I20260709 12:12:40.647040 18616 raft_consensus.cc:606] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Received request to transfer leadership to TS 50b49485ef1b42068695f8e0ed8a3606
I20260709 12:12:40.649883 18616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c"
dest_uuid: "b7647311c5df4756a2d5e112021c8512"
mode: GRACEFUL
new_leader_uuid: "8683cb3284784fef81af120ce39d5e51"
 from {username='slave'} at 127.0.0.1:39268
I20260709 12:12:40.650452 18616 raft_consensus.cc:606] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Received request to transfer leadership to TS 8683cb3284784fef81af120ce39d5e51
I20260709 12:12:40.651813 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:40.652566 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:40.759775 18908 raft_consensus.cc:993] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512: : Instructing follower 8683cb3284784fef81af120ce39d5e51 to start an election
I20260709 12:12:40.760507 18928 raft_consensus.cc:1081] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Signalling peer 8683cb3284784fef81af120ce39d5e51 to start an election
I20260709 12:12:40.762327 18540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85"
dest_uuid: "8683cb3284784fef81af120ce39d5e51"
 from {username='slave'} at 127.0.0.1:44044
I20260709 12:12:40.762916 18540 raft_consensus.cc:493] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:40.763262 18540 raft_consensus.cc:3060] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:40.769066 18540 raft_consensus.cc:515] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.771588 18540 leader_election.cc:290] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 election: Requested vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:40.773308 18689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:40.773124 18616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515aa89b6083412fbb678d19240cfb85" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:40.774008 18689 raft_consensus.cc:3060] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:40.774181 18616 raft_consensus.cc:3055] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:40.774680 18616 raft_consensus.cc:740] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:40.775665 18616 consensus_queue.cc:260] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.777163 18616 raft_consensus.cc:3060] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:40.779567 18689 raft_consensus.cc:2468] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 2.
I20260709 12:12:40.781082 18508 leader_election.cc:304] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51; no voters: 
I20260709 12:12:40.783123 18929 raft_consensus.cc:2804] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:40.784278 18929 raft_consensus.cc:697] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Becoming Leader. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:40.784432 18616 raft_consensus.cc:2468] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 2.
I20260709 12:12:40.785440 18929 consensus_queue.cc:237] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.794152 18439 catalog_manager.cc:5697] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 reported cstate change: term changed from 1 to 2, leader changed from b7647311c5df4756a2d5e112021c8512 (127.17.249.194) to 8683cb3284784fef81af120ce39d5e51 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "8683cb3284784fef81af120ce39d5e51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.839789 18908 raft_consensus.cc:993] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512: : Instructing follower 8683cb3284784fef81af120ce39d5e51 to start an election
I20260709 12:12:40.840334 18928 raft_consensus.cc:1081] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Signalling peer 8683cb3284784fef81af120ce39d5e51 to start an election
I20260709 12:12:40.841845 18540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c"
dest_uuid: "8683cb3284784fef81af120ce39d5e51"
 from {username='slave'} at 127.0.0.1:44044
I20260709 12:12:40.842545 18540 raft_consensus.cc:493] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:40.842918 18540 raft_consensus.cc:3060] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.848031 18540 raft_consensus.cc:515] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.850061 18540 leader_election.cc:290] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 3 election: Requested vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:40.850965 18616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:40.851689 18616 raft_consensus.cc:3055] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:40.851706 18690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c55d36760f4b02a71a21572418ec9c" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:40.852105 18616 raft_consensus.cc:740] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:40.852455 18690 raft_consensus.cc:3060] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.852841 18908 raft_consensus.cc:993] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512: : Instructing follower 50b49485ef1b42068695f8e0ed8a3606 to start an election
I20260709 12:12:40.853386 18928 raft_consensus.cc:1081] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Signalling peer 50b49485ef1b42068695f8e0ed8a3606 to start an election
I20260709 12:12:40.853008 18616 consensus_queue.cc:260] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.854393 18616 raft_consensus.cc:3060] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.855352 18689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba"
dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
 from {username='slave'} at 127.0.0.1:53408
I20260709 12:12:40.855934 18689 raft_consensus.cc:493] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:40.856277 18689 raft_consensus.cc:3060] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.859522 18690 raft_consensus.cc:2468] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 3.
I20260709 12:12:40.860186 18616 raft_consensus.cc:2468] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 3.
I20260709 12:12:40.860991 18508 leader_election.cc:304] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51; no voters: 
I20260709 12:12:40.862190 18929 raft_consensus.cc:2804] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:40.862771 18929 raft_consensus.cc:697] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 3 LEADER]: Becoming Leader. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:40.863699 18929 consensus_queue.cc:237] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.864920 18689 raft_consensus.cc:515] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.868543 18689 leader_election.cc:290] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 3 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:40.869120 18540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:40.869307 18616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a22cb623e847d09518e9e0f2fdb9ba" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:40.870048 18540 raft_consensus.cc:3060] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.870092 18616 raft_consensus.cc:3055] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:40.870657 18616 raft_consensus.cc:740] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:40.871698 18616 consensus_queue.cc:260] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.873042 18616 raft_consensus.cc:3060] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.876618 18540 raft_consensus.cc:2468] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 3.
I20260709 12:12:40.876024 18439 catalog_manager.cc:5697] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 reported cstate change: term changed from 2 to 3, leader changed from b7647311c5df4756a2d5e112021c8512 (127.17.249.194) to 8683cb3284784fef81af120ce39d5e51 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "8683cb3284784fef81af120ce39d5e51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.878192 18616 raft_consensus.cc:2468] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 3.
I20260709 12:12:40.878153 18655 leader_election.cc:304] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51; no voters: 
I20260709 12:12:40.880414 18861 raft_consensus.cc:2804] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:40.881821 18861 raft_consensus.cc:697] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 3 LEADER]: Becoming Leader. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Running, Role: LEADER
I20260709 12:12:40.882679 18861 consensus_queue.cc:237] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.890954 18439 catalog_manager.cc:5697] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 reported cstate change: term changed from 2 to 3, leader changed from b7647311c5df4756a2d5e112021c8512 (127.17.249.194) to 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195). New cstate: current_term: 3 leader_uuid: "50b49485ef1b42068695f8e0ed8a3606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:40.904277 18908 raft_consensus.cc:993] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512: : Instructing follower 8683cb3284784fef81af120ce39d5e51 to start an election
I20260709 12:12:40.904846 18908 raft_consensus.cc:1081] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Signalling peer 8683cb3284784fef81af120ce39d5e51 to start an election
I20260709 12:12:40.906438 18540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f"
dest_uuid: "8683cb3284784fef81af120ce39d5e51"
 from {username='slave'} at 127.0.0.1:44044
I20260709 12:12:40.906988 18540 raft_consensus.cc:493] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:40.907261 18540 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:40.912217 18540 raft_consensus.cc:515] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.914163 18540 leader_election.cc:290] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 4 election: Requested vote from peers b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619), 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195:43979)
I20260709 12:12:40.915377 18616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:40.915395 18689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f44e0740d54053833a5c24f22bf38f" candidate_uuid: "8683cb3284784fef81af120ce39d5e51" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
I20260709 12:12:40.916268 18689 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:40.916268 18616 raft_consensus.cc:3055] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:40.916990 18616 raft_consensus.cc:740] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:40.917698 18616 consensus_queue.cc:260] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.918685 18616 raft_consensus.cc:3060] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:40.921885 18689 raft_consensus.cc:2468] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 4.
I20260709 12:12:40.923175 18508 leader_election.cc:304] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51; no voters: 
I20260709 12:12:40.923200 18616 raft_consensus.cc:2468] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8683cb3284784fef81af120ce39d5e51 in term 4.
I20260709 12:12:40.924095 18929 raft_consensus.cc:2804] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:40.924609 18929 raft_consensus.cc:697] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 4 LEADER]: Becoming Leader. State: Replica: 8683cb3284784fef81af120ce39d5e51, State: Running, Role: LEADER
I20260709 12:12:40.925351 18929 consensus_queue.cc:237] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.934177 18439 catalog_manager.cc:5697] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 reported cstate change: term changed from 3 to 4, leader changed from b7647311c5df4756a2d5e112021c8512 (127.17.249.194) to 8683cb3284784fef81af120ce39d5e51 (127.17.249.193). New cstate: current_term: 4 leader_uuid: "8683cb3284784fef81af120ce39d5e51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.974637 18928 raft_consensus.cc:993] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512: : Instructing follower 50b49485ef1b42068695f8e0ed8a3606 to start an election
I20260709 12:12:40.975454 18908 raft_consensus.cc:1081] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 5 LEADER]: Signalling peer 50b49485ef1b42068695f8e0ed8a3606 to start an election
I20260709 12:12:40.977264 18689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49d13c214ec3462a90d8f75264011372"
dest_uuid: "50b49485ef1b42068695f8e0ed8a3606"
 from {username='slave'} at 127.0.0.1:53408
I20260709 12:12:40.977845 18689 raft_consensus.cc:493] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:40.978168 18689 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:40.983059 18689 raft_consensus.cc:515] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.984717 18689 leader_election.cc:290] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 6 election: Requested vote from peers 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915), b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619)
I20260709 12:12:40.985996 18540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "8683cb3284784fef81af120ce39d5e51"
I20260709 12:12:40.986004 18616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d13c214ec3462a90d8f75264011372" candidate_uuid: "50b49485ef1b42068695f8e0ed8a3606" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b7647311c5df4756a2d5e112021c8512"
I20260709 12:12:40.986624 18540 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:40.986881 18616 raft_consensus.cc:3055] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:12:40.987308 18616 raft_consensus.cc:740] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7647311c5df4756a2d5e112021c8512, State: Running, Role: LEADER
I20260709 12:12:40.987987 18616 consensus_queue.cc:260] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:40.988921 18616 raft_consensus.cc:3060] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:12:40.993110 18540 raft_consensus.cc:2468] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 6.
I20260709 12:12:40.993783 18616 raft_consensus.cc:2468] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b49485ef1b42068695f8e0ed8a3606 in term 6.
I20260709 12:12:40.994488 18655 leader_election.cc:304] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b49485ef1b42068695f8e0ed8a3606, 8683cb3284784fef81af120ce39d5e51; no voters: 
I20260709 12:12:40.995846 18861 raft_consensus.cc:2804] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:12:40.996344 18861 raft_consensus.cc:697] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 6 LEADER]: Becoming Leader. State: Replica: 50b49485ef1b42068695f8e0ed8a3606, State: Running, Role: LEADER
I20260709 12:12:40.997092 18861 consensus_queue.cc:237] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } }
I20260709 12:12:41.005112 18439 catalog_manager.cc:5697] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 reported cstate change: term changed from 5 to 6, leader changed from b7647311c5df4756a2d5e112021c8512 (127.17.249.194) to 50b49485ef1b42068695f8e0ed8a3606 (127.17.249.195). New cstate: current_term: 6 leader_uuid: "50b49485ef1b42068695f8e0ed8a3606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.262684 18616 raft_consensus.cc:1275] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Refusing update from remote peer 8683cb3284784fef81af120ce39d5e51: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:41.264361 18929 consensus_queue.cc:1048] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:41.272223 18689 raft_consensus.cc:1275] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Refusing update from remote peer 8683cb3284784fef81af120ce39d5e51: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:41.273201 18616 raft_consensus.cc:1275] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Refusing update from remote peer 8683cb3284784fef81af120ce39d5e51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:41.275312 18930 consensus_queue.cc:1048] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:41.278501 18929 consensus_queue.cc:1048] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:41.293581 18690 raft_consensus.cc:1275] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Refusing update from remote peer 8683cb3284784fef81af120ce39d5e51: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:41.296728 18943 consensus_queue.cc:1048] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:41.317948 18690 raft_consensus.cc:1275] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 4 FOLLOWER]: Refusing update from remote peer 8683cb3284784fef81af120ce39d5e51: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:41.319396 18943 consensus_queue.cc:1048] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b49485ef1b42068695f8e0ed8a3606" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 43979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:41.326457 18615 raft_consensus.cc:1275] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Refusing update from remote peer 50b49485ef1b42068695f8e0ed8a3606: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:41.328262 18861 consensus_queue.cc:1048] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:41.330266 18616 raft_consensus.cc:1275] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 4 FOLLOWER]: Refusing update from remote peer 8683cb3284784fef81af120ce39d5e51: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:41.332937 18929 consensus_queue.cc:1048] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:41.348658 18541 raft_consensus.cc:1275] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Refusing update from remote peer 50b49485ef1b42068695f8e0ed8a3606: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:41.350838 18937 consensus_queue.cc:1048] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:41.466604 18617 raft_consensus.cc:1275] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 6 FOLLOWER]: Refusing update from remote peer 50b49485ef1b42068695f8e0ed8a3606: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:12:41.468335 18937 consensus_queue.cc:1048] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7647311c5df4756a2d5e112021c8512" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:12:41.479383 18541 raft_consensus.cc:1275] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 6 FOLLOWER]: Refusing update from remote peer 50b49485ef1b42068695f8e0ed8a3606: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:12:41.481102 18937 consensus_queue.cc:1048] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8683cb3284784fef81af120ce39d5e51" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:12:41.654002 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:41.659190 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:41.659678 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:42.660841 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:42.666227 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:42.666705 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:43.815398 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:43.820950 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:43.821412 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:44.308068 18638 debug-util.cc:398] Leaking SignalData structure 0x7b0800188bc0 after lost signal to thread 18410
W20260709 12:12:44.308951 18638 debug-util.cc:398] Leaking SignalData structure 0x7b080019b660 after lost signal to thread 18473
W20260709 12:12:44.309782 18638 debug-util.cc:398] Leaking SignalData structure 0x7b080012a120 after lost signal to thread 18566
W20260709 12:12:44.310532 18638 debug-util.cc:398] Leaking SignalData structure 0x7b08000c4d40 after lost signal to thread 18641
W20260709 12:12:44.311302 18638 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1ca0 after lost signal to thread 18715
I20260709 12:12:44.822724 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:44.828498 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:44.829078 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:45.830440 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:45.838223 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:45.838858 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:46.840212 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:46.845752 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:46.846174 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:47.847417 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:47.852489 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:47.852980 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:48.854362 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:48.859818 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:48.860390 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:49.861940 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:49.868418 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:49.868857 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:50.906370 18407 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:12:50.907032 18407 tablet_server.cc:179] TabletServer@127.17.249.193:0 shutting down...
W20260709 12:12:50.948822 18581 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:50.953794 18581 consensus_peers.cc:597] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 -> Peer 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915): Couldn't send request to peer 8683cb3284784fef81af120ce39d5e51. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.955018 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:50.955850 18407 tablet_replica.cc:333] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51: stopping tablet replica
I20260709 12:12:50.956745 18407 raft_consensus.cc:2243] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.957695 18407 raft_consensus.cc:2272] T 49d13c214ec3462a90d8f75264011372 P 8683cb3284784fef81af120ce39d5e51 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.960453 18407 tablet_replica.cc:333] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51: stopping tablet replica
I20260709 12:12:50.961191 18407 raft_consensus.cc:2243] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.961656 18407 raft_consensus.cc:2272] T f1c8b362cf37450dafcfc8a70b5fed9a P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.963537 18407 tablet_replica.cc:333] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51: stopping tablet replica
I20260709 12:12:50.964073 18407 raft_consensus.cc:2243] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.964591 18407 raft_consensus.cc:2272] T 91a22cb623e847d09518e9e0f2fdb9ba P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.966745 18407 tablet_replica.cc:333] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51: stopping tablet replica
I20260709 12:12:50.967365 18407 raft_consensus.cc:2243] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.968348 18407 raft_consensus.cc:2272] T 515aa89b6083412fbb678d19240cfb85 P 8683cb3284784fef81af120ce39d5e51 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:50.969514 18655 consensus_peers.cc:597] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 -> Peer 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915): Couldn't send request to peer 8683cb3284784fef81af120ce39d5e51. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.970395 18407 tablet_replica.cc:333] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51: stopping tablet replica
I20260709 12:12:50.971109 18407 raft_consensus.cc:2243] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.971997 18407 raft_consensus.cc:2272] T 04f44e0740d54053833a5c24f22bf38f P 8683cb3284784fef81af120ce39d5e51 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.973702 18407 tablet_replica.cc:333] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51: stopping tablet replica
I20260709 12:12:50.974251 18407 raft_consensus.cc:2243] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.975131 18407 raft_consensus.cc:2272] T e2c55d36760f4b02a71a21572418ec9c P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.976944 18407 tablet_replica.cc:333] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51: stopping tablet replica
I20260709 12:12:50.977461 18407 raft_consensus.cc:2243] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.977911 18407 raft_consensus.cc:2272] T 11e449fe6895497ca5bc524b2cf40381 P 8683cb3284784fef81af120ce39d5e51 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.979687 18407 tablet_replica.cc:333] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51: stopping tablet replica
I20260709 12:12:50.980173 18407 raft_consensus.cc:2243] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.980603 18407 raft_consensus.cc:2272] T 165f73119613475ca0dcd63be023aa10 P 8683cb3284784fef81af120ce39d5e51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.982514 18407 tablet_replica.cc:333] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51: stopping tablet replica
I20260709 12:12:50.983096 18407 raft_consensus.cc:2243] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.983633 18407 raft_consensus.cc:2272] T 35af2dcd4cd04070808d3d78fc5a40b3 P 8683cb3284784fef81af120ce39d5e51 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:50.986353 18655 consensus_peers.cc:597] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 -> Peer 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915): Couldn't send request to peer 8683cb3284784fef81af120ce39d5e51. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.096812 18407 tablet_server.cc:196] TabletServer@127.17.249.193:0 shutdown complete.
W20260709 12:12:51.098296 18655 consensus_peers.cc:597] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 -> Peer 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915): Couldn't send request to peer 8683cb3284784fef81af120ce39d5e51. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.119189 18407 tablet_server.cc:179] TabletServer@127.17.249.194:0 shutting down...
W20260709 12:12:51.150090 18581 consensus_peers.cc:597] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 -> Peer 8683cb3284784fef81af120ce39d5e51 (127.17.249.193:41915): Couldn't send request to peer 8683cb3284784fef81af120ce39d5e51. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.163939 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:51.164928 18407 tablet_replica.cc:333] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512: stopping tablet replica
I20260709 12:12:51.166147 18407 raft_consensus.cc:2243] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.166989 18407 raft_consensus.cc:2272] T f1c8b362cf37450dafcfc8a70b5fed9a P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.169139 18407 tablet_replica.cc:333] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512: stopping tablet replica
I20260709 12:12:51.169715 18407 raft_consensus.cc:2243] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.170150 18407 raft_consensus.cc:2272] T 515aa89b6083412fbb678d19240cfb85 P b7647311c5df4756a2d5e112021c8512 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.172343 18407 tablet_replica.cc:333] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512: stopping tablet replica
I20260709 12:12:51.172905 18407 raft_consensus.cc:2243] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.173822 18407 raft_consensus.cc:2272] T 165f73119613475ca0dcd63be023aa10 P b7647311c5df4756a2d5e112021c8512 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.176131 18407 tablet_replica.cc:333] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512: stopping tablet replica
I20260709 12:12:51.176805 18407 raft_consensus.cc:2243] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.177783 18407 raft_consensus.cc:2272] T 11e449fe6895497ca5bc524b2cf40381 P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.179983 18407 tablet_replica.cc:333] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512: stopping tablet replica
I20260709 12:12:51.180523 18407 raft_consensus.cc:2243] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.180965 18407 raft_consensus.cc:2272] T 04f44e0740d54053833a5c24f22bf38f P b7647311c5df4756a2d5e112021c8512 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.182986 18407 tablet_replica.cc:333] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512: stopping tablet replica
I20260709 12:12:51.183485 18407 raft_consensus.cc:2243] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.183887 18407 raft_consensus.cc:2272] T e2c55d36760f4b02a71a21572418ec9c P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.185801 18407 tablet_replica.cc:333] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512: stopping tablet replica
I20260709 12:12:51.186318 18407 raft_consensus.cc:2243] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.186730 18407 raft_consensus.cc:2272] T 91a22cb623e847d09518e9e0f2fdb9ba P b7647311c5df4756a2d5e112021c8512 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.188691 18407 tablet_replica.cc:333] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512: stopping tablet replica
I20260709 12:12:51.189146 18407 raft_consensus.cc:2243] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.189536 18407 raft_consensus.cc:2272] T 49d13c214ec3462a90d8f75264011372 P b7647311c5df4756a2d5e112021c8512 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.191531 18407 tablet_replica.cc:333] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512: stopping tablet replica
I20260709 12:12:51.192037 18407 raft_consensus.cc:2243] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.192950 18407 raft_consensus.cc:2272] T 35af2dcd4cd04070808d3d78fc5a40b3 P b7647311c5df4756a2d5e112021c8512 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:51.204500 18654 consensus_peers.cc:597] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 -> Peer b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619): Couldn't send request to peer b7647311c5df4756a2d5e112021c8512. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.249596 18407 tablet_server.cc:196] TabletServer@127.17.249.194:0 shutdown complete.
W20260709 12:12:51.265236 18654 consensus_peers.cc:597] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 -> Peer b7647311c5df4756a2d5e112021c8512 (127.17.249.194:35619): Couldn't send request to peer b7647311c5df4756a2d5e112021c8512. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:35619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.275108 18407 tablet_server.cc:179] TabletServer@127.17.249.195:0 shutting down...
I20260709 12:12:51.316147 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:51.317008 18407 tablet_replica.cc:333] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606: stopping tablet replica
I20260709 12:12:51.318056 18407 raft_consensus.cc:2243] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.319272 18407 raft_consensus.cc:2272] T f1c8b362cf37450dafcfc8a70b5fed9a P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.321332 18407 tablet_replica.cc:333] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606: stopping tablet replica
I20260709 12:12:51.321849 18407 raft_consensus.cc:2243] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.322299 18407 raft_consensus.cc:2272] T 515aa89b6083412fbb678d19240cfb85 P 50b49485ef1b42068695f8e0ed8a3606 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.324296 18407 tablet_replica.cc:333] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606: stopping tablet replica
I20260709 12:12:51.324870 18407 raft_consensus.cc:2243] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.325373 18407 raft_consensus.cc:2272] T 04f44e0740d54053833a5c24f22bf38f P 50b49485ef1b42068695f8e0ed8a3606 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.327369 18407 tablet_replica.cc:333] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606: stopping tablet replica
I20260709 12:12:51.327916 18407 raft_consensus.cc:2243] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.328363 18407 raft_consensus.cc:2272] T e2c55d36760f4b02a71a21572418ec9c P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.330265 18407 tablet_replica.cc:333] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606: stopping tablet replica
I20260709 12:12:51.330885 18407 raft_consensus.cc:2243] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.331398 18407 raft_consensus.cc:2272] T 11e449fe6895497ca5bc524b2cf40381 P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.333225 18407 tablet_replica.cc:333] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606: stopping tablet replica
I20260709 12:12:51.333772 18407 raft_consensus.cc:2243] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.334187 18407 raft_consensus.cc:2272] T 165f73119613475ca0dcd63be023aa10 P 50b49485ef1b42068695f8e0ed8a3606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.336203 18407 tablet_replica.cc:333] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606: stopping tablet replica
I20260709 12:12:51.336920 18407 raft_consensus.cc:2243] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.337543 18407 raft_consensus.cc:2272] T 35af2dcd4cd04070808d3d78fc5a40b3 P 50b49485ef1b42068695f8e0ed8a3606 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.339637 18407 tablet_replica.cc:333] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606: stopping tablet replica
I20260709 12:12:51.340261 18407 raft_consensus.cc:2243] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.341181 18407 raft_consensus.cc:2272] T 91a22cb623e847d09518e9e0f2fdb9ba P 50b49485ef1b42068695f8e0ed8a3606 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.343250 18407 tablet_replica.cc:333] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606: stopping tablet replica
I20260709 12:12:51.343793 18407 raft_consensus.cc:2243] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.344753 18407 raft_consensus.cc:2272] T 49d13c214ec3462a90d8f75264011372 P 50b49485ef1b42068695f8e0ed8a3606 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.377105 18407 tablet_server.cc:196] TabletServer@127.17.249.195:0 shutdown complete.
I20260709 12:12:51.397500 18407 master.cc:562] Master@127.17.249.254:35783 shutting down...
I20260709 12:12:51.597270 18407 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.598062 18407 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.598435 18407 tablet_replica.cc:333] T 00000000000000000000000000000000 P e226176d4cd1420384f2495d2ab3aef9: stopping tablet replica
I20260709 12:12:51.620375 18407 master.cc:584] Master@127.17.249.254:35783 shutdown complete.
50b49485ef1b42068695f8e0ed8a3606  1
8683cb3284784fef81af120ce39d5e51  4
b7647311c5df4756a2d5e112021c8512  4
50b49485ef1b42068695f8e0ed8a3606  3
8683cb3284784fef81af120ce39d5e51  3
b7647311c5df4756a2d5e112021c8512  3
50b49485ef1b42068695f8e0ed8a3606  1
8683cb3284784fef81af120ce39d5e51  0
b7647311c5df4756a2d5e112021c8512  8
50b49485ef1b42068695f8e0ed8a3606  3
8683cb3284784fef81af120ce39d5e51  3
b7647311c5df4756a2d5e112021c8512  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32636 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:12:51.672879 18407 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.249.254:41473
I20260709 12:12:51.674314 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:51.681591 18975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:51.682010 18976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:51.683291 18407 server_base.cc:1061] running on GCE node
W20260709 12:12:51.683429 18978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:51.684808 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:51.685011 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:51.685130 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599171685119 us; error 0 us; skew 500 ppm
I20260709 12:12:51.685617 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:51.689558 18407 webserver.cc:533] Webserver started at http://127.17.249.254:34619/ using document root <none> and password file <none>
I20260709 12:12:51.690145 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:51.690336 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:51.690590 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:51.692035 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/master-0-root/instance:
uuid: "c8cd6bc372114ddcb1f93f4007b46516"
format_stamp: "Formatted at 2026-07-09 12:12:51 on dist-test-slave-7mcn"
I20260709 12:12:51.697312 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:12:51.701561 18983 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:51.702558 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:12:51.703019 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/master-0-root
uuid: "c8cd6bc372114ddcb1f93f4007b46516"
format_stamp: "Formatted at 2026-07-09 12:12:51 on dist-test-slave-7mcn"
I20260709 12:12:51.703364 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:51.720528 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:51.721820 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:51.769250 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.254:41473
I20260709 12:12:51.769402 19034 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.254:41473 every 8 connection(s)
I20260709 12:12:51.773897 19035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.785089 19035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516: Bootstrap starting.
I20260709 12:12:51.790454 19035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.796128 19035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516: No bootstrap required, opened a new log
I20260709 12:12:51.798702 19035 raft_consensus.cc:359] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cd6bc372114ddcb1f93f4007b46516" member_type: VOTER }
I20260709 12:12:51.799268 19035 raft_consensus.cc:385] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.799572 19035 raft_consensus.cc:740] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8cd6bc372114ddcb1f93f4007b46516, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.800216 19035 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cd6bc372114ddcb1f93f4007b46516" member_type: VOTER }
I20260709 12:12:51.800733 19035 raft_consensus.cc:399] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:51.800973 19035 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:51.801486 19035 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.807106 19035 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cd6bc372114ddcb1f93f4007b46516" member_type: VOTER }
I20260709 12:12:51.807837 19035 leader_election.cc:304] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8cd6bc372114ddcb1f93f4007b46516; no voters: 
I20260709 12:12:51.809229 19035 leader_election.cc:290] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:51.809754 19038 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.811316 19038 raft_consensus.cc:697] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [term 1 LEADER]: Becoming Leader. State: Replica: c8cd6bc372114ddcb1f93f4007b46516, State: Running, Role: LEADER
I20260709 12:12:51.812346 19038 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cd6bc372114ddcb1f93f4007b46516" member_type: VOTER }
I20260709 12:12:51.812877 19035 sys_catalog.cc:565] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:51.819366 19040 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8cd6bc372114ddcb1f93f4007b46516. Latest consensus state: current_term: 1 leader_uuid: "c8cd6bc372114ddcb1f93f4007b46516" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cd6bc372114ddcb1f93f4007b46516" member_type: VOTER } }
I20260709 12:12:51.819417 19039 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8cd6bc372114ddcb1f93f4007b46516" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8cd6bc372114ddcb1f93f4007b46516" member_type: VOTER } }
I20260709 12:12:51.820802 19040 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:51.820848 19039 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:51.823994 19046 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:51.830526 19046 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:51.834100 18407 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:51.843151 19046 catalog_manager.cc:1383] Generated new cluster ID: 31a1a5126fa144efb611605fd7816b0f
I20260709 12:12:51.843696 19046 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:51.863137 19046 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:51.864652 19046 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:51.893565 19046 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516: Generated new TSK 0
I20260709 12:12:51.894311 19046 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:51.902905 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:51.910362 19056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:51.912262 19057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:51.913954 19059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:51.914372 18407 server_base.cc:1061] running on GCE node
I20260709 12:12:51.915894 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:51.916180 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:51.916391 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599171916377 us; error 0 us; skew 500 ppm
I20260709 12:12:51.917150 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:51.920495 18407 webserver.cc:533] Webserver started at http://127.17.249.193:41099/ using document root <none> and password file <none>
I20260709 12:12:51.921123 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:51.921337 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:51.921686 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:51.923065 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-0-root/instance:
uuid: "ccd68072dd7448289851e695f02a58fa"
format_stamp: "Formatted at 2026-07-09 12:12:51 on dist-test-slave-7mcn"
I20260709 12:12:51.929270 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:51.934259 19064 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:51.935276 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:12:51.935731 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-0-root
uuid: "ccd68072dd7448289851e695f02a58fa"
format_stamp: "Formatted at 2026-07-09 12:12:51 on dist-test-slave-7mcn"
I20260709 12:12:51.936103 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:51.963598 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:51.965777 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:51.968691 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:51.972973 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:51.973235 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:51.973459 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:51.973709 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:52.028055 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.193:43971
I20260709 12:12:52.028180 19126 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.193:43971 every 8 connection(s)
I20260709 12:12:52.033691 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:52.043228 19131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:52.045205 19132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:52.047369 19134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:52.049314 18407 server_base.cc:1061] running on GCE node
I20260709 12:12:52.051218 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:52.051251 19127 heartbeater.cc:344] Connected to a master server at 127.17.249.254:41473
W20260709 12:12:52.051606 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:52.051939 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599172051898 us; error 0 us; skew 500 ppm
I20260709 12:12:52.051977 19127 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:52.052707 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:52.053138 19127 heartbeater.cc:507] Master 127.17.249.254:41473 requested a full tablet report, sending...
I20260709 12:12:52.056037 18407 webserver.cc:533] Webserver started at http://127.17.249.194:41215/ using document root <none> and password file <none>
I20260709 12:12:52.056519 19000 ts_manager.cc:194] Registered new tserver with Master: ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971)
I20260709 12:12:52.056653 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:52.056975 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:52.057296 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:52.058547 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-1-root/instance:
uuid: "5bd07372a85a49d2b0b2ba959004a596"
format_stamp: "Formatted at 2026-07-09 12:12:52 on dist-test-slave-7mcn"
I20260709 12:12:52.058670 19000 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42440
I20260709 12:12:52.064476 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:12:52.069226 19139 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:52.070401 18407 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:12:52.071023 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-1-root
uuid: "5bd07372a85a49d2b0b2ba959004a596"
format_stamp: "Formatted at 2026-07-09 12:12:52 on dist-test-slave-7mcn"
I20260709 12:12:52.071367 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:52.099079 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:52.100384 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:52.101963 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:52.104466 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:52.104712 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:52.104979 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:52.105156 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:52.152823 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.194:35915
I20260709 12:12:52.152972 19201 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.194:35915 every 8 connection(s)
I20260709 12:12:52.157895 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:52.167531 19205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:52.169974 19206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:52.173213 18407 server_base.cc:1061] running on GCE node
W20260709 12:12:52.173599 19208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:52.175145 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:52.175444 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:52.175653 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599172175633 us; error 0 us; skew 500 ppm
I20260709 12:12:52.176157 19202 heartbeater.cc:344] Connected to a master server at 127.17.249.254:41473
I20260709 12:12:52.176720 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:52.176908 19202 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:52.178411 19202 heartbeater.cc:507] Master 127.17.249.254:41473 requested a full tablet report, sending...
I20260709 12:12:52.180816 18407 webserver.cc:533] Webserver started at http://127.17.249.195:33377/ using document root <none> and password file <none>
I20260709 12:12:52.181483 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:52.181679 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:52.181906 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:52.181952 19000 ts_manager.cc:194] Registered new tserver with Master: 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:12:52.183326 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-2-root/instance:
uuid: "e7ea24e7a921470dbb649650c6870f5d"
format_stamp: "Formatted at 2026-07-09 12:12:52 on dist-test-slave-7mcn"
I20260709 12:12:52.183961 19000 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42450
I20260709 12:12:52.189632 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:52.194608 19213 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:52.196185 18407 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:12:52.196635 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-2-root
uuid: "e7ea24e7a921470dbb649650c6870f5d"
format_stamp: "Formatted at 2026-07-09 12:12:52 on dist-test-slave-7mcn"
I20260709 12:12:52.196944 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599138854584-18407-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:52.216885 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:52.218454 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:52.220232 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:52.222841 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:52.223066 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:52.223349 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:52.223577 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:52.273336 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.195:40389
I20260709 12:12:52.273452 19275 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.195:40389 every 8 connection(s)
I20260709 12:12:52.297338 19276 heartbeater.cc:344] Connected to a master server at 127.17.249.254:41473
I20260709 12:12:52.297945 19276 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:52.298890 19276 heartbeater.cc:507] Master 127.17.249.254:41473 requested a full tablet report, sending...
I20260709 12:12:52.301565 19000 ts_manager.cc:194] Registered new tserver with Master: e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:52.302198 18407 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.02491513s
I20260709 12:12:52.303356 19000 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42452
I20260709 12:12:52.336509 19000 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42462:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:52.340032 19000 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:52.419919 19167 tablet_service.cc:1511] Processing CreateTablet for tablet c054d570a53c413b98f35967ef37262a (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:52.420763 19241 tablet_service.cc:1511] Processing CreateTablet for tablet c054d570a53c413b98f35967ef37262a (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:52.421674 19167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c054d570a53c413b98f35967ef37262a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.422171 19241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c054d570a53c413b98f35967ef37262a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.424263 19166 tablet_service.cc:1511] Processing CreateTablet for tablet 954bdeed047a4119afe2c5bd95d23822 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:52.425889 19166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954bdeed047a4119afe2c5bd95d23822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.430737 19240 tablet_service.cc:1511] Processing CreateTablet for tablet 954bdeed047a4119afe2c5bd95d23822 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:52.434002 19240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954bdeed047a4119afe2c5bd95d23822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.439688 19165 tablet_service.cc:1511] Processing CreateTablet for tablet a278856b2c8e4e8bbff0fab7807f0065 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:52.441396 19165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a278856b2c8e4e8bbff0fab7807f0065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.445343 19239 tablet_service.cc:1511] Processing CreateTablet for tablet a278856b2c8e4e8bbff0fab7807f0065 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:52.446923 19239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a278856b2c8e4e8bbff0fab7807f0065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.454046 19238 tablet_service.cc:1511] Processing CreateTablet for tablet dfc860d5e2d040e2ab61a30c25444c45 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:52.457072 19238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc860d5e2d040e2ab61a30c25444c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.456954 19164 tablet_service.cc:1511] Processing CreateTablet for tablet dfc860d5e2d040e2ab61a30c25444c45 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:52.458673 19164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc860d5e2d040e2ab61a30c25444c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.466166 19237 tablet_service.cc:1511] Processing CreateTablet for tablet a121b37529ee4d9dae023bbdb5901aa5 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:52.469087 19237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a121b37529ee4d9dae023bbdb5901aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.468823 19163 tablet_service.cc:1511] Processing CreateTablet for tablet a121b37529ee4d9dae023bbdb5901aa5 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:52.470461 19163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a121b37529ee4d9dae023bbdb5901aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.474373 19236 tablet_service.cc:1511] Processing CreateTablet for tablet 0e59d1b33be24671b742b188a69d835a (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:52.476543 19236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e59d1b33be24671b742b188a69d835a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.481046 19162 tablet_service.cc:1511] Processing CreateTablet for tablet 0e59d1b33be24671b742b188a69d835a (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:52.483177 19162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e59d1b33be24671b742b188a69d835a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.497370 19161 tablet_service.cc:1511] Processing CreateTablet for tablet e342edc4ecec4e5ba112280b7b7a2bee (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:52.499121 19161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e342edc4ecec4e5ba112280b7b7a2bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.515758 19160 tablet_service.cc:1511] Processing CreateTablet for tablet 5660612675c1496eb8995fbd1771ba02 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:52.518090 19160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5660612675c1496eb8995fbd1771ba02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.520397 19159 tablet_service.cc:1511] Processing CreateTablet for tablet e35c682da20343f8987c96c4ef81f108 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:52.523896 19158 tablet_service.cc:1511] Processing CreateTablet for tablet 064b5c45d66a463c9e6df4f0542dbf4f (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:52.526945 19092 tablet_service.cc:1511] Processing CreateTablet for tablet c054d570a53c413b98f35967ef37262a (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:52.528595 19092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c054d570a53c413b98f35967ef37262a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.528221 19087 tablet_service.cc:1511] Processing CreateTablet for tablet 0e59d1b33be24671b742b188a69d835a (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:52.529754 19087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e59d1b33be24671b742b188a69d835a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.526945 19083 tablet_service.cc:1511] Processing CreateTablet for tablet 064b5c45d66a463c9e6df4f0542dbf4f (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:52.531015 19091 tablet_service.cc:1511] Processing CreateTablet for tablet 954bdeed047a4119afe2c5bd95d23822 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:52.533391 19086 tablet_service.cc:1511] Processing CreateTablet for tablet e342edc4ecec4e5ba112280b7b7a2bee (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:52.534097 19090 tablet_service.cc:1511] Processing CreateTablet for tablet a278856b2c8e4e8bbff0fab7807f0065 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:52.537014 19089 tablet_service.cc:1511] Processing CreateTablet for tablet dfc860d5e2d040e2ab61a30c25444c45 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:52.538493 19083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064b5c45d66a463c9e6df4f0542dbf4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.542742 19088 tablet_service.cc:1511] Processing CreateTablet for tablet a121b37529ee4d9dae023bbdb5901aa5 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:52.546083 19158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064b5c45d66a463c9e6df4f0542dbf4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.562726 19234 tablet_service.cc:1511] Processing CreateTablet for tablet 5660612675c1496eb8995fbd1771ba02 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:52.565691 19084 tablet_service.cc:1511] Processing CreateTablet for tablet e35c682da20343f8987c96c4ef81f108 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:52.566478 19234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5660612675c1496eb8995fbd1771ba02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.561209 19086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e342edc4ecec4e5ba112280b7b7a2bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.574476 19232 tablet_service.cc:1511] Processing CreateTablet for tablet 064b5c45d66a463c9e6df4f0542dbf4f (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:52.574517 19233 tablet_service.cc:1511] Processing CreateTablet for tablet e35c682da20343f8987c96c4ef81f108 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:52.575682 19085 tablet_service.cc:1511] Processing CreateTablet for tablet 5660612675c1496eb8995fbd1771ba02 (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:52.576444 19232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064b5c45d66a463c9e6df4f0542dbf4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.576821 19291 tablet_bootstrap.cc:492] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d: Bootstrap starting.
I20260709 12:12:52.562628 19235 tablet_service.cc:1511] Processing CreateTablet for tablet e342edc4ecec4e5ba112280b7b7a2bee (DEFAULT_TABLE table=test-workload [id=4f189ef371e047118c6329540a2b6c9a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:52.583335 19085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5660612675c1496eb8995fbd1771ba02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.584162 19089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc860d5e2d040e2ab61a30c25444c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.586158 19159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35c682da20343f8987c96c4ef81f108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.587433 19235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e342edc4ecec4e5ba112280b7b7a2bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.591210 19084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35c682da20343f8987c96c4ef81f108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.596529 19233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35c682da20343f8987c96c4ef81f108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.598482 19091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954bdeed047a4119afe2c5bd95d23822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.599941 19088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a121b37529ee4d9dae023bbdb5901aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.604501 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a278856b2c8e4e8bbff0fab7807f0065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.639887 19291 tablet_bootstrap.cc:654] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.681020 19293 tablet_bootstrap.cc:492] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa: Bootstrap starting.
I20260709 12:12:52.681850 19292 tablet_bootstrap.cc:492] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596: Bootstrap starting.
I20260709 12:12:52.688872 19293 tablet_bootstrap.cc:654] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.725625 19292 tablet_bootstrap.cc:654] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.731891 19291 tablet_bootstrap.cc:492] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d: No bootstrap required, opened a new log
I20260709 12:12:52.732558 19291 ts_tablet_manager.cc:1403] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d: Time spent bootstrapping tablet: real 0.156s	user 0.015s	sys 0.012s
I20260709 12:12:52.736459 19291 raft_consensus.cc:359] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.737497 19291 raft_consensus.cc:385] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.737872 19291 raft_consensus.cc:740] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.739579 19291 consensus_queue.cc:260] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.740885 19293 tablet_bootstrap.cc:492] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa: No bootstrap required, opened a new log
I20260709 12:12:52.741477 19293 ts_tablet_manager.cc:1403] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.005s
I20260709 12:12:52.744578 19293 raft_consensus.cc:359] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.745457 19293 raft_consensus.cc:385] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.746678 19293 raft_consensus.cc:740] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.747660 19293 consensus_queue.cc:260] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.751606 19127 heartbeater.cc:499] Master 127.17.249.254:41473 was elected leader, sending a full tablet report...
I20260709 12:12:52.752313 19293 ts_tablet_manager.cc:1434] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.009s
I20260709 12:12:52.753489 19293 tablet_bootstrap.cc:492] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa: Bootstrap starting.
I20260709 12:12:52.753911 19276 heartbeater.cc:499] Master 127.17.249.254:41473 was elected leader, sending a full tablet report...
I20260709 12:12:52.754449 19291 ts_tablet_manager.cc:1434] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 12:12:52.755689 19291 tablet_bootstrap.cc:492] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d: Bootstrap starting.
I20260709 12:12:52.760342 19293 tablet_bootstrap.cc:654] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.763723 19291 tablet_bootstrap.cc:654] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.775122 19291 tablet_bootstrap.cc:492] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d: No bootstrap required, opened a new log
I20260709 12:12:52.774896 19293 tablet_bootstrap.cc:492] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa: No bootstrap required, opened a new log
I20260709 12:12:52.775122 19292 tablet_bootstrap.cc:492] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596: No bootstrap required, opened a new log
I20260709 12:12:52.775964 19291 ts_tablet_manager.cc:1403] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:12:52.776089 19293 ts_tablet_manager.cc:1403] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.002s
I20260709 12:12:52.776091 19292 ts_tablet_manager.cc:1403] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.006s
W20260709 12:12:52.778679 19277 tablet.cc:2406] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:52.779006 19291 raft_consensus.cc:359] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:52.779829 19291 raft_consensus.cc:385] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.779413 19292 raft_consensus.cc:359] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:52.780166 19291 raft_consensus.cc:740] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.780289 19292 raft_consensus.cc:385] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.780689 19292 raft_consensus.cc:740] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.781002 19291 consensus_queue.cc:260] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:52.781626 19292 consensus_queue.cc:260] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:52.781749 19293 raft_consensus.cc:359] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.782732 19293 raft_consensus.cc:385] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.783147 19293 raft_consensus.cc:740] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.783619 19291 ts_tablet_manager.cc:1434] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:52.784330 19293 consensus_queue.cc:260] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.784930 19291 tablet_bootstrap.cc:492] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d: Bootstrap starting.
I20260709 12:12:52.787751 19293 ts_tablet_manager.cc:1434] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:12:52.789076 19293 tablet_bootstrap.cc:492] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa: Bootstrap starting.
I20260709 12:12:52.795622 19291 tablet_bootstrap.cc:654] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.797555 19293 tablet_bootstrap.cc:654] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.800056 19202 heartbeater.cc:499] Master 127.17.249.254:41473 was elected leader, sending a full tablet report...
I20260709 12:12:52.800747 19292 ts_tablet_manager.cc:1434] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596: Time spent starting tablet: real 0.024s	user 0.012s	sys 0.011s
I20260709 12:12:52.801898 19292 tablet_bootstrap.cc:492] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596: Bootstrap starting.
I20260709 12:12:52.812431 19292 tablet_bootstrap.cc:654] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.813889 19291 tablet_bootstrap.cc:492] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d: No bootstrap required, opened a new log
I20260709 12:12:52.814488 19291 ts_tablet_manager.cc:1403] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.003s
I20260709 12:12:52.818135 19291 raft_consensus.cc:359] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.819260 19291 raft_consensus.cc:385] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.819725 19291 raft_consensus.cc:740] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.820815 19291 consensus_queue.cc:260] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.824287 19291 ts_tablet_manager.cc:1434] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:52.825925 19291 tablet_bootstrap.cc:492] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d: Bootstrap starting.
I20260709 12:12:52.831828 19296 raft_consensus.cc:493] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.833069 19296 raft_consensus.cc:515] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
W20260709 12:12:52.837184 19048 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:52.838182 19291 tablet_bootstrap.cc:654] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.854945 19296 leader_election.cc:290] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971)
I20260709 12:12:52.932538 19293 tablet_bootstrap.cc:492] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa: No bootstrap required, opened a new log
I20260709 12:12:52.933213 19293 ts_tablet_manager.cc:1403] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa: Time spent bootstrapping tablet: real 0.144s	user 0.055s	sys 0.076s
I20260709 12:12:52.934315 19292 tablet_bootstrap.cc:492] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596: No bootstrap required, opened a new log
I20260709 12:12:52.935097 19292 ts_tablet_manager.cc:1403] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596: Time spent bootstrapping tablet: real 0.133s	user 0.039s	sys 0.087s
I20260709 12:12:52.936264 19297 raft_consensus.cc:493] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.936851 19297 raft_consensus.cc:515] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.938359 19291 tablet_bootstrap.cc:492] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d: No bootstrap required, opened a new log
I20260709 12:12:52.939059 19291 ts_tablet_manager.cc:1403] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d: Time spent bootstrapping tablet: real 0.113s	user 0.026s	sys 0.082s
I20260709 12:12:52.939926 19297 leader_election.cc:290] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:52.936925 19293 raft_consensus.cc:359] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.944788 19293 raft_consensus.cc:385] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.945323 19293 raft_consensus.cc:740] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.946172 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:12:52.946623 19293 consensus_queue.cc:260] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
W20260709 12:12:52.948873 19214 leader_election.cc:343] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.950003 19293 ts_tablet_manager.cc:1434] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:12:52.942499 19291 raft_consensus.cc:359] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.950865 19291 raft_consensus.cc:385] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.951227 19293 tablet_bootstrap.cc:492] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa: Bootstrap starting.
I20260709 12:12:52.951269 19291 raft_consensus.cc:740] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.938573 19292 raft_consensus.cc:359] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.957600 19292 raft_consensus.cc:385] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.958016 19292 raft_consensus.cc:740] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.957476 19291 consensus_queue.cc:260] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.958585 19297 raft_consensus.cc:493] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.959280 19297 raft_consensus.cc:515] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.960273 19291 ts_tablet_manager.cc:1434] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:12:52.961552 19297 leader_election.cc:290] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:52.960318 19293 tablet_bootstrap.cc:654] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.961716 19291 tablet_bootstrap.cc:492] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d: Bootstrap starting.
I20260709 12:12:52.964989 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:52.965818 19177 raft_consensus.cc:2468] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 0.
I20260709 12:12:52.967588 19215 leader_election.cc:304] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: ccd68072dd7448289851e695f02a58fa
I20260709 12:12:52.968550 19296 raft_consensus.cc:2804] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.968945 19296 raft_consensus.cc:493] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.969310 19296 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.972558 19291 tablet_bootstrap.cc:654] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.980170 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:52.980512 19176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:52.959280 19292 consensus_queue.cc:260] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.979187 19296 raft_consensus.cc:515] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:52.985632 19293 tablet_bootstrap.cc:492] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa: No bootstrap required, opened a new log
I20260709 12:12:52.986183 19293 ts_tablet_manager.cc:1403] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.004s
I20260709 12:12:52.988225 19176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:12:52.989084 19176 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.991047 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:12:52.991684 19292 ts_tablet_manager.cc:1434] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:12:52.992930 19292 tablet_bootstrap.cc:492] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596: Bootstrap starting.
W20260709 12:12:52.993359 19214 leader_election.cc:343] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.994062 19296 leader_election.cc:290] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971)
I20260709 12:12:52.989444 19293 raft_consensus.cc:359] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:52.995075 19293 raft_consensus.cc:385] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.995458 19293 raft_consensus.cc:740] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.996476 19293 consensus_queue.cc:260] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.001508 19292 tablet_bootstrap.cc:654] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.005889 19293 ts_tablet_manager.cc:1434] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 12:12:53.007433 19293 tablet_bootstrap.cc:492] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa: Bootstrap starting.
W20260709 12:12:53.007803 19066 leader_election.cc:343] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:53.008677 19066 leader_election.cc:343] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.017006 19301 raft_consensus.cc:493] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.017926 19291 tablet_bootstrap.cc:492] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d: No bootstrap required, opened a new log
I20260709 12:12:53.017620 19301 raft_consensus.cc:515] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.018582 19291 ts_tablet_manager.cc:1403] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.015s
I20260709 12:12:53.018577 19293 tablet_bootstrap.cc:654] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.021693 19297 raft_consensus.cc:493] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.025025 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:53.028537 19291 raft_consensus.cc:359] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.029841 19291 raft_consensus.cc:385] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.030220 19291 raft_consensus.cc:740] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.030375 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
W20260709 12:12:53.032997 19066 leader_election.cc:343] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.033689 19066 leader_election.cc:304] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd68072dd7448289851e695f02a58fa; no voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:53.022601 19297 raft_consensus.cc:515] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.028950 19176 raft_consensus.cc:2468] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 1.
I20260709 12:12:53.037891 19297 leader_election.cc:290] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.038578 19297 raft_consensus.cc:2749] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.039734 19291 consensus_queue.cc:260] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.040602 19296 raft_consensus.cc:493] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.041836 19301 leader_election.cc:290] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.042178 19296 raft_consensus.cc:515] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.045293 19296 leader_election.cc:290] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:12:53.049324 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
W20260709 12:12:53.051720 19214 leader_election.cc:343] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:53.066175 19066 leader_election.cc:343] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.066820 19066 leader_election.cc:304] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd68072dd7448289851e695f02a58fa; no voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:53.068217 19292 tablet_bootstrap.cc:492] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596: No bootstrap required, opened a new log
I20260709 12:12:53.068926 19292 ts_tablet_manager.cc:1403] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.030s
I20260709 12:12:53.069478 19176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:53.070137 19317 raft_consensus.cc:2749] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.070283 19176 raft_consensus.cc:2468] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 0.
I20260709 12:12:53.069478 19293 tablet_bootstrap.cc:492] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa: No bootstrap required, opened a new log
I20260709 12:12:53.072116 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:53.072337 19293 ts_tablet_manager.cc:1403] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa: Time spent bootstrapping tablet: real 0.065s	user 0.024s	sys 0.024s
I20260709 12:12:53.072912 19251 raft_consensus.cc:2468] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 0.
I20260709 12:12:53.073169 19292 raft_consensus.cc:359] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.074191 19292 raft_consensus.cc:385] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.074651 19292 raft_consensus.cc:740] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.074615 19066 leader_election.cc:304] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:12:53.076079 19215 leader_election.cc:304] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: ccd68072dd7448289851e695f02a58fa
I20260709 12:12:53.075934 19293 raft_consensus.cc:359] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.076910 19317 raft_consensus.cc:2804] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.077462 19317 raft_consensus.cc:493] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.077610 19318 raft_consensus.cc:2804] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.078133 19291 ts_tablet_manager.cc:1434] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.008s
I20260709 12:12:53.077968 19317 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.079613 19291 tablet_bootstrap.cc:492] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d: Bootstrap starting.
I20260709 12:12:53.078204 19318 raft_consensus.cc:697] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Becoming Leader. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:12:53.076936 19293 raft_consensus.cc:385] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.078362 19292 consensus_queue.cc:260] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.081039 19293 raft_consensus.cc:740] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.080765 19318 consensus_queue.cc:237] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:53.082041 19293 consensus_queue.cc:260] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.085088 19292 ts_tablet_manager.cc:1434] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 12:12:53.087687 19292 tablet_bootstrap.cc:492] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596: Bootstrap starting.
I20260709 12:12:53.092795 19293 ts_tablet_manager.cc:1434] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:53.092399 19317 raft_consensus.cc:515] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.096419 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:12:53.097133 19177 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.097265 19292 tablet_bootstrap.cc:654] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.088680 19176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:53.088830 19291 tablet_bootstrap.cc:654] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.100694 19293 tablet_bootstrap.cc:492] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa: Bootstrap starting.
W20260709 12:12:53.107583 19215 leader_election.cc:343] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.108176 19215 leader_election.cc:304] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa
I20260709 12:12:53.109612 19296 raft_consensus.cc:2749] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.110451 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:53.111384 19251 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.117448 19297 raft_consensus.cc:493] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.119801 19250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:53.120761 19177 raft_consensus.cc:2468] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 1.
I20260709 12:12:53.122366 19066 leader_election.cc:304] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:12:53.118388 19297 raft_consensus.cc:515] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.123183 18996 catalog_manager.cc:5697] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d reported cstate change: term changed from 0 to 1, leader changed from <none> to e7ea24e7a921470dbb649650c6870f5d (127.17.249.195). New cstate: current_term: 1 leader_uuid: "e7ea24e7a921470dbb649650c6870f5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.126145 19317 leader_election.cc:290] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.126696 19297 leader_election.cc:290] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.126873 19317 raft_consensus.cc:2804] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.127799 19317 raft_consensus.cc:697] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:12:53.129395 19317 consensus_queue.cc:237] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.133124 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:12:53.136660 19140 leader_election.cc:304] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596; no voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:53.137451 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:53.138449 19301 raft_consensus.cc:2749] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.139971 19293 tablet_bootstrap.cc:654] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.140764 19250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:53.141597 19250 raft_consensus.cc:2468] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 0.
I20260709 12:12:53.145812 19066 leader_election.cc:304] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:12:53.148160 19321 raft_consensus.cc:2804] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.149757 19321 raft_consensus.cc:493] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.153399 19321 raft_consensus.cc:3060] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:53.148039 19066 leader_election.cc:343] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.151494 19291 tablet_bootstrap.cc:492] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d: No bootstrap required, opened a new log
I20260709 12:12:53.155181 19291 ts_tablet_manager.cc:1403] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.031s
I20260709 12:12:53.146409 19251 raft_consensus.cc:2468] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 1.
I20260709 12:12:53.156033 19292 tablet_bootstrap.cc:492] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596: No bootstrap required, opened a new log
I20260709 12:12:53.156658 19292 ts_tablet_manager.cc:1403] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.007s
I20260709 12:12:53.156801 18997 catalog_manager.cc:5697] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 1 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.158486 19291 raft_consensus.cc:359] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.159350 19291 raft_consensus.cc:385] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.159658 19291 raft_consensus.cc:740] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.160238 19292 raft_consensus.cc:359] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.160931 19292 raft_consensus.cc:385] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.160540 19291 consensus_queue.cc:260] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.161258 19292 raft_consensus.cc:740] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.162058 19292 consensus_queue.cc:260] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.163450 19291 ts_tablet_manager.cc:1434] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:12:53.164587 19291 tablet_bootstrap.cc:492] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d: Bootstrap starting.
I20260709 12:12:53.164862 19292 ts_tablet_manager.cc:1434] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 12:12:53.165930 19292 tablet_bootstrap.cc:492] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596: Bootstrap starting.
I20260709 12:12:53.170446 19321 raft_consensus.cc:515] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.178123 19291 tablet_bootstrap.cc:654] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.178673 19292 tablet_bootstrap.cc:654] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.182200 19293 tablet_bootstrap.cc:492] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa: No bootstrap required, opened a new log
I20260709 12:12:53.183168 19293 ts_tablet_manager.cc:1403] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.004s
I20260709 12:12:53.184531 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
W20260709 12:12:53.186285 19066 leader_election.cc:343] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.188217 19321 leader_election.cc:290] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.189407 19293 raft_consensus.cc:359] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.189909 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:53.190828 19293 raft_consensus.cc:385] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.191033 19251 raft_consensus.cc:3060] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.191396 19293 raft_consensus.cc:740] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.192694 19293 consensus_queue.cc:260] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.196807 19293 ts_tablet_manager.cc:1434] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:12:53.198596 19293 tablet_bootstrap.cc:492] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa: Bootstrap starting.
I20260709 12:12:53.199996 19292 tablet_bootstrap.cc:492] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596: No bootstrap required, opened a new log
I20260709 12:12:53.201423 19292 ts_tablet_manager.cc:1403] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.013s
I20260709 12:12:53.204548 19251 raft_consensus.cc:2468] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 1.
I20260709 12:12:53.206329 19066 leader_election.cc:304] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596
I20260709 12:12:53.207861 19321 raft_consensus.cc:2804] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.208683 19321 raft_consensus.cc:697] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:12:53.210747 19321 consensus_queue.cc:237] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.208315 19292 raft_consensus.cc:359] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.212121 19292 raft_consensus.cc:385] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.212517 19292 raft_consensus.cc:740] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.213559 19292 consensus_queue.cc:260] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.215189 19291 tablet_bootstrap.cc:492] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d: No bootstrap required, opened a new log
I20260709 12:12:53.215598 19293 tablet_bootstrap.cc:654] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.215759 19291 ts_tablet_manager.cc:1403] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.010s
I20260709 12:12:53.216158 19292 ts_tablet_manager.cc:1434] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.006s
I20260709 12:12:53.217254 19292 tablet_bootstrap.cc:492] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596: Bootstrap starting.
I20260709 12:12:53.220794 19291 raft_consensus.cc:359] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.221721 19291 raft_consensus.cc:385] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.222046 19291 raft_consensus.cc:740] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.225422 19292 tablet_bootstrap.cc:654] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.225457 19291 consensus_queue.cc:260] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.230556 19291 ts_tablet_manager.cc:1434] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:12:53.232565 19291 tablet_bootstrap.cc:492] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d: Bootstrap starting.
I20260709 12:12:53.233345 19293 tablet_bootstrap.cc:492] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa: No bootstrap required, opened a new log
I20260709 12:12:53.234112 19293 ts_tablet_manager.cc:1403] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.005s
I20260709 12:12:53.241042 19291 tablet_bootstrap.cc:654] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.247735 19293 raft_consensus.cc:359] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:53.248551 19293 raft_consensus.cc:385] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.248834 19293 raft_consensus.cc:740] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.249864 19293 consensus_queue.cc:260] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:53.254256 19292 tablet_bootstrap.cc:492] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596: No bootstrap required, opened a new log
I20260709 12:12:53.254328 19293 ts_tablet_manager.cc:1434] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.005s
I20260709 12:12:53.255092 19292 ts_tablet_manager.cc:1403] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.021s
I20260709 12:12:53.255646 19293 tablet_bootstrap.cc:492] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa: Bootstrap starting.
I20260709 12:12:53.258210 19292 raft_consensus.cc:359] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.259171 19292 raft_consensus.cc:385] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.259547 19292 raft_consensus.cc:740] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.260488 19292 consensus_queue.cc:260] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.262509 19293 tablet_bootstrap.cc:654] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.268306 19000 catalog_manager.cc:5697] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 1 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.273247 19292 ts_tablet_manager.cc:1434] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 12:12:53.277307 19301 raft_consensus.cc:493] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.277971 19301 raft_consensus.cc:515] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.279844 19321 raft_consensus.cc:493] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.280345 19321 raft_consensus.cc:515] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.282045 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:53.282505 19321 leader_election.cc:290] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.282701 19251 raft_consensus.cc:2468] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 0.
I20260709 12:12:53.285560 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:53.286657 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:12:53.287518 19102 raft_consensus.cc:2468] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 0.
I20260709 12:12:53.288671 19140 leader_election.cc:304] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:12:53.289716 19318 raft_consensus.cc:493] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.290315 19318 raft_consensus.cc:515] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.290657 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
W20260709 12:12:53.288820 19066 leader_election.cc:343] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:53.292738 19066 leader_election.cc:343] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.293114 19301 leader_election.cc:290] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.293326 19066 leader_election.cc:304] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd68072dd7448289851e695f02a58fa; no voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:53.293744 19301 raft_consensus.cc:2804] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.294095 19301 raft_consensus.cc:493] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.294431 19301 raft_consensus.cc:3060] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.294803 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:12:53.295627 19102 raft_consensus.cc:2468] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 0.
I20260709 12:12:53.296285 19321 raft_consensus.cc:2749] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.296976 19214 leader_election.cc:304] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:12:53.297829 19318 leader_election.cc:290] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:12:53.298581 19296 raft_consensus.cc:2804] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.298491 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:53.299234 19296 raft_consensus.cc:493] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.299650 19296 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.301680 19301 raft_consensus.cc:515] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
W20260709 12:12:53.303253 19215 leader_election.cc:343] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.303475 19292 tablet_bootstrap.cc:492] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596: Bootstrap starting.
I20260709 12:12:53.309082 19291 tablet_bootstrap.cc:492] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d: No bootstrap required, opened a new log
I20260709 12:12:53.308773 19296 raft_consensus.cc:515] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.309674 19291 ts_tablet_manager.cc:1403] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.031s
I20260709 12:12:53.309827 19292 tablet_bootstrap.cc:654] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.311967 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:12:53.312668 19102 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.313031 19293 tablet_bootstrap.cc:492] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa: No bootstrap required, opened a new log
I20260709 12:12:53.312806 19291 raft_consensus.cc:359] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.313645 19293 ts_tablet_manager.cc:1403] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa: Time spent bootstrapping tablet: real 0.058s	user 0.024s	sys 0.002s
I20260709 12:12:53.313552 19291 raft_consensus.cc:385] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.313546 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:12:53.314324 19291 raft_consensus.cc:740] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.314570 19101 raft_consensus.cc:3060] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.315340 19291 consensus_queue.cc:260] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.317049 19293 raft_consensus.cc:359] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.317462 19291 ts_tablet_manager.cc:1434] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:12:53.317925 19293 raft_consensus.cc:385] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.318307 19293 raft_consensus.cc:740] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.318816 19291 tablet_bootstrap.cc:492] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d: Bootstrap starting.
I20260709 12:12:53.319173 19293 consensus_queue.cc:260] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.323738 19293 ts_tablet_manager.cc:1434] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:53.323911 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:53.324481 19251 raft_consensus.cc:3060] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.324928 19293 tablet_bootstrap.cc:492] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa: Bootstrap starting.
I20260709 12:12:53.325696 19291 tablet_bootstrap.cc:654] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.331228 19293 tablet_bootstrap.cc:654] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.332072 19318 raft_consensus.cc:493] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.332860 19318 raft_consensus.cc:515] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.343154 19293 tablet_bootstrap.cc:492] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa: No bootstrap required, opened a new log
I20260709 12:12:53.343775 19293 ts_tablet_manager.cc:1403] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.006s
I20260709 12:12:53.344523 19251 raft_consensus.cc:2468] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 1.
I20260709 12:12:53.345217 19318 leader_election.cc:290] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:12:53.345543 19301 leader_election.cc:290] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.346961 19101 raft_consensus.cc:2468] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 1.
I20260709 12:12:53.346727 19293 raft_consensus.cc:359] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.347277 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:53.347671 19293 raft_consensus.cc:385] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.348131 19293 raft_consensus.cc:740] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.348948 19293 consensus_queue.cc:260] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
W20260709 12:12:53.349431 19215 leader_election.cc:343] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.351944 19293 ts_tablet_manager.cc:1434] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:12:53.352903 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:12:53.353274 19293 tablet_bootstrap.cc:492] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa: Bootstrap starting.
I20260709 12:12:53.355804 19101 raft_consensus.cc:2468] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 0.
I20260709 12:12:53.357532 19140 leader_election.cc:304] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:12:53.358894 19301 raft_consensus.cc:2804] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.359189 19336 raft_consensus.cc:493] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.359737 19336 raft_consensus.cc:515] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.360373 19214 leader_election.cc:304] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596
I20260709 12:12:53.362468 19336 leader_election.cc:290] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.363253 19293 tablet_bootstrap.cc:654] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.364799 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:12:53.365737 19101 raft_consensus.cc:2468] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 0.
I20260709 12:12:53.367558 19292 tablet_bootstrap.cc:492] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596: No bootstrap required, opened a new log
I20260709 12:12:53.367513 19140 leader_election.cc:304] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:12:53.368417 19292 ts_tablet_manager.cc:1403] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596: Time spent bootstrapping tablet: real 0.065s	user 0.005s	sys 0.014s
I20260709 12:12:53.368983 19318 raft_consensus.cc:2804] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.369040 19340 raft_consensus.cc:2804] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.369866 19318 raft_consensus.cc:493] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.369972 19340 raft_consensus.cc:493] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.370522 19318 raft_consensus.cc:3060] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.370638 19340 raft_consensus.cc:3060] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.371551 19292 raft_consensus.cc:359] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.372332 19292 raft_consensus.cc:385] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.372718 19292 raft_consensus.cc:740] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.373947 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:53.374704 19251 raft_consensus.cc:2468] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 0.
I20260709 12:12:53.378243 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:12:53.373508 19301 raft_consensus.cc:697] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Becoming Leader. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
W20260709 12:12:53.380424 19215 leader_election.cc:343] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.381124 19301 consensus_queue.cc:237] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.382488 19293 tablet_bootstrap.cc:492] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa: No bootstrap required, opened a new log
I20260709 12:12:53.383157 19293 ts_tablet_manager.cc:1403] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.008s
I20260709 12:12:53.385612 19102 raft_consensus.cc:2468] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 1.
I20260709 12:12:53.385941 19293 raft_consensus.cc:359] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.387662 19214 leader_election.cc:304] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596
I20260709 12:12:53.388473 19296 leader_election.cc:290] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:12:53.388497 19292 consensus_queue.cc:260] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.393458 19296 raft_consensus.cc:2804] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.393971 19293 raft_consensus.cc:385] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.394289 19296 raft_consensus.cc:697] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Becoming Leader. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:12:53.394970 19292 ts_tablet_manager.cc:1434] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596: Time spent starting tablet: real 0.026s	user 0.000s	sys 0.009s
I20260709 12:12:53.394867 19293 raft_consensus.cc:740] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.396184 19292 tablet_bootstrap.cc:492] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596: Bootstrap starting.
I20260709 12:12:53.395591 19296 consensus_queue.cc:237] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.396868 19293 consensus_queue.cc:260] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.400727 19293 ts_tablet_manager.cc:1434] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:12:53.391672 19340 raft_consensus.cc:515] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.409286 19292 tablet_bootstrap.cc:654] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.420923 19340 leader_election.cc:290] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.419924 19000 catalog_manager.cc:5697] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "5bd07372a85a49d2b0b2ba959004a596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.423564 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:53.424532 19251 raft_consensus.cc:3060] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.434477 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:12:53.437072 19102 raft_consensus.cc:3060] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.446125 19251 raft_consensus.cc:2468] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 1.
I20260709 12:12:53.446864 19291 tablet_bootstrap.cc:492] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d: No bootstrap required, opened a new log
I20260709 12:12:53.447428 19291 ts_tablet_manager.cc:1403] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d: Time spent bootstrapping tablet: real 0.129s	user 0.045s	sys 0.074s
I20260709 12:12:53.447830 19141 leader_election.cc:304] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:12:53.448135 19292 tablet_bootstrap.cc:492] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596: No bootstrap required, opened a new log
I20260709 12:12:53.448669 19292 ts_tablet_manager.cc:1403] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.036s
I20260709 12:12:53.448823 19340 raft_consensus.cc:2804] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.449308 19340 raft_consensus.cc:697] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Becoming Leader. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:12:53.450189 19340 consensus_queue.cc:237] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.450554 19291 raft_consensus.cc:359] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.451342 19291 raft_consensus.cc:385] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.451654 19291 raft_consensus.cc:740] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.452486 19291 consensus_queue.cc:260] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.452733 19292 raft_consensus.cc:359] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.454062 19292 raft_consensus.cc:385] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.455219 19291 ts_tablet_manager.cc:1434] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:53.444800 19318 raft_consensus.cc:515] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.454389 19292 raft_consensus.cc:740] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.456308 19291 tablet_bootstrap.cc:492] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d: Bootstrap starting.
I20260709 12:12:53.456606 19292 consensus_queue.cc:260] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.457835 19318 leader_election.cc:290] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:12:53.458945 19292 ts_tablet_manager.cc:1434] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:12:53.459195 19321 raft_consensus.cc:493] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.459839 19292 tablet_bootstrap.cc:492] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596: Bootstrap starting.
I20260709 12:12:53.459941 19321 raft_consensus.cc:515] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.460625 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:12:53.461279 19101 raft_consensus.cc:3060] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.462251 19321 leader_election.cc:290] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.464133 19102 raft_consensus.cc:2468] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 1.
I20260709 12:12:53.464541 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:12:53.466297 19176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:53.467996 19177 raft_consensus.cc:3060] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.468099 19176 raft_consensus.cc:2468] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 0.
I20260709 12:12:53.467132 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:53.472098 19066 leader_election.cc:304] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:12:53.474851 19321 raft_consensus.cc:2804] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.475329 19321 raft_consensus.cc:493] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.475669 19321 raft_consensus.cc:3060] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.475813 19000 catalog_manager.cc:5697] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d reported cstate change: term changed from 0 to 1, leader changed from <none> to e7ea24e7a921470dbb649650c6870f5d (127.17.249.195). New cstate: current_term: 1 leader_uuid: "e7ea24e7a921470dbb649650c6870f5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:53.477767 19177 raft_consensus.cc:2468] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 1.
I20260709 12:12:53.479218 19215 leader_election.cc:304] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:12:53.472214 19251 raft_consensus.cc:2468] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 0.
I20260709 12:12:53.484858 19101 raft_consensus.cc:2468] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 1.
I20260709 12:12:53.485702 19296 raft_consensus.cc:2804] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.486235 19296 raft_consensus.cc:697] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Becoming Leader. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:12:53.487109 19296 consensus_queue.cc:237] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.489564 19292 tablet_bootstrap.cc:654] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.490597 18996 catalog_manager.cc:5697] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "5bd07372a85a49d2b0b2ba959004a596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.494486 19291 tablet_bootstrap.cc:654] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.493851 19321 raft_consensus.cc:515] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.498657 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:12:53.499527 19177 raft_consensus.cc:3060] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.506533 19000 catalog_manager.cc:5697] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d reported cstate change: term changed from 0 to 1, leader changed from <none> to e7ea24e7a921470dbb649650c6870f5d (127.17.249.195). New cstate: current_term: 1 leader_uuid: "e7ea24e7a921470dbb649650c6870f5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:53.509361 19177 raft_consensus.cc:2468] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 1.
I20260709 12:12:53.510932 19321 leader_election.cc:290] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.511317 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:53.512634 19251 raft_consensus.cc:3060] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.514914 19291 tablet_bootstrap.cc:492] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d: No bootstrap required, opened a new log
I20260709 12:12:53.515473 19291 ts_tablet_manager.cc:1403] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.000s
I20260709 12:12:53.511802 19066 leader_election.cc:304] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:12:53.518327 19291 raft_consensus.cc:359] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.518740 19292 tablet_bootstrap.cc:492] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596: No bootstrap required, opened a new log
I20260709 12:12:53.519119 19291 raft_consensus.cc:385] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.519438 19321 raft_consensus.cc:2804] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.519488 19291 raft_consensus.cc:740] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.521044 19251 raft_consensus.cc:2468] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 1.
I20260709 12:12:53.521138 19321 raft_consensus.cc:697] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:12:53.520821 19291 consensus_queue.cc:260] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.522223 19321 consensus_queue.cc:237] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.523764 19291 ts_tablet_manager.cc:1434] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:12:53.519419 19292 ts_tablet_manager.cc:1403] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.012s
I20260709 12:12:53.529089 19292 raft_consensus.cc:359] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.529847 19292 raft_consensus.cc:385] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.530133 19292 raft_consensus.cc:740] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.530274 19317 consensus_queue.cc:1048] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.530942 19292 consensus_queue.cc:260] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.533486 19292 ts_tablet_manager.cc:1434] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:53.534466 19292 tablet_bootstrap.cc:492] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596: Bootstrap starting.
I20260709 12:12:53.539438 19321 raft_consensus.cc:493] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.538357 18996 catalog_manager.cc:5697] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 1 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.540030 19321 raft_consensus.cc:515] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.542325 19321 leader_election.cc:290] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.545516 19292 tablet_bootstrap.cc:654] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.547487 19176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:53.549856 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:53.550817 19251 raft_consensus.cc:2468] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 0.
I20260709 12:12:53.551415 19340 raft_consensus.cc:493] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:53.552239 19066 leader_election.cc:343] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.552191 19340 raft_consensus.cc:515] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.553311 19066 leader_election.cc:304] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596
I20260709 12:12:53.554493 19321 raft_consensus.cc:2804] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.554919 19321 raft_consensus.cc:493] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.555629 19321 raft_consensus.cc:3060] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.558203 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:12:53.562611 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:53.563802 19321 raft_consensus.cc:515] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.565783 19340 leader_election.cc:290] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.566623 19101 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.566636 19251 raft_consensus.cc:2393] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bd07372a85a49d2b0b2ba959004a596 in current term 1: Already voted for candidate ccd68072dd7448289851e695f02a58fa in this term.
I20260709 12:12:53.567929 19176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
W20260709 12:12:53.569625 19066 leader_election.cc:343] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.569752 19321 leader_election.cc:290] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.571444 19292 tablet_bootstrap.cc:492] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596: No bootstrap required, opened a new log
I20260709 12:12:53.571607 19141 leader_election.cc:304] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596; no voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:53.571995 19292 ts_tablet_manager.cc:1403] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.006s
I20260709 12:12:53.572530 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:53.572942 19340 raft_consensus.cc:3060] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.573530 19251 raft_consensus.cc:3060] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.575376 19321 raft_consensus.cc:493] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.575064 19292 raft_consensus.cc:359] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.575935 19292 raft_consensus.cc:385] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.575886 19321 raft_consensus.cc:515] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:53.576349 19292 raft_consensus.cc:740] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.576475 19296 consensus_queue.cc:1048] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.578262 19321 leader_election.cc:290] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.579165 19176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:12:53.579816 19176 raft_consensus.cc:2468] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 1.
I20260709 12:12:53.581238 19066 leader_election.cc:304] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:12:53.582609 19250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:53.577719 19292 consensus_queue.cc:260] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.585009 19340 raft_consensus.cc:2749] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.588595 19292 ts_tablet_manager.cc:1434] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:12:53.595649 19317 raft_consensus.cc:2804] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:53.595649 19321 consensus_queue.cc:1048] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.598693 19251 raft_consensus.cc:2468] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 1.
I20260709 12:12:53.600216 19066 leader_election.cc:304] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596
I20260709 12:12:53.602758 19321 raft_consensus.cc:2804] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.598841 19317 raft_consensus.cc:493] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader e7ea24e7a921470dbb649650c6870f5d)
I20260709 12:12:53.606829 19317 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.604389 19321 raft_consensus.cc:697] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:12:53.608263 19321 consensus_queue.cc:237] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.609513 19340 raft_consensus.cc:493] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.610067 19340 raft_consensus.cc:515] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.613909 19340 leader_election.cc:290] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.614645 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:12:53.614843 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:53.615422 19101 raft_consensus.cc:2468] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 0.
I20260709 12:12:53.615567 19251 raft_consensus.cc:2468] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 0.
I20260709 12:12:53.616762 19140 leader_election.cc:304] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:12:53.617631 19340 raft_consensus.cc:2804] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.618075 19340 raft_consensus.cc:493] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.618522 19340 raft_consensus.cc:3060] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.624125 19317 raft_consensus.cc:515] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:53.625336 19102 raft_consensus.cc:1240] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Rejecting Update request from peer e7ea24e7a921470dbb649650c6870f5d for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:53.630817 19318 consensus_queue.cc:1059] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.631915 19340 raft_consensus.cc:515] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.633031 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:12:53.633984 19177 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.634719 19317 leader_election.cc:290] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.637470 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:53.641175 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:12:53.641877 19102 raft_consensus.cc:3060] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.642935 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:53.643607 19251 raft_consensus.cc:3060] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.645179 19177 raft_consensus.cc:2468] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 2.
I20260709 12:12:53.646997 19066 leader_election.cc:304] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:53.648475 19317 raft_consensus.cc:2804] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:53.649274 19317 raft_consensus.cc:697] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:12:53.650256 19317 consensus_queue.cc:237] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:53.657420 19340 leader_election.cc:290] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.651757 19102 raft_consensus.cc:2468] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 1.
I20260709 12:12:53.658821 19140 leader_election.cc:304] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:12:53.659642 19340 raft_consensus.cc:2804] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.654708 19251 raft_consensus.cc:2468] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 1.
I20260709 12:12:53.660168 19340 raft_consensus.cc:697] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Becoming Leader. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:12:53.661037 19340 consensus_queue.cc:237] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.663079 19177 raft_consensus.cc:1240] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Rejecting Update request from peer e7ea24e7a921470dbb649650c6870f5d for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:53.663137 19343 raft_consensus.cc:3055] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:53.664522 19343 raft_consensus.cc:740] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:12:53.665375 19343 consensus_queue.cc:260] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:12:53.666450 19318 consensus_queue.cc:1059] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.668388 19000 catalog_manager.cc:5697] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 1 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.671056 19343 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.682435 18996 catalog_manager.cc:5697] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "5bd07372a85a49d2b0b2ba959004a596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.691104 19000 catalog_manager.cc:5697] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 1 to 2, leader changed from e7ea24e7a921470dbb649650c6870f5d (127.17.249.195) to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 2 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:53.765654 19321 consensus_queue.cc:1048] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.778596 19321 consensus_queue.cc:1048] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.839701 19340 consensus_queue.cc:1048] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.857260 19336 consensus_queue.cc:1048] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.863186 19177 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.875399 19343 consensus_queue.cc:1048] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.889117 19176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822"
dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
mode: GRACEFUL
new_leader_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:44452
I20260709 12:12:53.889950 19176 raft_consensus.cc:606] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Received request to transfer leadership to TS ccd68072dd7448289851e695f02a58fa
I20260709 12:12:53.894836 19296 consensus_queue.cc:1048] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.903973 19296 consensus_queue.cc:1048] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.916055 19250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065"
dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
mode: GRACEFUL
new_leader_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:47414
I20260709 12:12:53.916962 19250 raft_consensus.cc:606] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Received request to transfer leadership to TS ccd68072dd7448289851e695f02a58fa
I20260709 12:12:53.923547 19296 consensus_queue.cc:1048] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.934994 19297 consensus_queue.cc:1048] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.951534 19372 raft_consensus.cc:993] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d: : Instructing follower ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:12:53.952070 19372 raft_consensus.cc:1081] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Signalling peer ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:12:53.956998 19321 consensus_queue.cc:1048] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.958629 19102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:37730
I20260709 12:12:53.970768 19102 raft_consensus.cc:493] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:53.971530 19102 raft_consensus.cc:3060] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.977414 19101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
mode: GRACEFUL
new_leader_uuid: "5bd07372a85a49d2b0b2ba959004a596"
 from {username='slave'} at 127.0.0.1:37742
I20260709 12:12:53.978113 19101 raft_consensus.cc:606] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Received request to transfer leadership to TS 5bd07372a85a49d2b0b2ba959004a596
I20260709 12:12:53.982708 19102 raft_consensus.cc:515] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.986683 19102 leader_election.cc:290] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:53.986949 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:12:53.987325 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:53.986970 19250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108"
dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
mode: GRACEFUL
new_leader_uuid: "5bd07372a85a49d2b0b2ba959004a596"
 from {username='slave'} at 127.0.0.1:47414
I20260709 12:12:53.988180 19251 raft_consensus.cc:3055] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:53.988440 19250 raft_consensus.cc:606] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Received request to transfer leadership to TS 5bd07372a85a49d2b0b2ba959004a596
I20260709 12:12:53.988615 19251 raft_consensus.cc:740] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:12:53.988750 19177 raft_consensus.cc:3060] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.989626 19251 consensus_queue.cc:260] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:53.991094 19251 raft_consensus.cc:3060] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.995704 19102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
mode: GRACEFUL
new_leader_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 12:12:53.996374 19102 raft_consensus.cc:606] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Received request to transfer leadership to TS e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:53.997597 19177 raft_consensus.cc:2468] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 2.
I20260709 12:12:53.998946 19251 raft_consensus.cc:2468] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 2.
I20260709 12:12:53.999087 19066 leader_election.cc:304] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:12:54.000072 19321 raft_consensus.cc:2804] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:54.000622 19321 raft_consensus.cc:697] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:12:54.001641 19321 consensus_queue.cc:237] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.010200 18996 catalog_manager.cc:5697] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 1 to 2, leader changed from e7ea24e7a921470dbb649650c6870f5d (127.17.249.195) to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 2 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.061282 19336 consensus_queue.cc:1048] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.063086 19336 consensus_queue.cc:1048] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.070472 19340 consensus_queue.cc:1048] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.073642 19340 raft_consensus.cc:493] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.074172 19340 raft_consensus.cc:515] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.077194 19340 leader_election.cc:290] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:54.078285 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:12:54.082001 19251 raft_consensus.cc:2393] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bd07372a85a49d2b0b2ba959004a596 in current term 1: Already voted for candidate ccd68072dd7448289851e695f02a58fa in this term.
I20260709 12:12:54.083082 19381 raft_consensus.cc:993] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596: : Instructing follower ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:12:54.088078 19336 raft_consensus.cc:1081] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Signalling peer ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:12:54.096356 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:12:54.097834 19379 consensus_queue.cc:1048] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.098748 19102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:37736
I20260709 12:12:54.099452 19102 raft_consensus.cc:493] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:54.099607 19177 raft_consensus.cc:1275] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.099897 19102 raft_consensus.cc:3060] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.101666 19177 raft_consensus.cc:3060] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.103739 19321 consensus_queue.cc:1048] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.105768 19140 leader_election.cc:304] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596; no voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:54.107524 19102 raft_consensus.cc:515] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.108568 19101 raft_consensus.cc:1240] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Rejecting Update request from peer 5bd07372a85a49d2b0b2ba959004a596 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:54.109714 19102 leader_election.cc:290] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:54.110275 19379 consensus_queue.cc:1059] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.111352 19175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:12:54.111624 19379 raft_consensus.cc:3055] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:54.112092 19382 raft_consensus.cc:2749] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.112025 19379 raft_consensus.cc:740] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:12:54.113190 19379 consensus_queue.cc:260] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.114256 19379 raft_consensus.cc:3060] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.115150 19321 consensus_queue.cc:1048] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.115388 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:54.133400 19175 raft_consensus.cc:2468] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 2.
I20260709 12:12:54.136385 19297 raft_consensus.cc:993] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa: : Instructing follower 5bd07372a85a49d2b0b2ba959004a596 to start an election
I20260709 12:12:54.137265 19297 raft_consensus.cc:1081] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Signalling peer 5bd07372a85a49d2b0b2ba959004a596 to start an election
I20260709 12:12:54.140480 19250 raft_consensus.cc:1275] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.142738 19297 consensus_queue.cc:1048] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:54.143227 19176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02"
dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
 from {username='slave'} at 127.0.0.1:44440
I20260709 12:12:54.143908 19176 raft_consensus.cc:493] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:54.144346 19176 raft_consensus.cc:3060] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.144325 19297 consensus_queue.cc:1048] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.155459 19176 raft_consensus.cc:515] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.156711 19177 raft_consensus.cc:1240] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Rejecting Update request from peer ccd68072dd7448289851e695f02a58fa for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:54.157939 19176 leader_election.cc:290] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 2 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:54.160600 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:12:54.161257 19102 raft_consensus.cc:3055] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:54.161605 19102 raft_consensus.cc:740] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:12:54.161752 19250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:54.162513 19102 consensus_queue.cc:260] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.163563 19102 raft_consensus.cc:3060] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.168118 19066 leader_election.cc:304] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:54.169206 19297 raft_consensus.cc:2804] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:54.170069 19297 raft_consensus.cc:697] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:12:54.171904 19102 raft_consensus.cc:2468] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 2.
I20260709 12:12:54.171556 19297 consensus_queue.cc:237] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.173786 19140 leader_election.cc:304] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:54.175113 19340 raft_consensus.cc:2804] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:54.175629 19340 raft_consensus.cc:697] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 LEADER]: Becoming Leader. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:12:54.176460 19340 consensus_queue.cc:237] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.186947 18996 catalog_manager.cc:5697] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 1 to 2, leader changed from 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194) to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 2 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.197465 18997 catalog_manager.cc:5697] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 reported cstate change: term changed from 1 to 2, leader changed from ccd68072dd7448289851e695f02a58fa (127.17.249.193) to 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "5bd07372a85a49d2b0b2ba959004a596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.277679 19317 raft_consensus.cc:993] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa: : Instructing follower e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:12:54.278268 19297 raft_consensus.cc:1081] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Signalling peer e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:12:54.280084 19251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f"
dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:47388
I20260709 12:12:54.280679 19251 raft_consensus.cc:493] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:54.280999 19251 raft_consensus.cc:3060] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.286556 19251 raft_consensus.cc:515] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.288359 19251 leader_election.cc:290] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 2 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:12:54.289568 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:12:54.289568 19175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:12:54.290408 19102 raft_consensus.cc:3055] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:54.290586 19175 raft_consensus.cc:3060] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.290729 19102 raft_consensus.cc:740] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:12:54.291683 19102 consensus_queue.cc:260] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.292708 19102 raft_consensus.cc:3060] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.296175 19175 raft_consensus.cc:2468] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 2.
I20260709 12:12:54.297586 19215 leader_election.cc:304] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:12:54.298318 19102 raft_consensus.cc:2468] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 2.
I20260709 12:12:54.298487 19296 raft_consensus.cc:2804] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:54.299136 19296 raft_consensus.cc:697] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Becoming Leader. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:12:54.300005 19296 consensus_queue.cc:237] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.308188 18997 catalog_manager.cc:5697] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d reported cstate change: term changed from 1 to 2, leader changed from ccd68072dd7448289851e695f02a58fa (127.17.249.193) to e7ea24e7a921470dbb649650c6870f5d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "e7ea24e7a921470dbb649650c6870f5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.404666 19251 raft_consensus.cc:1275] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.406360 19297 consensus_queue.cc:1048] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:54.417668 19175 raft_consensus.cc:1275] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.419808 19362 consensus_queue.cc:1048] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:54.423832 19318 raft_consensus.cc:993] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d: : Instructing follower 5bd07372a85a49d2b0b2ba959004a596 to start an election
I20260709 12:12:54.424364 19318 raft_consensus.cc:1081] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Signalling peer 5bd07372a85a49d2b0b2ba959004a596 to start an election
I20260709 12:12:54.428120 19177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108"
dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
 from {username='slave'} at 127.0.0.1:44438
I20260709 12:12:54.428690 19177 raft_consensus.cc:493] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:54.429023 19177 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.438308 19177 raft_consensus.cc:515] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.440609 19177 leader_election.cc:290] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 2 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:12:54.442122 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:12:54.442699 19102 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.443336 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:12:54.443949 19251 raft_consensus.cc:3055] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:54.444334 19251 raft_consensus.cc:740] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:12:54.445221 19251 consensus_queue.cc:260] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.446571 19251 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.452127 19102 raft_consensus.cc:2468] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 2.
I20260709 12:12:54.454187 19140 leader_election.cc:304] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:12:54.455286 19340 raft_consensus.cc:2804] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:54.455482 19251 raft_consensus.cc:2468] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 2.
I20260709 12:12:54.456132 19340 raft_consensus.cc:697] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 LEADER]: Becoming Leader. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:12:54.457199 19340 consensus_queue.cc:237] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:54.464108 19000 catalog_manager.cc:5697] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 reported cstate change: term changed from 1 to 2, leader changed from e7ea24e7a921470dbb649650c6870f5d (127.17.249.195) to 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "5bd07372a85a49d2b0b2ba959004a596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.564271 19251 raft_consensus.cc:3060] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.570508 19251 raft_consensus.cc:1275] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.572350 19297 consensus_queue.cc:1048] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:54.581972 19177 raft_consensus.cc:1275] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.584607 19297 consensus_queue.cc:1048] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:54.629681 19251 raft_consensus.cc:3060] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.636165 19251 raft_consensus.cc:1275] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.638038 19340 consensus_queue.cc:1048] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:54.647842 19102 raft_consensus.cc:1275] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.649775 19301 consensus_queue.cc:1048] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:54.690948 19102 raft_consensus.cc:1275] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.692592 19296 consensus_queue.cc:1048] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:54.703670 19177 raft_consensus.cc:1275] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.706725 19372 consensus_queue.cc:1048] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:54.946771 19251 raft_consensus.cc:1275] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.948314 19387 consensus_queue.cc:1048] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:54.960431 19102 raft_consensus.cc:1275] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:54.962230 19387 consensus_queue.cc:1048] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:57.039357 18407 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:12:57.040251 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:57.064674 19102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
mode: GRACEFUL
new_leader_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:37744
I20260709 12:12:57.065361 19102 raft_consensus.cc:606] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Received request to transfer leadership to TS e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:57.068594 19102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
mode: GRACEFUL
new_leader_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:37744
I20260709 12:12:57.069252 19102 raft_consensus.cc:606] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Received request to transfer leadership to TS e7ea24e7a921470dbb649650c6870f5d
I20260709 12:12:57.070709 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:57.071393 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:57.391947 19396 raft_consensus.cc:993] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa: : Instructing follower e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:12:57.392576 19396 raft_consensus.cc:1081] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Signalling peer e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:12:57.394366 19251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45"
dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:47388
I20260709 12:12:57.394999 19251 raft_consensus.cc:493] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:57.395296 19251 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:57.401750 19251 raft_consensus.cc:515] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:57.404337 19251 leader_election.cc:290] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 2 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:12:57.404770 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:12:57.405016 19175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:12:57.405447 19102 raft_consensus.cc:3055] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:57.405690 19175 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:57.405918 19102 raft_consensus.cc:740] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:12:57.407078 19102 consensus_queue.cc:260] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:57.407966 19102 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:57.412024 19175 raft_consensus.cc:2468] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 2.
I20260709 12:12:57.413538 19102 raft_consensus.cc:2468] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 2.
I20260709 12:12:57.413514 19215 leader_election.cc:304] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:12:57.414861 19391 raft_consensus.cc:2804] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:57.416381 19391 raft_consensus.cc:697] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Becoming Leader. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:12:57.417219 19391 consensus_queue.cc:237] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:57.429147 18996 catalog_manager.cc:5697] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d reported cstate change: term changed from 1 to 2, leader changed from ccd68072dd7448289851e695f02a58fa (127.17.249.193) to e7ea24e7a921470dbb649650c6870f5d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "e7ea24e7a921470dbb649650c6870f5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.545215 19362 raft_consensus.cc:993] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa: : Instructing follower e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:12:57.545794 19362 raft_consensus.cc:1081] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Signalling peer e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:12:57.547824 19251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5"
dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:47388
I20260709 12:12:57.548365 19251 raft_consensus.cc:493] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:57.548661 19251 raft_consensus.cc:3060] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:57.553365 19251 raft_consensus.cc:515] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:57.555212 19251 leader_election.cc:290] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 2 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:12:57.556317 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:12:57.556597 19175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:12:57.556984 19102 raft_consensus.cc:3055] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:57.557260 19175 raft_consensus.cc:3060] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:57.557410 19102 raft_consensus.cc:740] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:12:57.558275 19102 consensus_queue.cc:260] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:57.559291 19102 raft_consensus.cc:3060] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:57.562770 19175 raft_consensus.cc:2468] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 2.
I20260709 12:12:57.565027 19102 raft_consensus.cc:2468] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 2.
I20260709 12:12:57.564888 19215 leader_election.cc:304] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:12:57.566738 19391 raft_consensus.cc:2804] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:57.567533 19391 raft_consensus.cc:697] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Becoming Leader. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:12:57.568393 19391 consensus_queue.cc:237] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:12:57.577261 18996 catalog_manager.cc:5697] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d reported cstate change: term changed from 1 to 2, leader changed from ccd68072dd7448289851e695f02a58fa (127.17.249.193) to e7ea24e7a921470dbb649650c6870f5d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "e7ea24e7a921470dbb649650c6870f5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.808074 19102 raft_consensus.cc:1275] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:57.809881 19391 consensus_queue.cc:1048] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:57.827994 19175 raft_consensus.cc:1275] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:57.830519 19407 consensus_queue.cc:1048] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:58.072544 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:58.077975 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:58.078387 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:58.140280 19102 raft_consensus.cc:1275] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:58.141631 19407 consensus_queue.cc:1048] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:58.151288 19175 raft_consensus.cc:1275] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:58.153334 19391 consensus_queue.cc:1048] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:59.079608 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:59.086061 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:59.086652 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:00.087968 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:00.094252 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:00.094826 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:01.096326 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:01.102959 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:01.103510 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:02.104667 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:02.110809 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:02.111276 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:03.112460 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:03.118896 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:03.119401 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:04.120674 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:04.126341 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:04.126945 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:05.128093 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:05.134274 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:05.134871 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:06.136054 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:06.141976 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:06.142500 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:07.185364 18407 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:13:07.202669 19251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45"
dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
mode: GRACEFUL
new_leader_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:47414
I20260709 12:13:07.203562 19251 raft_consensus.cc:606] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Received request to transfer leadership to TS ccd68072dd7448289851e695f02a58fa
I20260709 12:13:07.211229 19251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5"
dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
mode: GRACEFUL
new_leader_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:47414
I20260709 12:13:07.212386 19251 raft_consensus.cc:606] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Received request to transfer leadership to TS ccd68072dd7448289851e695f02a58fa
I20260709 12:13:07.220845 19175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a"
dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
mode: GRACEFUL
new_leader_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:44452
I20260709 12:13:07.221668 19175 raft_consensus.cc:606] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Received request to transfer leadership to TS ccd68072dd7448289851e695f02a58fa
I20260709 12:13:07.228758 19175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee"
dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
mode: GRACEFUL
new_leader_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:44452
I20260709 12:13:07.229410 19175 raft_consensus.cc:606] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Received request to transfer leadership to TS ccd68072dd7448289851e695f02a58fa
I20260709 12:13:07.236459 19175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02"
dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
mode: GRACEFUL
new_leader_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:44452
I20260709 12:13:07.237206 19175 raft_consensus.cc:606] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 LEADER]: Received request to transfer leadership to TS ccd68072dd7448289851e695f02a58fa
I20260709 12:13:07.285692 19421 raft_consensus.cc:993] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596: : Instructing follower ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:13:07.286470 19426 raft_consensus.cc:1081] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Signalling peer ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:13:07.288518 19102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:37736
I20260709 12:13:07.289047 19102 raft_consensus.cc:493] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:07.289481 19102 raft_consensus.cc:3060] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.294978 19102 raft_consensus.cc:515] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.296695 19102 leader_election.cc:290] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:07.298236 19175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:13:07.298396 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:13:07.298924 19175 raft_consensus.cc:3055] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:07.299214 19251 raft_consensus.cc:3060] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.299393 19175 raft_consensus.cc:740] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:13:07.300462 19175 consensus_queue.cc:260] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.301460 19175 raft_consensus.cc:3060] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.306238 19251 raft_consensus.cc:2468] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 2.
I20260709 12:13:07.307937 19175 raft_consensus.cc:2468] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 2.
I20260709 12:13:07.307868 19066 leader_election.cc:304] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:13:07.309144 19422 raft_consensus.cc:2804] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:07.310454 19422 raft_consensus.cc:697] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:13:07.311724 19422 consensus_queue.cc:237] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.313642 19428 raft_consensus.cc:993] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d: : Instructing follower ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:13:07.314193 19428 raft_consensus.cc:1081] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Signalling peer ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:13:07.316349 19102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:37730
I20260709 12:13:07.317199 19102 raft_consensus.cc:493] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:07.317852 19102 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:07.321878 19000 catalog_manager.cc:5697] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 1 to 2, leader changed from 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194) to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 2 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:07.323633 19102 raft_consensus.cc:515] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.325930 19102 leader_election.cc:290] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:07.327224 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:13:07.327852 19251 raft_consensus.cc:3055] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:07.327450 19175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:13:07.328230 19251 raft_consensus.cc:740] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:13:07.328681 19175 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:07.329218 19251 consensus_queue.cc:260] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.330277 19251 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:07.336431 19251 raft_consensus.cc:2468] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 3.
I20260709 12:13:07.337450 19175 raft_consensus.cc:2468] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 3.
I20260709 12:13:07.338069 19066 leader_election.cc:304] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:13:07.339095 19422 raft_consensus.cc:2804] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:07.339733 19422 raft_consensus.cc:697] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 3 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:13:07.340699 19422 consensus_queue.cc:237] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.353883 19000 catalog_manager.cc:5697] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 2 to 3, leader changed from e7ea24e7a921470dbb649650c6870f5d (127.17.249.195) to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 3 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:07.405750 19425 raft_consensus.cc:993] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596: : Instructing follower ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:13:07.406268 19426 raft_consensus.cc:1081] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 LEADER]: Signalling peer ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:13:07.408429 19102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:37736
I20260709 12:13:07.409008 19102 raft_consensus.cc:493] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:07.409349 19102 raft_consensus.cc:3060] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:07.416761 19102 raft_consensus.cc:515] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.419163 19102 leader_election.cc:290] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:07.420644 19175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:13:07.420800 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:13:07.421244 19175 raft_consensus.cc:3055] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:07.421733 19175 raft_consensus.cc:740] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:13:07.421612 19251 raft_consensus.cc:3060] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:07.422993 19175 consensus_queue.cc:260] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.424497 19175 raft_consensus.cc:3060] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:07.431180 19251 raft_consensus.cc:2468] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 3.
I20260709 12:13:07.432155 19066 leader_election.cc:304] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:13:07.432911 19422 raft_consensus.cc:2804] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:07.433458 19422 raft_consensus.cc:697] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 3 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:13:07.434423 19422 consensus_queue.cc:237] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.434952 19175 raft_consensus.cc:2468] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 3.
I20260709 12:13:07.444090 19000 catalog_manager.cc:5697] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 2 to 3, leader changed from 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194) to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 3 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:07.595373 19425 raft_consensus.cc:993] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596: : Instructing follower ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:13:07.595929 19426 raft_consensus.cc:1081] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Signalling peer ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:13:07.597682 19102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:37736
I20260709 12:13:07.598260 19102 raft_consensus.cc:493] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:07.598553 19102 raft_consensus.cc:3060] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.603753 19102 raft_consensus.cc:515] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.606056 19102 leader_election.cc:290] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:07.607048 19175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:13:07.607188 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:13:07.607764 19251 raft_consensus.cc:3060] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.607764 19175 raft_consensus.cc:3055] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:07.608314 19175 raft_consensus.cc:740] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:13:07.609180 19175 consensus_queue.cc:260] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.610350 19175 raft_consensus.cc:3060] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:07.614476 19251 raft_consensus.cc:2468] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 2.
I20260709 12:13:07.615842 19066 leader_election.cc:304] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:13:07.616775 19422 raft_consensus.cc:2804] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:07.617034 19175 raft_consensus.cc:2468] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 2.
I20260709 12:13:07.617311 19422 raft_consensus.cc:697] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:13:07.618281 19422 consensus_queue.cc:237] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.627003 19000 catalog_manager.cc:5697] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 1 to 2, leader changed from 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194) to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 2 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:07.682046 19424 raft_consensus.cc:993] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d: : Instructing follower ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:13:07.682528 19428 raft_consensus.cc:1081] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Signalling peer ccd68072dd7448289851e695f02a58fa to start an election
I20260709 12:13:07.684221 19102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
 from {username='slave'} at 127.0.0.1:37730
I20260709 12:13:07.684837 19102 raft_consensus.cc:493] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:07.685177 19102 raft_consensus.cc:3060] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:07.690347 19102 raft_consensus.cc:515] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.692296 19102 leader_election.cc:290] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:07.693507 19175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:13:07.693703 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:13:07.694154 19251 raft_consensus.cc:3055] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:07.694154 19175 raft_consensus.cc:3060] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:07.694703 19251 raft_consensus.cc:740] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:13:07.695616 19251 consensus_queue.cc:260] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.696753 19251 raft_consensus.cc:3060] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:07.701921 19175 raft_consensus.cc:2468] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 3.
I20260709 12:13:07.703455 19066 leader_election.cc:304] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:13:07.703953 19251 raft_consensus.cc:2468] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 3.
I20260709 12:13:07.704525 19422 raft_consensus.cc:2804] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:07.705209 19422 raft_consensus.cc:697] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 3 LEADER]: Becoming Leader. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:13:07.706228 19422 consensus_queue.cc:237] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:07.709709 19251 raft_consensus.cc:1275] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:07.711395 19422 consensus_queue.cc:1048] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:07.716404 19000 catalog_manager.cc:5697] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa reported cstate change: term changed from 2 to 3, leader changed from e7ea24e7a921470dbb649650c6870f5d (127.17.249.195) to ccd68072dd7448289851e695f02a58fa (127.17.249.193). New cstate: current_term: 3 leader_uuid: "ccd68072dd7448289851e695f02a58fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:07.728956 19175 raft_consensus.cc:1275] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:07.730412 19422 consensus_queue.cc:1048] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:07.808357 19175 raft_consensus.cc:1275] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:07.809717 19422 consensus_queue.cc:1048] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.821606 19251 raft_consensus.cc:1275] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:07.824154 19427 consensus_queue.cc:1048] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.955762 19251 raft_consensus.cc:1275] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:07.957331 19427 consensus_queue.cc:1048] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.981093 19177 raft_consensus.cc:1275] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:07.983415 19445 consensus_queue.cc:1048] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:08.032912 19251 raft_consensus.cc:1275] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.034344 19445 consensus_queue.cc:1048] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.046193 19177 raft_consensus.cc:1275] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:08.048036 19422 consensus_queue.cc:1048] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:08.089937 19175 raft_consensus.cc:1275] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:08.091445 19445 consensus_queue.cc:1048] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.102893 19251 raft_consensus.cc:1275] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Refusing update from remote peer ccd68072dd7448289851e695f02a58fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:08.104265 19422 consensus_queue.cc:1048] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:10.287483 18407 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:13:10.288420 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:10.296320 19102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
mode: GRACEFUL
new_leader_uuid: "5bd07372a85a49d2b0b2ba959004a596"
 from {username='slave'} at 127.0.0.1:37744
I20260709 12:13:10.297073 19102 raft_consensus.cc:606] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Received request to transfer leadership to TS 5bd07372a85a49d2b0b2ba959004a596
I20260709 12:13:10.300264 19102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c054d570a53c413b98f35967ef37262a"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
mode: GRACEFUL
new_leader_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:37744
I20260709 12:13:10.300800 19102 raft_consensus.cc:606] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Received request to transfer leadership to TS e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:10.303567 19102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
mode: GRACEFUL
new_leader_uuid: "5bd07372a85a49d2b0b2ba959004a596"
 from {username='slave'} at 127.0.0.1:37744
I20260709 12:13:10.304169 19102 raft_consensus.cc:606] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 3 LEADER]: Received request to transfer leadership to TS 5bd07372a85a49d2b0b2ba959004a596
I20260709 12:13:10.307035 19102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
mode: GRACEFUL
new_leader_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:37744
I20260709 12:13:10.307521 19102 raft_consensus.cc:606] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Received request to transfer leadership to TS e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:10.308852 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:10.309507 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:10.458067 19455 raft_consensus.cc:993] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa: : Instructing follower e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:13:10.458732 19456 raft_consensus.cc:1081] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Signalling peer e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:13:10.460704 19250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee"
dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:47388
I20260709 12:13:10.461395 19250 raft_consensus.cc:493] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:10.461771 19250 raft_consensus.cc:3060] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:10.469228 19250 raft_consensus.cc:515] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:10.471803 19250 leader_election.cc:290] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:13:10.473480 19175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:13:10.473166 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:13:10.474148 19175 raft_consensus.cc:3060] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:10.474251 19102 raft_consensus.cc:3055] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:10.474632 19102 raft_consensus.cc:740] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:13:10.475664 19102 consensus_queue.cc:260] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:10.477154 19102 raft_consensus.cc:3060] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:10.482612 19175 raft_consensus.cc:2468] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 3.
I20260709 12:13:10.484263 19215 leader_election.cc:304] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:13:10.485448 19428 raft_consensus.cc:2804] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:10.485617 19102 raft_consensus.cc:2468] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 3.
I20260709 12:13:10.486677 19428 raft_consensus.cc:697] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 3 LEADER]: Becoming Leader. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:13:10.487845 19428 consensus_queue.cc:237] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:10.496894 19000 catalog_manager.cc:5697] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d reported cstate change: term changed from 2 to 3, leader changed from ccd68072dd7448289851e695f02a58fa (127.17.249.193) to e7ea24e7a921470dbb649650c6870f5d (127.17.249.195). New cstate: current_term: 3 leader_uuid: "e7ea24e7a921470dbb649650c6870f5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:10.522217 19455 raft_consensus.cc:993] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa: : Instructing follower e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:13:10.522816 19455 raft_consensus.cc:1081] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Signalling peer e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:13:10.524577 19250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c054d570a53c413b98f35967ef37262a"
dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:47388
I20260709 12:13:10.525136 19250 raft_consensus.cc:493] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:10.525552 19250 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:10.527926 19456 raft_consensus.cc:993] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa: : Instructing follower 5bd07372a85a49d2b0b2ba959004a596 to start an election
I20260709 12:13:10.528502 19455 raft_consensus.cc:1081] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Signalling peer 5bd07372a85a49d2b0b2ba959004a596 to start an election
I20260709 12:13:10.530414 19175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822"
dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
 from {username='slave'} at 127.0.0.1:44440
I20260709 12:13:10.531021 19175 raft_consensus.cc:493] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:10.531328 19175 raft_consensus.cc:3060] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:10.532298 19250 raft_consensus.cc:515] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:13:10.534505 19250 leader_election.cc:290] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971)
I20260709 12:13:10.535593 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:13:10.535636 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:13:10.536126 19177 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:10.536263 19102 raft_consensus.cc:3055] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:10.536641 19102 raft_consensus.cc:740] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:13:10.537413 19102 consensus_queue.cc:260] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:13:10.538822 19102 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:10.540740 19175 raft_consensus.cc:515] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:10.542089 19177 raft_consensus.cc:2468] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 3.
I20260709 12:13:10.543380 19215 leader_election.cc:304] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:13:10.544132 19175 leader_election.cc:290] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 3 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:10.544314 19428 raft_consensus.cc:2804] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:10.544958 19428 raft_consensus.cc:697] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 3 LEADER]: Becoming Leader. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:13:10.545945 19428 consensus_queue.cc:237] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:13:10.546453 19102 raft_consensus.cc:2468] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 3.
I20260709 12:13:10.549202 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:13:10.550033 19101 raft_consensus.cc:3055] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:10.550496 19101 raft_consensus.cc:740] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:13:10.551481 19101 consensus_queue.cc:260] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:10.552482 19250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954bdeed047a4119afe2c5bd95d23822" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:13:10.552706 19101 raft_consensus.cc:3060] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:10.553174 19250 raft_consensus.cc:3060] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:10.557989 19000 catalog_manager.cc:5697] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d reported cstate change: term changed from 2 to 3, leader changed from ccd68072dd7448289851e695f02a58fa (127.17.249.193) to e7ea24e7a921470dbb649650c6870f5d (127.17.249.195). New cstate: current_term: 3 leader_uuid: "e7ea24e7a921470dbb649650c6870f5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.559934 19101 raft_consensus.cc:2468] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 3.
I20260709 12:13:10.560591 19250 raft_consensus.cc:2468] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 3.
I20260709 12:13:10.561393 19140 leader_election.cc:304] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:13:10.562399 19426 raft_consensus.cc:2804] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:10.564007 19426 raft_consensus.cc:697] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 LEADER]: Becoming Leader. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:13:10.564927 19426 consensus_queue.cc:237] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:10.574108 19000 catalog_manager.cc:5697] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 reported cstate change: term changed from 2 to 3, leader changed from ccd68072dd7448289851e695f02a58fa (127.17.249.193) to 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "5bd07372a85a49d2b0b2ba959004a596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.737627 19455 raft_consensus.cc:993] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa: : Instructing follower 5bd07372a85a49d2b0b2ba959004a596 to start an election
I20260709 12:13:10.738230 19456 raft_consensus.cc:1081] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 3 LEADER]: Signalling peer 5bd07372a85a49d2b0b2ba959004a596 to start an election
I20260709 12:13:10.740192 19175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45"
dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
 from {username='slave'} at 127.0.0.1:44440
I20260709 12:13:10.740746 19175 raft_consensus.cc:493] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:10.741027 19175 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:10.745635 19175 raft_consensus.cc:515] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:10.747315 19175 leader_election.cc:290] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:10.748631 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:13:10.748613 19250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc860d5e2d040e2ab61a30c25444c45" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:13:10.749485 19101 raft_consensus.cc:3055] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:10.749897 19250 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:10.749938 19101 raft_consensus.cc:740] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:13:10.751168 19101 consensus_queue.cc:260] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:10.752283 19101 raft_consensus.cc:3060] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:10.755100 19250 raft_consensus.cc:2468] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 4.
I20260709 12:13:10.756325 19141 leader_election.cc:304] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:13:10.757210 19426 raft_consensus.cc:2804] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:10.757778 19426 raft_consensus.cc:697] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 4 LEADER]: Becoming Leader. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:13:10.759238 19101 raft_consensus.cc:2468] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 4.
I20260709 12:13:10.758908 19426 consensus_queue.cc:237] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:10.767342 19000 catalog_manager.cc:5697] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 reported cstate change: term changed from 3 to 4, leader changed from ccd68072dd7448289851e695f02a58fa (127.17.249.193) to 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194). New cstate: current_term: 4 leader_uuid: "5bd07372a85a49d2b0b2ba959004a596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.998741 19175 raft_consensus.cc:1275] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:11.001412 19457 consensus_queue.cc:1048] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:11.573179 19175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.004s	sys 0.023s
W20260709 12:13:11.573730 19175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.005s	sys 0.024s
I20260709 12:13:12.169996 19457 raft_consensus.cc:493] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd68072dd7448289851e695f02a58fa)
I20260709 12:13:12.170861 19457 raft_consensus.cc:515] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.173735 19457 leader_election.cc:290] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:13:12.192471 19469 raft_consensus.cc:493] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd68072dd7448289851e695f02a58fa)
I20260709 12:13:12.193853 19471 raft_consensus.cc:493] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e7ea24e7a921470dbb649650c6870f5d)
I20260709 12:13:12.193557 19469 raft_consensus.cc:515] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.194986 19468 raft_consensus.cc:493] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd68072dd7448289851e695f02a58fa)
I20260709 12:13:12.195690 19468 raft_consensus.cc:515] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.194648 19471 raft_consensus.cc:515] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.205006 19457 raft_consensus.cc:493] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bd07372a85a49d2b0b2ba959004a596)
I20260709 12:13:12.205854 19457 raft_consensus.cc:515] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.210577 19457 leader_election.cc:290] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:13:12.213340 19473 raft_consensus.cc:493] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.198580 19468 leader_election.cc:290] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:12.213840 19102 raft_consensus.cc:1275] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:12.213945 19473 raft_consensus.cc:515] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:13:12.216305 19473 leader_election.cc:290] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389), ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971)
I20260709 12:13:12.208205 19471 leader_election.cc:290] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:12.206965 19469 leader_election.cc:290] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:12.210878 19470 raft_consensus.cc:493] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.219432 19470 raft_consensus.cc:515] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.222932 19477 raft_consensus.cc:493] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.223393 19101 raft_consensus.cc:1275] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:12.223608 19477 raft_consensus.cc:515] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:13:12.211746 19472 raft_consensus.cc:493] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bd07372a85a49d2b0b2ba959004a596)
I20260709 12:13:12.227665 19475 raft_consensus.cc:493] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd68072dd7448289851e695f02a58fa)
I20260709 12:13:12.227942 19472 raft_consensus.cc:515] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.228229 19475 raft_consensus.cc:515] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.230702 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:12.226436 19477 leader_election.cc:290] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:12.222548 19470 leader_election.cc:290] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:12.233516 19472 leader_election.cc:290] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:12.239159 19457 consensus_queue.cc:1048] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:12.233695 19475 leader_election.cc:290] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:13:12.234054 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:12.245752 19100 raft_consensus.cc:2468] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 2.
I20260709 12:13:12.254998 19469 raft_consensus.cc:493] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e7ea24e7a921470dbb649650c6870f5d)
I20260709 12:13:12.255884 19469 raft_consensus.cc:515] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.259443 19469 leader_election.cc:290] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:12.260210 19469 raft_consensus.cc:493] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd68072dd7448289851e695f02a58fa)
I20260709 12:13:12.260829 19469 raft_consensus.cc:515] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.263811 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:13:12.264484 19177 raft_consensus.cc:2468] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd68072dd7448289851e695f02a58fa in term 2.
I20260709 12:13:12.266943 19475 raft_consensus.cc:493] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd68072dd7448289851e695f02a58fa)
I20260709 12:13:12.268011 19475 raft_consensus.cc:515] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.273643 19475 leader_election.cc:290] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:13:12.274432 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:13:12.279796 19172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:13:12.275825 19476 raft_consensus.cc:493] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd68072dd7448289851e695f02a58fa)
I20260709 12:13:12.276628 19175 raft_consensus.cc:1275] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:12.276860 19174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:13:12.281814 19173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:13:12.283860 19469 leader_election.cc:290] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:12.282325 19476 raft_consensus.cc:515] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.282744 19172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:13:12.284870 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:13:12.284934 19173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:13:12.285593 19100 raft_consensus.cc:1275] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:12.287528 19100 raft_consensus.cc:1275] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:12.288203 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:12.287513 19476 leader_election.cc:290] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
W20260709 12:13:12.289278 19214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:43971, user_credentials={real_user=slave}} blocked reactor thread for 59959.9us
I20260709 12:13:12.289944 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:12.293702 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:12.294796 19457 consensus_queue.cc:1048] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:12.296711 19101 raft_consensus.cc:2468] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 3.
I20260709 12:13:12.299156 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:12.301029 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:12.301857 19066 leader_election.cc:304] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:13:12.303464 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:12.303692 19471 raft_consensus.cc:2804] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:12.305207 19471 raft_consensus.cc:493] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Starting leader election (detected failure of leader e7ea24e7a921470dbb649650c6870f5d)
I20260709 12:13:12.306143 19471 raft_consensus.cc:3060] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:12.318286 19476 consensus_queue.cc:1048] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:12.318641 19469 consensus_queue.cc:1048] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:12.319367 19140 leader_election.cc:304] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:13:12.325150 19473 raft_consensus.cc:2804] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:12.325587 19471 raft_consensus.cc:515] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.327109 19473 raft_consensus.cc:493] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e7ea24e7a921470dbb649650c6870f5d)
I20260709 12:13:12.327540 19473 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:12.327944 19471 leader_election.cc:290] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 election: Requested vote from peers 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:12.330112 19173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:13:12.338125 19473 raft_consensus.cc:515] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:13:12.339881 19177 raft_consensus.cc:1240] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Rejecting Update request from peer e7ea24e7a921470dbb649650c6870f5d for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:12.342213 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:12.342176 19475 consensus_queue.cc:1059] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:12.343086 19473 leader_election.cc:290] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 election: Requested vote from peers e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389), ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971)
I20260709 12:13:12.344242 19457 raft_consensus.cc:3055] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:12.344709 19457 raft_consensus.cc:740] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:13:12.345580 19457 consensus_queue.cc:260] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:13:12.346472 19102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:13:12.347117 19102 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:12.352707 19457 raft_consensus.cc:3060] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:12.354393 19102 raft_consensus.cc:2468] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 4.
I20260709 12:13:12.371351 19457 raft_consensus.cc:493] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd68072dd7448289851e695f02a58fa)
I20260709 12:13:12.352828 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:12.372030 19457 raft_consensus.cc:515] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.372658 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:12.365724 19140 leader_election.cc:304] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:13:12.374238 19457 leader_election.cc:290] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:13:12.375938 19476 raft_consensus.cc:2804] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:12.376569 19476 raft_consensus.cc:697] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 4 LEADER]: Becoming Leader. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:13:12.378001 19476 consensus_queue.cc:237] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } }
I20260709 12:13:12.383412 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
W20260709 12:13:12.386715 19214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:43971, user_credentials={real_user=slave}} blocked reactor thread for 96451.4us
I20260709 12:13:12.387594 19214 leader_election.cc:304] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa
I20260709 12:13:12.388727 19479 raft_consensus.cc:2749] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:12.389460 19214 leader_election.cc:304] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596
I20260709 12:13:12.390419 19482 consensus_queue.cc:1048] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:13:12.389528 19000 catalog_manager.cc:5697] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 reported cstate change: term changed from 3 to 4, leader changed from e7ea24e7a921470dbb649650c6870f5d (127.17.249.195) to 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194). New cstate: current_term: 4 leader_uuid: "5bd07372a85a49d2b0b2ba959004a596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:12.396407 19479 raft_consensus.cc:2804] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:12.398383 19479 raft_consensus.cc:493] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bd07372a85a49d2b0b2ba959004a596)
I20260709 12:13:12.399102 19250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:13:12.401556 19250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e342edc4ecec4e5ba112280b7b7a2bee" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:13:12.405335 19250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:13:12.398939 19479 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:12.406714 19250 raft_consensus.cc:2410] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd68072dd7448289851e695f02a58fa for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:12.409093 19250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:13:12.410872 19251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "ccd68072dd7448289851e695f02a58fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:13:12.413347 19251 raft_consensus.cc:1275] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:12.416595 19249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a278856b2c8e4e8bbff0fab7807f0065" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:13:12.419113 19249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:13:12.420692 19248 raft_consensus.cc:1275] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:12.422286 19249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:13:12.423075 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:13:12.423357 19249 raft_consensus.cc:2410] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bd07372a85a49d2b0b2ba959004a596 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:12.423441 19248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:13:12.424260 19479 raft_consensus.cc:515] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.424921 19247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:13:12.425477 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c054d570a53c413b98f35967ef37262a" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:13:12.426297 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5660612675c1496eb8995fbd1771ba02" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:12.426666 19250 raft_consensus.cc:2393] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd68072dd7448289851e695f02a58fa in current term 3: Already voted for candidate e7ea24e7a921470dbb649650c6870f5d in this term.
I20260709 12:13:12.427537 19479 leader_election.cc:290] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:13:12.428977 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:13:12.429242 19251 raft_consensus.cc:1240] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Rejecting Update request from peer 5bd07372a85a49d2b0b2ba959004a596 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:12.431555 19102 raft_consensus.cc:1240] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Rejecting Update request from peer e7ea24e7a921470dbb649650c6870f5d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:13:12.431897 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:12.430462 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a121b37529ee4d9dae023bbdb5901aa5" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:12.436028 19101 raft_consensus.cc:1240] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Rejecting Update request from peer e7ea24e7a921470dbb649650c6870f5d for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:12.436981 19246 raft_consensus.cc:2468] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 4.
I20260709 12:13:12.437598 19066 leader_election.cc:304] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd68072dd7448289851e695f02a58fa; no voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:12.438814 19472 raft_consensus.cc:2749] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:12.441466 19066 leader_election.cc:304] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd68072dd7448289851e695f02a58fa; no voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:12.442408 19472 raft_consensus.cc:2749] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:12.443631 19066 leader_election.cc:304] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd68072dd7448289851e695f02a58fa; no voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:12.444960 19472 raft_consensus.cc:2749] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:12.446570 19141 leader_election.cc:304] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596; no voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:12.447561 19473 consensus_queue.cc:1048] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:12.448024 19141 leader_election.cc:304] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596; no voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:12.449055 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:13:12.449358 19473 raft_consensus.cc:2749] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:12.449640 19141 leader_election.cc:304] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596; no voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:12.450820 19474 consensus_queue.cc:1048] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:12.451758 19214 leader_election.cc:304] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa
I20260709 12:13:12.452648 19479 raft_consensus.cc:2749] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:12.450076 19473 raft_consensus.cc:2749] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:12.453485 19214 leader_election.cc:304] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa
I20260709 12:13:12.454512 19479 raft_consensus.cc:2749] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:12.455132 19214 leader_election.cc:304] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa
I20260709 12:13:12.456187 19479 raft_consensus.cc:2749] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:12.457054 19482 consensus_queue.cc:1059] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:12.458173 19473 raft_consensus.cc:2749] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:12.458819 19457 raft_consensus.cc:3055] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:12.459380 19457 raft_consensus.cc:740] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:13:12.459417 19141 leader_election.cc:304] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596; no voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:12.460687 19066 leader_election.cc:304] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd68072dd7448289851e695f02a58fa; no voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:12.461437 19473 raft_consensus.cc:2749] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:12.461107 19457 consensus_queue.cc:260] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.462752 19141 leader_election.cc:304] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596; no voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:12.464395 19472 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:12.468148 19457 raft_consensus.cc:3060] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:12.472575 19472 raft_consensus.cc:2749] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:12.473270 19473 raft_consensus.cc:2749] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:12.473768 19469 consensus_queue.cc:1059] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:12.475627 19473 raft_consensus.cc:3055] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:12.476037 19473 raft_consensus.cc:740] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:13:12.475728 19214 leader_election.cc:304] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7ea24e7a921470dbb649650c6870f5d; no voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa
I20260709 12:13:12.478396 19479 raft_consensus.cc:2749] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:12.478422 19473 consensus_queue.cc:260] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:12.480300 19473 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:12.586098 19031 debug-util.cc:398] Leaking SignalData structure 0x7b0800053000 after lost signal to thread 18410
W20260709 12:13:12.587018 19031 debug-util.cc:398] Leaking SignalData structure 0x7b08000536e0 after lost signal to thread 19034
W20260709 12:13:12.588018 19031 debug-util.cc:398] Leaking SignalData structure 0x7b0800106a20 after lost signal to thread 19126
W20260709 12:13:12.588881 19031 debug-util.cc:398] Leaking SignalData structure 0x7b08000907e0 after lost signal to thread 19201
W20260709 12:13:12.589674 19031 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad1e0 after lost signal to thread 19275
I20260709 12:13:12.832792 19246 raft_consensus.cc:1275] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:12.834751 19473 consensus_queue.cc:1048] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:12.838197 19101 raft_consensus.cc:1275] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:12.841395 19469 consensus_queue.cc:1048] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.374161 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:13.386857 19101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a"
dest_uuid: "ccd68072dd7448289851e695f02a58fa"
mode: GRACEFUL
new_leader_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:37744
I20260709 12:13:13.387763 19101 raft_consensus.cc:606] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Received request to transfer leadership to TS e7ea24e7a921470dbb649650c6870f5d
I20260709 12:13:13.389439 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:13.390143 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:13.848292 19502 raft_consensus.cc:493] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.848794 19502 raft_consensus.cc:515] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:13.850672 19502 leader_election.cc:290] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:13.851600 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:13.852172 19101 raft_consensus.cc:2468] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 3.
I20260709 12:13:13.852116 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d" is_pre_election: true
I20260709 12:13:13.853374 19246 raft_consensus.cc:2468] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 3.
I20260709 12:13:13.854043 19140 leader_election.cc:304] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:13:13.854904 19502 raft_consensus.cc:2804] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:13.855427 19502 raft_consensus.cc:493] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.855854 19502 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:13.857003 19482 raft_consensus.cc:493] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.857445 19482 raft_consensus.cc:515] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:13.860082 19482 leader_election.cc:290] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:13:13.860296 19173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596" is_pre_election: true
I20260709 12:13:13.860915 19173 raft_consensus.cc:2468] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 2.
I20260709 12:13:13.861896 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa" is_pre_election: true
I20260709 12:13:13.861958 19215 leader_election.cc:304] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:13:13.862982 19482 raft_consensus.cc:2804] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:13.863184 19101 raft_consensus.cc:2468] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 3.
I20260709 12:13:13.863413 19482 raft_consensus.cc:493] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.864928 19482 raft_consensus.cc:3060] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:13.867595 19502 raft_consensus.cc:515] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:13.870090 19482 raft_consensus.cc:515] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:13.870973 19502 leader_election.cc:290] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), e7ea24e7a921470dbb649650c6870f5d (127.17.249.195:40389)
I20260709 12:13:13.871594 19246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
I20260709 12:13:13.872411 19482 leader_election.cc:290] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 4 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:13:13.872299 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35c682da20343f8987c96c4ef81f108" candidate_uuid: "5bd07372a85a49d2b0b2ba959004a596" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:13:13.872268 19246 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:13.873476 19101 raft_consensus.cc:3060] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:13.875471 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:13:13.876034 19100 raft_consensus.cc:3060] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:13.878278 19478 raft_consensus.cc:993] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa: : Instructing follower e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:13:13.878861 19503 raft_consensus.cc:1081] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Signalling peer e7ea24e7a921470dbb649650c6870f5d to start an election
I20260709 12:13:13.880847 19249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a"
dest_uuid: "e7ea24e7a921470dbb649650c6870f5d"
 from {username='slave'} at 127.0.0.1:47388
I20260709 12:13:13.881578 19249 raft_consensus.cc:493] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:13.881740 19101 raft_consensus.cc:2468] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 4.
I20260709 12:13:13.882035 19249 raft_consensus.cc:3060] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:13.894423 19249 raft_consensus.cc:515] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:13.895085 19100 raft_consensus.cc:2468] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 4.
I20260709 12:13:13.895485 19246 raft_consensus.cc:2468] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd07372a85a49d2b0b2ba959004a596 in term 4.
I20260709 12:13:13.896477 19214 leader_election.cc:304] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd68072dd7448289851e695f02a58fa, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:13:13.896616 19140 leader_election.cc:304] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, ccd68072dd7448289851e695f02a58fa; no voters: 
I20260709 12:13:13.897305 19502 raft_consensus.cc:2804] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:13.898454 19173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064b5c45d66a463c9e6df4f0542dbf4f" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:13:13.899094 19173 raft_consensus.cc:3060] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:13.901814 19482 raft_consensus.cc:2804] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:13.899560 19502 raft_consensus.cc:697] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 4 LEADER]: Becoming Leader. State: Replica: 5bd07372a85a49d2b0b2ba959004a596, State: Running, Role: LEADER
I20260709 12:13:13.903301 19502 consensus_queue.cc:237] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:13.906720 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ccd68072dd7448289851e695f02a58fa"
I20260709 12:13:13.909415 19173 raft_consensus.cc:2468] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 4.
I20260709 12:13:13.908771 19177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e59d1b33be24671b742b188a69d835a" candidate_uuid: "e7ea24e7a921470dbb649650c6870f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bd07372a85a49d2b0b2ba959004a596"
I20260709 12:13:13.910087 19177 raft_consensus.cc:3060] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:13.907682 19249 leader_election.cc:290] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 election: Requested vote from peers ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971), 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915)
I20260709 12:13:13.909554 19101 raft_consensus.cc:3055] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:13.913986 19101 raft_consensus.cc:740] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccd68072dd7448289851e695f02a58fa, State: Running, Role: LEADER
I20260709 12:13:13.915592 19101 consensus_queue.cc:260] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:13.917312 19101 raft_consensus.cc:3060] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:13.918718 19000 catalog_manager.cc:5697] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5bd07372a85a49d2b0b2ba959004a596" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:13.921329 19177 raft_consensus.cc:2468] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 3.
I20260709 12:13:13.919250 19482 raft_consensus.cc:697] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 4 LEADER]: Becoming Leader. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:13:13.923094 19215 leader_election.cc:304] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd07372a85a49d2b0b2ba959004a596, e7ea24e7a921470dbb649650c6870f5d; no voters: 
I20260709 12:13:13.924342 19504 raft_consensus.cc:2804] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:13.923555 19482 consensus_queue.cc:237] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:13.933619 19101 raft_consensus.cc:2468] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ea24e7a921470dbb649650c6870f5d in term 3.
I20260709 12:13:13.940659 19504 raft_consensus.cc:697] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 3 LEADER]: Becoming Leader. State: Replica: e7ea24e7a921470dbb649650c6870f5d, State: Running, Role: LEADER
I20260709 12:13:13.942215 19504 consensus_queue.cc:237] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } }
I20260709 12:13:13.955011 18996 catalog_manager.cc:5697] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e7ea24e7a921470dbb649650c6870f5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:13.984160 18996 catalog_manager.cc:5697] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d reported cstate change: term changed from 2 to 3, leader changed from ccd68072dd7448289851e695f02a58fa (127.17.249.193) to e7ea24e7a921470dbb649650c6870f5d (127.17.249.195). New cstate: current_term: 3 leader_uuid: "e7ea24e7a921470dbb649650c6870f5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.384263 19101 raft_consensus.cc:1275] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:14.385838 19504 consensus_queue.cc:1048] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.391683 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:14.397284 19100 raft_consensus.cc:1275] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:14.399346 19502 consensus_queue.cc:1048] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.400348 19100 raft_consensus.cc:1275] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:14.401939 19177 raft_consensus.cc:1275] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:14.402452 19507 consensus_queue.cc:1048] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd68072dd7448289851e695f02a58fa" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 43971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.406112 19504 consensus_queue.cc:1048] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.408987 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:14.410053 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:14.412621 19177 raft_consensus.cc:1275] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Refusing update from remote peer e7ea24e7a921470dbb649650c6870f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:14.416404 19504 consensus_queue.cc:1048] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd07372a85a49d2b0b2ba959004a596" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.466240 19249 raft_consensus.cc:1275] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Refusing update from remote peer 5bd07372a85a49d2b0b2ba959004a596: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:14.468851 19525 consensus_queue.cc:1048] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ea24e7a921470dbb649650c6870f5d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 40389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:15.411597 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:15.420979 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:15.421656 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:17.103327 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:17.109371 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:17.109966 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:13:17.630264 19031 debug-util.cc:398] Leaking SignalData structure 0x7b080009fea0 after lost signal to thread 18410
W20260709 12:13:17.631131 19031 debug-util.cc:398] Leaking SignalData structure 0x7b080004a2a0 after lost signal to thread 19034
W20260709 12:13:17.631924 19031 debug-util.cc:398] Leaking SignalData structure 0x7b0800053120 after lost signal to thread 19126
W20260709 12:13:17.632635 19031 debug-util.cc:398] Leaking SignalData structure 0x7b08001cae40 after lost signal to thread 19201
W20260709 12:13:17.633328 19031 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3dc0 after lost signal to thread 19275
I20260709 12:13:18.111127 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.116642 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:18.117161 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:19.118294 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:19.125895 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:19.126456 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:20.127732 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.133589 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:20.134114 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:21.135419 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.141881 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:21.142627 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:22.184448 18407 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:13:22.185029 18407 tablet_server.cc:179] TabletServer@127.17.249.193:0 shutting down...
W20260709 12:13:22.192932 19214 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 12:13:22.198241 19214 consensus_peers.cc:597] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d -> Peer ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971): Couldn't send request to peer ccd68072dd7448289851e695f02a58fa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.227890 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:22.228804 18407 tablet_replica.cc:333] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa: stopping tablet replica
I20260709 12:13:22.230059 18407 raft_consensus.cc:2243] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.231302 18407 raft_consensus.cc:2272] T 064b5c45d66a463c9e6df4f0542dbf4f P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.234105 18407 tablet_replica.cc:333] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa: stopping tablet replica
I20260709 12:13:22.234769 18407 raft_consensus.cc:2243] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.235783 18407 raft_consensus.cc:2272] T 5660612675c1496eb8995fbd1771ba02 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.238297 18407 tablet_replica.cc:333] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa: stopping tablet replica
I20260709 12:13:22.238989 18407 raft_consensus.cc:2243] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.239518 18407 raft_consensus.cc:2272] T e342edc4ecec4e5ba112280b7b7a2bee P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.241780 18407 tablet_replica.cc:333] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa: stopping tablet replica
I20260709 12:13:22.242388 18407 raft_consensus.cc:2243] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.243049 18407 raft_consensus.cc:2272] T e35c682da20343f8987c96c4ef81f108 P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.245734 18407 tablet_replica.cc:333] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa: stopping tablet replica
I20260709 12:13:22.246470 18407 raft_consensus.cc:2243] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.247426 18407 raft_consensus.cc:2272] T a121b37529ee4d9dae023bbdb5901aa5 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.249343 18407 tablet_replica.cc:333] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa: stopping tablet replica
I20260709 12:13:22.249814 18407 raft_consensus.cc:2243] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.250733 18407 raft_consensus.cc:2272] T a278856b2c8e4e8bbff0fab7807f0065 P ccd68072dd7448289851e695f02a58fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.253582 18407 tablet_replica.cc:333] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa: stopping tablet replica
I20260709 12:13:22.254266 18407 raft_consensus.cc:2243] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.255064 18407 raft_consensus.cc:2272] T 0e59d1b33be24671b742b188a69d835a P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.257594 19140 consensus_peers.cc:597] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 -> Peer ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971): Couldn't send request to peer ccd68072dd7448289851e695f02a58fa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.258139 18407 tablet_replica.cc:333] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa: stopping tablet replica
I20260709 12:13:22.258991 18407 raft_consensus.cc:2243] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.259581 18407 raft_consensus.cc:2272] T 954bdeed047a4119afe2c5bd95d23822 P ccd68072dd7448289851e695f02a58fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.261813 18407 tablet_replica.cc:333] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa: stopping tablet replica
I20260709 12:13:22.262498 18407 raft_consensus.cc:2243] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.263115 18407 raft_consensus.cc:2272] T c054d570a53c413b98f35967ef37262a P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.265518 19140 consensus_peers.cc:597] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 -> Peer ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971): Couldn't send request to peer ccd68072dd7448289851e695f02a58fa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.265628 18407 tablet_replica.cc:333] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa: stopping tablet replica
I20260709 12:13:22.266351 18407 raft_consensus.cc:2243] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.266940 18407 raft_consensus.cc:2272] T dfc860d5e2d040e2ab61a30c25444c45 P ccd68072dd7448289851e695f02a58fa [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.284340 19214 consensus_peers.cc:597] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d -> Peer ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971): Couldn't send request to peer ccd68072dd7448289851e695f02a58fa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.301908 19140 consensus_peers.cc:597] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 -> Peer ccd68072dd7448289851e695f02a58fa (127.17.249.193:43971): Couldn't send request to peer ccd68072dd7448289851e695f02a58fa. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:43971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.305670 18407 tablet_server.cc:196] TabletServer@127.17.249.193:0 shutdown complete.
I20260709 12:13:22.333318 18407 tablet_server.cc:179] TabletServer@127.17.249.194:0 shutting down...
W20260709 12:13:22.342326 19215 consensus_peers.cc:597] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d -> Peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Couldn't send request to peer 5bd07372a85a49d2b0b2ba959004a596. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.376250 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:22.377339 18407 tablet_replica.cc:333] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596: stopping tablet replica
I20260709 12:13:22.378357 18407 raft_consensus.cc:2243] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.379021 18407 raft_consensus.cc:2272] T 064b5c45d66a463c9e6df4f0542dbf4f P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.381218 18407 tablet_replica.cc:333] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596: stopping tablet replica
I20260709 12:13:22.381866 18407 raft_consensus.cc:2243] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.382752 18407 raft_consensus.cc:2272] T e35c682da20343f8987c96c4ef81f108 P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.384655 18407 tablet_replica.cc:333] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596: stopping tablet replica
I20260709 12:13:22.385423 18407 raft_consensus.cc:2243] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.385973 18407 raft_consensus.cc:2272] T 5660612675c1496eb8995fbd1771ba02 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.387939 18407 tablet_replica.cc:333] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596: stopping tablet replica
I20260709 12:13:22.388473 18407 raft_consensus.cc:2243] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.388943 18407 raft_consensus.cc:2272] T e342edc4ecec4e5ba112280b7b7a2bee P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.390880 18407 tablet_replica.cc:333] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596: stopping tablet replica
I20260709 12:13:22.391441 18407 raft_consensus.cc:2243] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.391899 18407 raft_consensus.cc:2272] T a278856b2c8e4e8bbff0fab7807f0065 P 5bd07372a85a49d2b0b2ba959004a596 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.393843 18407 tablet_replica.cc:333] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596: stopping tablet replica
I20260709 12:13:22.394454 18407 raft_consensus.cc:2243] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.395021 18407 raft_consensus.cc:2272] T a121b37529ee4d9dae023bbdb5901aa5 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.397231 18407 tablet_replica.cc:333] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596: stopping tablet replica
I20260709 12:13:22.397820 18407 raft_consensus.cc:2243] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.398377 18407 raft_consensus.cc:2272] T 0e59d1b33be24671b742b188a69d835a P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.400342 18407 tablet_replica.cc:333] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596: stopping tablet replica
I20260709 12:13:22.400893 18407 raft_consensus.cc:2243] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.401727 18407 raft_consensus.cc:2272] T 954bdeed047a4119afe2c5bd95d23822 P 5bd07372a85a49d2b0b2ba959004a596 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.403913 18407 tablet_replica.cc:333] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596: stopping tablet replica
I20260709 12:13:22.404474 18407 raft_consensus.cc:2243] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.405323 18407 raft_consensus.cc:2272] T dfc860d5e2d040e2ab61a30c25444c45 P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.407788 18407 tablet_replica.cc:333] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596: stopping tablet replica
I20260709 12:13:22.408491 18407 raft_consensus.cc:2243] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.409407 18407 raft_consensus.cc:2272] T c054d570a53c413b98f35967ef37262a P 5bd07372a85a49d2b0b2ba959004a596 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.442077 18407 tablet_server.cc:196] TabletServer@127.17.249.194:0 shutdown complete.
I20260709 12:13:22.469631 18407 tablet_server.cc:179] TabletServer@127.17.249.195:0 shutting down...
W20260709 12:13:22.497412 19215 consensus_peers.cc:597] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d -> Peer 5bd07372a85a49d2b0b2ba959004a596 (127.17.249.194:35915): Couldn't send request to peer 5bd07372a85a49d2b0b2ba959004a596. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:35915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.512542 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:22.513576 18407 tablet_replica.cc:333] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d: stopping tablet replica
I20260709 12:13:22.514365 18407 raft_consensus.cc:2243] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.514971 18407 raft_consensus.cc:2272] T e35c682da20343f8987c96c4ef81f108 P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.517045 18407 tablet_replica.cc:333] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d: stopping tablet replica
I20260709 12:13:22.517616 18407 raft_consensus.cc:2243] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.518108 18407 raft_consensus.cc:2272] T a121b37529ee4d9dae023bbdb5901aa5 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.520049 18407 tablet_replica.cc:333] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d: stopping tablet replica
I20260709 12:13:22.520546 18407 raft_consensus.cc:2243] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.521049 18407 raft_consensus.cc:2272] T a278856b2c8e4e8bbff0fab7807f0065 P e7ea24e7a921470dbb649650c6870f5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.522887 18407 tablet_replica.cc:333] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d: stopping tablet replica
I20260709 12:13:22.523448 18407 raft_consensus.cc:2243] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.524255 18407 raft_consensus.cc:2272] T 0e59d1b33be24671b742b188a69d835a P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.526153 18407 tablet_replica.cc:333] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d: stopping tablet replica
I20260709 12:13:22.526702 18407 raft_consensus.cc:2243] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.527597 18407 raft_consensus.cc:2272] T 064b5c45d66a463c9e6df4f0542dbf4f P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.529438 18407 tablet_replica.cc:333] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d: stopping tablet replica
I20260709 12:13:22.529994 18407 raft_consensus.cc:2243] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.530491 18407 raft_consensus.cc:2272] T 5660612675c1496eb8995fbd1771ba02 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.532357 18407 tablet_replica.cc:333] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d: stopping tablet replica
I20260709 12:13:22.532912 18407 raft_consensus.cc:2243] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.533744 18407 raft_consensus.cc:2272] T e342edc4ecec4e5ba112280b7b7a2bee P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.535597 18407 tablet_replica.cc:333] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d: stopping tablet replica
I20260709 12:13:22.536118 18407 raft_consensus.cc:2243] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.536688 18407 raft_consensus.cc:2272] T c054d570a53c413b98f35967ef37262a P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.538447 18407 tablet_replica.cc:333] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d: stopping tablet replica
I20260709 12:13:22.538981 18407 raft_consensus.cc:2243] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.539431 18407 raft_consensus.cc:2272] T dfc860d5e2d040e2ab61a30c25444c45 P e7ea24e7a921470dbb649650c6870f5d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.541244 18407 tablet_replica.cc:333] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d: stopping tablet replica
I20260709 12:13:22.541718 18407 raft_consensus.cc:2243] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.542217 18407 raft_consensus.cc:2272] T 954bdeed047a4119afe2c5bd95d23822 P e7ea24e7a921470dbb649650c6870f5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.574618 18407 tablet_server.cc:196] TabletServer@127.17.249.195:0 shutdown complete.
I20260709 12:13:22.596167 18407 master.cc:562] Master@127.17.249.254:41473 shutting down...
I20260709 12:13:22.624073 18407 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.624712 18407 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.625085 18407 tablet_replica.cc:333] T 00000000000000000000000000000000 P c8cd6bc372114ddcb1f93f4007b46516: stopping tablet replica
I20260709 12:13:22.672772 18407 master.cc:584] Master@127.17.249.254:41473 shutdown complete.
5bd07372a85a49d2b0b2ba959004a596  4
ccd68072dd7448289851e695f02a58fa  5
e7ea24e7a921470dbb649650c6870f5d  1
5bd07372a85a49d2b0b2ba959004a596  4
ccd68072dd7448289851e695f02a58fa  3
e7ea24e7a921470dbb649650c6870f5d  3
5bd07372a85a49d2b0b2ba959004a596  1
ccd68072dd7448289851e695f02a58fa  8
e7ea24e7a921470dbb649650c6870f5d  1
5bd07372a85a49d2b0b2ba959004a596  4
ccd68072dd7448289851e695f02a58fa  3
e7ea24e7a921470dbb649650c6870f5d  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (31051 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:13:22.722934 18407 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.249.254:37145
I20260709 12:13:22.724136 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:22.730136 19548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:22.731920 19551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:22.732352 19549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:22.732962 18407 server_base.cc:1061] running on GCE node
I20260709 12:13:22.734294 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:22.734511 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:22.734724 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599202734704 us; error 0 us; skew 500 ppm
I20260709 12:13:22.735507 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:22.738937 18407 webserver.cc:533] Webserver started at http://127.17.249.254:38441/ using document root <none> and password file <none>
I20260709 12:13:22.739756 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:22.739982 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:22.740320 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:22.741689 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/master-0-root/instance:
uuid: "ece09a42b2e24409af39499c01c3884f"
format_stamp: "Formatted at 2026-07-09 12:13:22 on dist-test-slave-7mcn"
I20260709 12:13:22.746992 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:13:22.751376 19556 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:22.752226 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:13:22.752571 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/master-0-root
uuid: "ece09a42b2e24409af39499c01c3884f"
format_stamp: "Formatted at 2026-07-09 12:13:22 on dist-test-slave-7mcn"
I20260709 12:13:22.752916 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:22.775516 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:22.776983 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:22.823910 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.254:37145
I20260709 12:13:22.824041 19607 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.254:37145 every 8 connection(s)
I20260709 12:13:22.828573 19608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:22.839033 19608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f: Bootstrap starting.
I20260709 12:13:22.843976 19608 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:22.848953 19608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f: No bootstrap required, opened a new log
I20260709 12:13:22.851351 19608 raft_consensus.cc:359] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece09a42b2e24409af39499c01c3884f" member_type: VOTER }
I20260709 12:13:22.851811 19608 raft_consensus.cc:385] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:22.852092 19608 raft_consensus.cc:740] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ece09a42b2e24409af39499c01c3884f, State: Initialized, Role: FOLLOWER
I20260709 12:13:22.852821 19608 consensus_queue.cc:260] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece09a42b2e24409af39499c01c3884f" member_type: VOTER }
I20260709 12:13:22.853315 19608 raft_consensus.cc:399] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:22.853540 19608 raft_consensus.cc:493] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:22.853827 19608 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:22.858426 19608 raft_consensus.cc:515] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece09a42b2e24409af39499c01c3884f" member_type: VOTER }
I20260709 12:13:22.859072 19608 leader_election.cc:304] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ece09a42b2e24409af39499c01c3884f; no voters: 
I20260709 12:13:22.860423 19608 leader_election.cc:290] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:22.861033 19611 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:22.862609 19611 raft_consensus.cc:697] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [term 1 LEADER]: Becoming Leader. State: Replica: ece09a42b2e24409af39499c01c3884f, State: Running, Role: LEADER
I20260709 12:13:22.863468 19611 consensus_queue.cc:237] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece09a42b2e24409af39499c01c3884f" member_type: VOTER }
I20260709 12:13:22.863636 19608 sys_catalog.cc:565] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:22.869463 19612 sys_catalog.cc:455] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ece09a42b2e24409af39499c01c3884f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece09a42b2e24409af39499c01c3884f" member_type: VOTER } }
I20260709 12:13:22.870261 19612 sys_catalog.cc:458] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:22.872023 19613 sys_catalog.cc:455] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ece09a42b2e24409af39499c01c3884f. Latest consensus state: current_term: 1 leader_uuid: "ece09a42b2e24409af39499c01c3884f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ece09a42b2e24409af39499c01c3884f" member_type: VOTER } }
I20260709 12:13:22.872732 19613 sys_catalog.cc:458] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:22.876385 19619 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:22.882153 19619 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:22.884860 18407 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:22.893416 19619 catalog_manager.cc:1383] Generated new cluster ID: 33d5c051c163415f9f8ded67303c3b90
I20260709 12:13:22.893792 19619 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:22.913029 19619 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:22.914480 19619 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:22.930552 19619 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f: Generated new TSK 0
I20260709 12:13:22.931360 19619 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:22.953068 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:22.960893 19629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:22.962396 19630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:22.965596 18407 server_base.cc:1061] running on GCE node
W20260709 12:13:22.965955 19632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:22.967500 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:22.967738 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:22.967880 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599202967857 us; error 0 us; skew 500 ppm
I20260709 12:13:22.968461 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:22.971369 18407 webserver.cc:533] Webserver started at http://127.17.249.193:42185/ using document root <none> and password file <none>
I20260709 12:13:22.971865 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:22.972044 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:22.972281 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:22.973480 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/instance:
uuid: "f662c4f7d6a74013a1e58a5330a049b8"
format_stamp: "Formatted at 2026-07-09 12:13:22 on dist-test-slave-7mcn"
I20260709 12:13:22.978948 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:13:22.983085 19637 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:22.984004 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:13:22.984333 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root
uuid: "f662c4f7d6a74013a1e58a5330a049b8"
format_stamp: "Formatted at 2026-07-09 12:13:22 on dist-test-slave-7mcn"
I20260709 12:13:22.984625 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:22.994954 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:22.996630 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:22.998360 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:23.001286 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:23.001523 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.001835 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:23.002305 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.059993 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.193:36713
I20260709 12:13:23.060115 19699 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.193:36713 every 8 connection(s)
I20260709 12:13:23.066032 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:23.076476 19704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:23.077242 19705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:23.081776 18407 server_base.cc:1061] running on GCE node
W20260709 12:13:23.082049 19708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:23.083606 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:23.083839 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:23.084086 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599203084062 us; error 0 us; skew 500 ppm
I20260709 12:13:23.084942 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:23.088541 18407 webserver.cc:533] Webserver started at http://127.17.249.194:42185/ using document root <none> and password file <none>
I20260709 12:13:23.089159 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:23.089445 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:23.089529 19700 heartbeater.cc:344] Connected to a master server at 127.17.249.254:37145
I20260709 12:13:23.089800 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:23.090047 19700 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:23.090931 19700 heartbeater.cc:507] Master 127.17.249.254:37145 requested a full tablet report, sending...
I20260709 12:13:23.091482 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/instance:
uuid: "ca42d3c27d2e46348120791d1282b193"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-7mcn"
I20260709 12:13:23.093292 19573 ts_manager.cc:194] Registered new tserver with Master: f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713)
I20260709 12:13:23.095275 19573 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47138
I20260709 12:13:23.098044 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:13:23.102945 19712 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.103936 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:13:23.104228 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root
uuid: "ca42d3c27d2e46348120791d1282b193"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-7mcn"
I20260709 12:13:23.104502 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:23.147207 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:23.148665 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:23.150354 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:23.153182 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:23.153446 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.153715 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:23.153898 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.204394 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.194:46489
I20260709 12:13:23.204583 19774 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.194:46489 every 8 connection(s)
I20260709 12:13:23.209780 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:23.218745 19778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:23.219578 19779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:23.221190 19781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:23.222596 18407 server_base.cc:1061] running on GCE node
I20260709 12:13:23.223778 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:23.224092 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:23.224327 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599203224305 us; error 0 us; skew 500 ppm
I20260709 12:13:23.225157 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:23.225276 19775 heartbeater.cc:344] Connected to a master server at 127.17.249.254:37145
I20260709 12:13:23.225786 19775 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:23.226701 19775 heartbeater.cc:507] Master 127.17.249.254:37145 requested a full tablet report, sending...
I20260709 12:13:23.228310 18407 webserver.cc:533] Webserver started at http://127.17.249.195:42631/ using document root <none> and password file <none>
I20260709 12:13:23.229044 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:23.229274 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:23.229187 19573 ts_manager.cc:194] Registered new tserver with Master: ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:23.229750 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:23.230942 19573 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47140
I20260709 12:13:23.231135 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/instance:
uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-7mcn"
I20260709 12:13:23.236501 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:23.240816 19786 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.241855 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:13:23.242336 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root
uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-7mcn"
I20260709 12:13:23.242674 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:23.255982 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:23.257444 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:23.259012 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:23.261579 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:23.261848 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.262143 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:23.262334 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.319769 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.195:42991
I20260709 12:13:23.319962 19848 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.195:42991 every 8 connection(s)
I20260709 12:13:23.338618 19849 heartbeater.cc:344] Connected to a master server at 127.17.249.254:37145
I20260709 12:13:23.339120 19849 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:23.340009 19849 heartbeater.cc:507] Master 127.17.249.254:37145 requested a full tablet report, sending...
I20260709 12:13:23.342569 19573 ts_manager.cc:194] Registered new tserver with Master: 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:23.343240 18407 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019370526s
I20260709 12:13:23.344611 19573 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47152
I20260709 12:13:23.378206 19573 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:23.385295 19573 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:23.620434 19665 tablet_service.cc:1511] Processing CreateTablet for tablet 70bffa2c492142dcb1c6ffe4ce59bde8 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:23.621941 19665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bffa2c492142dcb1c6ffe4ce59bde8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.621706 19664 tablet_service.cc:1511] Processing CreateTablet for tablet def3393082b24fed88cd1cc954e4e568 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:23.624137 19663 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3fa3feedde422fbce04c9f6ab16f44 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:23.626250 19662 tablet_service.cc:1511] Processing CreateTablet for tablet fd361cc5d6794bb1a8c5e6cf32a7a8fe (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:23.629594 19661 tablet_service.cc:1511] Processing CreateTablet for tablet f571c10f46804596bd8b664f6181c2c8 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:23.631927 19660 tablet_service.cc:1511] Processing CreateTablet for tablet 3efb146893bc46c5b42e3fc209a2135d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:23.633797 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def3393082b24fed88cd1cc954e4e568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.634342 19813 tablet_service.cc:1511] Processing CreateTablet for tablet def3393082b24fed88cd1cc954e4e568 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:23.636013 19813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def3393082b24fed88cd1cc954e4e568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.635895 19812 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3fa3feedde422fbce04c9f6ab16f44 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:23.637394 19812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3fa3feedde422fbce04c9f6ab16f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.638531 19659 tablet_service.cc:1511] Processing CreateTablet for tablet a61494383461482b9ddf0e4f6ceb4323 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:23.640115 19810 tablet_service.cc:1511] Processing CreateTablet for tablet f571c10f46804596bd8b664f6181c2c8 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:23.640944 19811 tablet_service.cc:1511] Processing CreateTablet for tablet fd361cc5d6794bb1a8c5e6cf32a7a8fe (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:23.642007 19810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f571c10f46804596bd8b664f6181c2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.643244 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd361cc5d6794bb1a8c5e6cf32a7a8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.643628 19814 tablet_service.cc:1511] Processing CreateTablet for tablet 70bffa2c492142dcb1c6ffe4ce59bde8 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:23.644321 19809 tablet_service.cc:1511] Processing CreateTablet for tablet 3efb146893bc46c5b42e3fc209a2135d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:23.645102 19814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bffa2c492142dcb1c6ffe4ce59bde8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.646100 19809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efb146893bc46c5b42e3fc209a2135d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.634910 19660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efb146893bc46c5b42e3fc209a2135d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.647559 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f571c10f46804596bd8b664f6181c2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.649400 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3fa3feedde422fbce04c9f6ab16f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.650811 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61494383461482b9ddf0e4f6ceb4323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.653702 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd361cc5d6794bb1a8c5e6cf32a7a8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.685951 19658 tablet_service.cc:1511] Processing CreateTablet for tablet 5895f7d8826c4e48a39f2ead181ee1bd (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:23.687526 19658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5895f7d8826c4e48a39f2ead181ee1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.688041 19740 tablet_service.cc:1511] Processing CreateTablet for tablet 70bffa2c492142dcb1c6ffe4ce59bde8 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:23.689694 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bffa2c492142dcb1c6ffe4ce59bde8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.690534 19737 tablet_service.cc:1511] Processing CreateTablet for tablet fd361cc5d6794bb1a8c5e6cf32a7a8fe (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:23.692159 19739 tablet_service.cc:1511] Processing CreateTablet for tablet def3393082b24fed88cd1cc954e4e568 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:23.693004 19736 tablet_service.cc:1511] Processing CreateTablet for tablet f571c10f46804596bd8b664f6181c2c8 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:23.694773 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3fa3feedde422fbce04c9f6ab16f44 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:23.696692 19734 tablet_service.cc:1511] Processing CreateTablet for tablet a61494383461482b9ddf0e4f6ceb4323 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:23.697335 19811 tablet_service.cc:1511] Processing CreateTablet for tablet a61494383461482b9ddf0e4f6ceb4323 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:23.698699 19735 tablet_service.cc:1511] Processing CreateTablet for tablet 3efb146893bc46c5b42e3fc209a2135d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:23.700887 19737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd361cc5d6794bb1a8c5e6cf32a7a8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.702358 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f571c10f46804596bd8b664f6181c2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.704027 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61494383461482b9ddf0e4f6ceb4323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.705526 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efb146893bc46c5b42e3fc209a2135d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.707248 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def3393082b24fed88cd1cc954e4e568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.708746 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3fa3feedde422fbce04c9f6ab16f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.710949 19864 tablet_bootstrap.cc:492] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:23.699170 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61494383461482b9ddf0e4f6ceb4323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.752395 19733 tablet_service.cc:1511] Processing CreateTablet for tablet 5895f7d8826c4e48a39f2ead181ee1bd (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:23.753960 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5895f7d8826c4e48a39f2ead181ee1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.752988 19864 tablet_bootstrap.cc:654] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:23.777383 19865 tablet_bootstrap.cc:492] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:23.786651 19810 tablet_service.cc:1511] Processing CreateTablet for tablet 5895f7d8826c4e48a39f2ead181ee1bd (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:23.788038 19810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5895f7d8826c4e48a39f2ead181ee1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.806730 19658 tablet_service.cc:1511] Processing CreateTablet for tablet dc5e311340504d31a6b1704b5459afa8 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:23.807672 19733 tablet_service.cc:1511] Processing CreateTablet for tablet dc5e311340504d31a6b1704b5459afa8 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:23.808146 19658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5e311340504d31a6b1704b5459afa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.808897 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5e311340504d31a6b1704b5459afa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.811574 19865 tablet_bootstrap.cc:654] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:23.816655 19864 tablet_bootstrap.cc:492] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:23.816479 19811 tablet_service.cc:1511] Processing CreateTablet for tablet dc5e311340504d31a6b1704b5459afa8 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:23.820057 19867 tablet_bootstrap.cc:492] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:23.822278 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 20aaa30e54fa432caa5875892f7b4398 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:23.826282 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5e311340504d31a6b1704b5459afa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.826483 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20aaa30e54fa432caa5875892f7b4398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.828994 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 20aaa30e54fa432caa5875892f7b4398 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:23.829952 19810 tablet_service.cc:1511] Processing CreateTablet for tablet 20aaa30e54fa432caa5875892f7b4398 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:23.834022 19661 tablet_service.cc:1511] Processing CreateTablet for tablet f602836b3181405ca03967cbb5c11bc2 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:23.830507 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20aaa30e54fa432caa5875892f7b4398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.835467 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f602836b3181405ca03967cbb5c11bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.844801 19814 tablet_service.cc:1511] Processing CreateTablet for tablet f602836b3181405ca03967cbb5c11bc2 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:23.846477 19814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f602836b3181405ca03967cbb5c11bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.848234 19813 tablet_service.cc:1511] Processing CreateTablet for tablet b9b26df664874fc9abfb63a819ba56f7 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:23.848526 19664 tablet_service.cc:1511] Processing CreateTablet for tablet b9b26df664874fc9abfb63a819ba56f7 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:23.844806 19864 ts_tablet_manager.cc:1403] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.008s
I20260709 12:13:23.850026 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b26df664874fc9abfb63a819ba56f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.851464 19659 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfc1fb42f6b4712acea35286ba371c3 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:23.848234 19738 tablet_service.cc:1511] Processing CreateTablet for tablet f602836b3181405ca03967cbb5c11bc2 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:23.852837 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfc1fb42f6b4712acea35286ba371c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.853394 19734 tablet_service.cc:1511] Processing CreateTablet for tablet b9b26df664874fc9abfb63a819ba56f7 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:23.856555 19864 raft_consensus.cc:359] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:23.857342 19864 raft_consensus.cc:385] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:23.857656 19864 raft_consensus.cc:740] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.858362 19813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b26df664874fc9abfb63a819ba56f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.858481 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f602836b3181405ca03967cbb5c11bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.864183 19864 consensus_queue.cc:260] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:23.871920 19809 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfc1fb42f6b4712acea35286ba371c3 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:23.876500 19663 tablet_service.cc:1511] Processing CreateTablet for tablet f034c09c286a4ac3a1f560c84eb05120 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:23.879076 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f034c09c286a4ac3a1f560c84eb05120. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:23.880628 19621 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:23.884825 19867 tablet_bootstrap.cc:654] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:23.885345 19733 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfc1fb42f6b4712acea35286ba371c3 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:23.886837 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfc1fb42f6b4712acea35286ba371c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.890607 19810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20aaa30e54fa432caa5875892f7b4398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.891336 19812 tablet_service.cc:1511] Processing CreateTablet for tablet f034c09c286a4ac3a1f560c84eb05120 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:23.893085 19812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f034c09c286a4ac3a1f560c84eb05120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.891434 19737 tablet_service.cc:1511] Processing CreateTablet for tablet f034c09c286a4ac3a1f560c84eb05120 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:23.902043 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b26df664874fc9abfb63a819ba56f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.904757 19737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f034c09c286a4ac3a1f560c84eb05120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.905988 19865 tablet_bootstrap.cc:492] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:23.908185 19661 tablet_service.cc:1511] Processing CreateTablet for tablet 364cf3a27fd34a1a913602f0fdb49018 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:23.910524 19735 tablet_service.cc:1511] Processing CreateTablet for tablet 364cf3a27fd34a1a913602f0fdb49018 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:23.917603 19865 ts_tablet_manager.cc:1403] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.141s	user 0.019s	sys 0.012s
I20260709 12:13:23.913026 19808 tablet_service.cc:1511] Processing CreateTablet for tablet 364cf3a27fd34a1a913602f0fdb49018 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:23.914898 19809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfc1fb42f6b4712acea35286ba371c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.916567 19736 tablet_service.cc:1511] Processing CreateTablet for tablet 705ac6c3557f4f89b2fe88524f96bafb (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:23.920967 19865 raft_consensus.cc:359] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:13:23.921783 19865 raft_consensus.cc:385] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:23.922082 19865 raft_consensus.cc:740] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.923416 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364cf3a27fd34a1a913602f0fdb49018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.927518 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705ac6c3557f4f89b2fe88524f96bafb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.930931 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 8f69387176614121ab470bb58987f450 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:23.931716 19808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364cf3a27fd34a1a913602f0fdb49018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.932473 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f69387176614121ab470bb58987f450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.933602 19807 tablet_service.cc:1511] Processing CreateTablet for tablet 8f69387176614121ab470bb58987f450 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:23.935075 19807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f69387176614121ab470bb58987f450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.943169 19865 consensus_queue.cc:260] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:13:23.945314 19737 tablet_service.cc:1511] Processing CreateTablet for tablet 8f69387176614121ab470bb58987f450 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:23.946931 19737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f69387176614121ab470bb58987f450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.951316 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364cf3a27fd34a1a913602f0fdb49018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.957016 19864 ts_tablet_manager.cc:1434] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.107s	user 0.010s	sys 0.005s
I20260709 12:13:23.959990 19849 heartbeater.cc:499] Master 127.17.249.254:37145 was elected leader, sending a full tablet report...
I20260709 12:13:23.927522 19811 tablet_service.cc:1511] Processing CreateTablet for tablet 705ac6c3557f4f89b2fe88524f96bafb (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:23.916667 19658 tablet_service.cc:1511] Processing CreateTablet for tablet 705ac6c3557f4f89b2fe88524f96bafb (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:23.979298 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705ac6c3557f4f89b2fe88524f96bafb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.980446 19864 tablet_bootstrap.cc:492] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:23.981951 19659 tablet_service.cc:1511] Processing CreateTablet for tablet 871f15effca34f488df4f83da15c1167 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:23.983656 19867 tablet_bootstrap.cc:492] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:23.984252 19867 ts_tablet_manager.cc:1403] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.165s	user 0.005s	sys 0.013s
I20260709 12:13:23.987710 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871f15effca34f488df4f83da15c1167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.996304 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 871f15effca34f488df4f83da15c1167 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:23.997839 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871f15effca34f488df4f83da15c1167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.006539 19700 heartbeater.cc:499] Master 127.17.249.254:37145 was elected leader, sending a full tablet report...
I20260709 12:13:24.011480 19658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705ac6c3557f4f89b2fe88524f96bafb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.014508 19871 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.015082 19871 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:13:24.022873 19806 tablet_service.cc:1511] Processing CreateTablet for tablet 871f15effca34f488df4f83da15c1167 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:24.024595 19806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871f15effca34f488df4f83da15c1167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.013592 19865 ts_tablet_manager.cc:1434] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.006s
I20260709 12:13:24.036921 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 09360ce480dc4631988b668a1a16fd23 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:24.051522 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 09360ce480dc4631988b668a1a16fd23 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:24.053649 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09360ce480dc4631988b668a1a16fd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.032028 19871 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:24.066116 19864 tablet_bootstrap.cc:654] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.073246 19867 raft_consensus.cc:359] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.074347 19867 raft_consensus.cc:385] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.076318 19867 raft_consensus.cc:740] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
W20260709 12:13:24.077392 19701 tablet.cc:2406] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:24.071081 19865 tablet_bootstrap.cc:492] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:24.091396 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09360ce480dc4631988b668a1a16fd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.099045 19809 tablet_service.cc:1511] Processing CreateTablet for tablet 09360ce480dc4631988b668a1a16fd23 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:24.100700 19809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09360ce480dc4631988b668a1a16fd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.087368 19867 consensus_queue.cc:260] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.121187 19864 tablet_bootstrap.cc:492] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:24.121848 19864 ts_tablet_manager.cc:1403] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.142s	user 0.019s	sys 0.004s
I20260709 12:13:24.129287 19865 tablet_bootstrap.cc:654] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.145532 19867 ts_tablet_manager.cc:1434] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.161s	user 0.016s	sys 0.026s
I20260709 12:13:24.146858 19867 tablet_bootstrap.cc:492] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:24.146742 19775 heartbeater.cc:499] Master 127.17.249.254:37145 was elected leader, sending a full tablet report...
I20260709 12:13:24.155055 19867 tablet_bootstrap.cc:654] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.155905 19734 tablet_service.cc:1511] Processing CreateTablet for tablet ef4176fd716e466dae3f850b4d2c258f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:24.157445 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef4176fd716e466dae3f850b4d2c258f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.159464 19659 tablet_service.cc:1511] Processing CreateTablet for tablet 478219fa5bde484ea1c2b7351aa260c7 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:24.161007 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 478219fa5bde484ea1c2b7351aa260c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.160859 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:24.163983 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:24.166396 19640 leader_election.cc:343] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:24.168136 19638 leader_election.cc:343] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.168751 19638 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:24.169358 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 478219fa5bde484ea1c2b7351aa260c7 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:24.170046 19809 tablet_service.cc:1511] Processing CreateTablet for tablet 478219fa5bde484ea1c2b7351aa260c7 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:24.170312 19871 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:24.170980 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 478219fa5bde484ea1c2b7351aa260c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.171391 19809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 478219fa5bde484ea1c2b7351aa260c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.176091 19811 tablet_service.cc:1511] Processing CreateTablet for tablet ef4176fd716e466dae3f850b4d2c258f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:24.177907 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef4176fd716e466dae3f850b4d2c258f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.126557 19864 raft_consensus.cc:359] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.191174 19864 raft_consensus.cc:385] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.194478 19864 raft_consensus.cc:740] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.197980 19864 consensus_queue.cc:260] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.199604 19664 tablet_service.cc:1511] Processing CreateTablet for tablet 38079882b39945f6b049a6e7401f7280 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:24.193316 19662 tablet_service.cc:1511] Processing CreateTablet for tablet ef4176fd716e466dae3f850b4d2c258f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:24.201618 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38079882b39945f6b049a6e7401f7280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.211560 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef4176fd716e466dae3f850b4d2c258f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.219326 19876 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.219870 19876 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.220614 19864 ts_tablet_manager.cc:1434] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.098s	user 0.011s	sys 0.000s
I20260709 12:13:24.222180 19864 tablet_bootstrap.cc:492] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:24.223232 19876 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:24.224261 19869 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.224839 19869 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.245100 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 38079882b39945f6b049a6e7401f7280 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:24.247229 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38079882b39945f6b049a6e7401f7280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.257331 19806 tablet_service.cc:1511] Processing CreateTablet for tablet 38079882b39945f6b049a6e7401f7280 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:24.258983 19806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38079882b39945f6b049a6e7401f7280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.271567 19867 tablet_bootstrap.cc:492] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:24.272228 19867 ts_tablet_manager.cc:1403] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.059s
I20260709 12:13:24.271875 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 613b9bd906514e3684eb97813eda93a5 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:24.273940 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613b9bd906514e3684eb97813eda93a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.279029 19869 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:24.286536 19865 tablet_bootstrap.cc:492] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:24.287344 19865 ts_tablet_manager.cc:1403] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.224s	user 0.019s	sys 0.012s
I20260709 12:13:24.289309 19864 tablet_bootstrap.cc:654] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.299116 19661 tablet_service.cc:1511] Processing CreateTablet for tablet 8da80375ede34511af0e77afa09d8640 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:24.300737 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da80375ede34511af0e77afa09d8640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.305154 19663 tablet_service.cc:1511] Processing CreateTablet for tablet bc8e96dba8054da2a8d0b930ae6a53a0 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:24.306558 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8e96dba8054da2a8d0b930ae6a53a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.308048 19809 tablet_service.cc:1511] Processing CreateTablet for tablet 613b9bd906514e3684eb97813eda93a5 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:24.308744 19812 tablet_service.cc:1511] Processing CreateTablet for tablet 8da80375ede34511af0e77afa09d8640 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:24.310417 19812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da80375ede34511af0e77afa09d8640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.324965 19867 raft_consensus.cc:359] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:13:24.325847 19867 raft_consensus.cc:385] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.325932 19735 tablet_service.cc:1511] Processing CreateTablet for tablet bc8e96dba8054da2a8d0b930ae6a53a0 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:24.327418 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8e96dba8054da2a8d0b930ae6a53a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.329774 19736 tablet_service.cc:1511] Processing CreateTablet for tablet 8da80375ede34511af0e77afa09d8640 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:24.331209 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da80375ede34511af0e77afa09d8640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.339164 19809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613b9bd906514e3684eb97813eda93a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.326979 19865 raft_consensus.cc:359] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.341032 19865 raft_consensus.cc:385] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.341468 19865 raft_consensus.cc:740] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.342549 19865 consensus_queue.cc:260] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.326229 19867 raft_consensus.cc:740] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.349833 19811 tablet_service.cc:1511] Processing CreateTablet for tablet bc8e96dba8054da2a8d0b930ae6a53a0 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:24.373143 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8e96dba8054da2a8d0b930ae6a53a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.316474 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 613b9bd906514e3684eb97813eda93a5 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:24.375620 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613b9bd906514e3684eb97813eda93a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.383692 19865 ts_tablet_manager.cc:1434] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.005s
I20260709 12:13:24.384835 19658 tablet_service.cc:1511] Processing CreateTablet for tablet d86cf843c11e474cb87f4e55acb4505d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:24.386458 19658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86cf843c11e474cb87f4e55acb4505d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.388121 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:24.390071 19713 leader_election.cc:343] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.394052 19739 tablet_service.cc:1511] Processing CreateTablet for tablet d86cf843c11e474cb87f4e55acb4505d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:24.395488 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86cf843c11e474cb87f4e55acb4505d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.384891 19865 tablet_bootstrap.cc:492] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:24.403839 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:24.405704 19714 leader_election.cc:343] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.406200 19714 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:24.407042 19876 raft_consensus.cc:2749] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:24.408828 19867 consensus_queue.cc:260] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:13:24.410645 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:24.411440 19867 ts_tablet_manager.cc:1434] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.139s	user 0.009s	sys 0.005s
I20260709 12:13:24.412233 19864 tablet_bootstrap.cc:492] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
W20260709 12:13:24.412701 19788 leader_election.cc:343] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.412480 19867 tablet_bootstrap.cc:492] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:24.412716 19864 ts_tablet_manager.cc:1403] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.191s	user 0.016s	sys 0.007s
I20260709 12:13:24.417644 19864 raft_consensus.cc:359] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.422286 19808 tablet_service.cc:1511] Processing CreateTablet for tablet d86cf843c11e474cb87f4e55acb4505d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:24.423815 19808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86cf843c11e474cb87f4e55acb4505d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.438148 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:24.440382 19865 tablet_bootstrap.cc:654] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:24.440446 19789 leader_election.cc:343] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.441066 19789 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:24.420354 19867 tablet_bootstrap.cc:654] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.442974 19876 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.443570 19876 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:13:24.442498 19869 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:24.452056 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:24.452919 19675 raft_consensus.cc:2468] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:24.454469 19714 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:24.459151 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:24.460817 19713 leader_election.cc:343] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.462056 19876 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:24.462682 19876 raft_consensus.cc:2804] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:24.463111 19876 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.463474 19876 raft_consensus.cc:3060] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.418697 19864 raft_consensus.cc:385] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.468683 19864 raft_consensus.cc:740] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.469712 19659 tablet_service.cc:1511] Processing CreateTablet for tablet e480dc321ba24a11bdd32d2f0298f2e1 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:24.470822 19864 consensus_queue.cc:260] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.471537 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e480dc321ba24a11bdd32d2f0298f2e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.476266 19812 tablet_service.cc:1511] Processing CreateTablet for tablet e480dc321ba24a11bdd32d2f0298f2e1 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:24.477710 19812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e480dc321ba24a11bdd32d2f0298f2e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.479342 19664 tablet_service.cc:1511] Processing CreateTablet for tablet 062f541ef1eb40229095ed423b256495 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:24.481024 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062f541ef1eb40229095ed423b256495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.488916 19735 tablet_service.cc:1511] Processing CreateTablet for tablet e480dc321ba24a11bdd32d2f0298f2e1 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:24.489413 19864 ts_tablet_manager.cc:1434] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.002s
I20260709 12:13:24.490350 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e480dc321ba24a11bdd32d2f0298f2e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.502509 19865 tablet_bootstrap.cc:492] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:24.503213 19865 ts_tablet_manager.cc:1403] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.119s	user 0.009s	sys 0.006s
I20260709 12:13:24.505298 19864 tablet_bootstrap.cc:492] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:24.505798 19733 tablet_service.cc:1511] Processing CreateTablet for tablet 062f541ef1eb40229095ed423b256495 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:24.507158 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062f541ef1eb40229095ed423b256495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.514919 19865 raft_consensus.cc:359] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.515944 19865 raft_consensus.cc:385] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.516417 19810 tablet_service.cc:1511] Processing CreateTablet for tablet 062f541ef1eb40229095ed423b256495 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:24.517453 19876 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:13:24.517980 19810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062f541ef1eb40229095ed423b256495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.520659 19869 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.521207 19869 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.521663 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:24.522482 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:24.523162 19675 raft_consensus.cc:3060] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:24.523294 19713 leader_election.cc:343] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.524129 19876 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:24.516594 19865 raft_consensus.cc:740] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.526561 19865 consensus_queue.cc:260] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.529263 19865 ts_tablet_manager.cc:1434] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:13:24.532450 19869 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:24.533085 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:24.534927 19788 leader_election.cc:343] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.539561 19865 tablet_bootstrap.cc:492] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:24.547462 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:13:24.549369 19789 leader_election.cc:343] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.549945 19789 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:24.550978 19869 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:24.551614 19675 raft_consensus.cc:2468] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:24.552946 19714 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:24.553870 19876 raft_consensus.cc:2804] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:24.554477 19876 raft_consensus.cc:697] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:24.555663 19876 consensus_queue.cc:237] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:13:24.563247 19867 tablet_bootstrap.cc:492] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:24.564283 19867 ts_tablet_manager.cc:1403] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.152s	user 0.023s	sys 0.022s
I20260709 12:13:24.564332 19664 tablet_service.cc:1511] Processing CreateTablet for tablet 199b867263264f1c8e61b1e410b2a082 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:24.566433 19864 tablet_bootstrap.cc:654] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.570752 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199b867263264f1c8e61b1e410b2a082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.572919 19865 tablet_bootstrap.cc:654] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.572475 19736 tablet_service.cc:1511] Processing CreateTablet for tablet 199b867263264f1c8e61b1e410b2a082 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:24.573572 19810 tablet_service.cc:1511] Processing CreateTablet for tablet 199b867263264f1c8e61b1e410b2a082 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:24.574271 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199b867263264f1c8e61b1e410b2a082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.580343 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 739682f97cd84854a1b009c4b2271c7b (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:24.581894 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739682f97cd84854a1b009c4b2271c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.582599 19867 raft_consensus.cc:359] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.583755 19867 raft_consensus.cc:385] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.584115 19867 raft_consensus.cc:740] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.585057 19867 consensus_queue.cc:260] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.587363 19810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199b867263264f1c8e61b1e410b2a082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.593623 19867 ts_tablet_manager.cc:1434] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:13:24.592533 19572 catalog_manager.cc:5697] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.594920 19735 tablet_service.cc:1511] Processing CreateTablet for tablet 739682f97cd84854a1b009c4b2271c7b (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:24.595765 19811 tablet_service.cc:1511] Processing CreateTablet for tablet 739682f97cd84854a1b009c4b2271c7b (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:24.596565 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739682f97cd84854a1b009c4b2271c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.597011 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739682f97cd84854a1b009c4b2271c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.597787 19867 tablet_bootstrap.cc:492] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:24.618419 19659 tablet_service.cc:1511] Processing CreateTablet for tablet e32227fe2da84ebdaa3ba00cfe55031e (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:24.620042 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32227fe2da84ebdaa3ba00cfe55031e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.623852 19808 tablet_service.cc:1511] Processing CreateTablet for tablet e32227fe2da84ebdaa3ba00cfe55031e (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:24.627616 19808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32227fe2da84ebdaa3ba00cfe55031e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.630026 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 729536e45a0e41f181949f78e28166c2 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:24.631757 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729536e45a0e41f181949f78e28166c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.633931 19871 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.634737 19871 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.639485 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:24.642529 19658 tablet_service.cc:1511] Processing CreateTablet for tablet 729536e45a0e41f181949f78e28166c2 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:24.644474 19867 tablet_bootstrap.cc:654] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.645792 19733 tablet_service.cc:1511] Processing CreateTablet for tablet e32227fe2da84ebdaa3ba00cfe55031e (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:24.648007 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32227fe2da84ebdaa3ba00cfe55031e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:24.649717 19640 leader_election.cc:343] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.657188 19812 tablet_service.cc:1511] Processing CreateTablet for tablet 729536e45a0e41f181949f78e28166c2 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:24.660180 19658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729536e45a0e41f181949f78e28166c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.660355 19812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729536e45a0e41f181949f78e28166c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.659911 19662 tablet_service.cc:1511] Processing CreateTablet for tablet a78fc08630dd4a7494e6acb5b859150f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:24.661698 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78fc08630dd4a7494e6acb5b859150f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.663434 19871 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:24.664669 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:24.665397 19824 raft_consensus.cc:2468] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:24.666813 19638 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:24.668582 19871 raft_consensus.cc:2804] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:24.669044 19871 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.669462 19871 raft_consensus.cc:3060] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.671456 19735 tablet_service.cc:1511] Processing CreateTablet for tablet a78fc08630dd4a7494e6acb5b859150f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:24.673161 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78fc08630dd4a7494e6acb5b859150f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.673686 19864 tablet_bootstrap.cc:492] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:24.674311 19864 ts_tablet_manager.cc:1403] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.169s	user 0.019s	sys 0.004s
I20260709 12:13:24.681069 19810 tablet_service.cc:1511] Processing CreateTablet for tablet a78fc08630dd4a7494e6acb5b859150f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:24.682488 19810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78fc08630dd4a7494e6acb5b859150f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.694386 19663 tablet_service.cc:1511] Processing CreateTablet for tablet c9123f5829474284995dd8a5c8139d82 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:24.696074 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9123f5829474284995dd8a5c8139d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.699306 19864 raft_consensus.cc:359] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.700188 19864 raft_consensus.cc:385] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.700505 19864 raft_consensus.cc:740] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.700961 19887 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.701350 19864 consensus_queue.cc:260] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.701659 19887 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.706154 19887 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:24.711884 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:24.713253 19811 tablet_service.cc:1511] Processing CreateTablet for tablet c9123f5829474284995dd8a5c8139d82 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:24.713737 19864 ts_tablet_manager.cc:1434] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:13:24.714593 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9123f5829474284995dd8a5c8139d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.715526 19864 tablet_bootstrap.cc:492] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
W20260709 12:13:24.715925 19713 leader_election.cc:343] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.717496 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:24.718375 19736 tablet_service.cc:1511] Processing CreateTablet for tablet c9123f5829474284995dd8a5c8139d82 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 12:13:24.719117 19714 leader_election.cc:343] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.719657 19714 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:24.720258 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9123f5829474284995dd8a5c8139d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.723629 19887 raft_consensus.cc:2749] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:24.732245 19659 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1b950de64348a69098644dcf9be21d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:24.733716 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1b950de64348a69098644dcf9be21d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.734108 19864 tablet_bootstrap.cc:654] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.735548 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1b950de64348a69098644dcf9be21d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:24.736867 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1b950de64348a69098644dcf9be21d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.742535 19808 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1b950de64348a69098644dcf9be21d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:24.744553 19808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1b950de64348a69098644dcf9be21d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.758100 19806 tablet_service.cc:1511] Processing CreateTablet for tablet 5281957321c64f93988644f4841fbe35 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:24.758369 19735 tablet_service.cc:1511] Processing CreateTablet for tablet 5281957321c64f93988644f4841fbe35 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:24.759467 19806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5281957321c64f93988644f4841fbe35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.756721 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 5281957321c64f93988644f4841fbe35 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:24.760782 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5281957321c64f93988644f4841fbe35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.767426 19658 tablet_service.cc:1511] Processing CreateTablet for tablet 186a44ea95974c119996690984996f55 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:24.769062 19658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186a44ea95974c119996690984996f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.772859 19734 tablet_service.cc:1511] Processing CreateTablet for tablet 186a44ea95974c119996690984996f55 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:24.774472 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186a44ea95974c119996690984996f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.775195 19737 tablet_service.cc:1511] Processing CreateTablet for tablet 298cdd8cc5a94e2d9165affadf233104 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:24.776471 19661 tablet_service.cc:1511] Processing CreateTablet for tablet 298cdd8cc5a94e2d9165affadf233104 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:24.778964 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298cdd8cc5a94e2d9165affadf233104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.781275 19865 tablet_bootstrap.cc:492] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:24.781800 19865 ts_tablet_manager.cc:1403] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.242s	user 0.010s	sys 0.019s
I20260709 12:13:24.783967 19807 tablet_service.cc:1511] Processing CreateTablet for tablet 298cdd8cc5a94e2d9165affadf233104 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:24.785687 19807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298cdd8cc5a94e2d9165affadf233104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.788000 19809 tablet_service.cc:1511] Processing CreateTablet for tablet 186a44ea95974c119996690984996f55 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:24.789352 19809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186a44ea95974c119996690984996f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.791385 19869 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.791878 19737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298cdd8cc5a94e2d9165affadf233104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.791910 19869 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.795001 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5281957321c64f93988644f4841fbe35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.796581 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:24.797506 19675 raft_consensus.cc:2468] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:24.799153 19788 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:24.815670 19665 tablet_service.cc:1511] Processing CreateTablet for tablet 798fecda3ed247f4941d585924251970 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:24.817123 19665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798fecda3ed247f4941d585924251970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.821702 19869 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:24.826647 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:24.828513 19733 tablet_service.cc:1511] Processing CreateTablet for tablet 798fecda3ed247f4941d585924251970 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:24.830149 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798fecda3ed247f4941d585924251970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.829941 19814 tablet_service.cc:1511] Processing CreateTablet for tablet 798fecda3ed247f4941d585924251970 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:24.831465 19814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798fecda3ed247f4941d585924251970. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:24.831349 19789 leader_election.cc:343] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.837255 19867 tablet_bootstrap.cc:492] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:24.836834 19664 tablet_service.cc:1511] Processing CreateTablet for tablet 9f633905374c40ef9d178aa3de255d6f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:24.837847 19867 ts_tablet_manager.cc:1403] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.240s	user 0.010s	sys 0.015s
I20260709 12:13:24.844094 19740 tablet_service.cc:1511] Processing CreateTablet for tablet 9f633905374c40ef9d178aa3de255d6f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:24.845636 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f633905374c40ef9d178aa3de255d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.838333 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f633905374c40ef9d178aa3de255d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.856230 19871 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.859740 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:24.859869 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:24.860518 19824 raft_consensus.cc:3060] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.865296 19871 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:13:24.871623 19640 leader_election.cc:343] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.872900 19810 tablet_service.cc:1511] Processing CreateTablet for tablet 9f633905374c40ef9d178aa3de255d6f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:24.874298 19810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f633905374c40ef9d178aa3de255d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.895376 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 185cd8f7a6e242a7993588e5c71850fd (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:24.896652 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 185cd8f7a6e242a7993588e5c71850fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.900842 19867 raft_consensus.cc:359] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.901685 19867 raft_consensus.cc:385] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.901993 19867 raft_consensus.cc:740] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.884606 19869 raft_consensus.cc:2804] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:24.909547 19864 tablet_bootstrap.cc:492] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:24.910172 19864 ts_tablet_manager.cc:1403] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.195s	user 0.018s	sys 0.015s
I20260709 12:13:24.913424 19864 raft_consensus.cc:359] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.916213 19864 raft_consensus.cc:385] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.916563 19864 raft_consensus.cc:740] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.916579 19740 tablet_service.cc:1511] Processing CreateTablet for tablet 185cd8f7a6e242a7993588e5c71850fd (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:24.917527 19865 raft_consensus.cc:359] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.918152 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 185cd8f7a6e242a7993588e5c71850fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.918340 19865 raft_consensus.cc:385] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.918653 19865 raft_consensus.cc:740] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.919625 19865 consensus_queue.cc:260] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.921918 19865 ts_tablet_manager.cc:1434] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.140s	user 0.003s	sys 0.008s
I20260709 12:13:24.905815 19869 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.930312 19869 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.935956 19865 tablet_bootstrap.cc:492] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:24.940492 19811 tablet_service.cc:1511] Processing CreateTablet for tablet 185cd8f7a6e242a7993588e5c71850fd (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:24.941772 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 185cd8f7a6e242a7993588e5c71850fd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:24.931006 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 131930us
I20260709 12:13:24.933000 19864 consensus_queue.cc:260] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.956573 19864 ts_tablet_manager.cc:1434] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.003s
I20260709 12:13:24.957863 19864 tablet_bootstrap.cc:492] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:24.960419 19662 tablet_service.cc:1511] Processing CreateTablet for tablet 2ccab10bc1b5444482abde3bf4bced52 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:24.961977 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ccab10bc1b5444482abde3bf4bced52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.941344 19824 raft_consensus.cc:2468] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:13:24.971457 19638 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:24.973246 19871 raft_consensus.cc:2804] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:24.925913 19867 consensus_queue.cc:260] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.962965 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 2ccab10bc1b5444482abde3bf4bced52 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:24.981458 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ccab10bc1b5444482abde3bf4bced52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.982764 19867 ts_tablet_manager.cc:1434] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.145s	user 0.011s	sys 0.000s
I20260709 12:13:24.984205 19867 tablet_bootstrap.cc:492] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:24.986975 19869 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:24.991000 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:13:24.992914 19789 leader_election.cc:343] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.997695 19864 tablet_bootstrap.cc:654] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:25.009243 19621 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:25.009145 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:25.009959 19675 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.021806 19809 tablet_service.cc:1511] Processing CreateTablet for tablet 2ccab10bc1b5444482abde3bf4bced52 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:25.022958 19865 tablet_bootstrap.cc:654] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.023592 19809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ccab10bc1b5444482abde3bf4bced52. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:25.029044 19713 consensus_peers.cc:597] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.035156 19871 raft_consensus.cc:697] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:25.044178 19871 consensus_queue.cc:237] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.006629 19869 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:25.038985 19675 raft_consensus.cc:2468] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:25.039546 19661 tablet_service.cc:1511] Processing CreateTablet for tablet d7c81f67e1574e8eb631a5176b7276f9 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:25.051764 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c81f67e1574e8eb631a5176b7276f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.066524 19788 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:25.068737 19869 raft_consensus.cc:2804] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.069362 19869 raft_consensus.cc:697] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:25.070290 19869 consensus_queue.cc:237] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.082446 19864 tablet_bootstrap.cc:492] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:25.083161 19864 ts_tablet_manager.cc:1403] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.027s
I20260709 12:13:25.083954 19739 tablet_service.cc:1511] Processing CreateTablet for tablet d7c81f67e1574e8eb631a5176b7276f9 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:25.086349 19864 raft_consensus.cc:359] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:13:25.086961 19865 tablet_bootstrap.cc:492] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:25.087179 19864 raft_consensus.cc:385] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.077178 19867 tablet_bootstrap.cc:654] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.087460 19865 ts_tablet_manager.cc:1403] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.156s	user 0.018s	sys 0.009s
I20260709 12:13:25.088712 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c81f67e1574e8eb631a5176b7276f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.087486 19864 raft_consensus.cc:740] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.095175 19865 raft_consensus.cc:359] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.096169 19865 raft_consensus.cc:385] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.096521 19865 raft_consensus.cc:740] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.097587 19865 consensus_queue.cc:260] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.101625 19806 tablet_service.cc:1511] Processing CreateTablet for tablet d7c81f67e1574e8eb631a5176b7276f9 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:25.103168 19806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c81f67e1574e8eb631a5176b7276f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.089737 19864 consensus_queue.cc:260] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:13:25.108496 19865 ts_tablet_manager.cc:1434] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:13:25.109138 19864 ts_tablet_manager.cc:1434] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:13:25.099231 19573 catalog_manager.cc:5697] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.114624 19865 tablet_bootstrap.cc:492] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:25.109290 19664 tablet_service.cc:1511] Processing CreateTablet for tablet a2ba1229768c4d258720bb3492dde33d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:25.117702 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ba1229768c4d258720bb3492dde33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.122483 19814 tablet_service.cc:1511] Processing CreateTablet for tablet a2ba1229768c4d258720bb3492dde33d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:25.122687 19571 catalog_manager.cc:5697] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.124809 19665 tablet_service.cc:1511] Processing CreateTablet for tablet c56f5017d25a447ab75b3f0cb650c9e6 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:25.129133 19740 tablet_service.cc:1511] Processing CreateTablet for tablet a2ba1229768c4d258720bb3492dde33d (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:25.130811 19871 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.131379 19871 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.133508 19871 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:25.137113 19665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56f5017d25a447ab75b3f0cb650c9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.137679 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:25.141618 19824 raft_consensus.cc:2468] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:25.142160 19865 tablet_bootstrap.cc:654] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.142942 19737 tablet_service.cc:1511] Processing CreateTablet for tablet c56f5017d25a447ab75b3f0cb650c9e6 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:25.143247 19638 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:25.144907 19871 raft_consensus.cc:2804] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:25.145577 19871 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.146067 19871 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.149492 19812 tablet_service.cc:1511] Processing CreateTablet for tablet c56f5017d25a447ab75b3f0cb650c9e6 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:25.138266 19864 tablet_bootstrap.cc:492] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:25.138726 19814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ba1229768c4d258720bb3492dde33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.157195 19887 consensus_queue.cc:1048] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:25.139348 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ba1229768c4d258720bb3492dde33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.140885 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:13:25.164876 19640 leader_election.cc:343] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.169140 19812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56f5017d25a447ab75b3f0cb650c9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.175223 19737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56f5017d25a447ab75b3f0cb650c9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.188977 19664 tablet_service.cc:1511] Processing CreateTablet for tablet 65e1443af427414db7bbd4a4be3fa074 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:25.190653 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e1443af427414db7bbd4a4be3fa074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.193756 19867 tablet_bootstrap.cc:492] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:25.194667 19867 ts_tablet_manager.cc:1403] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.211s	user 0.025s	sys 0.013s
I20260709 12:13:25.193331 19871 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.198441 19867 raft_consensus.cc:359] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.238087 19867 raft_consensus.cc:385] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.235781 19887 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.240716 19887 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.238628 19867 raft_consensus.cc:740] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.244143 19887 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:25.244405 19867 consensus_queue.cc:260] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.245141 19733 tablet_service.cc:1511] Processing CreateTablet for tablet 65e1443af427414db7bbd4a4be3fa074 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:25.246091 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:25.246547 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e1443af427414db7bbd4a4be3fa074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.247241 19867 ts_tablet_manager.cc:1434] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.016s
W20260709 12:13:25.247653 19713 leader_election.cc:343] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.248489 19867 tablet_bootstrap.cc:492] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:25.248234 19811 tablet_service.cc:1511] Processing CreateTablet for tablet f055e0ff3254433f83caca3e0e190a4c (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:25.249610 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f055e0ff3254433f83caca3e0e190a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.250182 19809 tablet_service.cc:1511] Processing CreateTablet for tablet 65e1443af427414db7bbd4a4be3fa074 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:25.250259 19808 tablet_service.cc:1511] Processing CreateTablet for tablet 26992be39c764bb3bc020dd42bc74a55 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:25.259984 19807 tablet_service.cc:1511] Processing CreateTablet for tablet e46881c3a8b942fcb904f98b7ac1716f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:25.265399 19810 tablet_service.cc:1511] Processing CreateTablet for tablet 9a2ad2622957437eae185bfda331f538 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:25.265978 19808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26992be39c764bb3bc020dd42bc74a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.266963 19810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a2ad2622957437eae185bfda331f538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.276855 19813 tablet_service.cc:1511] Processing CreateTablet for tablet 62ed1b9937fd41ab83a0000603a38fc9 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:25.277158 19871 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:25.278374 19813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ed1b9937fd41ab83a0000603a38fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.285197 19664 tablet_service.cc:1511] Processing CreateTablet for tablet f055e0ff3254433f83caca3e0e190a4c (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:25.287256 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f055e0ff3254433f83caca3e0e190a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.287508 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:25.288174 19824 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.291422 19867 tablet_bootstrap.cc:654] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.292194 19658 tablet_service.cc:1511] Processing CreateTablet for tablet 26992be39c764bb3bc020dd42bc74a55 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:25.293211 19663 tablet_service.cc:1511] Processing CreateTablet for tablet 9a2ad2622957437eae185bfda331f538 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:25.293890 19658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26992be39c764bb3bc020dd42bc74a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.294654 19663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a2ad2622957437eae185bfda331f538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.295821 19662 tablet_service.cc:1511] Processing CreateTablet for tablet e46881c3a8b942fcb904f98b7ac1716f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:25.298306 19657 tablet_service.cc:1511] Processing CreateTablet for tablet b65b6b06871344a9bd4bbd3e34b99502 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:25.315089 19871 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.315693 19657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65b6b06871344a9bd4bbd3e34b99502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.298992 19869 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.334662 19869 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.337277 19869 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:25.324013 19864 tablet_bootstrap.cc:700] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent opening tablet: real 0.122s	user 0.001s	sys 0.007s
I20260709 12:13:25.340600 19662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e46881c3a8b942fcb904f98b7ac1716f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.315653 19871 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.339362 19809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e1443af427414db7bbd4a4be3fa074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.348373 19864 tablet_bootstrap.cc:654] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.349750 19871 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:25.298019 19660 tablet_service.cc:1511] Processing CreateTablet for tablet 1fed9282bd954e378bf04bb924e3e716 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:25.351157 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:25.351872 19823 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:25.353348 19638 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:25.348176 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:25.355258 19788 leader_election.cc:343] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.351997 19660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fed9282bd954e378bf04bb924e3e716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.295207 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:25.357323 19807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e46881c3a8b942fcb904f98b7ac1716f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.358008 19814 tablet_service.cc:1511] Processing CreateTablet for tablet b65b6b06871344a9bd4bbd3e34b99502 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:25.359059 19871 raft_consensus.cc:2804] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:25.359380 19814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65b6b06871344a9bd4bbd3e34b99502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.296931 19659 tablet_service.cc:1511] Processing CreateTablet for tablet 62ed1b9937fd41ab83a0000603a38fc9 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:25.360677 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ed1b9937fd41ab83a0000603a38fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.359483 19871 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.362982 19871 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.367738 19911 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.368266 19911 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:25.372306 19640 leader_election.cc:343] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.373759 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:13:25.383177 19640 leader_election.cc:343] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.385596 19865 tablet_bootstrap.cc:492] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:25.386164 19865 ts_tablet_manager.cc:1403] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.272s	user 0.029s	sys 0.017s
W20260709 12:13:25.330608 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 88367.4us
I20260709 12:13:25.376456 19911 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:25.299988 19805 tablet_service.cc:1511] Processing CreateTablet for tablet 1fed9282bd954e378bf04bb924e3e716 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:25.396170 19805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fed9282bd954e378bf04bb924e3e716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.390689 19869 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.398434 19869 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:13:25.400588 19869 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:25.402680 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:25.404299 19664 tablet_service.cc:1511] Processing CreateTablet for tablet 31e10328bf7c47c599ca08bbced8fe7e (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:25.404633 19661 tablet_service.cc:1511] Processing CreateTablet for tablet cf852411f79143c4b7d9d087e57902ee (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:25.406162 19661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf852411f79143c4b7d9d087e57902ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.406575 19656 tablet_service.cc:1511] Processing CreateTablet for tablet 1a16e4dda0004683a44ee0708e576b6a (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:25.408001 19656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a16e4dda0004683a44ee0708e576b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.408680 19867 tablet_bootstrap.cc:492] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:25.409219 19867 ts_tablet_manager.cc:1403] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.161s	user 0.012s	sys 0.014s
I20260709 12:13:25.410717 19664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e10328bf7c47c599ca08bbced8fe7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.389986 19824 raft_consensus.cc:2468] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:13:25.412493 19810 tablet_service.cc:1511] Processing CreateTablet for tablet 31e10328bf7c47c599ca08bbced8fe7e (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:25.412753 19638 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:25.414036 19810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e10328bf7c47c599ca08bbced8fe7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.414280 19899 raft_consensus.cc:2804] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.416177 19665 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca66c6318754a02b1dc2218db00b004 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:25.417521 19665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca66c6318754a02b1dc2218db00b004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.417670 19806 tablet_service.cc:1511] Processing CreateTablet for tablet cf852411f79143c4b7d9d087e57902ee (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:25.417532 19811 tablet_service.cc:1511] Processing CreateTablet for tablet 1a16e4dda0004683a44ee0708e576b6a (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:25.419230 19806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf852411f79143c4b7d9d087e57902ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.420308 19811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a16e4dda0004683a44ee0708e576b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.420449 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:25.421241 19750 raft_consensus.cc:2468] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:25.421695 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:25.380173 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:25.423327 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:25.424413 19823 raft_consensus.cc:2393] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 1: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:13:25.428028 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:25.445708 19739 tablet_service.cc:1511] Processing CreateTablet for tablet f055e0ff3254433f83caca3e0e190a4c (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:25.452409 19812 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca66c6318754a02b1dc2218db00b004 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:25.453835 19812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca66c6318754a02b1dc2218db00b004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.457747 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f055e0ff3254433f83caca3e0e190a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.458105 19871 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.465689 19871 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:25.425065 19867 raft_consensus.cc:359] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.473968 19657 tablet_service.cc:1511] Processing CreateTablet for tablet 0057355e85a74bfa9919f82a00f3fecc (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:25.474089 19813 tablet_service.cc:1511] Processing CreateTablet for tablet 0057355e85a74bfa9919f82a00f3fecc (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:25.475425 19657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0057355e85a74bfa9919f82a00f3fecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.475536 19813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0057355e85a74bfa9919f82a00f3fecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.463770 19865 raft_consensus.cc:359] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.483248 19865 raft_consensus.cc:385] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.483632 19865 raft_consensus.cc:740] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.485227 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:25.485878 19823 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.488987 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:13:25.490396 19640 leader_election.cc:343] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.491259 19750 raft_consensus.cc:3060] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.484485 19865 consensus_queue.cc:260] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.502909 19871 consensus_queue.cc:1048] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:13:25.512166 19740 tablet_service.cc:1511] Processing CreateTablet for tablet 26992be39c764bb3bc020dd42bc74a55 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:25.513649 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26992be39c764bb3bc020dd42bc74a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.471426 19867 raft_consensus.cc:385] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.514324 19867 raft_consensus.cc:740] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.520219 19867 consensus_queue.cc:260] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.521770 19864 tablet_bootstrap.cc:492] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:25.522308 19864 ts_tablet_manager.cc:1403] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.384s	user 0.014s	sys 0.007s
I20260709 12:13:25.529312 19810 tablet_service.cc:1511] Processing CreateTablet for tablet 20afb18f0c024945ab458d1b8f6c62aa (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:25.529731 19864 raft_consensus.cc:359] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.530869 19810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20afb18f0c024945ab458d1b8f6c62aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.532560 19737 tablet_service.cc:1511] Processing CreateTablet for tablet 9a2ad2622957437eae185bfda331f538 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:25.532887 19735 tablet_service.cc:1511] Processing CreateTablet for tablet 62ed1b9937fd41ab83a0000603a38fc9 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:25.533914 19737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a2ad2622957437eae185bfda331f538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.534539 19735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ed1b9937fd41ab83a0000603a38fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.540325 19736 tablet_service.cc:1511] Processing CreateTablet for tablet 1fed9282bd954e378bf04bb924e3e716 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:25.534648 19865 ts_tablet_manager.cc:1434] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.148s	user 0.008s	sys 0.000s
I20260709 12:13:25.541680 19736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fed9282bd954e378bf04bb924e3e716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.545595 19789 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:25.545769 19732 tablet_service.cc:1511] Processing CreateTablet for tablet cf852411f79143c4b7d9d087e57902ee (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:25.543751 19734 tablet_service.cc:1511] Processing CreateTablet for tablet b65b6b06871344a9bd4bbd3e34b99502 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:25.523561 19659 tablet_service.cc:1511] Processing CreateTablet for tablet 20afb18f0c024945ab458d1b8f6c62aa (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:25.544569 19731 tablet_service.cc:1511] Processing CreateTablet for tablet 1a16e4dda0004683a44ee0708e576b6a (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:25.530556 19864 raft_consensus.cc:385] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.543771 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 31e10328bf7c47c599ca08bbced8fe7e (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:25.548774 19732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf852411f79143c4b7d9d087e57902ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.549777 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e10328bf7c47c599ca08bbced8fe7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.546864 19869 raft_consensus.cc:2804] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:25.550385 19869 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.550721 19869 raft_consensus.cc:3060] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.552243 19864 raft_consensus.cc:740] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.554979 19864 consensus_queue.cc:260] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.555791 19659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20afb18f0c024945ab458d1b8f6c62aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.555194 19734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65b6b06871344a9bd4bbd3e34b99502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.555713 19898 consensus_queue.cc:1048] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:25.507084 19899 raft_consensus.cc:697] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:25.561618 19899 consensus_queue.cc:237] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.548059 19739 tablet_service.cc:1511] Processing CreateTablet for tablet e46881c3a8b942fcb904f98b7ac1716f (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:25.566819 19731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a16e4dda0004683a44ee0708e576b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.568193 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e46881c3a8b942fcb904f98b7ac1716f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.573789 19824 raft_consensus.cc:3060] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.565459 19867 ts_tablet_manager.cc:1434] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.156s	user 0.008s	sys 0.004s
I20260709 12:13:25.588953 19898 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.579051 19789 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:25.623188 19865 tablet_bootstrap.cc:492] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:25.636767 19869 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.647341 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 5ca66c6318754a02b1dc2218db00b004 (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:25.651041 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ca66c6318754a02b1dc2218db00b004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.663491 19867 tablet_bootstrap.cc:492] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:25.675525 19733 tablet_service.cc:1511] Processing CreateTablet for tablet 20afb18f0c024945ab458d1b8f6c62aa (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:25.677122 19733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20afb18f0c024945ab458d1b8f6c62aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.619822 19714 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:25.679693 19887 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:25.679913 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 68065.1us
I20260709 12:13:25.678969 19823 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
W20260709 12:13:25.680873 19714 leader_election.cc:343] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.681447 19714 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:25.682579 19887 raft_consensus.cc:2749] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:25.691751 19887 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.692478 19887 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.697822 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:25.699041 19822 raft_consensus.cc:2393] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 1: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:13:25.699986 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:25.700685 19887 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:25.629026 19898 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.707451 19898 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:25.707377 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:25.708920 19675 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:25.711035 19788 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:25.713541 19714 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:25.722508 19869 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:25.723474 19887 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.734254 19887 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:25.746196 19865 tablet_bootstrap.cc:654] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.766609 19867 tablet_bootstrap.cc:654] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.780174 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 0057355e85a74bfa9919f82a00f3fecc (DEFAULT_TABLE table=test-workload [id=831db38b38d04314a1d3345bb96f0999]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:25.781785 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0057355e85a74bfa9919f82a00f3fecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.766937 19898 raft_consensus.cc:2804] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:25.787125 19898 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.787637 19898 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.807154 19864 ts_tablet_manager.cc:1434] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.281s	user 0.012s	sys 0.022s
W20260709 12:13:25.804883 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 93979us
W20260709 12:13:25.824707 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 245786us
I20260709 12:13:25.835494 19638 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:25.836961 19912 raft_consensus.cc:2804] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.837484 19912 raft_consensus.cc:697] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:25.838277 19912 consensus_queue.cc:237] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.828836 19898 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.832567 19864 tablet_bootstrap.cc:492] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:25.833259 19570 catalog_manager.cc:5697] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.849396 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:25.850240 19750 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:25.849535 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:13:25.853439 19788 leader_election.cc:343] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:25.860426 19864 tablet_bootstrap.cc:654] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:25.864020 19789 consensus_peers.cc:597] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.849396 19865 tablet_bootstrap.cc:492] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:25.865135 19865 ts_tablet_manager.cc:1403] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.270s	user 0.013s	sys 0.015s
I20260709 12:13:25.847652 19867 tablet_bootstrap.cc:492] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:25.866289 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:25.870158 19898 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:25.872442 19750 raft_consensus.cc:3060] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.872916 19867 ts_tablet_manager.cc:1403] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.235s	user 0.016s	sys 0.008s
I20260709 12:13:25.875000 19925 consensus_queue.cc:1048] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:13:25.874332 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:25.878331 19674 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.878401 19867 raft_consensus.cc:359] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.879458 19869 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:25.881198 19865 raft_consensus.cc:359] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.882139 19865 raft_consensus.cc:385] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.882520 19865 raft_consensus.cc:740] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.883594 19865 consensus_queue.cc:260] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.884130 19750 raft_consensus.cc:2468] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:25.892829 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:25.879475 19867 raft_consensus.cc:385] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.893733 19749 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.893839 19867 raft_consensus.cc:740] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.895226 19867 consensus_queue.cc:260] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.902885 19867 ts_tablet_manager.cc:1434] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:13:25.904255 19867 tablet_bootstrap.cc:492] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:25.910336 19789 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:25.911527 19865 ts_tablet_manager.cc:1434] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 12:13:25.914141 19865 tablet_bootstrap.cc:492] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:25.914826 19749 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:25.919903 19869 raft_consensus.cc:2804] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.920549 19869 raft_consensus.cc:697] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:25.921566 19869 consensus_queue.cc:237] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.923686 19871 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.924399 19871 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.930217 19789 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:25.931788 19871 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:25.935456 19898 raft_consensus.cc:2804] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.936297 19898 raft_consensus.cc:697] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:25.937536 19898 consensus_queue.cc:237] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.938882 19864 tablet_bootstrap.cc:492] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:25.939461 19864 ts_tablet_manager.cc:1403] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.020s
I20260709 12:13:25.945271 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:25.947690 19749 raft_consensus.cc:2393] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:13:25.949625 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:25.951134 19674 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:25.952036 19864 raft_consensus.cc:359] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.952723 19864 raft_consensus.cc:385] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.952977 19864 raft_consensus.cc:740] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.954068 19867 tablet_bootstrap.cc:654] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.955407 19638 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:25.956612 19871 raft_consensus.cc:3060] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.954530 19864 consensus_queue.cc:260] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.960269 19865 tablet_bootstrap.cc:654] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.964882 19864 ts_tablet_manager.cc:1434] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:13:25.977855 19864 tablet_bootstrap.cc:492] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:25.986374 19864 tablet_bootstrap.cc:654] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:25.978734 19871 raft_consensus.cc:2749] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:25.991285 19867 tablet_bootstrap.cc:492] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:25.991947 19867 ts_tablet_manager.cc:1403] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.007s
I20260709 12:13:25.993795 19571 catalog_manager.cc:5697] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.996047 19867 raft_consensus.cc:359] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:25.997156 19867 raft_consensus.cc:385] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:25.997772 19867 raft_consensus.cc:740] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:25.997093 19571 catalog_manager.cc:5697] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.000365 19865 tablet_bootstrap.cc:492] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:26.003305 19867 consensus_queue.cc:260] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.004061 19865 ts_tablet_manager.cc:1403] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.090s	user 0.033s	sys 0.005s
I20260709 12:13:26.006866 19865 raft_consensus.cc:359] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.007692 19865 raft_consensus.cc:385] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.008461 19865 raft_consensus.cc:740] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.009410 19865 consensus_queue.cc:260] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.012087 19865 ts_tablet_manager.cc:1434] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:26.013278 19865 tablet_bootstrap.cc:492] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
W20260709 12:13:26.014633 19621 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:26.018294 19867 ts_tablet_manager.cc:1434] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 12:13:26.019551 19867 tablet_bootstrap.cc:492] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:26.020206 19865 tablet_bootstrap.cc:654] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.025467 19573 catalog_manager.cc:5697] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.032648 19867 tablet_bootstrap.cc:654] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.042253 19898 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.043156 19898 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.045995 19867 tablet_bootstrap.cc:492] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:26.047737 19864 tablet_bootstrap.cc:492] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:26.046958 19867 ts_tablet_manager.cc:1403] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.005s
I20260709 12:13:26.047783 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:26.048463 19864 ts_tablet_manager.cc:1403] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.002s
I20260709 12:13:26.048907 19674 raft_consensus.cc:2468] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:26.050674 19887 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.051103 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:26.051246 19887 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.052078 19864 raft_consensus.cc:359] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.052404 19749 raft_consensus.cc:2468] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:26.053047 19864 raft_consensus.cc:385] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.053366 19864 raft_consensus.cc:740] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.054270 19864 consensus_queue.cc:260] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.054934 19887 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:26.055927 19789 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:26.055850 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:26.057096 19864 ts_tablet_manager.cc:1434] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:26.058238 19864 tablet_bootstrap.cc:492] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:26.061828 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:26.063019 19824 raft_consensus.cc:2393] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 1: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:13:26.057121 19869 raft_consensus.cc:2804] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.057825 19867 raft_consensus.cc:359] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.064020 19869 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.064342 19867 raft_consensus.cc:385] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.064903 19864 tablet_bootstrap.cc:654] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.065459 19713 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:26.065999 19898 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:26.064422 19869 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.071817 19887 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.084218 19869 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.085634 19867 raft_consensus.cc:740] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.087126 19869 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:26.087891 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:26.088599 19674 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.087342 19867 consensus_queue.cc:260] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.091706 19887 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:26.093778 19867 ts_tablet_manager.cc:1434] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.005s
I20260709 12:13:26.089813 19865 tablet_bootstrap.cc:492] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:26.094977 19865 ts_tablet_manager.cc:1403] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.026s
I20260709 12:13:26.095222 19871 consensus_queue.cc:1048] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.099644 19674 raft_consensus.cc:2468] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:26.099340 19865 raft_consensus.cc:359] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.100328 19865 raft_consensus.cc:385] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.100741 19865 raft_consensus.cc:740] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.101760 19865 consensus_queue.cc:260] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.105954 19869 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.106593 19869 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.109485 19869 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:26.109624 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:26.109949 19867 tablet_bootstrap.cc:492] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
W20260709 12:13:26.111353 19788 leader_election.cc:343] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:26.112038 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 44918.9us
I20260709 12:13:26.113005 19865 ts_tablet_manager.cc:1434] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:13:26.114187 19865 tablet_bootstrap.cc:492] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:26.115404 19749 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.119880 19864 tablet_bootstrap.cc:492] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:26.120445 19864 ts_tablet_manager.cc:1403] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.031s
I20260709 12:13:26.120608 19865 tablet_bootstrap.cc:654] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.122537 19867 tablet_bootstrap.cc:654] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.123755 19864 raft_consensus.cc:359] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.124583 19864 raft_consensus.cc:385] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.124948 19864 raft_consensus.cc:740] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.126420 19864 consensus_queue.cc:260] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.127743 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:26.128279 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:26.150868 19750 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.150928 19748 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:26.130729 19864 ts_tablet_manager.cc:1434] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:13:26.152724 19864 tablet_bootstrap.cc:492] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:26.139022 19788 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:26.156741 19871 consensus_queue.cc:1048] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.165930 19864 tablet_bootstrap.cc:654] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.159051 19898 raft_consensus.cc:2804] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.167491 19898 raft_consensus.cc:697] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:26.168354 19898 consensus_queue.cc:237] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.175464 19789 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:26.176826 19869 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.177187 19869 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.177538 19869 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.187042 19750 raft_consensus.cc:2468] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:26.192942 19869 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.196394 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:13:26.199580 19788 leader_election.cc:343] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.203864 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:26.205360 19869 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:26.220098 19867 tablet_bootstrap.cc:492] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:26.220839 19869 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.221122 19867 ts_tablet_manager.cc:1403] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.111s	user 0.020s	sys 0.004s
I20260709 12:13:26.221517 19869 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.222978 19750 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.229583 19865 tablet_bootstrap.cc:492] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:26.230226 19865 ts_tablet_manager.cc:1403] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.116s	user 0.048s	sys 0.016s
I20260709 12:13:26.231846 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:26.232461 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:26.233553 19789 leader_election.cc:343] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:26.234393 19788 leader_election.cc:343] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.235821 19788 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:26.237881 19867 raft_consensus.cc:359] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.239007 19865 raft_consensus.cc:359] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.240480 19867 raft_consensus.cc:385] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.240531 19865 raft_consensus.cc:385] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.241012 19867 raft_consensus.cc:740] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.231405 19869 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:26.241050 19865 raft_consensus.cc:740] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.242120 19867 consensus_queue.cc:260] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.242509 19865 consensus_queue.cc:260] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.244484 19898 raft_consensus.cc:2749] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:26.244710 19867 ts_tablet_manager.cc:1434] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 12:13:26.245532 19865 ts_tablet_manager.cc:1434] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:13:26.246524 19865 tablet_bootstrap.cc:492] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:26.252674 19572 catalog_manager.cc:5697] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.255632 19864 tablet_bootstrap.cc:492] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:26.256134 19864 ts_tablet_manager.cc:1403] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.020s
I20260709 12:13:26.257332 19867 tablet_bootstrap.cc:492] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:26.260043 19864 raft_consensus.cc:359] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.260856 19864 raft_consensus.cc:385] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.261169 19864 raft_consensus.cc:740] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.262096 19864 consensus_queue.cc:260] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.266748 19865 tablet_bootstrap.cc:654] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.256870 19750 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:26.269289 19864 ts_tablet_manager.cc:1434] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:13:26.269140 19789 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:26.270455 19864 tablet_bootstrap.cc:492] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:26.270610 19898 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.271574 19867 tablet_bootstrap.cc:654] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.271590 19898 raft_consensus.cc:697] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:26.273358 19898 consensus_queue.cc:237] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.279230 19864 tablet_bootstrap.cc:654] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.290225 19867 tablet_bootstrap.cc:492] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:26.290753 19867 ts_tablet_manager.cc:1403] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.002s
I20260709 12:13:26.290970 19865 tablet_bootstrap.cc:492] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:26.291399 19865 ts_tablet_manager.cc:1403] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.000s
I20260709 12:13:26.294721 19865 raft_consensus.cc:359] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.295480 19865 raft_consensus.cc:385] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.296037 19865 raft_consensus.cc:740] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.295212 19572 catalog_manager.cc:5697] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.297040 19865 consensus_queue.cc:260] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.300824 19867 raft_consensus.cc:359] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.303395 19864 tablet_bootstrap.cc:492] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:26.303458 19865 ts_tablet_manager.cc:1434] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:13:26.304315 19864 ts_tablet_manager.cc:1403] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.011s
I20260709 12:13:26.304987 19865 tablet_bootstrap.cc:492] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:26.309243 19864 raft_consensus.cc:359] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.310305 19864 raft_consensus.cc:385] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.310665 19864 raft_consensus.cc:740] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.311586 19864 consensus_queue.cc:260] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.314129 19864 ts_tablet_manager.cc:1434] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:26.315342 19864 tablet_bootstrap.cc:492] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:26.322388 19865 tablet_bootstrap.cc:654] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.301608 19867 raft_consensus.cc:385] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.324173 19867 raft_consensus.cc:740] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.325526 19867 consensus_queue.cc:260] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.328408 19867 ts_tablet_manager.cc:1434] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 12:13:26.330539 19867 tablet_bootstrap.cc:492] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:26.332023 19864 tablet_bootstrap.cc:654] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.334483 19898 consensus_queue.cc:1048] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.337299 19867 tablet_bootstrap.cc:654] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.338279 19871 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.348093 19867 tablet_bootstrap.cc:492] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:26.347271 19871 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.341219 19865 tablet_bootstrap.cc:492] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:26.349735 19865 ts_tablet_manager.cc:1403] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.003s
I20260709 12:13:26.350075 19871 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:26.351984 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:26.352757 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:26.353356 19823 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:26.353282 19865 raft_consensus.cc:359] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:26.353430 19640 leader_election.cc:343] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.354270 19865 raft_consensus.cc:385] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.354609 19865 raft_consensus.cc:740] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.355010 19867 ts_tablet_manager.cc:1403] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.001s
I20260709 12:13:26.355082 19638 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:26.358700 19865 consensus_queue.cc:260] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.359782 19871 raft_consensus.cc:2804] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.360191 19871 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.360531 19871 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.361187 19865 ts_tablet_manager.cc:1434] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.007s
I20260709 12:13:26.362339 19865 tablet_bootstrap.cc:492] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:26.370474 19898 consensus_queue.cc:1048] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.372635 19864 tablet_bootstrap.cc:492] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:26.373842 19864 ts_tablet_manager.cc:1403] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.059s	user 0.005s	sys 0.015s
I20260709 12:13:26.374877 19871 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.359247 19867 raft_consensus.cc:359] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.376483 19867 raft_consensus.cc:385] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.376781 19867 raft_consensus.cc:740] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.377244 19864 raft_consensus.cc:359] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.378450 19864 raft_consensus.cc:385] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.378962 19864 raft_consensus.cc:740] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.380236 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:26.380350 19864 consensus_queue.cc:260] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:26.381829 19640 leader_election.cc:343] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.377521 19867 consensus_queue.cc:260] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.383175 19887 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.383772 19887 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.384325 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:26.384819 19867 ts_tablet_manager.cc:1434] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 12:13:26.384877 19823 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.385844 19887 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:26.386125 19867 tablet_bootstrap.cc:492] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:26.387881 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:26.389509 19713 leader_election.cc:343] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.390997 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:26.391680 19898 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:26.393615 19867 tablet_bootstrap.cc:654] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:26.393992 19714 leader_election.cc:343] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.394553 19714 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:26.395701 19942 raft_consensus.cc:2749] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:26.383195 19864 ts_tablet_manager.cc:1434] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.002s
I20260709 12:13:26.396798 19871 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:26.393985 19823 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:13:26.396998 19864 tablet_bootstrap.cc:492] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:26.370548 19865 tablet_bootstrap.cc:654] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.399358 19638 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:26.401607 19871 raft_consensus.cc:2804] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.429420 19871 raft_consensus.cc:697] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:26.432735 19871 consensus_queue.cc:237] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.461508 19920 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.469740 19925 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.491474 19898 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.493166 19898 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.506418 19925 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.507774 19864 tablet_bootstrap.cc:654] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.510016 19571 catalog_manager.cc:5697] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.512157 19898 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:26.516613 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:26.518586 19788 leader_election.cc:343] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.523109 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:26.524431 19748 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:26.548002 19789 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:26.563371 19898 raft_consensus.cc:2804] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.564095 19898 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.564481 19898 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.574364 19867 tablet_bootstrap.cc:492] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:26.575009 19867 ts_tablet_manager.cc:1403] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.189s	user 0.013s	sys 0.005s
I20260709 12:13:26.597867 19942 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.607084 19865 tablet_bootstrap.cc:492] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:26.607725 19865 ts_tablet_manager.cc:1403] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.246s	user 0.063s	sys 0.041s
I20260709 12:13:26.611836 19865 raft_consensus.cc:359] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.613559 19865 raft_consensus.cc:385] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.614507 19865 raft_consensus.cc:740] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.608569 19942 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.620702 19867 raft_consensus.cc:359] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.627795 19867 raft_consensus.cc:385] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.628559 19867 raft_consensus.cc:740] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.629019 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:26.632195 19675 raft_consensus.cc:2468] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:26.629634 19867 consensus_queue.cc:260] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.633445 19942 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:26.631248 19865 consensus_queue.cc:260] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.633957 19714 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:26.634953 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:26.635782 19824 raft_consensus.cc:2468] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:26.635185 19942 raft_consensus.cc:2804] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:26.636499 19942 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.636946 19942 raft_consensus.cc:3060] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.637077 19867 ts_tablet_manager.cc:1434] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.002s
I20260709 12:13:26.638651 19867 tablet_bootstrap.cc:492] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:26.639850 19864 tablet_bootstrap.cc:492] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:26.640432 19864 ts_tablet_manager.cc:1403] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.244s	user 0.030s	sys 0.013s
I20260709 12:13:26.635927 19865 ts_tablet_manager.cc:1434] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:13:26.643929 19864 raft_consensus.cc:359] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.644860 19864 raft_consensus.cc:385] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.645267 19864 raft_consensus.cc:740] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.646281 19864 consensus_queue.cc:260] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.649812 19864 ts_tablet_manager.cc:1434] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:13:26.651120 19864 tablet_bootstrap.cc:492] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:26.652181 19942 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.658677 19865 tablet_bootstrap.cc:492] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:26.669402 19674 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.661759 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:26.677856 19675 raft_consensus.cc:3060] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.678210 19864 tablet_bootstrap.cc:654] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.682526 19925 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.683146 19925 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.691488 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:26.692335 19824 raft_consensus.cc:3060] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.693046 19925 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:26.694471 19865 tablet_bootstrap.cc:654] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.694639 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:26.685273 19942 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:26.694933 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:13:26.697031 19638 leader_election.cc:343] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:26.697757 19640 leader_election.cc:343] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.698196 19640 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:26.705652 19871 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.699118 19925 raft_consensus.cc:2749] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:26.707018 19871 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.714068 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:26.716178 19871 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:26.701840 19898 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.720106 19920 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.721191 19898 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:26.724455 19867 tablet_bootstrap.cc:654] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.727056 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:26.726584 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:26.732009 19747 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:13:26.735742 19640 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:26.740909 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:26.741621 19747 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.741515 19675 raft_consensus.cc:2468] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:26.743836 19674 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.751951 19912 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:26.753567 19912 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:13:26.754083 19912 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.769438 19714 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:26.770634 19942 raft_consensus.cc:2804] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.771291 19942 raft_consensus.cc:697] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:26.772217 19942 consensus_queue.cc:237] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.773965 19920 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.749876 19824 raft_consensus.cc:2468] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:26.781252 19865 tablet_bootstrap.cc:492] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:26.781926 19865 ts_tablet_manager.cc:1403] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.012s
I20260709 12:13:26.788149 19747 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:26.806264 19571 catalog_manager.cc:5697] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.799242 19789 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:26.824867 19864 tablet_bootstrap.cc:492] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:26.825493 19864 ts_tablet_manager.cc:1403] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.175s	user 0.019s	sys 0.013s
I20260709 12:13:26.820439 19898 raft_consensus.cc:2804] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:26.827541 19898 raft_consensus.cc:697] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:26.832571 19920 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.834386 19898 consensus_queue.cc:237] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.835151 19867 tablet_bootstrap.cc:492] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:26.827920 19912 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.840637 19912 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:26.843461 19673 raft_consensus.cc:1240] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:26.846377 19920 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.847201 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:26.870314 19864 raft_consensus.cc:359] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.871184 19864 raft_consensus.cc:385] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.871472 19864 raft_consensus.cc:740] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.872746 19867 ts_tablet_manager.cc:1403] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.234s	user 0.015s	sys 0.012s
I20260709 12:13:26.873451 19864 consensus_queue.cc:260] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.877023 19864 ts_tablet_manager.cc:1434] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 12:13:26.878705 19869 consensus_queue.cc:1059] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:26.889228 19864 tablet_bootstrap.cc:492] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:26.891359 19865 raft_consensus.cc:359] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.893344 19865 raft_consensus.cc:385] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.893841 19865 raft_consensus.cc:740] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.894928 19865 consensus_queue.cc:260] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.908605 19865 ts_tablet_manager.cc:1434] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.126s	user 0.009s	sys 0.003s
I20260709 12:13:26.910029 19865 tablet_bootstrap.cc:492] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:26.899560 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:13:26.916424 19977 log.cc:927] Time spent T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:13:26.919164 19640 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:26.921375 19871 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:26.918445 19867 raft_consensus.cc:359] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.926730 19867 raft_consensus.cc:385] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:26.927194 19867 raft_consensus.cc:740] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:26.929077 19867 consensus_queue.cc:260] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.927968 19674 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:26.933187 19898 raft_consensus.cc:3055] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.933903 19898 raft_consensus.cc:740] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:26.936736 19867 ts_tablet_manager.cc:1434] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.004s
I20260709 12:13:26.937801 19867 tablet_bootstrap.cc:492] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:26.940032 19898 consensus_queue.cc:260] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.943151 19865 tablet_bootstrap.cc:654] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.944427 19981 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.945000 19981 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.948033 19749 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:26.953253 19864 tablet_bootstrap.cc:654] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.962285 19981 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:26.962580 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:26.963665 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:13:26.967720 19788 leader_election.cc:343] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:26.968433 19789 leader_election.cc:343] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.968986 19789 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:26.970505 19981 raft_consensus.cc:2749] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:26.973834 19867 tablet_bootstrap.cc:654] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:26.974596 19983 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.975174 19983 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:26.975020 19573 catalog_manager.cc:5697] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.981837 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:26.981940 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:26.984087 19713 leader_election.cc:343] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:26.985571 19714 leader_election.cc:343] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:26.986199 19714 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:26.984930 19898 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.993532 19865 tablet_bootstrap.cc:492] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:26.994037 19865 ts_tablet_manager.cc:1403] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.084s	user 0.021s	sys 0.009s
I20260709 12:13:26.989657 19942 raft_consensus.cc:2749] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:26.984839 19983 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:27.041136 19865 raft_consensus.cc:359] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.042090 19865 raft_consensus.cc:385] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.041746 19912 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:27.047123 19983 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.047840 19983 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.048120 19912 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:27.050433 19983 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:27.052035 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:27.054633 19867 tablet_bootstrap.cc:492] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:27.055245 19867 ts_tablet_manager.cc:1403] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.118s	user 0.004s	sys 0.015s
W20260709 12:13:27.055277 19621 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:27.056666 19865 raft_consensus.cc:740] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.059338 19867 raft_consensus.cc:359] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.060997 19867 raft_consensus.cc:385] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.061391 19867 raft_consensus.cc:740] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.062278 19867 consensus_queue.cc:260] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.063512 19864 tablet_bootstrap.cc:492] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:27.064046 19864 ts_tablet_manager.cc:1403] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.186s	user 0.015s	sys 0.003s
I20260709 12:13:27.052395 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:27.064229 19865 consensus_queue.cc:260] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.067868 19714 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:27.067996 19864 raft_consensus.cc:359] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.068696 19864 raft_consensus.cc:385] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.068729 19865 ts_tablet_manager.cc:1434] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.074s	user 0.003s	sys 0.005s
I20260709 12:13:27.068998 19864 raft_consensus.cc:740] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.069824 19864 consensus_queue.cc:260] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.072953 19864 ts_tablet_manager.cc:1434] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:27.073768 19865 tablet_bootstrap.cc:492] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:27.077890 19983 raft_consensus.cc:2749] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:27.079176 19867 ts_tablet_manager.cc:1434] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.004s
I20260709 12:13:27.079584 19864 tablet_bootstrap.cc:492] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:27.080222 19867 tablet_bootstrap.cc:492] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:27.095217 19864 tablet_bootstrap.cc:654] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.131378 19867 tablet_bootstrap.cc:654] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.134183 19864 tablet_bootstrap.cc:492] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:27.134806 19864 ts_tablet_manager.cc:1403] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.009s
I20260709 12:13:27.137604 19864 raft_consensus.cc:359] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.138322 19864 raft_consensus.cc:385] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.138615 19864 raft_consensus.cc:740] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.139878 19864 consensus_queue.cc:260] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.142480 19864 ts_tablet_manager.cc:1434] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:27.144057 19865 tablet_bootstrap.cc:654] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.148080 19864 tablet_bootstrap.cc:492] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:27.154052 19864 tablet_bootstrap.cc:654] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.157617 19867 tablet_bootstrap.cc:492] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:27.157814 19865 tablet_bootstrap.cc:492] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:27.158612 19981 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.159353 19867 ts_tablet_manager.cc:1403] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.079s	user 0.024s	sys 0.008s
I20260709 12:13:27.159324 19981 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.162468 19981 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:27.162578 19867 raft_consensus.cc:359] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.163221 19865 ts_tablet_manager.cc:1403] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.090s	user 0.010s	sys 0.006s
I20260709 12:13:27.163215 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:27.163843 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:27.164150 19748 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:27.164661 19673 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:27.165728 19789 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:27.163452 19867 raft_consensus.cc:385] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.166445 19867 raft_consensus.cc:740] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.167424 19981 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:27.167935 19981 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.166312 19865 raft_consensus.cc:359] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.167580 19867 consensus_queue.cc:260] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.168501 19865 raft_consensus.cc:385] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.169021 19865 raft_consensus.cc:740] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.169817 19865 consensus_queue.cc:260] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.170181 19867 ts_tablet_manager.cc:1434] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:27.171847 19865 ts_tablet_manager.cc:1434] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:27.171902 19867 tablet_bootstrap.cc:492] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:27.168385 19981 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.180081 19867 tablet_bootstrap.cc:654] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.181926 19864 tablet_bootstrap.cc:492] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:27.182588 19864 ts_tablet_manager.cc:1403] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.004s
I20260709 12:13:27.183451 19865 tablet_bootstrap.cc:492] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:27.189862 19865 tablet_bootstrap.cc:654] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.189570 19981 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.185663 19864 raft_consensus.cc:359] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.191640 19864 raft_consensus.cc:385] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.191921 19864 raft_consensus.cc:740] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.193300 19864 consensus_queue.cc:260] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.194856 19871 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.195415 19871 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.195523 19981 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:27.197683 19871 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:27.196121 19867 tablet_bootstrap.cc:492] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:27.197467 19864 ts_tablet_manager.cc:1434] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:13:27.198426 19867 ts_tablet_manager.cc:1403] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.001s
I20260709 12:13:27.199529 19864 tablet_bootstrap.cc:492] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:27.199813 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:27.200963 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:27.201714 19749 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.201413 19867 raft_consensus.cc:359] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.202229 19867 raft_consensus.cc:385] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:27.202174 19640 leader_election.cc:343] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:27.202634 19867 raft_consensus.cc:740] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.203405 19867 consensus_queue.cc:260] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.205174 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:27.206728 19674 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.208671 19864 tablet_bootstrap.cc:654] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.205751 19983 consensus_queue.cc:1048] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:27.215638 19749 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:27.205860 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:27.217414 19824 raft_consensus.cc:2468] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:27.219712 19789 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:27.220672 19981 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:27.221199 19981 raft_consensus.cc:697] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:27.221339 19638 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:27.222167 19981 consensus_queue.cc:237] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.221933 19674 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:27.223343 19973 raft_consensus.cc:2804] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:27.223778 19973 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.224112 19973 raft_consensus.cc:3060] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.224201 19942 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.224845 19942 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.225955 19867 ts_tablet_manager.cc:1434] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:13:27.227054 19867 tablet_bootstrap.cc:492] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:27.227468 19864 tablet_bootstrap.cc:492] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:27.228012 19864 ts_tablet_manager.cc:1403] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.000s
I20260709 12:13:27.228593 19887 consensus_queue.cc:1048] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:27.232035 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:27.233517 19867 tablet_bootstrap.cc:654] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:27.233620 19714 leader_election.cc:343] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:27.234756 19898 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.235388 19898 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.237766 19898 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:27.238104 19942 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:27.241703 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:27.242678 19822 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:27.243922 19864 raft_consensus.cc:359] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.244688 19864 raft_consensus.cc:385] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.244961 19864 raft_consensus.cc:740] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.248139 19713 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:27.251155 19942 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:27.251799 19942 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.252178 19942 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.252406 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:27.248240 19864 consensus_queue.cc:260] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.253401 19674 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:27.248651 19865 tablet_bootstrap.cc:492] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:27.254815 19865 ts_tablet_manager.cc:1403] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.001s
I20260709 12:13:27.255055 19788 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:27.256013 19981 raft_consensus.cc:2804] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:27.256479 19981 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.256871 19981 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.261788 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:27.262895 19864 ts_tablet_manager.cc:1434] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:13:27.267092 19864 tablet_bootstrap.cc:492] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:27.267048 19749 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:27.266904 19865 raft_consensus.cc:359] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.272449 19942 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.273118 19865 raft_consensus.cc:385] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.273715 19865 raft_consensus.cc:740] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.275032 19865 consensus_queue.cc:260] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.276109 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:27.276302 19981 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.276914 19674 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.277966 19867 tablet_bootstrap.cc:492] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:27.276214 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:27.278393 19865 ts_tablet_manager.cc:1434] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:13:27.278841 19822 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.280035 19865 tablet_bootstrap.cc:492] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:27.282819 19864 tablet_bootstrap.cc:654] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.280550 19981 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:27.280788 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:27.283522 19675 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.284788 19674 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:27.286175 19867 ts_tablet_manager.cc:1403] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.010s
I20260709 12:13:27.286069 19822 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:27.286332 19714 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:27.281544 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:27.287451 19887 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:27.288261 19887 raft_consensus.cc:697] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:27.289031 19867 raft_consensus.cc:359] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.289628 19867 raft_consensus.cc:385] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.289188 19887 consensus_queue.cc:237] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.289907 19867 raft_consensus.cc:740] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.290593 19867 consensus_queue.cc:260] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.292373 19867 ts_tablet_manager.cc:1434] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:13:27.293378 19867 tablet_bootstrap.cc:492] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:27.293895 19675 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:27.294903 19942 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:27.295351 19788 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:27.297641 19981 raft_consensus.cc:2804] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:27.299099 19981 raft_consensus.cc:697] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:27.300040 19981 consensus_queue.cc:237] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.303591 19867 tablet_bootstrap.cc:654] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.266672 19973 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.309180 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:27.309942 19748 raft_consensus.cc:3060] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.317780 19573 catalog_manager.cc:5697] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.320914 19864 tablet_bootstrap.cc:492] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:27.321535 19864 ts_tablet_manager.cc:1403] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.003s
I20260709 12:13:27.322374 19871 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.323220 19871 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.325197 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:27.325856 19871 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:27.325992 19822 raft_consensus.cc:3060] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.332087 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:27.333086 19824 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:27.335011 19638 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:27.336311 19967 consensus_queue.cc:1048] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:27.336858 19871 raft_consensus.cc:2804] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:27.337450 19871 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.337864 19871 raft_consensus.cc:3060] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.342001 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:27.343031 19747 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:27.351878 19967 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.351691 19864 raft_consensus.cc:359] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.352787 19864 raft_consensus.cc:385] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.352540 19967 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.353228 19864 raft_consensus.cc:740] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.354952 19871 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.355780 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:27.357327 19788 leader_election.cc:343] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:27.356323 19967 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:27.357812 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:27.358770 19747 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:27.360630 19789 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:27.361743 19967 raft_consensus.cc:2804] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:27.362303 19967 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.362671 19967 raft_consensus.cc:3060] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.364650 19871 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:27.362751 19748 raft_consensus.cc:2468] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:13:27.366425 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:27.367654 19824 raft_consensus.cc:3060] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.367203 19864 consensus_queue.cc:260] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.370203 19864 ts_tablet_manager.cc:1434] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.004s
I20260709 12:13:27.371510 19864 tablet_bootstrap.cc:492] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:27.372334 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:27.373036 19749 raft_consensus.cc:3060] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.376540 19824 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:13:27.376614 19967 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.378196 19638 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:27.379161 19871 raft_consensus.cc:2804] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:27.379663 19898 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.379951 19871 raft_consensus.cc:697] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:27.380182 19898 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.381215 19871 consensus_queue.cc:237] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.382448 19898 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:27.384918 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:27.386767 19788 leader_election.cc:343] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:27.388458 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:27.389622 19864 tablet_bootstrap.cc:654] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:27.390177 19789 leader_election.cc:343] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:27.390770 19789 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:27.390278 19571 catalog_manager.cc:5697] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.391958 19898 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:27.396368 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:13:27.397985 19788 leader_election.cc:343] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:27.366895 19973 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:27.407099 19920 consensus_queue.cc:1048] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:27.410188 19996 log.cc:927] Time spent T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:13:27.415580 19967 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:27.432219 19865 tablet_bootstrap.cc:654] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:27.438189 20004 log.cc:927] Time spent T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:27.440364 19640 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:27.440580 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:27.445179 19747 raft_consensus.cc:3060] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.447583 19749 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:13:27.450997 19973 raft_consensus.cc:2804] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:27.453379 19973 raft_consensus.cc:697] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:27.461653 19973 consensus_queue.cc:237] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.513986 19822 raft_consensus.cc:2468] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
W20260709 12:13:27.535650 20002 log.cc:927] Time spent T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
I20260709 12:13:27.553550 19867 tablet_bootstrap.cc:492] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:27.554085 19867 ts_tablet_manager.cc:1403] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.261s	user 0.061s	sys 0.144s
I20260709 12:13:27.556979 19867 raft_consensus.cc:359] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.557768 19867 raft_consensus.cc:385] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.558048 19867 raft_consensus.cc:740] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.508950 19571 catalog_manager.cc:5697] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.558964 19867 consensus_queue.cc:260] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.562978 19867 ts_tablet_manager.cc:1434] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:13:27.564247 19867 tablet_bootstrap.cc:492] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:27.568591 19864 tablet_bootstrap.cc:492] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:27.570600 19864 ts_tablet_manager.cc:1403] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.199s	user 0.010s	sys 0.009s
I20260709 12:13:27.571334 19867 tablet_bootstrap.cc:654] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.569818 19747 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:27.572948 19789 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:27.574249 19920 raft_consensus.cc:2804] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:27.574980 19920 raft_consensus.cc:697] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:27.575862 19920 consensus_queue.cc:237] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.580646 19865 tablet_bootstrap.cc:492] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:27.581346 19865 ts_tablet_manager.cc:1403] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.302s	user 0.019s	sys 0.000s
I20260709 12:13:27.585177 19865 raft_consensus.cc:359] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.586169 19865 raft_consensus.cc:385] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.589411 19864 raft_consensus.cc:359] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.594985 19864 raft_consensus.cc:385] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.596588 19864 raft_consensus.cc:740] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.594398 19572 catalog_manager.cc:5697] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.598053 19864 consensus_queue.cc:260] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.601949 19864 ts_tablet_manager.cc:1434] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 12:13:27.603221 19864 tablet_bootstrap.cc:492] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:27.586542 19865 raft_consensus.cc:740] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.617303 19920 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.617935 19920 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.618335 19865 consensus_queue.cc:260] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.620340 19920 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:27.621354 19865 ts_tablet_manager.cc:1434] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 12:13:27.622325 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:27.622920 19865 tablet_bootstrap.cc:492] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
W20260709 12:13:27.624491 19788 leader_election.cc:343] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:27.631388 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:13:27.633523 19789 leader_election.cc:343] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:27.634081 19789 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:27.634891 19920 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:27.649286 19572 catalog_manager.cc:5697] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.651098 19865 tablet_bootstrap.cc:654] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.652199 19867 tablet_bootstrap.cc:492] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:27.652863 19867 ts_tablet_manager.cc:1403] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.018s
I20260709 12:13:27.655120 19864 tablet_bootstrap.cc:654] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.656262 19867 raft_consensus.cc:359] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.657523 19867 raft_consensus.cc:385] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.657963 19867 raft_consensus.cc:740] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.659477 19867 consensus_queue.cc:260] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.668229 19571 catalog_manager.cc:5697] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.669019 19867 ts_tablet_manager.cc:1434] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 12:13:27.670187 19867 tablet_bootstrap.cc:492] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:27.673869 19920 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:27.695631 19920 consensus_queue.cc:1048] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:27.701833 20007 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.702351 20007 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.705782 20007 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:27.706982 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:27.708374 19749 raft_consensus.cc:2393] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:13:27.710201 19983 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.710886 19983 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.715835 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:27.719807 19714 leader_election.cc:343] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:27.720199 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:27.721237 19822 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:27.721765 19983 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:27.724491 19713 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:27.728477 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:27.730026 19749 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.730752 19638 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:27.732434 20007 raft_consensus.cc:3060] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.734565 19983 raft_consensus.cc:2804] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:27.735355 19983 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.735939 19983 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:27.742575 19920 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:27.761763 20007 raft_consensus.cc:2749] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:27.771896 19942 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:27.822467 20007 consensus_queue.cc:1048] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:27.845811 19871 consensus_queue.cc:1048] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:27.893740 19867 tablet_bootstrap.cc:654] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:27.903118 19942 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:27.930495 19981 consensus_queue.cc:1048] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:27.947885 19887 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.948417 19887 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.950551 19887 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:27.952178 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:27.954408 19983 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:27.956748 19714 leader_election.cc:343] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:27.957744 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:27.958667 19824 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:27.989732 19713 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:27.994004 19867 tablet_bootstrap.cc:492] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:27.994643 19867 ts_tablet_manager.cc:1403] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.325s	user 0.073s	sys 0.077s
I20260709 12:13:27.997494 19867 raft_consensus.cc:359] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:27.998270 19867 raft_consensus.cc:385] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:27.998556 19867 raft_consensus.cc:740] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:27.999397 19887 raft_consensus.cc:2804] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:27.999869 19887 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.000221 19887 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.000787 19867 consensus_queue.cc:260] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.001266 19898 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:28.003224 19867 ts_tablet_manager.cc:1434] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:13:28.004276 19867 tablet_bootstrap.cc:492] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:27.994004 19864 tablet_bootstrap.cc:492] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:28.005290 19864 ts_tablet_manager.cc:1403] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.402s	user 0.046s	sys 0.101s
I20260709 12:13:28.020780 19865 tablet_bootstrap.cc:492] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:28.021377 19865 ts_tablet_manager.cc:1403] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.399s	user 0.019s	sys 0.000s
I20260709 12:13:28.024341 19898 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:28.027073 19942 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.026316 19865 raft_consensus.cc:359] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.028009 19865 raft_consensus.cc:385] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.028462 19865 raft_consensus.cc:740] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.027896 19942 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.027161 19864 raft_consensus.cc:359] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.030224 19864 raft_consensus.cc:385] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.029403 19865 consensus_queue.cc:260] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.032800 19865 ts_tablet_manager.cc:1434] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:13:28.033429 19864 raft_consensus.cc:740] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.034468 19864 consensus_queue.cc:260] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.038012 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:28.038933 19824 raft_consensus.cc:2468] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:28.039553 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:28.036809 19942 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.040203 19713 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:28.043901 20007 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.043547 19871 consensus_queue.cc:1048] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:28.045729 20007 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.042603 19942 raft_consensus.cc:2804] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:28.048343 19942 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.049015 19942 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.051466 19865 tablet_bootstrap.cc:492] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:28.059237 19864 ts_tablet_manager.cc:1434] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 12:13:28.060720 19864 tablet_bootstrap.cc:492] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:28.063568 19973 consensus_queue.cc:1048] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:28.048243 20007 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.050189 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:28.070017 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:28.070384 19748 raft_consensus.cc:2393] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:28.073886 19672 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.078627 19867 tablet_bootstrap.cc:654] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.078881 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:28.080142 19714 leader_election.cc:343] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.081861 19983 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.081934 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:28.087287 19822 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:28.099202 19638 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:28.122329 19865 tablet_bootstrap.cc:654] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.124199 19672 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:28.125088 20007 raft_consensus.cc:2764] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:13:28.128664 19887 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.132822 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:28.133579 19822 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.135340 19887 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.151679 19714 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:28.162580 19887 raft_consensus.cc:2804] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:28.163223 19887 raft_consensus.cc:697] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:28.164132 19887 consensus_queue.cc:237] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.159137 19867 tablet_bootstrap.cc:492] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:28.170596 19867 ts_tablet_manager.cc:1403] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.167s	user 0.029s	sys 0.005s
I20260709 12:13:28.156569 19864 tablet_bootstrap.cc:654] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.177237 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:28.177696 19942 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.178460 19822 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:28.181734 19713 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:28.183317 19942 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.182989 19867 raft_consensus.cc:359] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.187623 19867 raft_consensus.cc:385] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.185559 20028 raft_consensus.cc:2804] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:28.188164 19867 raft_consensus.cc:740] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.188542 20028 raft_consensus.cc:697] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:28.189774 19867 consensus_queue.cc:260] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:28.184408 19714 leader_election.cc:343] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.193171 19867 ts_tablet_manager.cc:1434] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:13:28.194543 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:28.195353 19824 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.194555 19867 tablet_bootstrap.cc:492] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:28.201017 19942 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.204180 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:28.189836 20028 consensus_queue.cc:237] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.207712 19942 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:28.211716 19621 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:28.212906 19942 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.216517 19865 tablet_bootstrap.cc:492] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:28.217806 19865 ts_tablet_manager.cc:1403] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.005s
I20260709 12:13:28.217181 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:28.222730 19713 leader_election.cc:343] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.223615 19865 raft_consensus.cc:359] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.224547 19867 tablet_bootstrap.cc:654] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.224736 19865 raft_consensus.cc:385] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.225382 19864 tablet_bootstrap.cc:492] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:28.225876 19864 ts_tablet_manager.cc:1403] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.165s	user 0.007s	sys 0.015s
I20260709 12:13:28.225029 19865 raft_consensus.cc:740] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.227144 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:28.227478 19865 consensus_queue.cc:260] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.227914 19824 raft_consensus.cc:2468] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:28.229707 19713 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:28.234772 19942 raft_consensus.cc:2804] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:28.235636 19942 raft_consensus.cc:697] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:28.236624 19942 consensus_queue.cc:237] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:28.230525 19714 leader_election.cc:343] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:28.241283 19714 leader_election.cc:343] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.241792 19714 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:28.244833 19865 ts_tablet_manager.cc:1434] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:13:28.245994 19865 tablet_bootstrap.cc:492] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:28.247097 20028 raft_consensus.cc:2749] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:28.247174 19864 raft_consensus.cc:359] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.249909 19864 raft_consensus.cc:385] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.250458 19864 raft_consensus.cc:740] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.251288 19867 tablet_bootstrap.cc:492] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:28.251920 19867 ts_tablet_manager.cc:1403] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.004s
I20260709 12:13:28.251356 19864 consensus_queue.cc:260] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.255658 19865 tablet_bootstrap.cc:654] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.255250 19573 catalog_manager.cc:5697] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.257579 19573 catalog_manager.cc:5697] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.259024 19864 ts_tablet_manager.cc:1434] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:13:28.259943 19864 tablet_bootstrap.cc:492] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:28.265504 19867 raft_consensus.cc:359] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.266630 19867 raft_consensus.cc:385] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.267062 19867 raft_consensus.cc:740] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.268136 19867 consensus_queue.cc:260] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.276433 19865 tablet_bootstrap.cc:492] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:28.277170 19865 ts_tablet_manager.cc:1403] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.007s
I20260709 12:13:28.280578 19865 raft_consensus.cc:359] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.281622 19865 raft_consensus.cc:385] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.282006 19865 raft_consensus.cc:740] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.282863 19865 consensus_queue.cc:260] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.283763 19867 ts_tablet_manager.cc:1434] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:13:28.284526 19864 tablet_bootstrap.cc:654] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.285149 19867 tablet_bootstrap.cc:492] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:28.285380 19865 ts_tablet_manager.cc:1434] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:28.286502 19865 tablet_bootstrap.cc:492] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:28.293612 19867 tablet_bootstrap.cc:654] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.295116 19865 tablet_bootstrap.cc:654] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.308368 19864 tablet_bootstrap.cc:492] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:28.309038 19864 ts_tablet_manager.cc:1403] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.013s
I20260709 12:13:28.312569 19867 tablet_bootstrap.cc:492] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:28.313133 19867 ts_tablet_manager.cc:1403] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.001s
I20260709 12:13:28.315526 19864 raft_consensus.cc:359] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.316701 19867 raft_consensus.cc:359] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.317555 19867 raft_consensus.cc:385] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.317207 19864 raft_consensus.cc:385] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.317889 19867 raft_consensus.cc:740] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.318030 19864 raft_consensus.cc:740] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.319000 19867 consensus_queue.cc:260] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.321651 19865 tablet_bootstrap.cc:492] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:28.322433 19867 ts_tablet_manager.cc:1434] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:13:28.322654 19865 ts_tablet_manager.cc:1403] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.007s
I20260709 12:13:28.323340 19864 consensus_queue.cc:260] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.326623 19864 ts_tablet_manager.cc:1434] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 12:13:28.327561 19865 raft_consensus.cc:359] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.328429 19865 raft_consensus.cc:385] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.328732 19865 raft_consensus.cc:740] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.328111 19573 catalog_manager.cc:5697] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.329653 19865 consensus_queue.cc:260] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.332597 19865 ts_tablet_manager.cc:1434] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:13:28.333709 19865 tablet_bootstrap.cc:492] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:28.335747 19867 tablet_bootstrap.cc:492] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:28.337847 19942 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:13:28.338472 19942 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.343628 19867 tablet_bootstrap.cc:654] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.347725 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:28.348630 19672 raft_consensus.cc:2393] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 2: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:13:28.348997 19864 tablet_bootstrap.cc:492] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:28.351476 19865 tablet_bootstrap.cc:654] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.352180 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:28.353121 19824 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:13:28.356648 19713 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:28.360698 20028 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:28.361169 20028 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:13:28.361573 20028 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.357002 19942 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.376921 19867 tablet_bootstrap.cc:492] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:28.377418 19867 ts_tablet_manager.cc:1403] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.042s	user 0.005s	sys 0.008s
I20260709 12:13:28.378196 20028 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.385540 19942 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.386111 19942 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.387291 19867 raft_consensus.cc:359] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.388216 19867 raft_consensus.cc:385] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.388535 19867 raft_consensus.cc:740] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.389344 19867 consensus_queue.cc:260] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.390252 19942 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.393965 20028 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.395094 19867 ts_tablet_manager.cc:1434] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 12:13:28.395455 19865 tablet_bootstrap.cc:492] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:28.396399 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:28.398697 19865 ts_tablet_manager.cc:1403] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.013s
I20260709 12:13:28.398921 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:28.399499 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:28.396661 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:28.403452 19675 raft_consensus.cc:2393] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 2: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:13:28.402897 19865 raft_consensus.cc:359] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.404039 19865 raft_consensus.cc:385] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.404397 19865 raft_consensus.cc:740] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
W20260709 12:13:28.404907 19713 leader_election.cc:343] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:28.406008 19714 leader_election.cc:343] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.406738 19714 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:28.405814 19865 consensus_queue.cc:260] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.413371 19865 ts_tablet_manager.cc:1434] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 12:13:28.415155 19867 tablet_bootstrap.cc:492] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:28.415347 19865 tablet_bootstrap.cc:492] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:28.419173 20028 raft_consensus.cc:2749] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:28.397629 19864 tablet_bootstrap.cc:654] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.421516 19920 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.424650 19920 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.426374 19942 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.427012 19942 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.430274 19942 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.432071 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:28.437971 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:28.438544 19824 raft_consensus.cc:2468] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:28.433477 19822 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:13:28.439800 19981 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.440145 19713 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:28.440338 19981 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.438758 19747 raft_consensus.cc:2468] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:28.442577 19981 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:28.441777 19713 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:28.432597 19920 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:28.433781 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:28.446646 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:28.438477 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:28.447230 20028 raft_consensus.cc:2804] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:28.448047 19867 tablet_bootstrap.cc:654] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.449214 20028 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.447993 19675 raft_consensus.cc:2468] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:28.448058 19674 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:28.449287 19942 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:28.451742 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:28.449824 20028 raft_consensus.cc:3060] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.455363 19864 tablet_bootstrap.cc:492] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:28.455899 19864 ts_tablet_manager.cc:1403] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.000s
I20260709 12:13:28.451334 19942 raft_consensus.cc:697] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:28.457110 19942 consensus_queue.cc:237] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.452991 19789 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:28.463214 19920 raft_consensus.cc:2804] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:28.463922 19920 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.464468 19920 raft_consensus.cc:3060] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:28.466516 19789 leader_election.cc:343] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.469637 19788 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
W20260709 12:13:28.470378 19714 leader_election.cc:343] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.473897 19864 raft_consensus.cc:359] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.474769 19864 raft_consensus.cc:385] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.475136 19865 tablet_bootstrap.cc:654] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.476819 19981 raft_consensus.cc:2804] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:28.477260 19981 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.477636 19981 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.475121 19864 raft_consensus.cc:740] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.480363 19864 consensus_queue.cc:260] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.484155 19920 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.491214 19920 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:28.496130 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:28.496937 19748 raft_consensus.cc:3060] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.496759 19981 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.498653 19864 ts_tablet_manager.cc:1434] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.001s
I20260709 12:13:28.498477 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:28.499241 19672 raft_consensus.cc:3060] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.499476 19981 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:28.499799 19864 tablet_bootstrap.cc:492] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:28.501039 19871 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.501555 19871 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.512786 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:28.512991 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:28.516726 19867 tablet_bootstrap.cc:492] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:28.517499 19867 ts_tablet_manager.cc:1403] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.018s
I20260709 12:13:28.512807 19871 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.522547 20007 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.521606 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:28.523553 20007 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.523765 19674 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:28.525274 19789 leader_election.cc:343] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.529270 19571 catalog_manager.cc:5697] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.523824 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:28.531453 19822 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:13:28.527163 20007 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.531896 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:28.536911 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:28.538308 19822 raft_consensus.cc:2393] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:28.539402 19867 raft_consensus.cc:359] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.540172 19867 raft_consensus.cc:385] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.540462 19867 raft_consensus.cc:740] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.541644 19638 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:28.542997 19638 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:28.544060 19871 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:28.544440 19871 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.544799 19871 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.544942 20007 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.552021 19748 raft_consensus.cc:2468] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:28.541065 19867 consensus_queue.cc:260] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.554490 19789 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:28.559235 19871 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.560230 19920 raft_consensus.cc:2804] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:28.561091 19920 raft_consensus.cc:697] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:28.544673 20028 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.563257 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:28.565570 20028 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.566535 19867 ts_tablet_manager.cc:1434] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.004s
I20260709 12:13:28.567070 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:28.567631 19867 tablet_bootstrap.cc:492] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:28.567914 19865 tablet_bootstrap.cc:492] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:28.567777 19824 raft_consensus.cc:3060] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.568465 19865 ts_tablet_manager.cc:1403] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.049s
I20260709 12:13:28.568580 19864 tablet_bootstrap.cc:654] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.571283 19672 raft_consensus.cc:2468] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:28.573962 19865 raft_consensus.cc:359] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.574877 19865 raft_consensus.cc:385] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.575207 19865 raft_consensus.cc:740] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.575693 20007 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:28.575999 19865 consensus_queue.cc:260] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.576668 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:28.578771 19920 consensus_queue.cc:237] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.576833 19824 raft_consensus.cc:2468] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:28.582636 19713 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:28.583655 19674 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:28.584267 19865 ts_tablet_manager.cc:1434] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:13:28.585386 19865 tablet_bootstrap.cc:492] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:28.587113 20028 raft_consensus.cc:2804] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:28.588214 20028 raft_consensus.cc:697] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:28.589493 20028 consensus_queue.cc:237] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.592244 19867 tablet_bootstrap.cc:654] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.592414 19865 tablet_bootstrap.cc:654] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:28.597216 19714 leader_election.cc:343] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.579741 19871 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.600641 19788 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:28.601708 19981 raft_consensus.cc:2804] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:28.602227 19981 raft_consensus.cc:697] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:28.603341 19981 consensus_queue.cc:237] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.606501 19864 tablet_bootstrap.cc:492] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:28.607048 19864 ts_tablet_manager.cc:1403] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.007s
I20260709 12:13:28.608181 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:28.608999 19824 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.615525 19871 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.618932 19871 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.620987 19864 raft_consensus.cc:359] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.621873 19864 raft_consensus.cc:385] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.622146 19864 raft_consensus.cc:740] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.630561 19672 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.634289 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:28.635442 19748 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:28.637530 19640 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:28.638490 20007 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:28.639081 20007 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.639484 20007 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.638537 19572 catalog_manager.cc:5697] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:28.641309 19871 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.641347 19822 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.643244 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:28.645344 19638 leader_election.cc:343] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.647136 19824 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:13:28.648810 19638 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:13:28.652087 20007 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.653146 20028 consensus_queue.cc:1048] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:28.658219 19867 tablet_bootstrap.cc:492] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:28.658726 19867 ts_tablet_manager.cc:1403] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.002s
I20260709 12:13:28.659488 20028 consensus_queue.cc:1048] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:28.660094 19571 catalog_manager.cc:5697] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.664605 19865 tablet_bootstrap.cc:492] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:28.664376 19867 raft_consensus.cc:359] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.665094 19865 ts_tablet_manager.cc:1403] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.034s
I20260709 12:13:28.665104 19867 raft_consensus.cc:385] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.665594 19867 raft_consensus.cc:740] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.666412 19867 consensus_queue.cc:260] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.666332 19942 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.667501 19871 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:28.666682 19573 catalog_manager.cc:5697] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:28.668216 19871 raft_consensus.cc:697] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:28.669642 19867 ts_tablet_manager.cc:1434] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:13:28.637866 19864 consensus_queue.cc:260] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.670634 19867 tablet_bootstrap.cc:492] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:28.667917 19942 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.674073 19864 ts_tablet_manager.cc:1434] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.002s
I20260709 12:13:28.673874 19865 raft_consensus.cc:359] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.674574 19865 raft_consensus.cc:385] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.674867 19865 raft_consensus.cc:740] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.669266 19871 consensus_queue.cc:237] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.674891 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:28.675671 19748 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.675513 19865 consensus_queue.cc:260] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.676623 20007 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.675045 19864 tablet_bootstrap.cc:492] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:28.677830 19865 ts_tablet_manager.cc:1434] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:13:28.678285 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:28.679590 19672 raft_consensus.cc:2393] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 1: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:13:28.679733 19942 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:28.687808 19865 tablet_bootstrap.cc:492] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:28.688436 19920 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.679620 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:28.688943 19920 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.692570 19920 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:28.695611 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:13:28.711611 19638 leader_election.cc:343] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.712634 20025 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.711089 19714 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:28.713366 20025 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.714598 20028 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.724296 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:28.725057 19749 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:28.713325 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:28.735833 19672 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:28.739730 20025 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:28.742307 19788 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:28.743005 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:28.756251 19867 tablet_bootstrap.cc:654] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.746408 20025 raft_consensus.cc:2804] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:28.758488 20025 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.759403 20025 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.758128 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:28.786783 19864 tablet_bootstrap.cc:654] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.782580 19747 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
W20260709 12:13:28.759404 19788 leader_election.cc:343] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.788513 19748 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:13:28.788167 19942 consensus_queue.cc:1048] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:13:28.791277 19572 catalog_manager.cc:5697] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 2 to 3, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.794051 19887 consensus_queue.cc:1048] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:28.805655 20025 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.817119 19789 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:28.824651 19887 consensus_queue.cc:1048] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:28.824007 19981 raft_consensus.cc:2804] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:28.826509 19981 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.826992 19981 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.827270 19865 tablet_bootstrap.cc:654] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:28.829118 20028 raft_consensus.cc:2749] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:28.836009 19640 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:28.842828 19871 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:28.843322 19871 raft_consensus.cc:697] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:28.844121 19871 consensus_queue.cc:237] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.841841 20025 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:28.863176 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:28.866444 19674 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.905978 19867 tablet_bootstrap.cc:492] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:28.909076 19865 tablet_bootstrap.cc:492] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:28.909571 19865 ts_tablet_manager.cc:1403] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.222s	user 0.010s	sys 0.011s
I20260709 12:13:28.907634 19867 ts_tablet_manager.cc:1403] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.237s	user 0.012s	sys 0.012s
I20260709 12:13:28.912743 19981 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.918614 19864 tablet_bootstrap.cc:492] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:28.919533 19864 ts_tablet_manager.cc:1403] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.245s	user 0.016s	sys 0.012s
I20260709 12:13:28.920981 19981 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:28.921452 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:28.922029 20028 consensus_queue.cc:1048] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:28.924180 19788 leader_election.cc:343] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:28.927901 19674 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:28.927778 19867 raft_consensus.cc:359] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.928762 19867 raft_consensus.cc:385] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.929240 19867 raft_consensus.cc:740] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
W20260709 12:13:28.930131 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 87831.6us
I20260709 12:13:28.932245 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:28.933147 19747 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.934531 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:28.936061 19748 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:28.937016 19867 consensus_queue.cc:260] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.928777 19865 raft_consensus.cc:359] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.939143 19865 raft_consensus.cc:385] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.940311 19788 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:28.941278 19981 raft_consensus.cc:2804] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:28.941787 19981 raft_consensus.cc:697] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:28.942659 19981 consensus_queue.cc:237] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.949375 19865 raft_consensus.cc:740] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.955669 19865 consensus_queue.cc:260] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.957469 19867 ts_tablet_manager.cc:1434] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.004s
I20260709 12:13:28.958622 19867 tablet_bootstrap.cc:492] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:28.968000 19747 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:28.968482 19864 raft_consensus.cc:359] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:28.953938 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 50564.8us
I20260709 12:13:28.969344 19864 raft_consensus.cc:385] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:28.969645 19864 raft_consensus.cc:740] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:28.970512 19864 consensus_queue.cc:260] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:28.973652 19864 ts_tablet_manager.cc:1434] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:13:28.975296 19864 tablet_bootstrap.cc:492] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:28.976609 19748 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:28.982280 19572 catalog_manager.cc:5697] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.985203 19789 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:28.987210 20025 raft_consensus.cc:2804] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:28.987951 20025 raft_consensus.cc:697] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:28.988765 20025 consensus_queue.cc:237] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.045332 19865 ts_tablet_manager.cc:1434] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.135s	user 0.012s	sys 0.004s
I20260709 12:13:29.049925 19865 tablet_bootstrap.cc:492] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:29.054746 19864 tablet_bootstrap.cc:654] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.060098 19573 catalog_manager.cc:5697] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.070396 19867 tablet_bootstrap.cc:654] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.086239 19673 raft_consensus.cc:1240] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:29.094345 19865 tablet_bootstrap.cc:654] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.098694 19864 tablet_bootstrap.cc:492] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:29.099258 19864 ts_tablet_manager.cc:1403] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.015s
I20260709 12:13:29.111474 20074 consensus_queue.cc:1059] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:29.112665 20074 consensus_queue.cc:1243] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer f662c4f7d6a74013a1e58a5330a049b8 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:13:29.113195 19887 raft_consensus.cc:3055] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:29.113590 19887 raft_consensus.cc:740] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:29.113967 19864 raft_consensus.cc:359] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.114766 19864 raft_consensus.cc:385] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.114500 19887 consensus_queue.cc:260] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.115120 19864 raft_consensus.cc:740] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.116112 19887 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.115875 19864 consensus_queue.cc:260] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.117645 19864 ts_tablet_manager.cc:1434] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:13:29.117832 20025 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:29.118629 19864 tablet_bootstrap.cc:492] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:29.120992 19573 catalog_manager.cc:5697] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.124665 19871 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.125263 19871 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.127319 19871 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:29.128252 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:29.134017 19864 tablet_bootstrap.cc:654] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:29.138883 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 63422.9us
I20260709 12:13:29.143456 19821 raft_consensus.cc:1240] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:29.148085 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:29.149196 19823 raft_consensus.cc:2393] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:29.159387 19865 tablet_bootstrap.cc:492] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:29.159893 19865 ts_tablet_manager.cc:1403] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.110s	user 0.018s	sys 0.016s
I20260709 12:13:29.160964 19638 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:29.162573 19865 raft_consensus.cc:359] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.163385 19671 raft_consensus.cc:3060] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:29.169018 19887 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.169778 19887 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.171301 19865 raft_consensus.cc:385] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.171679 19865 raft_consensus.cc:740] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.172596 19865 consensus_queue.cc:260] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.176522 19871 raft_consensus.cc:2749] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:29.180629 19865 ts_tablet_manager.cc:1434] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:13:29.187155 19865 tablet_bootstrap.cc:492] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:29.187002 20080 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:29.191751 19887 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:29.194772 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:29.194948 19887 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:29.195956 19672 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:29.198239 19865 tablet_bootstrap.cc:654] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.203552 20081 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:29.204490 19920 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:29.205222 19714 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:29.206168 19887 raft_consensus.cc:2804] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:29.207201 19887 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.208670 19887 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:29.219058 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:29.219934 19824 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:29.221910 19864 tablet_bootstrap.cc:492] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:29.221992 19824 raft_consensus.cc:1275] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:29.223223 19864 ts_tablet_manager.cc:1403] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.020s
I20260709 12:13:29.227094 19871 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:29.227893 19867 tablet_bootstrap.cc:492] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:29.227586 19864 raft_consensus.cc:359] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.228338 19864 raft_consensus.cc:385] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.228650 19864 raft_consensus.cc:740] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.228359 19867 ts_tablet_manager.cc:1403] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.270s	user 0.015s	sys 0.005s
I20260709 12:13:29.229828 19864 consensus_queue.cc:260] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.231925 20074 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:29.243639 19864 ts_tablet_manager.cc:1434] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:13:29.245824 19867 raft_consensus.cc:359] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.246512 19865 tablet_bootstrap.cc:492] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:29.247187 19865 ts_tablet_manager.cc:1403] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.065s	user 0.005s	sys 0.013s
I20260709 12:13:29.246548 19867 raft_consensus.cc:385] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.248914 19867 raft_consensus.cc:740] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.252259 19864 tablet_bootstrap.cc:492] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:29.249825 19887 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.257530 19865 raft_consensus.cc:359] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.265232 19864 tablet_bootstrap.cc:654] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.269644 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:29.271977 19865 raft_consensus.cc:385] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.272445 19865 raft_consensus.cc:740] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.272483 19823 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:29.272845 20081 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.273380 20081 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.273427 19865 consensus_queue.cc:260] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.275673 19865 ts_tablet_manager.cc:1434] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 12:13:29.276885 19865 tablet_bootstrap.cc:492] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:29.276723 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:29.278389 19788 leader_election.cc:343] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:29.268357 19887 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:29.253423 19867 consensus_queue.cc:260] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.281754 19867 ts_tablet_manager.cc:1434] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.000s
I20260709 12:13:29.269536 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:29.282644 19673 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:29.282769 19867 tablet_bootstrap.cc:492] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:29.288175 20081 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:29.299759 19747 raft_consensus.cc:1275] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:29.301234 19747 pending_rounds.cc:85] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193: Aborting all ops after (but not including) 1
I20260709 12:13:29.301527 19747 pending_rounds.cc:107] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:29.301818 19747 raft_consensus.cc:2889] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:29.302013 20007 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.302492 20007 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.305233 20007 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:29.305809 20007 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:29.306277 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:29.307183 19748 raft_consensus.cc:2393] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:13:29.289232 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:29.317685 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:29.316991 19823 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
W20260709 12:13:29.317305 19789 leader_election.cc:343] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:29.332286 19713 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:29.332460 19789 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:29.334725 20081 raft_consensus.cc:2749] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:29.333930 20074 raft_consensus.cc:2804] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:29.335610 20074 raft_consensus.cc:697] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:29.336562 20074 consensus_queue.cc:237] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.338591 19638 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:29.339936 19912 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:29.342684 19865 tablet_bootstrap.cc:654] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.338204 19673 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:29.355193 19867 tablet_bootstrap.cc:654] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.368620 19864 tablet_bootstrap.cc:492] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:29.369251 19864 ts_tablet_manager.cc:1403] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.117s	user 0.034s	sys 0.037s
I20260709 12:13:29.372911 19864 raft_consensus.cc:359] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.373858 19864 raft_consensus.cc:385] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.374133 19864 raft_consensus.cc:740] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.370771 19912 raft_consensus.cc:2749] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:29.385628 19573 catalog_manager.cc:5697] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:29.390424 19621 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:29.393637 19865 tablet_bootstrap.cc:492] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:29.394354 19865 ts_tablet_manager.cc:1403] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.118s	user 0.016s	sys 0.010s
I20260709 12:13:29.397365 19865 raft_consensus.cc:359] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.398182 19865 raft_consensus.cc:385] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.398475 19865 raft_consensus.cc:740] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.398371 19864 consensus_queue.cc:260] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.399710 19865 consensus_queue.cc:260] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.402138 20077 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.402726 20077 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.406005 19864 ts_tablet_manager.cc:1434] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:13:29.409327 19864 tablet_bootstrap.cc:492] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:29.409809 19865 ts_tablet_manager.cc:1434] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:13:29.411388 19865 tablet_bootstrap.cc:492] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:29.421347 19864 tablet_bootstrap.cc:654] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.442170 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:29.442376 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:29.444701 19788 leader_election.cc:343] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:29.452556 19865 tablet_bootstrap.cc:654] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.452970 19823 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:29.453033 19789 leader_election.cc:343] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:29.455709 19973 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:29.457437 19867 tablet_bootstrap.cc:492] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:29.458169 19867 ts_tablet_manager.cc:1403] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.176s	user 0.004s	sys 0.011s
I20260709 12:13:29.461634 19867 raft_consensus.cc:359] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.436010 20077 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:29.462936 19789 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:29.469316 20077 raft_consensus.cc:2749] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:29.462579 19867 raft_consensus.cc:385] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.471537 19867 raft_consensus.cc:740] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.472074 20077 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:29.473070 19867 consensus_queue.cc:260] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.485893 19865 tablet_bootstrap.cc:492] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:29.486498 19865 ts_tablet_manager.cc:1403] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.002s
I20260709 12:13:29.493743 19867 ts_tablet_manager.cc:1434] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.004s
I20260709 12:13:29.494912 19867 tablet_bootstrap.cc:492] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:29.490100 19865 raft_consensus.cc:359] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.499238 19865 raft_consensus.cc:385] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.499614 19865 raft_consensus.cc:740] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.500351 19865 consensus_queue.cc:260] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.502836 19865 ts_tablet_manager.cc:1434] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 12:13:29.502913 20077 consensus_queue.cc:1048] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:29.503957 19865 tablet_bootstrap.cc:492] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:29.506423 19912 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.507056 19912 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.509521 19912 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:29.510375 19867 tablet_bootstrap.cc:654] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.512166 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:29.512239 20081 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:29.514994 19864 tablet_bootstrap.cc:492] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:29.515535 19864 ts_tablet_manager.cc:1403] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.029s
W20260709 12:13:29.515038 19638 leader_election.cc:343] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:29.527935 19865 tablet_bootstrap.cc:654] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.528573 19864 raft_consensus.cc:359] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.529368 19864 raft_consensus.cc:385] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.529676 19864 raft_consensus.cc:740] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.531131 19864 consensus_queue.cc:260] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.534053 19864 ts_tablet_manager.cc:1434] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 12:13:29.535197 19864 tablet_bootstrap.cc:492] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:29.591708 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:29.593963 19748 raft_consensus.cc:2468] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:29.613691 19920 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.610857 20074 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.617709 20074 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.611016 19912 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.621392 20074 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:29.621578 19912 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.614611 19920 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.624155 19640 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:29.630295 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:29.631666 19823 raft_consensus.cc:2468] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:29.624197 19973 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:13:29.638304 19867 tablet_bootstrap.cc:492] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:29.641355 19981 consensus_queue.cc:1048] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:29.641760 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:29.644279 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:29.645411 19713 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:29.647310 19912 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:29.648229 19887 raft_consensus.cc:2804] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:29.648742 19887 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.649209 19887 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:29.645622 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:29.646041 19920 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:29.654318 19864 tablet_bootstrap.cc:654] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.652006 19867 ts_tablet_manager.cc:1403] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.157s	user 0.018s	sys 0.003s
W20260709 12:13:29.659991 19640 leader_election.cc:343] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:29.660148 20102 raft_consensus.cc:2804] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:29.666031 19673 raft_consensus.cc:2468] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:29.675544 19867 raft_consensus.cc:359] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.676398 19867 raft_consensus.cc:385] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.676719 19867 raft_consensus.cc:740] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.677537 19867 consensus_queue.cc:260] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.671521 20102 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.679121 20102 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:29.681478 19867 ts_tablet_manager.cc:1434] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.003s
W20260709 12:13:29.687242 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 49924.3us
I20260709 12:13:29.677929 19887 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.693079 19867 tablet_bootstrap.cc:492] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
W20260709 12:13:29.695350 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 50362.5us
I20260709 12:13:29.704636 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:29.723564 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:29.725582 19865 tablet_bootstrap.cc:492] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:29.729063 19887 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:29.729910 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:29.732012 19865 ts_tablet_manager.cc:1403] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.228s	user 0.022s	sys 0.003s
I20260709 12:13:29.737039 19887 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.738039 19887 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.742574 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:29.747263 19638 leader_election.cc:343] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:29.747781 19638 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:29.749269 19912 raft_consensus.cc:2749] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:29.744853 19887 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:29.752345 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:29.753356 19824 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:29.754320 19789 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:29.764808 19865 raft_consensus.cc:359] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.769330 19865 raft_consensus.cc:385] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.769675 19865 raft_consensus.cc:740] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.755196 19713 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:29.776723 20073 raft_consensus.cc:2804] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:29.777215 20073 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.777597 20073 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:29.779269 19714 leader_election.cc:343] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:29.779948 19865 consensus_queue.cc:260] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.781356 19867 tablet_bootstrap.cc:654] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.781939 19865 ts_tablet_manager.cc:1434] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:13:29.783737 19864 tablet_bootstrap.cc:492] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:29.784293 19864 ts_tablet_manager.cc:1403] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.249s	user 0.037s	sys 0.026s
I20260709 12:13:29.790817 19865 tablet_bootstrap.cc:492] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:29.793339 19942 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:29.782107 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:29.798967 19821 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:29.802467 20074 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:29.825706 19864 raft_consensus.cc:359] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.839694 19864 raft_consensus.cc:385] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.840543 19864 raft_consensus.cc:740] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.842291 19864 consensus_queue.cc:260] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.851603 19864 ts_tablet_manager.cc:1434] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.067s	user 0.010s	sys 0.001s
I20260709 12:13:29.854226 19864 tablet_bootstrap.cc:492] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:29.861688 20073 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.866411 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:13:29.870271 19714 leader_election.cc:343] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:29.873623 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:29.874567 19820 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:29.870893 20073 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:29.869261 20102 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.877441 19673 raft_consensus.cc:2393] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 1: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:13:29.881078 20077 raft_consensus.cc:2749] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:29.893707 19865 tablet_bootstrap.cc:654] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.903855 19867 tablet_bootstrap.cc:492] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:29.904469 19867 ts_tablet_manager.cc:1403] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.212s	user 0.022s	sys 0.030s
I20260709 12:13:29.911942 20102 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:29.919963 19867 raft_consensus.cc:359] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.920981 19867 raft_consensus.cc:385] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:29.921345 19867 raft_consensus.cc:740] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:29.912344 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:29.923277 19867 consensus_queue.cc:260] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.924283 19749 raft_consensus.cc:2393] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:29.925204 19867 ts_tablet_manager.cc:1434] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.010s
I20260709 12:13:29.926561 19867 tablet_bootstrap.cc:492] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:29.926744 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:29.932662 19638 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:29.933650 19973 raft_consensus.cc:2749] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:29.929616 19821 raft_consensus.cc:2468] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:29.940454 19713 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:29.941906 19942 raft_consensus.cc:2804] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:29.942448 19942 raft_consensus.cc:697] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:29.943830 19820 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:29.943655 19942 consensus_queue.cc:237] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.946179 19867 tablet_bootstrap.cc:654] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.946668 19713 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:29.949016 20074 raft_consensus.cc:2804] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:29.950765 20074 raft_consensus.cc:697] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:29.952011 20074 consensus_queue.cc:237] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:29.965380 20102 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.966156 20102 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:29.985184 20111 log.cc:927] Time spent T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.066s	user 0.005s	sys 0.000s
I20260709 12:13:29.988226 19864 tablet_bootstrap.cc:654] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:29.993397 20073 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.996275 20073 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.001039 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:30.002071 19747 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:30.002660 20073 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.003993 19640 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:30.005304 19973 raft_consensus.cc:2804] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:30.006429 19973 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.007036 19973 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.005270 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:30.009507 19867 tablet_bootstrap.cc:492] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:30.015947 19867 ts_tablet_manager.cc:1403] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.011s
I20260709 12:13:30.006496 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:30.019357 19820 raft_consensus.cc:2468] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:30.020815 19713 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:30.021930 20073 raft_consensus.cc:2804] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:30.022859 20073 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.023509 20073 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:30.025267 19714 leader_election.cc:343] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.024286 19867 raft_consensus.cc:359] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.031177 19867 raft_consensus.cc:385] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.032135 19867 raft_consensus.cc:740] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.033408 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:30.034447 19824 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:30.033433 19867 consensus_queue.cc:260] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.041009 20102 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.028891 19973 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.038677 19867 ts_tablet_manager.cc:1434] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:13:30.058681 19973 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.063026 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:30.068939 19749 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.069415 19867 tablet_bootstrap.cc:492] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:30.072377 20073 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.087073 20073 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.088210 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:30.089334 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:30.090056 19824 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:30.091066 19714 leader_election.cc:343] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.091223 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:30.091905 19820 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.107028 19864 tablet_bootstrap.cc:492] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:30.107570 19864 ts_tablet_manager.cc:1403] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.254s	user 0.040s	sys 0.045s
I20260709 12:13:30.107384 19824 raft_consensus.cc:2468] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:30.109135 19713 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:30.111016 19887 raft_consensus.cc:2804] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:30.110896 19864 raft_consensus.cc:359] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.111770 19864 raft_consensus.cc:385] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.111775 19887 raft_consensus.cc:697] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:30.112144 19864 raft_consensus.cc:740] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.113240 19864 consensus_queue.cc:260] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.113328 19887 consensus_queue.cc:237] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.119125 19864 ts_tablet_manager.cc:1434] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:13:30.120642 19865 tablet_bootstrap.cc:492] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:30.121206 19865 ts_tablet_manager.cc:1403] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.331s	user 0.005s	sys 0.028s
I20260709 12:13:30.125728 19864 tablet_bootstrap.cc:492] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:30.126359 19573 catalog_manager.cc:5697] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.135233 19573 catalog_manager.cc:5697] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.132956 19820 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:13:30.141664 19867 tablet_bootstrap.cc:654] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.142313 19638 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:30.148504 20007 raft_consensus.cc:2804] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:30.149121 20007 raft_consensus.cc:697] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:30.153988 19865 raft_consensus.cc:359] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.156708 19865 raft_consensus.cc:385] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.157003 19865 raft_consensus.cc:740] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.157852 20007 consensus_queue.cc:237] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.160813 19864 tablet_bootstrap.cc:654] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.160557 19865 consensus_queue.cc:260] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.173936 19865 ts_tablet_manager.cc:1434] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.052s	user 0.001s	sys 0.009s
I20260709 12:13:30.175504 19865 tablet_bootstrap.cc:492] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:30.187747 19867 tablet_bootstrap.cc:492] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:30.188344 19867 ts_tablet_manager.cc:1403] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.119s	user 0.008s	sys 0.014s
I20260709 12:13:30.192147 19867 raft_consensus.cc:359] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.195698 19867 raft_consensus.cc:385] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.189531 19749 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:13:30.195994 19867 raft_consensus.cc:740] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.197130 19867 consensus_queue.cc:260] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.199007 19867 ts_tablet_manager.cc:1434] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:13:30.203532 19867 tablet_bootstrap.cc:492] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:30.205811 19571 catalog_manager.cc:5697] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.209198 19865 tablet_bootstrap.cc:654] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.223187 19867 tablet_bootstrap.cc:654] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.228389 19864 tablet_bootstrap.cc:492] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:30.229112 19864 ts_tablet_manager.cc:1403] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.017s
I20260709 12:13:30.234066 19864 raft_consensus.cc:359] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.239486 19864 raft_consensus.cc:385] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.240182 19864 raft_consensus.cc:740] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.241554 19864 consensus_queue.cc:260] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.247285 19864 ts_tablet_manager.cc:1434] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:13:30.250355 19864 tablet_bootstrap.cc:492] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:30.263298 19864 tablet_bootstrap.cc:654] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.278855 19867 tablet_bootstrap.cc:492] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:30.279562 19867 ts_tablet_manager.cc:1403] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.076s	user 0.020s	sys 0.023s
I20260709 12:13:30.289664 19867 raft_consensus.cc:359] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.290230 19867 raft_consensus.cc:385] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.292575 19865 tablet_bootstrap.cc:492] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:30.293140 19865 ts_tablet_manager.cc:1403] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.118s	user 0.013s	sys 0.009s
I20260709 12:13:30.290572 19867 raft_consensus.cc:740] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.294351 19867 consensus_queue.cc:260] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.300180 19867 ts_tablet_manager.cc:1434] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:13:30.301403 19865 raft_consensus.cc:359] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.301927 19867 tablet_bootstrap.cc:492] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:30.304291 19865 raft_consensus.cc:385] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.304701 19865 raft_consensus.cc:740] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.305534 19865 consensus_queue.cc:260] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.308981 20080 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.309574 20080 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.311491 19867 tablet_bootstrap.cc:654] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.312054 20080 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:30.313588 19865 ts_tablet_manager.cc:1434] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:13:30.316984 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:30.317699 19865 tablet_bootstrap.cc:492] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:30.319782 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:13:30.323624 19788 leader_election.cc:343] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.325177 19865 tablet_bootstrap.cc:654] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:30.326453 19789 leader_election.cc:343] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.335045 19865 tablet_bootstrap.cc:492] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:30.335589 19865 ts_tablet_manager.cc:1403] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 12:13:30.338912 19865 raft_consensus.cc:359] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.339607 19865 raft_consensus.cc:385] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.339877 19865 raft_consensus.cc:740] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.340550 19864 tablet_bootstrap.cc:492] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:30.340488 19865 consensus_queue.cc:260] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.341241 19864 ts_tablet_manager.cc:1403] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.001s
I20260709 12:13:30.342634 19865 ts_tablet_manager.cc:1434] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:30.343816 19865 tablet_bootstrap.cc:492] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:30.344565 19864 raft_consensus.cc:359] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.345309 19864 raft_consensus.cc:385] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.345618 19864 raft_consensus.cc:740] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.346367 19864 consensus_queue.cc:260] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.351444 19865 tablet_bootstrap.cc:654] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.353721 19864 ts_tablet_manager.cc:1434] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:13:30.357240 19864 tablet_bootstrap.cc:492] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:30.358019 20007 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.358810 20007 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.361475 19867 tablet_bootstrap.cc:492] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:30.362064 19867 ts_tablet_manager.cc:1403] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.028s
I20260709 12:13:30.361778 20074 consensus_queue.cc:1048] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:30.364503 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:13:30.366469 19640 leader_election.cc:343] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.370234 19867 raft_consensus.cc:359] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.365379 20007 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.371276 19867 raft_consensus.cc:385] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.371627 19867 raft_consensus.cc:740] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.372682 19867 consensus_queue.cc:260] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.376919 19867 ts_tablet_manager.cc:1434] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:13:30.378187 19867 tablet_bootstrap.cc:492] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:30.330657 19789 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:30.379846 20080 raft_consensus.cc:2749] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:30.381213 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 54830.5us
I20260709 12:13:30.383445 19864 tablet_bootstrap.cc:654] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.385404 19867 tablet_bootstrap.cc:654] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.387096 19671 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.388356 19887 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.389005 19887 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.397717 19867 tablet_bootstrap.cc:492] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:30.397590 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:30.398316 19867 ts_tablet_manager.cc:1403] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:13:30.401470 19867 raft_consensus.cc:359] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.402288 19867 raft_consensus.cc:385] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.402769 19867 raft_consensus.cc:740] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
W20260709 12:13:30.403091 19714 leader_election.cc:343] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.403219 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:30.403940 19867 consensus_queue.cc:260] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.407142 19867 ts_tablet_manager.cc:1434] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:13:30.408043 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:30.408432 19867 tablet_bootstrap.cc:492] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
W20260709 12:13:30.409669 19713 leader_election.cc:343] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.410271 19713 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:30.411257 20074 raft_consensus.cc:2749] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:30.415309 19887 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.417297 19867 tablet_bootstrap.cc:654] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.402307 19572 catalog_manager.cc:5697] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:30.421340 19638 leader_election.cc:343] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.422016 19638 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:30.422909 20007 raft_consensus.cc:2749] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:30.424530 19887 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.424962 19887 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.427336 19867 tablet_bootstrap.cc:492] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:30.428030 19867 ts_tablet_manager.cc:1403] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 12:13:30.428344 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:30.430558 19714 leader_election.cc:343] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.430968 20074 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.431535 20074 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.433702 20074 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.436419 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:30.436302 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:30.437872 19824 raft_consensus.cc:2468] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:30.438349 19672 raft_consensus.cc:2468] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:30.439949 19713 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:30.441812 20074 raft_consensus.cc:2804] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:30.442212 20074 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.442549 20074 raft_consensus.cc:3060] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.447332 19942 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:30.479399 19864 tablet_bootstrap.cc:492] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:30.462024 19942 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 12:13:30.466300 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:30.504618 19824 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:30.506274 19713 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:30.470999 20073 consensus_queue.cc:1048] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:13:30.509447 20080 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.450397 20007 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.510263 20080 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.511196 20007 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.449937 19867 raft_consensus.cc:359] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.517593 19867 raft_consensus.cc:385] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.518019 19867 raft_consensus.cc:740] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.462987 19887 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.519006 19867 consensus_queue.cc:260] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.522668 19864 ts_tablet_manager.cc:1403] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.147s	user 0.017s	sys 0.009s
I20260709 12:13:30.525970 19864 raft_consensus.cc:359] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.526718 20074 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.528337 19865 tablet_bootstrap.cc:492] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:30.528857 19865 ts_tablet_manager.cc:1403] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.185s	user 0.049s	sys 0.066s
I20260709 12:13:30.529379 20074 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.526675 19864 raft_consensus.cc:385] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.531706 19864 raft_consensus.cc:740] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.533785 20007 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.517453 19942 raft_consensus.cc:2804] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:30.535283 19942 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.535776 19942 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.536518 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:30.532512 19864 consensus_queue.cc:260] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.541363 19865 raft_consensus.cc:359] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.542171 19865 raft_consensus.cc:385] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.542515 19865 raft_consensus.cc:740] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.543390 19865 consensus_queue.cc:260] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.550276 19864 ts_tablet_manager.cc:1434] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:13:30.554256 19867 ts_tablet_manager.cc:1434] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.126s	user 0.009s	sys 0.002s
I20260709 12:13:30.561491 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:30.563429 19788 leader_election.cc:343] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.564550 19865 ts_tablet_manager.cc:1434] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
W20260709 12:13:30.565523 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 83003.2us
I20260709 12:13:30.552680 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:30.565369 20074 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.575021 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:30.577255 19671 raft_consensus.cc:3060] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.579879 19867 tablet_bootstrap.cc:492] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:30.571167 19820 raft_consensus.cc:2393] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:30.575985 20074 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.591198 19638 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:30.594131 20007 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.594806 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:30.595504 19823 raft_consensus.cc:3060] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.599933 19864 tablet_bootstrap.cc:492] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:30.603338 19865 tablet_bootstrap.cc:492] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:30.616747 20080 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:30.616992 20074 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.620704 20007 raft_consensus.cc:2749] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:30.624643 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:30.625531 19820 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:30.641992 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:30.648159 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:30.648278 19864 tablet_bootstrap.cc:654] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.648886 19747 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:30.635566 19713 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:30.661937 19671 raft_consensus.cc:2468] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
W20260709 12:13:30.667271 19714 leader_election.cc:343] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.669519 20137 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:30.669996 20137 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.670353 20137 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.668861 20007 consensus_queue.cc:1048] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:30.674414 20141 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.675043 20141 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.677572 20141 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.677731 19867 tablet_bootstrap.cc:654] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.680863 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:30.681659 19670 raft_consensus.cc:2468] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:30.684888 19714 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:30.678308 19942 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.684901 19789 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:30.688246 20141 raft_consensus.cc:2804] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:30.690305 20141 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.690734 20141 raft_consensus.cc:3060] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.683806 19823 raft_consensus.cc:2468] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:30.691851 19714 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:30.697415 20074 raft_consensus.cc:2804] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:30.698102 20074 raft_consensus.cc:697] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:30.699198 20074 consensus_queue.cc:237] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:30.689102 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 57900.4us
I20260709 12:13:30.696086 20080 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:30.717113 20080 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.730228 20080 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.745015 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:30.731762 19621 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:30.750003 20137 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.768361 19864 tablet_bootstrap.cc:492] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:30.760840 20007 consensus_queue.cc:1048] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:13:30.780678 20140 consensus_queue.cc:1048] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:30.793001 19713 leader_election.cc:343] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.753979 19942 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.753638 20137 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.802054 19864 ts_tablet_manager.cc:1403] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.202s	user 0.019s	sys 0.015s
W20260709 12:13:30.811591 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 103594us
I20260709 12:13:30.816907 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:30.819057 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:30.819850 19821 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.807878 20141 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.821977 20141 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.827528 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:13:30.830509 19713 leader_election.cc:343] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.839793 19865 tablet_bootstrap.cc:654] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.843678 19864 raft_consensus.cc:359] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.844656 19864 raft_consensus.cc:385] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.844981 19864 raft_consensus.cc:740] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.845875 19864 consensus_queue.cc:260] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.854684 19867 tablet_bootstrap.cc:492] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:30.855293 19867 ts_tablet_manager.cc:1403] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.292s	user 0.010s	sys 0.012s
I20260709 12:13:30.861824 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:30.863965 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:30.868891 19867 raft_consensus.cc:359] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.869874 19867 raft_consensus.cc:385] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.870221 19867 raft_consensus.cc:740] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.876561 19867 consensus_queue.cc:260] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.879599 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:30.876084 20080 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.880370 19670 raft_consensus.cc:3060] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.881100 19824 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 1: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:13:30.885341 19864 ts_tablet_manager.cc:1434] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.002s
I20260709 12:13:30.884893 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:30.886477 19821 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
W20260709 12:13:30.888343 19788 leader_election.cc:343] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.887382 19864 tablet_bootstrap.cc:492] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:30.891672 19713 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:30.892671 20141 raft_consensus.cc:2804] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:13:30.893020 19714 leader_election.cc:343] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.887311 20080 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:13:30.894182 19714 leader_election.cc:343] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.893237 20141 raft_consensus.cc:697] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:30.895218 19714 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:30.894526 19942 consensus_queue.cc:1048] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:30.889870 19867 ts_tablet_manager.cc:1434] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:13:30.898947 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:30.897207 20140 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:30.900281 19748 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:30.895884 20141 consensus_queue.cc:237] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.904232 19789 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:30.905385 19572 catalog_manager.cc:5697] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.909433 20080 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:30.916971 20137 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.917848 19864 tablet_bootstrap.cc:654] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:30.917505 20137 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.916231 19981 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.919797 19981 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.922006 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:30.922966 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:30.924228 19867 tablet_bootstrap.cc:492] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
W20260709 12:13:30.924888 19788 leader_election.cc:343] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:30.925462 19713 leader_election.cc:343] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:30.929567 20137 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:30.932247 19865 tablet_bootstrap.cc:492] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:30.932849 19865 ts_tablet_manager.cc:1403] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.342s	user 0.013s	sys 0.006s
I20260709 12:13:30.936827 19981 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:30.941882 19670 raft_consensus.cc:2468] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:30.945197 19865 raft_consensus.cc:359] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.947682 19865 raft_consensus.cc:385] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:30.948350 19865 raft_consensus.cc:740] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.952996 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:30.949277 19865 consensus_queue.cc:260] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:30.960903 19865 ts_tablet_manager.cc:1434] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.004s
I20260709 12:13:30.953850 19749 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:30.966755 19789 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:30.968056 20161 raft_consensus.cc:2804] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:30.968995 20161 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.969478 20161 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:30.971284 19865 tablet_bootstrap.cc:492] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:30.982875 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:30.983915 19671 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:30.996023 19572 catalog_manager.cc:5697] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.997437 19865 tablet_bootstrap.cc:654] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.001237 19714 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:31.003405 20141 raft_consensus.cc:2804] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:31.003943 20141 raft_consensus.cc:697] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:31.007436 19714 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:31.005812 20141 consensus_queue.cc:237] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.015316 20137 raft_consensus.cc:2804] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:31.020998 20137 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.026355 20137 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.033484 19867 tablet_bootstrap.cc:654] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.037118 20161 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.045161 20141 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.064005 20141 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.039438 20137 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.065989 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:31.061743 19572 catalog_manager.cc:5697] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:31.067533 19788 leader_election.cc:343] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:31.072865 19864 tablet_bootstrap.cc:492] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:31.073457 19864 ts_tablet_manager.cc:1403] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.186s	user 0.007s	sys 0.025s
I20260709 12:13:31.076472 19864 raft_consensus.cc:359] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.077262 19864 raft_consensus.cc:385] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.076993 20137 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:31.077571 19864 raft_consensus.cc:740] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.078739 20141 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:31.078253 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:31.080224 19864 consensus_queue.cc:260] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.081120 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:31.081866 19821 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
W20260709 12:13:31.082262 19713 leader_election.cc:343] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:31.083808 19713 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:31.085647 20141 raft_consensus.cc:2804] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:31.079602 20161 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:31.088141 19864 ts_tablet_manager.cc:1434] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:13:31.088603 20141 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.092296 20141 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.089334 19864 tablet_bootstrap.cc:492] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:31.089823 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:31.093269 19749 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.091192 19867 tablet_bootstrap.cc:492] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:31.094022 19867 ts_tablet_manager.cc:1403] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.178s	user 0.012s	sys 0.004s
I20260709 12:13:31.091377 19865 tablet_bootstrap.cc:492] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:31.095681 19865 ts_tablet_manager.cc:1403] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.030s
I20260709 12:13:31.102742 19749 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:31.104326 19789 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:31.105242 19981 raft_consensus.cc:2804] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:31.105784 19981 raft_consensus.cc:697] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:31.106634 19981 consensus_queue.cc:237] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.118567 20154 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.119166 20154 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.121393 20154 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:31.122606 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:31.123132 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:31.124285 19640 leader_election.cc:343] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:31.124842 19638 leader_election.cc:343] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:31.125286 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:31.123328 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:31.127035 19672 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.130376 19864 tablet_bootstrap.cc:654] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.133226 19867 raft_consensus.cc:359] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.134426 19867 raft_consensus.cc:385] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.134824 19867 raft_consensus.cc:740] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.117496 19865 raft_consensus.cc:359] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.125319 19638 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:31.135968 19867 consensus_queue.cc:260] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.135651 19865 raft_consensus.cc:385] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.137061 20102 raft_consensus.cc:2749] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:31.137302 19865 raft_consensus.cc:740] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.138110 19865 consensus_queue.cc:260] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.140436 19865 ts_tablet_manager.cc:1434] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
W20260709 12:13:31.135568 19714 leader_election.cc:343] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:31.148030 19867 ts_tablet_manager.cc:1434] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:13:31.147852 20137 consensus_queue.cc:1048] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:31.149160 20074 raft_consensus.cc:493] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.149804 20074 raft_consensus.cc:515] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.149427 19571 catalog_manager.cc:5697] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.150755 19865 tablet_bootstrap.cc:492] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:31.153182 20137 consensus_queue.cc:1048] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:31.153360 20141 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.149348 19867 tablet_bootstrap.cc:492] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:31.157270 19864 tablet_bootstrap.cc:492] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:31.157821 19864 ts_tablet_manager.cc:1403] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.004s
I20260709 12:13:31.152192 20074 leader_election.cc:290] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:31.160737 19864 raft_consensus.cc:359] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.161526 19864 raft_consensus.cc:385] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.161954 19864 raft_consensus.cc:740] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.165354 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:31.167994 20141 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:31.171464 19865 tablet_bootstrap.cc:654] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:31.172045 19713 leader_election.cc:343] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:31.171353 19867 tablet_bootstrap.cc:654] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.173823 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:31.177100 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:31.177688 19824 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.189267 19864 consensus_queue.cc:260] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.191659 19824 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:31.192970 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:31.200423 19672 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:31.205678 19864 ts_tablet_manager.cc:1434] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.005s
I20260709 12:13:31.209580 19864 tablet_bootstrap.cc:492] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:31.209810 19865 tablet_bootstrap.cc:492] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:31.210268 19865 ts_tablet_manager.cc:1403] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.003s
I20260709 12:13:31.213301 19865 raft_consensus.cc:359] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.214059 19865 raft_consensus.cc:385] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.214331 19865 raft_consensus.cc:740] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.214972 19865 consensus_queue.cc:260] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:31.216784 19714 leader_election.cc:343] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:31.217363 19714 leader_election.cc:304] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:31.218076 20074 raft_consensus.cc:2749] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:31.219260 19714 leader_election.cc:343] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:31.219843 19714 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:31.223963 20080 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.226032 19713 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:31.227568 20080 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.228751 20141 raft_consensus.cc:2804] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:31.229450 20141 raft_consensus.cc:697] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:31.229913 20080 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:31.230607 20141 consensus_queue.cc:237] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.232184 19864 tablet_bootstrap.cc:654] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.232609 19942 raft_consensus.cc:2804] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:31.233146 19942 raft_consensus.cc:697] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:31.234047 19942 consensus_queue.cc:237] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.238497 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:31.239391 19670 raft_consensus.cc:2393] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:31.225972 19865 ts_tablet_manager.cc:1434] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:13:31.246033 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:31.249511 19865 tablet_bootstrap.cc:492] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:31.259326 19789 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:31.260411 20080 raft_consensus.cc:3060] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.267498 20080 raft_consensus.cc:2749] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:31.270990 19865 tablet_bootstrap.cc:654] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.271765 19864 tablet_bootstrap.cc:492] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:31.273048 19864 ts_tablet_manager.cc:1403] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.064s	user 0.028s	sys 0.005s
I20260709 12:13:31.276435 19867 tablet_bootstrap.cc:492] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:31.277037 19867 ts_tablet_manager.cc:1403] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.016s
I20260709 12:13:31.276527 19864 raft_consensus.cc:359] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.277503 19864 raft_consensus.cc:385] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.277853 19864 raft_consensus.cc:740] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.278878 19864 consensus_queue.cc:260] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.280042 19867 raft_consensus.cc:359] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.280755 19867 raft_consensus.cc:385] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.281026 19867 raft_consensus.cc:740] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.282546 19867 consensus_queue.cc:260] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.283003 19572 catalog_manager.cc:5697] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.285609 19867 ts_tablet_manager.cc:1434] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:31.286823 19867 tablet_bootstrap.cc:492] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:31.288097 19864 ts_tablet_manager.cc:1434] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:13:31.289321 19864 tablet_bootstrap.cc:492] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:31.293330 19867 tablet_bootstrap.cc:654] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.296816 19865 tablet_bootstrap.cc:492] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:31.297340 19865 ts_tablet_manager.cc:1403] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.003s
I20260709 12:13:31.299734 19672 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.302421 19865 raft_consensus.cc:359] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.305060 19864 tablet_bootstrap.cc:654] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.303205 19865 raft_consensus.cc:385] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.306489 19865 raft_consensus.cc:740] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.308225 19865 consensus_queue.cc:260] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.310626 19865 ts_tablet_manager.cc:1434] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:13:31.312929 19865 tablet_bootstrap.cc:492] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:31.317068 19570 catalog_manager.cc:5697] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.317787 20141 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:31.319253 19865 tablet_bootstrap.cc:654] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.322328 19864 tablet_bootstrap.cc:492] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:31.322855 19864 ts_tablet_manager.cc:1403] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.004s
I20260709 12:13:31.325671 19864 raft_consensus.cc:359] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.326399 19864 raft_consensus.cc:385] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.326664 19864 raft_consensus.cc:740] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.328665 19864 consensus_queue.cc:260] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.333026 19864 ts_tablet_manager.cc:1434] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:31.336287 19864 tablet_bootstrap.cc:492] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:31.337474 19867 tablet_bootstrap.cc:492] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:31.338021 19867 ts_tablet_manager.cc:1403] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 12:13:31.341378 19867 raft_consensus.cc:359] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.342128 19867 raft_consensus.cc:385] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.342403 19867 raft_consensus.cc:740] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.345033 19864 tablet_bootstrap.cc:654] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.345304 19867 consensus_queue.cc:260] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.360220 19867 ts_tablet_manager.cc:1434] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:13:31.361387 19867 tablet_bootstrap.cc:492] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:31.362048 19864 tablet_bootstrap.cc:492] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:31.362533 19864 ts_tablet_manager.cc:1403] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 12:13:31.364172 20080 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.364933 20080 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.365911 19864 raft_consensus.cc:359] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.367084 19864 raft_consensus.cc:385] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.367362 19864 raft_consensus.cc:740] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.367764 20137 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:31.368072 19864 consensus_queue.cc:260] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.370466 19864 ts_tablet_manager.cc:1434] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:31.372799 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:31.373667 19670 raft_consensus.cc:2393] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:31.373965 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:31.378140 19789 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:31.380360 20145 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.382162 19867 tablet_bootstrap.cc:654] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.390913 20080 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:31.407258 20145 raft_consensus.cc:2749] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:31.408463 19864 tablet_bootstrap.cc:492] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:31.469309 19864 tablet_bootstrap.cc:654] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.472045 20137 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.472889 20137 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.477851 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:31.479053 19670 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:31.483144 19714 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:31.488487 20141 raft_consensus.cc:2804] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:31.488905 20141 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.489235 20141 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.494554 20137 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:31.495725 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:31.497577 19823 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:31.499583 19865 tablet_bootstrap.cc:492] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:31.499877 19867 tablet_bootstrap.cc:492] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:31.500141 19865 ts_tablet_manager.cc:1403] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.187s	user 0.066s	sys 0.093s
I20260709 12:13:31.500411 19867 ts_tablet_manager.cc:1403] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.139s	user 0.037s	sys 0.060s
I20260709 12:13:31.500960 20141 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.502933 19865 raft_consensus.cc:359] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.503598 19865 raft_consensus.cc:385] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.503214 19867 raft_consensus.cc:359] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.503919 19865 raft_consensus.cc:740] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.504096 19867 raft_consensus.cc:385] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.504031 19942 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:31.504329 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:31.504531 19867 raft_consensus.cc:740] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.505007 19670 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.505353 19867 consensus_queue.cc:260] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.506819 20141 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:31.504673 19865 consensus_queue.cc:260] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.509135 19865 ts_tablet_manager.cc:1434] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:31.510531 19867 ts_tablet_manager.cc:1434] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:13:31.511996 19867 tablet_bootstrap.cc:492] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:31.512230 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:31.512895 19824 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.514394 19670 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:31.515626 19714 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:31.516453 19865 tablet_bootstrap.cc:492] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:31.516570 20137 raft_consensus.cc:2804] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:31.517364 20137 raft_consensus.cc:697] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:31.532588 19867 tablet_bootstrap.cc:654] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.532455 20137 consensus_queue.cc:237] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.542054 20141 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:31.546950 19864 tablet_bootstrap.cc:492] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:31.547578 19864 ts_tablet_manager.cc:1403] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.154s	user 0.005s	sys 0.012s
I20260709 12:13:31.547885 19865 tablet_bootstrap.cc:654] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.571120 19824 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:31.572479 19864 raft_consensus.cc:359] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.574000 19864 raft_consensus.cc:385] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.574406 19864 raft_consensus.cc:740] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.575182 19864 consensus_queue.cc:260] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.577481 19864 ts_tablet_manager.cc:1434] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.006s
I20260709 12:13:31.579787 20154 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.580578 19865 tablet_bootstrap.cc:492] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:31.580345 20154 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.581125 19865 ts_tablet_manager.cc:1403] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.065s	user 0.039s	sys 0.012s
I20260709 12:13:31.578725 19864 tablet_bootstrap.cc:492] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:31.584796 20154 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:31.586634 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:31.587285 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:31.587488 19820 raft_consensus.cc:2393] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:31.588656 20080 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.589365 20080 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.589694 19640 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:31.591903 20080 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:31.593336 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:31.593987 19749 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:31.594455 20161 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.594699 20154 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.594974 20161 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.595577 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:31.596235 19670 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:31.597296 20161 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:31.597891 19788 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:31.598417 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:31.598814 20161 raft_consensus.cc:2804] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:31.599319 20161 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.599722 20161 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:31.599821 19788 leader_election.cc:343] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:31.594935 19864 tablet_bootstrap.cc:654] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.607295 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:31.597265 19865 raft_consensus.cc:359] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.611606 19865 raft_consensus.cc:385] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.612035 19865 raft_consensus.cc:740] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
W20260709 12:13:31.612413 19789 leader_election.cc:343] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:31.612874 19789 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:31.613854 19981 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:31.614921 19865 consensus_queue.cc:260] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.617525 19865 ts_tablet_manager.cc:1434] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:13:31.618446 19865 tablet_bootstrap.cc:492] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:31.621847 19571 catalog_manager.cc:5697] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.625324 19981 raft_consensus.cc:493] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.625804 19981 raft_consensus.cc:515] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.628394 19981 leader_election.cc:290] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:31.629092 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:31.635821 20154 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:31.638885 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:31.639701 19671 raft_consensus.cc:2468] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:31.629946 19749 raft_consensus.cc:2468] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:31.641187 19788 leader_election.cc:304] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:31.641990 19981 raft_consensus.cc:2804] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:31.642333 19981 raft_consensus.cc:493] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.642649 19981 raft_consensus.cc:3060] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.650096 19981 raft_consensus.cc:515] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.652181 19981 leader_election.cc:290] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:13:31.656852 19788 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:31.658526 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:31.659111 19749 raft_consensus.cc:3060] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.657889 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:31.656443 20161 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.668074 19867 tablet_bootstrap.cc:492] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:31.668731 19867 ts_tablet_manager.cc:1403] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.157s	user 0.028s	sys 0.033s
I20260709 12:13:31.661146 19672 raft_consensus.cc:3060] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.673027 19867 raft_consensus.cc:359] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.673936 19867 raft_consensus.cc:385] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.674245 19867 raft_consensus.cc:740] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.676038 20080 consensus_queue.cc:1048] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:31.676947 19672 raft_consensus.cc:2468] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:31.677127 19864 tablet_bootstrap.cc:492] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:31.677814 19864 ts_tablet_manager.cc:1403] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.099s	user 0.024s	sys 0.008s
I20260709 12:13:31.679315 20161 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:31.682832 20137 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.683363 20137 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.684558 19788 leader_election.cc:304] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:31.685053 20137 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:31.686530 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:31.686292 19867 consensus_queue.cc:260] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.693922 19864 raft_consensus.cc:359] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.694679 19864 raft_consensus.cc:385] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.686756 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:31.694980 19864 raft_consensus.cc:740] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.688730 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:31.695544 19867 ts_tablet_manager.cc:1434] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 12:13:31.695964 19747 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.695796 19864 consensus_queue.cc:260] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.696899 19867 tablet_bootstrap.cc:492] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:31.698375 19864 ts_tablet_manager.cc:1434] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 12:13:31.698942 20161 raft_consensus.cc:2804] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:31.702112 19942 consensus_queue.cc:1048] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:31.699697 19713 leader_election.cc:343] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:31.704191 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:31.705179 20161 raft_consensus.cc:697] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:31.706107 20161 consensus_queue.cc:237] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.712728 19867 tablet_bootstrap.cc:654] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.714064 19864 tablet_bootstrap.cc:492] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
W20260709 12:13:31.705976 19714 leader_election.cc:343] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:31.715617 19714 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:31.716459 20137 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:31.719049 20137 consensus_queue.cc:1048] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:31.687215 19670 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.670115 19749 raft_consensus.cc:2468] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:31.693091 19865 tablet_bootstrap.cc:654] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.726285 19864 tablet_bootstrap.cc:654] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:31.726976 19747 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:31.732215 19789 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:31.733155 20145 raft_consensus.cc:2804] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:31.733716 20145 raft_consensus.cc:697] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:31.734912 20145 consensus_queue.cc:237] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.755035 20137 consensus_queue.cc:1048] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:31.767264 20141 consensus_queue.cc:1048] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:31.797601 20154 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.803072 20137 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.813745 20154 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.827629 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:31.828549 19821 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:13:31.826536 20154 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:31.840411 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:31.841178 19749 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:31.853250 19670 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:31.854993 19640 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:31.856158 20154 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:31.821724 20137 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.863461 19865 tablet_bootstrap.cc:492] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:31.864105 19865 ts_tablet_manager.cc:1403] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.246s	user 0.010s	sys 0.022s
I20260709 12:13:31.864840 20154 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:31.879254 19867 tablet_bootstrap.cc:492] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:31.880000 19867 ts_tablet_manager.cc:1403] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.183s	user 0.023s	sys 0.027s
I20260709 12:13:31.867353 20137 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:31.901437 19865 raft_consensus.cc:359] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.902431 19865 raft_consensus.cc:385] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.902762 19865 raft_consensus.cc:740] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
W20260709 12:13:31.905015 19621 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:31.913264 19864 tablet_bootstrap.cc:492] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:31.913789 19864 ts_tablet_manager.cc:1403] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.200s	user 0.013s	sys 0.018s
I20260709 12:13:31.918769 19571 catalog_manager.cc:5697] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.921805 19571 catalog_manager.cc:5697] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.908144 19865 consensus_queue.cc:260] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.934533 19865 ts_tablet_manager.cc:1434] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.070s	user 0.002s	sys 0.005s
W20260709 12:13:31.938437 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 98649.3us
W20260709 12:13:31.906183 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 67497.3us
I20260709 12:13:31.952625 19864 raft_consensus.cc:359] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.972584 19865 tablet_bootstrap.cc:492] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:31.973397 19867 raft_consensus.cc:359] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.978328 19864 raft_consensus.cc:385] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.980656 19864 raft_consensus.cc:740] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.981473 19864 consensus_queue.cc:260] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.974280 19867 raft_consensus.cc:385] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:31.983426 19867 raft_consensus.cc:740] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:31.995312 19864 ts_tablet_manager.cc:1434] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.009s
I20260709 12:13:31.994177 19867 consensus_queue.cc:260] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:31.996934 19864 tablet_bootstrap.cc:492] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:32.003540 19867 ts_tablet_manager.cc:1434] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.123s	user 0.007s	sys 0.003s
W20260709 12:13:32.019888 20195 log.cc:927] Time spent T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.136s	user 0.001s	sys 0.002s
I20260709 12:13:32.034067 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:32.041056 19713 leader_election.cc:343] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.051725 19867 tablet_bootstrap.cc:492] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:32.054003 20154 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.054579 20154 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.059229 20154 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:32.063097 19675 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.063237 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:32.069396 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:32.073396 19640 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:32.074087 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:32.075452 19865 tablet_bootstrap.cc:654] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.082680 20145 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.083573 19864 tablet_bootstrap.cc:654] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.083289 20145 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.087988 20145 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.090590 19867 tablet_bootstrap.cc:654] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.099107 19864 tablet_bootstrap.cc:492] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:32.099591 19864 ts_tablet_manager.cc:1403] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.103s	user 0.008s	sys 0.006s
I20260709 12:13:32.104569 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:32.108378 19714 leader_election.cc:343] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.108990 19714 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:13:32.111733 19788 leader_election.cc:343] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.112895 19864 raft_consensus.cc:359] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.118719 19864 raft_consensus.cc:385] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.119092 19864 raft_consensus.cc:740] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.119148 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:32.119787 19747 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:32.120908 20140 raft_consensus.cc:2749] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:32.119794 19864 consensus_queue.cc:260] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.126039 19864 ts_tablet_manager.cc:1434] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.004s
I20260709 12:13:32.127302 19864 tablet_bootstrap.cc:492] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:32.138281 20145 consensus_queue.cc:1048] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:32.145238 19865 tablet_bootstrap.cc:492] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:32.145828 19865 ts_tablet_manager.cc:1403] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.174s	user 0.017s	sys 0.006s
I20260709 12:13:32.148950 19865 raft_consensus.cc:359] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.149664 19865 raft_consensus.cc:385] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.149945 19865 raft_consensus.cc:740] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.150615 19865 consensus_queue.cc:260] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.152670 19865 ts_tablet_manager.cc:1434] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:32.153904 19865 tablet_bootstrap.cc:492] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:32.142583 19864 tablet_bootstrap.cc:654] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.166433 20140 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:32.166455 19867 tablet_bootstrap.cc:492] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:32.171381 19867 ts_tablet_manager.cc:1403] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.124s	user 0.006s	sys 0.021s
I20260709 12:13:32.173678 19867 raft_consensus.cc:359] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.174271 19867 raft_consensus.cc:385] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.174525 19867 raft_consensus.cc:740] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.175196 19867 consensus_queue.cc:260] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.177469 19867 ts_tablet_manager.cc:1434] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:32.180460 19864 tablet_bootstrap.cc:492] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:32.181118 19864 ts_tablet_manager.cc:1403] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.004s
I20260709 12:13:32.183140 19865 tablet_bootstrap.cc:654] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.184501 19864 raft_consensus.cc:359] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.184233 19867 tablet_bootstrap.cc:492] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:32.185254 19864 raft_consensus.cc:385] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.185582 19864 raft_consensus.cc:740] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.186708 19864 consensus_queue.cc:260] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.189079 19864 ts_tablet_manager.cc:1434] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:32.190171 19864 tablet_bootstrap.cc:492] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:32.203974 19789 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.207135 19864 tablet_bootstrap.cc:654] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.208873 19981 raft_consensus.cc:2804] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:32.209367 19981 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.209704 19981 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.216667 19867 tablet_bootstrap.cc:654] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.217141 19981 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.230386 19981 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.247498 20080 consensus_queue.cc:1048] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:32.248319 20205 consensus_queue.cc:1048] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:32.237079 20074 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:13:32.235594 20153 raft_consensus.cc:2749] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:32.252126 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:32.255036 19672 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.268316 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:32.269114 19750 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.262501 20205 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.271773 20205 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.278836 19865 tablet_bootstrap.cc:492] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:32.279706 19865 ts_tablet_manager.cc:1403] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.126s	user 0.031s	sys 0.004s
W20260709 12:13:32.286530 20213 log.cc:927] Time spent T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:13:32.295197 20205 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.295849 19864 tablet_bootstrap.cc:492] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:32.295814 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:32.296761 19864 ts_tablet_manager.cc:1403] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.107s	user 0.037s	sys 0.029s
W20260709 12:13:32.297569 19788 leader_election.cc:343] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.301667 19864 raft_consensus.cc:359] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.302471 19864 raft_consensus.cc:385] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.302814 19864 raft_consensus.cc:740] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.303496 19864 consensus_queue.cc:260] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.306770 19864 ts_tablet_manager.cc:1434] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:13:32.310209 19864 tablet_bootstrap.cc:492] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:32.313306 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:32.314051 19747 raft_consensus.cc:2468] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:32.321120 19789 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.322007 20145 raft_consensus.cc:2804] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:32.322443 20145 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.322896 20145 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.325083 19865 raft_consensus.cc:359] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.325899 19865 raft_consensus.cc:385] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.326249 19865 raft_consensus.cc:740] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.331543 19672 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:32.333468 19750 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:32.335866 19864 tablet_bootstrap.cc:654] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.339206 20145 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.339529 20206 consensus_queue.cc:1048] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:32.340507 19867 tablet_bootstrap.cc:492] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:32.340950 19788 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:32.341545 19867 ts_tablet_manager.cc:1403] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.158s	user 0.016s	sys 0.003s
I20260709 12:13:32.342445 20205 raft_consensus.cc:2804] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:32.343072 20205 raft_consensus.cc:697] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:32.343530 19865 consensus_queue.cc:260] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.344012 20205 consensus_queue.cc:237] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.345739 19867 raft_consensus.cc:359] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.346495 19867 raft_consensus.cc:385] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.346769 19867 raft_consensus.cc:740] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.345775 20145 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.348007 19867 consensus_queue.cc:260] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.350657 19865 ts_tablet_manager.cc:1434] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.070s	user 0.003s	sys 0.003s
I20260709 12:13:32.351704 19865 tablet_bootstrap.cc:492] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:32.355257 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:32.355737 20145 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.356319 20145 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:32.357087 19788 leader_election.cc:343] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.358187 19867 ts_tablet_manager.cc:1434] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:13:32.359270 20145 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.360919 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:32.363102 19788 leader_election.cc:343] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.363802 19867 tablet_bootstrap.cc:492] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:32.367519 19864 tablet_bootstrap.cc:492] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:32.368055 19864 ts_tablet_manager.cc:1403] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.002s
I20260709 12:13:32.370983 19864 raft_consensus.cc:359] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.371621 19864 raft_consensus.cc:385] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.371861 19864 raft_consensus.cc:740] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.372455 19864 consensus_queue.cc:260] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.374547 19864 ts_tablet_manager.cc:1434] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:32.383193 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:32.391490 19864 tablet_bootstrap.cc:492] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:32.387323 19865 tablet_bootstrap.cc:654] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.377967 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:32.399163 19750 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.386368 19867 tablet_bootstrap.cc:654] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.408533 19750 raft_consensus.cc:2468] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:32.387673 19572 catalog_manager.cc:5697] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.416154 19867 tablet_bootstrap.cc:492] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:32.416806 19867 ts_tablet_manager.cc:1403] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.002s
W20260709 12:13:32.420346 19789 leader_election.cc:343] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.421136 19789 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.424203 20206 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:32.425935 19867 raft_consensus.cc:359] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.427683 19867 raft_consensus.cc:385] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.428107 19867 raft_consensus.cc:740] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.428936 19867 consensus_queue.cc:260] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.430739 19867 ts_tablet_manager.cc:1434] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 12:13:32.432627 19867 tablet_bootstrap.cc:492] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:32.439306 19867 tablet_bootstrap.cc:654] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.439371 20206 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.439967 20206 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.440943 19865 tablet_bootstrap.cc:492] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:32.441478 19865 ts_tablet_manager.cc:1403] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.090s	user 0.006s	sys 0.022s
I20260709 12:13:32.442474 20140 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.443266 20140 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.446811 19865 raft_consensus.cc:359] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.447672 19865 raft_consensus.cc:385] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.447969 19865 raft_consensus.cc:740] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.448705 19865 consensus_queue.cc:260] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.449371 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:32.451131 19865 ts_tablet_manager.cc:1434] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:13:32.452334 19865 tablet_bootstrap.cc:492] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
W20260709 12:13:32.453595 19788 leader_election.cc:343] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.442636 20206 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.478369 19865 tablet_bootstrap.cc:654] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.479063 20153 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.479688 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:32.479930 20153 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.485984 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:32.486189 20153 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:32.486929 19750 raft_consensus.cc:2393] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
W20260709 12:13:32.487231 19713 leader_election.cc:343] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.493194 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:32.494248 19823 raft_consensus.cc:2393] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:13:32.466384 20140 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:32.501248 19789 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.502610 20205 raft_consensus.cc:2804] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:32.503377 20205 raft_consensus.cc:697] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:32.504402 20205 consensus_queue.cc:237] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.508888 19867 tablet_bootstrap.cc:492] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:32.509464 19867 ts_tablet_manager.cc:1403] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.077s	user 0.037s	sys 0.031s
I20260709 12:13:32.509908 19638 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:32.513304 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:32.525938 19864 tablet_bootstrap.cc:654] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.525898 19668 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:32.513988 20204 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.523542 19867 raft_consensus.cc:359] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.512933 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:32.528376 19867 raft_consensus.cc:385] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.528656 19867 raft_consensus.cc:740] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.528667 19749 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:32.529510 19714 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:32.527890 20204 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.531401 19789 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.532136 19981 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:32.530239 19867 consensus_queue.cc:260] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.515630 20141 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.537461 20141 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.532703 19981 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.538321 19865 tablet_bootstrap.cc:492] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:32.538527 19981 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.538858 19865 ts_tablet_manager.cc:1403] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.007s
I20260709 12:13:32.540875 20141 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:32.514020 20154 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.541117 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:32.541285 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:32.542414 19668 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:32.542476 19867 ts_tablet_manager.cc:1434] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:13:32.544121 19867 tablet_bootstrap.cc:492] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:32.544662 19714 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:32.536990 20204 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:32.548300 20141 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:32.548868 20141 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.549297 20141 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.562862 20154 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:32.568722 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:32.540479 20074 raft_consensus.cc:2804] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:32.566821 19573 catalog_manager.cc:5697] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.569543 19822 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:32.572042 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:32.575731 19823 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
W20260709 12:13:32.573788 19714 leader_election.cc:343] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.573756 19865 raft_consensus.cc:359] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.583719 19865 raft_consensus.cc:385] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.582885 19713 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.583386 19867 tablet_bootstrap.cc:654] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.574236 20074 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.591470 20074 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.597553 20203 raft_consensus.cc:2804] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:32.599007 20203 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.599640 20203 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.583159 20141 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.609588 20141 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:32.612191 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:32.620476 19672 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.620592 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:32.596439 19981 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.621246 19823 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.623394 19981 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.619313 19864 tablet_bootstrap.cc:492] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:32.623829 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:32.624176 19864 ts_tablet_manager.cc:1403] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.233s	user 0.022s	sys 0.020s
W20260709 12:13:32.625646 19788 leader_election.cc:343] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.619837 19865 raft_consensus.cc:740] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.627257 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:32.628005 19746 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.628132 19865 consensus_queue.cc:260] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.629153 19672 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:13:32.629623 19823 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:13:32.631213 19867 tablet_bootstrap.cc:492] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:32.631143 19714 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:32.631839 19867 ts_tablet_manager.cc:1403] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.005s
I20260709 12:13:32.632364 20141 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.633795 20141 raft_consensus.cc:697] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:32.634018 20074 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.636502 20074 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:32.635663 19867 raft_consensus.cc:359] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.639223 19867 raft_consensus.cc:385] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.639504 19867 raft_consensus.cc:740] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.639540 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:32.640169 19867 consensus_queue.cc:260] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.638188 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:32.642525 19867 ts_tablet_manager.cc:1434] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:13:32.642627 19672 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.644300 19865 ts_tablet_manager.cc:1434] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.001s
I20260709 12:13:32.643649 20203 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:32.645040 19713 leader_election.cc:343] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.645643 19865 tablet_bootstrap.cc:492] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:32.647128 20203 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:32.647802 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:32.648455 19673 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.627277 19864 raft_consensus.cc:359] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.649346 19864 raft_consensus.cc:385] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.649605 19864 raft_consensus.cc:740] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.649617 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:32.650524 19823 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.651260 19746 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:32.643635 19867 tablet_bootstrap.cc:492] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:32.657707 19823 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:32.650516 19864 consensus_queue.cc:260] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.635644 20141 consensus_queue.cc:237] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.658077 19867 tablet_bootstrap.cc:654] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.664916 19865 tablet_bootstrap.cc:654] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.658427 19789 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.674125 20206 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:32.674674 20206 raft_consensus.cc:697] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:32.674161 19672 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:32.659794 19713 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:32.677296 19864 ts_tablet_manager.cc:1434] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.007s
I20260709 12:13:32.660661 19673 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:32.678350 19864 tablet_bootstrap.cc:492] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:32.675638 20206 consensus_queue.cc:237] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.680410 19714 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:32.681563 20203 raft_consensus.cc:2804] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:32.682282 20203 raft_consensus.cc:697] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:32.683256 20203 consensus_queue.cc:237] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.689074 19864 tablet_bootstrap.cc:654] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.689879 20074 raft_consensus.cc:2804] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:32.690606 20074 raft_consensus.cc:697] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:32.691653 20074 consensus_queue.cc:237] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.701984 19864 tablet_bootstrap.cc:492] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:32.702561 19864 ts_tablet_manager.cc:1403] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 12:13:32.707955 19571 catalog_manager.cc:5697] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 2, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.712358 19864 raft_consensus.cc:359] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.713195 19864 raft_consensus.cc:385] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.713506 19864 raft_consensus.cc:740] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.714527 20205 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.717993 20205 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.720290 20205 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.715468 19865 tablet_bootstrap.cc:492] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:32.721100 19865 ts_tablet_manager.cc:1403] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.007s
I20260709 12:13:32.717522 19867 tablet_bootstrap.cc:492] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:32.723328 19867 ts_tablet_manager.cc:1403] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.009s
I20260709 12:13:32.724056 19865 raft_consensus.cc:359] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.724853 19865 raft_consensus.cc:385] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.725167 19865 raft_consensus.cc:740] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.726194 19867 raft_consensus.cc:359] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.728034 19867 raft_consensus.cc:385] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.728367 19867 raft_consensus.cc:740] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.727312 19864 consensus_queue.cc:260] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.730700 19864 ts_tablet_manager.cc:1434] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.001s
I20260709 12:13:32.731165 19865 consensus_queue.cc:260] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.724128 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:32.731456 19867 consensus_queue.cc:260] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.736183 19867 ts_tablet_manager.cc:1434] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:13:32.734552 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:32.737421 19867 tablet_bootstrap.cc:492] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
W20260709 12:13:32.738969 19788 leader_election.cc:343] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.740027 19864 tablet_bootstrap.cc:492] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
W20260709 12:13:32.743669 19789 leader_election.cc:343] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.744297 19789 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.749110 20145 consensus_queue.cc:1048] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:32.750497 19981 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:32.746542 19572 catalog_manager.cc:5697] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.757997 19865 ts_tablet_manager.cc:1434] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:13:32.759320 19865 tablet_bootstrap.cc:492] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:32.761108 19573 catalog_manager.cc:5697] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.762897 19573 catalog_manager.cc:5697] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.766382 19865 tablet_bootstrap.cc:654] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.769208 19864 tablet_bootstrap.cc:654] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.774547 19867 tablet_bootstrap.cc:654] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.785255 20141 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.785913 20141 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.789364 20145 consensus_queue.cc:1048] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:32.791988 19867 tablet_bootstrap.cc:492] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:32.792565 19867 ts_tablet_manager.cc:1403] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.007s
I20260709 12:13:32.796649 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:32.796846 20206 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.797525 20206 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.796519 19867 raft_consensus.cc:359] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.800098 19867 raft_consensus.cc:385] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.799818 20206 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.801307 19867 raft_consensus.cc:740] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
W20260709 12:13:32.799539 19714 leader_election.cc:343] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.802553 19867 consensus_queue.cc:260] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.804098 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:32.804982 19668 raft_consensus.cc:2393] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:32.803049 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:32.805379 20141 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:32.802968 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:32.807420 19867 ts_tablet_manager.cc:1434] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
W20260709 12:13:32.807845 19713 leader_election.cc:343] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.809408 19713 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.810513 19867 tablet_bootstrap.cc:492] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:32.810710 20204 raft_consensus.cc:2749] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:32.811025 19865 tablet_bootstrap.cc:492] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:32.813458 19865 ts_tablet_manager.cc:1403] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.007s
I20260709 12:13:32.813712 19789 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.814846 20206 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.822139 20206 raft_consensus.cc:2749] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:32.824512 20206 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.825021 20206 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.827859 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:32.829320 19788 leader_election.cc:343] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.830243 19865 raft_consensus.cc:359] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.838294 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:32.839277 19746 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:32.837942 20206 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.838528 19865 raft_consensus.cc:385] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.840969 19789 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.841257 19865 raft_consensus.cc:740] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.841928 19867 tablet_bootstrap.cc:654] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.842204 19865 consensus_queue.cc:260] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.842928 20206 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:32.843422 20206 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.843781 20206 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.844115 19865 ts_tablet_manager.cc:1434] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:13:32.849771 19865 tablet_bootstrap.cc:492] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:32.852033 19864 tablet_bootstrap.cc:492] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:32.854180 19867 tablet_bootstrap.cc:492] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:32.853256 20206 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.854956 19864 ts_tablet_manager.cc:1403] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.016s
I20260709 12:13:32.854924 20205 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.856455 20205 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.857249 19867 ts_tablet_manager.cc:1403] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.010s
I20260709 12:13:32.858407 19864 raft_consensus.cc:359] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.859144 19864 raft_consensus.cc:385] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.859452 19864 raft_consensus.cc:740] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.859755 20206 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.861828 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:32.860193 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:32.862964 19867 raft_consensus.cc:359] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.863857 19867 raft_consensus.cc:385] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.864462 19867 raft_consensus.cc:740] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.863250 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:32.863945 19789 leader_election.cc:343] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.861850 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:32.865864 19749 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.865541 19867 consensus_queue.cc:260] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.868372 19865 tablet_bootstrap.cc:654] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.869055 19867 ts_tablet_manager.cc:1434] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:13:32.870285 19867 tablet_bootstrap.cc:492] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
W20260709 12:13:32.875547 19788 leader_election.cc:343] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.879334 20204 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.879935 20204 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.882449 20204 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:13:32.883311 19788 leader_election.cc:343] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.883771 19788 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.885028 19981 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:32.885161 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:32.861940 20205 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:13:32.889570 19713 leader_election.cc:343] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.860083 19864 consensus_queue.cc:260] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.890496 20203 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.894214 20203 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.895908 19864 ts_tablet_manager.cc:1434] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:13:32.897800 19864 tablet_bootstrap.cc:492] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:32.904466 19864 tablet_bootstrap.cc:654] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:32.905421 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:32.910923 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:32.911648 19668 raft_consensus.cc:2468] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:32.913369 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:32.920974 19714 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:32.918977 19867 tablet_bootstrap.cc:654] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:32.922297 19714 leader_election.cc:343] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.922907 19714 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.896688 20203 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:32.925190 20074 raft_consensus.cc:2804] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:32.925755 20074 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.926251 20074 raft_consensus.cc:3060] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.927217 19865 tablet_bootstrap.cc:492] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:32.927820 19865 ts_tablet_manager.cc:1403] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.078s	user 0.023s	sys 0.021s
I20260709 12:13:32.892614 19749 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:32.930424 20203 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:32.931463 19713 leader_election.cc:343] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.936509 19865 raft_consensus.cc:359] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.941030 20206 consensus_queue.cc:1048] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:32.946554 19867 tablet_bootstrap.cc:492] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:32.947131 19867 ts_tablet_manager.cc:1403] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.004s
I20260709 12:13:32.948776 19865 raft_consensus.cc:385] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.949126 19865 raft_consensus.cc:740] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.949824 19865 consensus_queue.cc:260] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.956310 20074 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.960824 19865 ts_tablet_manager.cc:1434] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:13:32.962167 19865 tablet_bootstrap.cc:492] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:32.962443 19789 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.964581 20206 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:32.965293 20206 raft_consensus.cc:697] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:32.967255 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:32.967387 20206 consensus_queue.cc:237] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.968185 19672 raft_consensus.cc:3060] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:32.969707 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:32.965682 19981 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.966197 20074 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:32.965169 19867 raft_consensus.cc:359] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.971360 19981 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.971879 19867 raft_consensus.cc:385] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:32.972379 19867 raft_consensus.cc:740] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:32.973132 19867 consensus_queue.cc:260] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:32.974206 19981 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:32.975260 19867 ts_tablet_manager.cc:1434] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 12:13:32.976429 19867 tablet_bootstrap.cc:492] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:32.977672 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:32.981360 19621 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:13:32.983903 19713 leader_election.cc:343] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.986408 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:32.986953 19672 raft_consensus.cc:2468] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
W20260709 12:13:32.992637 19789 leader_election.cc:343] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.995616 19714 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
W20260709 12:13:32.995671 19788 leader_election.cc:343] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:32.996495 19788 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:32.996933 20140 raft_consensus.cc:2804] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:32.997308 20206 raft_consensus.cc:2749] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:32.998826 19864 tablet_bootstrap.cc:492] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:32.999480 20140 raft_consensus.cc:697] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:33.000017 19864 ts_tablet_manager.cc:1403] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.102s	user 0.024s	sys 0.021s
I20260709 12:13:33.000560 20140 consensus_queue.cc:237] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.006708 19572 catalog_manager.cc:5697] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:33.009618 19865 tablet_bootstrap.cc:654] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:33.011701 19867 tablet_bootstrap.cc:654] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:33.012583 19864 raft_consensus.cc:359] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.013674 19864 raft_consensus.cc:385] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:33.014079 19864 raft_consensus.cc:740] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:33.015269 19864 consensus_queue.cc:260] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.019147 19864 ts_tablet_manager.cc:1434] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 12:13:33.020659 19864 tablet_bootstrap.cc:492] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:33.021951 19865 tablet_bootstrap.cc:492] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:33.022934 20141 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.023007 19865 ts_tablet_manager.cc:1403] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.061s	user 0.006s	sys 0.012s
I20260709 12:13:33.023939 20141 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.026310 20141 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:33.027416 19865 raft_consensus.cc:359] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.028223 19865 raft_consensus.cc:385] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:33.029301 19864 tablet_bootstrap.cc:654] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:33.033980 19867 tablet_bootstrap.cc:492] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:33.034644 19867 ts_tablet_manager.cc:1403] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.006s
I20260709 12:13:33.036015 19865 raft_consensus.cc:740] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:33.037204 19865 consensus_queue.cc:260] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.045053 19865 ts_tablet_manager.cc:1434] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:13:33.047737 20154 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.048362 19865 tablet_bootstrap.cc:492] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:33.048724 19864 tablet_bootstrap.cc:492] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:33.048363 20154 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.049510 19864 ts_tablet_manager.cc:1403] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.005s
I20260709 12:13:33.053135 19864 raft_consensus.cc:359] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.054040 19864 raft_consensus.cc:385] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:33.054116 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:33.055125 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 57690.5us
I20260709 12:13:33.054446 19864 raft_consensus.cc:740] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
W20260709 12:13:33.056905 19638 leader_election.cc:343] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:33.060215 19864 consensus_queue.cc:260] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.057137 19867 raft_consensus.cc:359] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.061125 19867 raft_consensus.cc:385] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:33.061439 19867 raft_consensus.cc:740] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:33.058279 19865 tablet_bootstrap.cc:654] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:33.058418 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:33.062296 19749 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:33.062530 19864 ts_tablet_manager.cc:1434] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:13:33.063786 19640 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:33.064206 19864 tablet_bootstrap.cc:492] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:33.064744 20102 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:33.065183 20102 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.065582 20102 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:33.071776 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:33.076431 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:33.058591 20154 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:13:33.081063 19713 leader_election.cc:343] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:33.084400 20141 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:33.077901 20102 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.088574 19864 tablet_bootstrap.cc:654] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:33.089437 19867 consensus_queue.cc:260] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.101168 19867 ts_tablet_manager.cc:1434] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
I20260709 12:13:33.090030 19673 raft_consensus.cc:2393] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 1: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:13:33.102394 19867 tablet_bootstrap.cc:492] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:33.090355 20206 consensus_queue.cc:1048] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:13:33.150251 20140 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.151291 20140 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.215386 19981 consensus_queue.cc:1048] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 12:13:33.213002 19572 catalog_manager.cc:5697] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.161196 20140 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:33.168967 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:33.270148 19867 tablet_bootstrap.cc:654] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:33.290297 19714 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:13:33.289868 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 75840.4us
I20260709 12:13:33.315068 19822 raft_consensus.cc:2468] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:33.344386 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:33.349176 19672 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:33.295491 20102 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:13:33.360343 19638 leader_election.cc:343] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:33.275244 20206 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.351429 20260 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:33.372336 20206 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.365825 20102 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.377867 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:33.403273 20102 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:33.413702 20253 log.cc:927] Time spent T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:13:33.414990 20102 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:33.417591 19864 tablet_bootstrap.cc:492] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:33.418288 19864 ts_tablet_manager.cc:1403] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.354s	user 0.080s	sys 0.077s
I20260709 12:13:33.407677 20154 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.419355 20154 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.431501 20262 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.481588 20260 raft_consensus.cc:2749] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:33.490157 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 107529us
I20260709 12:13:33.459221 20261 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.493247 19864 raft_consensus.cc:359] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.494549 19864 raft_consensus.cc:385] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:33.495009 19864 raft_consensus.cc:740] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:33.495774 19864 consensus_queue.cc:260] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.502462 19713 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:33.484980 19674 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:33.588954 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 190324us
I20260709 12:13:33.470166 20262 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.602069 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:33.603200 20262 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:33.585278 20206 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:33.510404 20261 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.606401 20261 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:33.594189 20074 raft_consensus.cc:2804] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:33.608363 20154 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:33.612785 19864 ts_tablet_manager.cc:1434] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.194s	user 0.010s	sys 0.001s
I20260709 12:13:33.591084 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:33.622277 19864 tablet_bootstrap.cc:492] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:33.613237 20074 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.640918 20074 raft_consensus.cc:3060] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:33.689648 19865 tablet_bootstrap.cc:492] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:33.709635 19865 ts_tablet_manager.cc:1403] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.662s	user 0.017s	sys 0.029s
W20260709 12:13:33.707719 19788 leader_election.cc:343] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:33.718294 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 128501us
I20260709 12:13:33.716403 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:33.647940 20270 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.091s
I20260709 12:13:33.751238 20279 consensus_queue.cc:1048] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:33.787786 19714 leader_election.cc:343] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:33.797784 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:33.805470 19865 raft_consensus.cc:359] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.809559 19865 raft_consensus.cc:385] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:33.810017 19865 raft_consensus.cc:740] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:33.839895 19864 tablet_bootstrap.cc:654] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:33.839411 19865 consensus_queue.cc:260] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.846197 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:33.847725 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:33.848469 19818 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
W20260709 12:13:33.852227 20273 log.cc:927] Time spent T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:13:33.855054 19865 ts_tablet_manager.cc:1434] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.145s	user 0.022s	sys 0.011s
I20260709 12:13:33.860780 19867 tablet_bootstrap.cc:492] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:33.861383 19867 ts_tablet_manager.cc:1403] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.759s	user 0.027s	sys 0.038s
I20260709 12:13:33.877270 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:33.879739 19675 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:33.859926 20260 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.890120 19865 tablet_bootstrap.cc:492] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:33.889663 20260 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.895637 19743 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:13:33.899664 19867 raft_consensus.cc:359] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.900492 19867 raft_consensus.cc:385] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:33.900825 19867 raft_consensus.cc:740] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:33.901414 19867 consensus_queue.cc:260] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:33.907428 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:33.909420 19867 ts_tablet_manager.cc:1434] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 12:13:33.910737 19867 tablet_bootstrap.cc:492] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:33.910426 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:33.912277 19746 raft_consensus.cc:2468] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:33.930420 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:33.932195 19821 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:34.014468 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:34.032884 19867 tablet_bootstrap.cc:654] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:34.065194 20260 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:34.066964 20274 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.067503 20274 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.073586 20074 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:34.080899 20284 log.cc:927] Time spent T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:13:34.089754 19714 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:34.090520 20204 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:34.090906 20204 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.091275 20204 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:34.092895 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:34.094882 19621 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:34.082618 20274 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:34.101387 20145 consensus_queue.cc:1048] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:34.107134 20074 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:13:34.112341 19789 leader_election.cc:343] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:34.139829 19789 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:13:34.140774 19788 leader_election.cc:343] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:34.128456 19640 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:13:34.143031 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:34.144430 19788 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:34.155387 20278 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:13:34.159821 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:34.160590 19815 raft_consensus.cc:3060] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:34.161954 19713 consensus_peers.cc:597] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.164235 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:34.150512 20205 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:34.162554 19638 leader_election.cc:343] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:34.162890 20277 consensus_queue.cc:1048] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:13:34.151443 20262 raft_consensus.cc:2804] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:13:34.170264 19713 leader_election.cc:343] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:34.151607 20102 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:34.174412 20204 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.175501 20074 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:34.180059 20270 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.180627 20270 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.185763 19815 raft_consensus.cc:2468] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:34.153013 20206 consensus_queue.cc:1048] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:13:34.178545 20262 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.187678 20262 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:34.188781 19864 tablet_bootstrap.cc:492] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:34.189422 19864 ts_tablet_manager.cc:1403] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.567s	user 0.075s	sys 0.074s
I20260709 12:13:34.189702 19713 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:13:34.190377 19788 consensus_peers.cc:597] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.188673 19714 leader_election.cc:343] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:34.191769 19714 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:34.191962 20102 raft_consensus.cc:697] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:34.194684 20141 raft_consensus.cc:2749] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:34.205353 19788 leader_election.cc:343] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:34.199543 19640 leader_election.cc:343] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:34.195259 20277 raft_consensus.cc:2804] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:34.215752 20277 raft_consensus.cc:697] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:34.223376 19865 tablet_bootstrap.cc:654] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:34.235702 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:34.216832 20277 consensus_queue.cc:237] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.224378 19640 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:34.241781 20102 consensus_queue.cc:237] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.261294 19864 raft_consensus.cc:359] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.246444 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:34.262040 19864 raft_consensus.cc:385] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:34.264654 19864 raft_consensus.cc:740] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:34.270385 19864 consensus_queue.cc:260] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.272295 20272 raft_consensus.cc:2749] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:34.242923 19750 raft_consensus.cc:2468] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:34.288511 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:34.294129 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:34.299842 19864 ts_tablet_manager.cc:1434] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.001s
I20260709 12:13:34.295403 19668 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:34.334499 19714 leader_election.cc:343] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:34.335224 19714 leader_election.cc:343] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:34.346833 20270 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:13:34.348037 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 152542us
I20260709 12:13:34.335742 20268 consensus_queue.cc:1048] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:13:34.384469 19864 tablet_bootstrap.cc:492] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:34.357792 19640 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:34.441294 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:34.441871 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 51887.7us
I20260709 12:13:34.509052 20280 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.509826 20280 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.522258 20280 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:34.446560 19817 raft_consensus.cc:2468] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:34.569669 19867 tablet_bootstrap.cc:492] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:34.570334 19867 ts_tablet_manager.cc:1403] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.660s	user 0.037s	sys 0.061s
I20260709 12:13:34.571180 19713 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:34.581396 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:34.581693 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 229620us
I20260709 12:13:34.591588 20280 raft_consensus.cc:2804] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:34.594668 20280 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.595114 20280 raft_consensus.cc:3060] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:34.610373 20300 raft_consensus.cc:2749] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:34.613659 20206 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.624583 20206 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:34.626530 20298 log.cc:927] Time spent T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:13:34.631201 20206 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:34.640403 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:34.644378 19668 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:34.615571 20262 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.652813 20262 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:34.671010 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:34.672941 19672 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 0.
I20260709 12:13:34.677129 20204 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:34.678573 19867 raft_consensus.cc:359] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.682245 19867 raft_consensus.cc:385] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:34.682583 19867 raft_consensus.cc:740] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:34.685788 19867 consensus_queue.cc:260] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.689035 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:34.689823 19746 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:34.696370 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:34.697208 19817 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:34.698805 19788 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:34.699841 19981 raft_consensus.cc:2804] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:34.700284 19981 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.700587 19981 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:34.703877 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:13:34.706631 19788 leader_election.cc:343] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:34.696558 19789 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:34.709896 20206 raft_consensus.cc:2804] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:34.710372 20206 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.710829 20206 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:34.718609 19865 tablet_bootstrap.cc:492] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:34.719389 19865 ts_tablet_manager.cc:1403] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.843s	user 0.051s	sys 0.023s
I20260709 12:13:34.727329 19572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47140 (request call id 87) took 1606 ms. Trace:
I20260709 12:13:34.736792 19867 ts_tablet_manager.cc:1434] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.166s	user 0.009s	sys 0.000s
I20260709 12:13:34.737769 19571 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47138 (request call id 105) took 1382 ms. Trace:
I20260709 12:13:34.750267 19714 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:34.754947 20280 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.757423 20280 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:34.763595 19981 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.738184 19571 rpcz_store.cc:276] 0709 12:13:33.355513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.355732 (+   219us) service_pool.cc:224] Handling call
0709 12:13:33.466823 (+111091us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b540010ead4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e9090 00007fadf4787f3a 00007fadfa53de9c 00007fadfa63c04e 00007fadf8afd2a4 00007fadf8afd232 00007fadf8afd161 00007fadf8afd0dc 00007fadf8afc392 00007fadf2aba48c 00007fadf2ab98c6
0709 12:13:34.737699 (+1270876us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8701,"reported_tablets":4,"spinlock_wait_cycles":165024512}
I20260709 12:13:34.767822 19981 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:34.771152 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:34.771860 19670 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:34.772977 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:34.773387 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:34.773741 19822 raft_consensus.cc:3060] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:34.764928 20292 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:13:34.750202 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 167371us
I20260709 12:13:34.798834 19867 tablet_bootstrap.cc:492] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:34.796180 19817 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:34.790478 20292 raft_consensus.cc:697] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:34.809381 19865 raft_consensus.cc:359] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.820125 19865 raft_consensus.cc:385] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:34.820521 19865 raft_consensus.cc:740] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
W20260709 12:13:34.821684 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 78193.3us
I20260709 12:13:34.822616 19865 consensus_queue.cc:260] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:34.823419 19789 leader_election.cc:343] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:34.819326 20292 consensus_queue.cc:237] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.812819 19822 raft_consensus.cc:2468] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:34.840119 19865 ts_tablet_manager.cc:1434] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.002s
I20260709 12:13:34.852491 19670 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:34.852662 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:34.854444 19713 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:34.855648 20268 raft_consensus.cc:2804] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:34.856151 20268 raft_consensus.cc:697] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:34.856986 20268 consensus_queue.cc:237] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.857366 19788 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:34.730814 19572 rpcz_store.cc:276] 0709 12:13:33.130012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.130903 (+   891us) service_pool.cc:224] Handling call
0709 12:13:34.724427 (+1593524us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:33.273880 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:33.274672 (+   792us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:33.274730 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:13:33.274752 (+    22us) tablet.cc:662] Decoding operations
0709 12:13:33.275268 (+   516us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:33.275354 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:33.275398 (+    44us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:33.286711 (+ 11313us) tablet.cc:701] Row locks acquired
0709 12:13:33.289291 (+  2580us) write_op.cc:260] PREPARE: finished
0709 12:13:33.315851 (+ 26560us) write_op.cc:270] Start()
0709 12:13:33.345882 (+ 30031us) write_op.cc:276] Timestamp: P: 1783599213315755 usec, L: 0
0709 12:13:33.347364 (+  1482us) op_driver.cc:348] REPLICATION: starting
0709 12:13:33.411541 (+ 64177us) log.cc:844] Serialized 543 byte log entry
0709 12:13:34.177868 (+766327us) op_driver.cc:464] REPLICATION: finished
0709 12:13:34.240022 (+ 62154us) write_op.cc:301] APPLY: starting
0709 12:13:34.243175 (+  3153us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:34.249339 (+  6164us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:34.285672 (+ 36333us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:34.303605 (+ 17933us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:34.351881 (+ 48276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:34.355624 (+  3743us) write_op.cc:312] APPLY: finished
0709 12:13:34.384975 (+ 29351us) log.cc:844] Serialized 22 byte log entry
0709 12:13:34.385172 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:34.385246 (+    74us) write_op.cc:454] Released schema lock
0709 12:13:34.385283 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:34.385680 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:34.385707 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13562,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":55237,"apply.run_cpu_time_us":2743,"apply.run_wall_time_us":149486,"num_ops":1,"prepare.queue_time_us":4781,"prepare.run_cpu_time_us":5138,"prepare.run_wall_time_us":152434,"replication_time_us":830319,"thread_start_us":31491,"threads_started":1}]]}
I20260709 12:13:34.874353 19865 tablet_bootstrap.cc:492] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:34.884498 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:34.902817 20258 raft_consensus.cc:2804] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:34.904130 19746 raft_consensus.cc:2468] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:13:34.922430 19864 tablet_bootstrap.cc:654] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:34.932467 20206 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:34.935472 20206 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:34.956861 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:34.936136 20258 raft_consensus.cc:697] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
W20260709 12:13:34.966291 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 79095.8us
I20260709 12:13:34.986148 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:35.114274 20312 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.116216 20312 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.118613 20312 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:34.994973 20258 consensus_queue.cc:237] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:35.125600 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 139421us
W20260709 12:13:35.126798 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 160633us
W20260709 12:13:35.125633 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 142848us
I20260709 12:13:35.135555 19867 tablet_bootstrap.cc:654] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:35.133718 19744 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:35.143294 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 175912us
I20260709 12:13:35.151015 19865 tablet_bootstrap.cc:654] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:35.177920 19744 raft_consensus.cc:2468] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
W20260709 12:13:35.186619 19714 leader_election.cc:343] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:35.187183 19714 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:35.159859 20262 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.189181 20204 raft_consensus.cc:2749] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:35.189354 20262 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.196094 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:35.197067 19750 raft_consensus.cc:2468] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
W20260709 12:13:35.198565 19714 leader_election.cc:343] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:35.203164 19571 catalog_manager.cc:5697] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:35.225261 20270 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.225916 20270 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:35.228606 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 76136.9us
W20260709 12:13:35.229422 19789 leader_election.cc:343] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:35.230729 19789 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:13:35.235764 19714 consensus_peers.cc:597] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.237609 19789 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:35.228984 19640 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:13:35.247498 19788 leader_election.cc:343] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:35.225314 20277 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:13:35.244437 20275 raft_consensus.cc:2804] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:35.246568 20310 raft_consensus.cc:2804] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:35.246508 20205 raft_consensus.cc:2804] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:35.246208 20312 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 12:13:35.285406 19621 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:35.275857 20275 raft_consensus.cc:697] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:35.286818 20275 consensus_queue.cc:237] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.289987 20262 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:35.290726 20270 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:35.259270 20277 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.262269 20310 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:35.308101 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 50632.5us
I20260709 12:13:35.309484 20277 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:35.310389 20310 raft_consensus.cc:3060] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:35.310913 20205 raft_consensus.cc:697] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:35.348568 20205 consensus_queue.cc:237] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.382198 19865 tablet_bootstrap.cc:492] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
W20260709 12:13:35.383432 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 129335us
I20260709 12:13:35.388378 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:35.388881 19865 ts_tablet_manager.cc:1403] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.515s	user 0.025s	sys 0.027s
I20260709 12:13:35.363185 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:35.412024 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:13:35.439380 19789 leader_election.cc:343] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:35.442108 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:35.442909 19823 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:35.448132 20263 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:13:35.433909 20277 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:13:35.452975 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:35.451822 20263 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.483268 20263 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:35.491940 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:35.471695 19867 tablet_bootstrap.cc:492] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:35.501927 19867 ts_tablet_manager.cc:1403] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.703s	user 0.039s	sys 0.028s
I20260709 12:13:35.506691 19864 tablet_bootstrap.cc:492] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:35.507285 19864 ts_tablet_manager.cc:1403] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 1.123s	user 0.034s	sys 0.038s
I20260709 12:13:35.500294 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:35.512758 19865 raft_consensus.cc:359] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.513538 19865 raft_consensus.cc:385] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:35.513795 19865 raft_consensus.cc:740] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:35.514503 19865 consensus_queue.cc:260] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.516292 19865 ts_tablet_manager.cc:1434] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.127s	user 0.001s	sys 0.006s
I20260709 12:13:35.520184 19864 raft_consensus.cc:359] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.520921 19864 raft_consensus.cc:385] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:35.521173 19864 raft_consensus.cc:740] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:35.521908 19864 consensus_queue.cc:260] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.526072 19864 ts_tablet_manager.cc:1434] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:13:35.530524 19865 tablet_bootstrap.cc:492] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:35.538555 20292 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.543431 20292 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.543748 19817 raft_consensus.cc:2468] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 0.
I20260709 12:13:35.519544 20310 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:35.546144 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 161714us
I20260709 12:13:35.551854 20277 consensus_queue.cc:1048] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:35.553709 20292 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:35.556126 19713 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:35.560159 20269 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:35.560596 20269 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.561000 20269 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:35.571360 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:35.563208 19713 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:35.574286 20140 raft_consensus.cc:2749] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:35.583089 19864 tablet_bootstrap.cc:492] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:35.585948 20279 consensus_queue.cc:1048] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:35.589440 19714 leader_election.cc:343] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:35.592927 19714 consensus_peers.cc:597] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.608266 20277 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:35.609939 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:13:35.622213 19713 leader_election.cc:343] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:35.622786 19713 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:35.627719 20268 raft_consensus.cc:2749] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:35.633154 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:35.669679 19867 raft_consensus.cc:359] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.670734 19867 raft_consensus.cc:385] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:35.676831 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:35.677724 19750 raft_consensus.cc:3060] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:35.679773 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:35.682595 19865 tablet_bootstrap.cc:654] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:35.671092 19867 raft_consensus.cc:740] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:35.684607 19867 consensus_queue.cc:260] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:35.688973 19789 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.695909 19750 raft_consensus.cc:2468] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
W20260709 12:13:35.671581 20340 log.cc:927] Time spent T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 12:13:35.712273 19572 catalog_manager.cc:5697] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:35.657809 20269 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.732329 19867 ts_tablet_manager.cc:1434] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.230s	user 0.011s	sys 0.000s
I20260709 12:13:35.733596 19867 tablet_bootstrap.cc:492] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193: Bootstrap starting.
I20260709 12:13:35.736732 19640 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:35.748092 20264 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.748737 20264 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.755852 20264 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:35.763921 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:35.771867 20331 raft_consensus.cc:2804] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:35.772527 20331 raft_consensus.cc:697] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
W20260709 12:13:35.784749 19714 leader_election.cc:343] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:35.773535 20331 consensus_queue.cc:237] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:35.837409 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 56717.7us
I20260709 12:13:35.787200 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:35.853889 19817 raft_consensus.cc:2468] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 0.
I20260709 12:13:35.865633 20269 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:35.885823 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:35.886327 19824 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:35.877779 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:35.889643 19821 raft_consensus.cc:3060] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:35.877008 20312 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.892601 20312 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.893615 19675 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:35.875538 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:35.900046 19864 tablet_bootstrap.cc:654] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:35.907981 19714 leader_election.cc:343] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:35.912161 19867 tablet_bootstrap.cc:654] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:35.916261 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 47651.9us
I20260709 12:13:35.894731 20312 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:35.917728 19788 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:13:35.923050 19638 consensus_peers.cc:597] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.925822 19824 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
W20260709 12:13:35.931614 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 54789us
I20260709 12:13:35.933826 19713 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:35.934706 20204 raft_consensus.cc:2804] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:35.935201 20204 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.935565 20204 raft_consensus.cc:3060] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:35.936913 19713 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:35.937776 20267 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:35.940411 19821 raft_consensus.cc:2468] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
W20260709 12:13:35.950368 19788 leader_election.cc:343] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:35.951141 19788 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:35.959004 20204 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:35.951953 20269 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:35.971118 20269 raft_consensus.cc:697] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:35.969359 20258 consensus_queue.cc:1048] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:35.970050 20314 raft_consensus.cc:2749] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:35.972049 20269 consensus_queue.cc:237] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:35.991381 19788 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.003567 19865 tablet_bootstrap.cc:492] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:36.004155 19865 ts_tablet_manager.cc:1403] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.481s	user 0.018s	sys 0.007s
I20260709 12:13:36.005715 20204 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:36.011791 19865 raft_consensus.cc:359] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.012595 19865 raft_consensus.cc:385] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.012944 19865 raft_consensus.cc:740] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.013316 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:36.013921 19821 raft_consensus.cc:3060] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:36.013594 19865 consensus_queue.cc:260] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.036556 19865 ts_tablet_manager.cc:1434] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:13:36.037582 19865 tablet_bootstrap.cc:492] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:36.038275 20322 consensus_queue.cc:1048] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:36.047295 19821 raft_consensus.cc:2468] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:13:36.050608 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:36.068369 19713 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:13:36.069680 20268 raft_consensus.cc:2804] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:36.070164 20268 raft_consensus.cc:697] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:36.070384 19864 tablet_bootstrap.cc:492] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:36.070212 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:13:36.071003 19864 ts_tablet_manager.cc:1403] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.493s	user 0.018s	sys 0.033s
I20260709 12:13:36.071094 20268 consensus_queue.cc:237] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.073808 19864 raft_consensus.cc:359] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.074527 19864 raft_consensus.cc:385] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.074851 19864 raft_consensus.cc:740] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.079154 20310 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:36.075697 19864 consensus_queue.cc:260] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.080168 19867 tablet_bootstrap.cc:492] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193: No bootstrap required, opened a new log
I20260709 12:13:36.080686 19867 ts_tablet_manager.cc:1403] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193: Time spent bootstrapping tablet: real 0.347s	user 0.017s	sys 0.008s
I20260709 12:13:36.087848 19864 ts_tablet_manager.cc:1434] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:13:36.089159 19865 tablet_bootstrap.cc:654] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:36.090124 20323 consensus_queue.cc:1048] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:36.092290 19864 tablet_bootstrap.cc:492] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Bootstrap starting.
I20260709 12:13:36.093223 19867 raft_consensus.cc:359] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.093938 19867 raft_consensus.cc:385] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.094197 19867 raft_consensus.cc:740] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.094834 19867 consensus_queue.cc:260] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.096647 19867 ts_tablet_manager.cc:1434] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:13:36.096875 20205 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:36.099807 19573 catalog_manager.cc:5697] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:36.101290 19864 tablet_bootstrap.cc:654] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:36.109436 19865 tablet_bootstrap.cc:492] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:36.110196 19865 ts_tablet_manager.cc:1403] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.002s
I20260709 12:13:36.113119 19865 raft_consensus.cc:359] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.113806 19865 raft_consensus.cc:385] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.114085 19865 raft_consensus.cc:740] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.115005 19865 consensus_queue.cc:260] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:36.114259 19714 leader_election.cc:343] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:36.116418 19864 tablet_bootstrap.cc:492] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324: No bootstrap required, opened a new log
I20260709 12:13:36.117579 19865 ts_tablet_manager.cc:1434] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:36.117961 19864 ts_tablet_manager.cc:1403] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 12:13:36.118696 19865 tablet_bootstrap.cc:492] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:36.122516 19864 raft_consensus.cc:359] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.123271 19864 raft_consensus.cc:385] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.123535 19864 raft_consensus.cc:740] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.124310 19864 consensus_queue.cc:260] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.127345 19864 ts_tablet_manager.cc:1434] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:13:36.144632 19865 tablet_bootstrap.cc:654] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:36.146066 19573 catalog_manager.cc:5697] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:36.148037 19573 catalog_manager.cc:5697] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:36.168453 19865 tablet_bootstrap.cc:492] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:36.168401 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:36.169294 19865 ts_tablet_manager.cc:1403] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.004s
I20260709 12:13:36.169523 19742 raft_consensus.cc:2393] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:13:36.174348 19865 raft_consensus.cc:359] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.175227 19865 raft_consensus.cc:385] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.175532 19865 raft_consensus.cc:740] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.176369 19865 consensus_queue.cc:260] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.179275 19865 ts_tablet_manager.cc:1434] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:13:36.180498 19865 tablet_bootstrap.cc:492] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:36.184254 19640 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:36.189955 20269 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.192749 20303 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:36.193379 20269 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.197075 19744 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:36.197204 20269 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:36.203472 19865 tablet_bootstrap.cc:654] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:36.204453 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:36.204677 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:36.211215 19713 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:36.228024 19570 catalog_manager.cc:5697] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:36.260875 19572 catalog_manager.cc:5697] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:36.261757 19865 tablet_bootstrap.cc:492] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:36.262317 19865 ts_tablet_manager.cc:1403] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.010s
I20260709 12:13:36.263062 19572 catalog_manager.cc:5697] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:36.264837 19865 raft_consensus.cc:359] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.265507 19865 raft_consensus.cc:385] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.265779 19865 raft_consensus.cc:740] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.266566 19865 consensus_queue.cc:260] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.268603 19865 ts_tablet_manager.cc:1434] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:13:36.269537 19865 tablet_bootstrap.cc:492] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:36.275553 19865 tablet_bootstrap.cc:654] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:36.283151 19824 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:36.293841 20269 raft_consensus.cc:2749] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:36.365041 20308 consensus_queue.cc:1048] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:36.365348 19572 catalog_manager.cc:5697] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:36.368510 19572 catalog_manager.cc:5697] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:36.379633 19865 tablet_bootstrap.cc:492] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:36.380151 19865 ts_tablet_manager.cc:1403] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.021s
I20260709 12:13:36.431236 20102 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.431998 20102 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.434894 20102 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:36.439038 20349 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.442945 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:36.446817 20310 consensus_queue.cc:1048] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:36.439653 20349 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:13:36.457135 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 75026.9us
I20260709 12:13:36.466367 19865 raft_consensus.cc:359] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.467327 19865 raft_consensus.cc:385] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.467635 19865 raft_consensus.cc:740] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.470592 19865 consensus_queue.cc:260] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.476826 19865 ts_tablet_manager.cc:1434] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.001s
I20260709 12:13:36.477855 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:36.479007 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:36.501353 19865 tablet_bootstrap.cc:492] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8: Bootstrap starting.
I20260709 12:13:36.486518 19819 raft_consensus.cc:2393] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 1: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:13:36.486872 20349 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:36.488528 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:36.473418 20323 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.494403 20337 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.509936 19638 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:36.508756 20323 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.515964 19638 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:36.516376 19673 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:36.511477 20337 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.513960 20310 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:36.516528 20360 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:13:36.519863 20308 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:36.553989 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:13:36.555972 20323 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:36.557611 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:36.559374 20337 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:36.567155 19789 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:36.568334 20323 raft_consensus.cc:2749] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:36.574757 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:36.576743 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:36.579752 19865 tablet_bootstrap.cc:654] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:36.582643 19638 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:13:36.583027 19714 consensus_peers.cc:597] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.581691 20308 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:36.586526 20310 raft_consensus.cc:2749] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:36.589942 20310 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.590487 20310 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.592777 20310 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:36.595602 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:36.594759 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:36.603731 19819 raft_consensus.cc:3060] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:36.607689 19638 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:36.604699 20349 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:13:36.610037 20102 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:36.610545 20349 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.624523 20349 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:36.627921 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:36.629645 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:36.628130 20261 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:13:36.649531 19638 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:36.651206 20349 raft_consensus.cc:2749] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:36.671444 19673 raft_consensus.cc:3060] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:36.683451 19865 tablet_bootstrap.cc:492] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8: No bootstrap required, opened a new log
I20260709 12:13:36.683943 19865 ts_tablet_manager.cc:1403] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8: Time spent bootstrapping tablet: real 0.199s	user 0.014s	sys 0.024s
I20260709 12:13:36.687561 19865 raft_consensus.cc:359] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.688211 19865 raft_consensus.cc:385] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.688476 19865 raft_consensus.cc:740] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.689109 19865 consensus_queue.cc:260] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:36.702879 20203 consensus_queue.cc:1048] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:36.704375 19865 ts_tablet_manager.cc:1434] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:13:36.710052 19666 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:36.726188 19669 raft_consensus.cc:3060] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.029857 20102 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.030400 20102 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:37.032658 20102 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:37.033401 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:13:37.033798 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:13:37.035598 19638 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:13:37.036306 20102 raft_consensus.cc:2749] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:37.107779 19669 raft_consensus.cc:3060] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:38.134202 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:38.177933 20390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:38.178149 20388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:38.179529 20387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:38.180751 18407 server_base.cc:1061] running on GCE node
I20260709 12:13:38.182854 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:38.183169 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:38.183396 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599218183378 us; error 0 us; skew 500 ppm
I20260709 12:13:38.184157 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:38.188730 18407 webserver.cc:533] Webserver started at http://127.17.249.196:35797/ using document root <none> and password file <none>
I20260709 12:13:38.189433 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:38.189635 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:38.190080 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:38.191655 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-3-root/instance:
uuid: "b12c250fb1a244ed9a49cf86950af1bf"
format_stamp: "Formatted at 2026-07-09 12:13:38 on dist-test-slave-7mcn"
I20260709 12:13:38.198342 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:38.204264 20395 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:38.205657 18407 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:13:38.206161 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-3-root
uuid: "b12c250fb1a244ed9a49cf86950af1bf"
format_stamp: "Formatted at 2026-07-09 12:13:38 on dist-test-slave-7mcn"
I20260709 12:13:38.206614 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:38.223984 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:38.225946 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:38.228235 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:38.231458 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:38.231736 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:38.232025 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:38.232232 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:38.324410 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.196:38821
I20260709 12:13:38.324512 20457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.196:38821 every 8 connection(s)
I20260709 12:13:38.350483 18407 auto_leader_rebalancer-test.cc:439] add a tserver: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:38.375933 20458 heartbeater.cc:344] Connected to a master server at 127.17.249.254:37145
I20260709 12:13:38.376520 20458 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:38.377302 20458 heartbeater.cc:507] Master 127.17.249.254:37145 requested a full tablet report, sending...
I20260709 12:13:38.379590 19573 ts_manager.cc:194] Registered new tserver with Master: b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:13:38.381095 19573 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53406
I20260709 12:13:38.769343 19821 consensus_queue.cc:237] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:38.780494 19669 raft_consensus.cc:1275] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:38.782352 20323 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.785053 19750 raft_consensus.cc:1275] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:38.786706 20323 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.795888 19981 raft_consensus.cc:2955] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:38.797737 19669 raft_consensus.cc:2955] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
W20260709 12:13:38.799496 19789 consensus_peers.cc:597] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5895f7d8826c4e48a39f2ead181ee1bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:38.800381 19750 raft_consensus.cc:2955] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:38.817495 19573 catalog_manager.cc:5697] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.848373 19750 consensus_queue.cc:237] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:38.861908 19669 raft_consensus.cc:1275] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:38.862625 19819 raft_consensus.cc:1275] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:38.867142 20277 consensus_queue.cc:1048] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:38.883386 19715 consensus_peers.cc:597] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a2ad2622957437eae185bfda331f538. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:38.885759 20277 consensus_queue.cc:1048] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:38.895897 20277 raft_consensus.cc:2955] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:38.897753 19817 raft_consensus.cc:2955] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:38.909650 19669 raft_consensus.cc:2955] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:38.918704 19819 consensus_queue.cc:237] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:38.923477 19572 catalog_manager.cc:5697] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:38.950354 19789 consensus_peers.cc:597] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f034c09c286a4ac3a1f560c84eb05120. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:38.951820 19669 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:38.951985 19745 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:38.953459 20386 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.954401 20323 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.967401 20323 raft_consensus.cc:2955] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:38.969502 19669 raft_consensus.cc:2955] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:38.976909 19750 raft_consensus.cc:2955] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:38.998548 19570 catalog_manager.cc:5697] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:39.013334 19669 consensus_queue.cc:237] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:39.036239 19819 raft_consensus.cc:1275] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:39.037318 19744 raft_consensus.cc:1275] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:39.038178 20102 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:39.039366 20483 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:39.051844 19640 consensus_peers.cc:597] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fed9282bd954e378bf04bb924e3e716. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:39.059194 20102 raft_consensus.cc:2955] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:39.060954 19750 raft_consensus.cc:2955] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:39.063838 19819 raft_consensus.cc:2955] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:39.080101 19573 catalog_manager.cc:5697] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:39.261876 20487 ts_tablet_manager.cc:933] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:39.266021 20487 tablet_copy_client.cc:323] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.195:42991
I20260709 12:13:39.283038 19834 tablet_copy_service.cc:140] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Received BeginTabletCopySession request for tablet 5895f7d8826c4e48a39f2ead181ee1bd from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:60644)
I20260709 12:13:39.283704 19834 tablet_copy_service.cc:161] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Beginning new tablet copy session on tablet 5895f7d8826c4e48a39f2ead181ee1bd from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:60644: session id = b12c250fb1a244ed9a49cf86950af1bf-5895f7d8826c4e48a39f2ead181ee1bd
I20260709 12:13:39.290360 19834 tablet_copy_source_session.cc:215] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:39.295063 20487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5895f7d8826c4e48a39f2ead181ee1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.317487 20487 tablet_copy_client.cc:806] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:39.318434 20487 tablet_copy_client.cc:670] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:39.330474 20487 tablet_copy_client.cc:538] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:39.343653 20487 tablet_bootstrap.cc:492] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:39.375730 20492 ts_tablet_manager.cc:933] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:39.384272 20458 heartbeater.cc:499] Master 127.17.249.254:37145 was elected leader, sending a full tablet report...
I20260709 12:13:39.417723 20492 tablet_copy_client.cc:323] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.195:42991
I20260709 12:13:39.410643 20487 tablet_bootstrap.cc:492] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:39.426528 19834 tablet_copy_service.cc:140] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Received BeginTabletCopySession request for tablet f034c09c286a4ac3a1f560c84eb05120 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:60644)
I20260709 12:13:39.429257 19834 tablet_copy_service.cc:161] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Beginning new tablet copy session on tablet f034c09c286a4ac3a1f560c84eb05120 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:60644: session id = b12c250fb1a244ed9a49cf86950af1bf-f034c09c286a4ac3a1f560c84eb05120
I20260709 12:13:39.430363 20495 ts_tablet_manager.cc:933] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:39.439599 19834 tablet_copy_source_session.cc:215] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:39.441300 20487 tablet_bootstrap.cc:492] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:39.443792 20487 ts_tablet_manager.cc:1403] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.100s	user 0.030s	sys 0.004s
I20260709 12:13:39.446353 20492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f034c09c286a4ac3a1f560c84eb05120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.460845 20487 raft_consensus.cc:359] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:39.464687 20487 raft_consensus.cc:740] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:39.466876 20487 consensus_queue.cc:260] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:39.470862 20495 tablet_copy_client.cc:323] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.194:46489
I20260709 12:13:39.481545 20492 tablet_copy_client.cc:806] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:39.482638 20492 tablet_copy_client.cc:670] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:39.487193 20492 tablet_copy_client.cc:538] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:39.501324 20487 ts_tablet_manager.cc:1434] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.008s
I20260709 12:13:39.507525 20492 tablet_bootstrap.cc:492] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:39.517681 19834 tablet_copy_service.cc:342] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-5895f7d8826c4e48a39f2ead181ee1bd received from {username='slave'} at 127.0.0.1:60644
I20260709 12:13:39.518301 19834 tablet_copy_service.cc:434] P 1f9fb1b1a86c4eb99abdbaf9d239e324: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-5895f7d8826c4e48a39f2ead181ee1bd on tablet 5895f7d8826c4e48a39f2ead181ee1bd with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:39.539721 19760 tablet_copy_service.cc:140] P ca42d3c27d2e46348120791d1282b193: Received BeginTabletCopySession request for tablet 9a2ad2622957437eae185bfda331f538 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:40172)
I20260709 12:13:39.540346 19760 tablet_copy_service.cc:161] P ca42d3c27d2e46348120791d1282b193: Beginning new tablet copy session on tablet 9a2ad2622957437eae185bfda331f538 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:40172: session id = b12c250fb1a244ed9a49cf86950af1bf-9a2ad2622957437eae185bfda331f538
I20260709 12:13:39.553483 19760 tablet_copy_source_session.cc:215] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:39.558377 20495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a2ad2622957437eae185bfda331f538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.563900 20487 ts_tablet_manager.cc:933] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713)
I20260709 12:13:39.565994 20492 tablet_bootstrap.cc:492] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:39.567160 20492 tablet_bootstrap.cc:492] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:39.567921 20492 ts_tablet_manager.cc:1403] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.061s	user 0.033s	sys 0.009s
I20260709 12:13:39.571210 20492 raft_consensus.cc:359] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:39.572193 20492 raft_consensus.cc:740] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:39.574424 20492 consensus_queue.cc:260] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:39.582633 20492 ts_tablet_manager.cc:1434] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:13:39.588589 19834 tablet_copy_service.cc:342] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-f034c09c286a4ac3a1f560c84eb05120 received from {username='slave'} at 127.0.0.1:60644
I20260709 12:13:39.589097 19834 tablet_copy_service.cc:434] P 1f9fb1b1a86c4eb99abdbaf9d239e324: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-f034c09c286a4ac3a1f560c84eb05120 on tablet f034c09c286a4ac3a1f560c84eb05120 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:39.597582 20487 tablet_copy_client.cc:323] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.193:36713
I20260709 12:13:39.602634 20495 tablet_copy_client.cc:806] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:39.603483 20495 tablet_copy_client.cc:670] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:39.609082 20495 tablet_copy_client.cc:538] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:39.619726 20495 tablet_bootstrap.cc:492] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:39.622267 19685 tablet_copy_service.cc:140] P f662c4f7d6a74013a1e58a5330a049b8: Received BeginTabletCopySession request for tablet 1fed9282bd954e378bf04bb924e3e716 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:54544)
I20260709 12:13:39.623267 19685 tablet_copy_service.cc:161] P f662c4f7d6a74013a1e58a5330a049b8: Beginning new tablet copy session on tablet 1fed9282bd954e378bf04bb924e3e716 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:54544: session id = b12c250fb1a244ed9a49cf86950af1bf-1fed9282bd954e378bf04bb924e3e716
I20260709 12:13:39.638847 19685 tablet_copy_source_session.cc:215] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:39.643339 20487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fed9282bd954e378bf04bb924e3e716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.660828 20495 tablet_bootstrap.cc:492] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:39.662173 20487 tablet_copy_client.cc:806] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:39.665190 20495 tablet_bootstrap.cc:492] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:39.665979 20495 ts_tablet_manager.cc:1403] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.013s
I20260709 12:13:39.666131 20487 tablet_copy_client.cc:670] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:39.669579 20495 raft_consensus.cc:359] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:39.671748 20495 raft_consensus.cc:740] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:39.672495 20495 consensus_queue.cc:260] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:39.675261 20433 raft_consensus.cc:1217] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:39.677316 20487 tablet_copy_client.cc:538] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:39.677596 20495 ts_tablet_manager.cc:1434] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 12:13:39.680114 19760 tablet_copy_service.cc:342] P ca42d3c27d2e46348120791d1282b193: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-9a2ad2622957437eae185bfda331f538 received from {username='slave'} at 127.0.0.1:40172
I20260709 12:13:39.680599 19760 tablet_copy_service.cc:434] P ca42d3c27d2e46348120791d1282b193: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-9a2ad2622957437eae185bfda331f538 on tablet 9a2ad2622957437eae185bfda331f538 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:39.698851 20487 tablet_bootstrap.cc:492] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:39.915371 20433 raft_consensus.cc:1217] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:39.948782 20433 raft_consensus.cc:1217] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:13:39.964078 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 49614.5us
I20260709 12:13:40.064970 20487 tablet_bootstrap.cc:492] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:40.070700 20487 tablet_bootstrap.cc:492] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:40.071807 20487 ts_tablet_manager.cc:1403] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.373s	user 0.028s	sys 0.026s
I20260709 12:13:40.076530 20487 raft_consensus.cc:359] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:40.078004 20487 raft_consensus.cc:740] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:40.078859 20487 consensus_queue.cc:260] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:40.094085 20487 ts_tablet_manager.cc:1434] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 12:13:40.104779 19685 tablet_copy_service.cc:342] P f662c4f7d6a74013a1e58a5330a049b8: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-1fed9282bd954e378bf04bb924e3e716 received from {username='slave'} at 127.0.0.1:54544
I20260709 12:13:40.105861 19685 tablet_copy_service.cc:434] P f662c4f7d6a74013a1e58a5330a049b8: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-1fed9282bd954e378bf04bb924e3e716 on tablet 1fed9282bd954e378bf04bb924e3e716 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:40.126607 20510 raft_consensus.cc:1064] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:40.130615 20510 consensus_queue.cc:237] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:40.158615 20433 raft_consensus.cc:1275] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.160805 20507 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:40.166751 19666 raft_consensus.cc:1275] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.168541 20507 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.186836 19747 raft_consensus.cc:1275] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.200517 20507 raft_consensus.cc:2955] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.215173 20432 raft_consensus.cc:1217] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:40.217748 20431 raft_consensus.cc:2955] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.228035 20386 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:40.256119 19666 raft_consensus.cc:2955] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.271078 19573 catalog_manager.cc:5697] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.287473 19748 raft_consensus.cc:2955] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.342235 19821 consensus_queue.cc:237] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:40.348456 20431 raft_consensus.cc:1275] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:40.349591 19673 raft_consensus.cc:1275] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:40.349885 20386 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:40.353206 20507 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:40.357684 20507 raft_consensus.cc:2955] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.367503 20277 raft_consensus.cc:1064] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:40.370859 20277 consensus_queue.cc:237] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:40.390897 20433 raft_consensus.cc:1275] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.390790 20431 raft_consensus.cc:2955] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.392787 20260 consensus_queue.cc:1048] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:40.393509 19817 raft_consensus.cc:1275] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.395725 20260 consensus_queue.cc:1048] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.403275 19668 raft_consensus.cc:1275] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.419950 19666 raft_consensus.cc:2955] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.415448 20351 consensus_queue.cc:1048] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:13:40.478741 20519 raft_consensus.cc:1064] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:40.481765 20519 consensus_queue.cc:237] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:40.501771 19557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5895f7d8826c4e48a39f2ead181ee1bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:40.515504 19673 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.517488 20507 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:40.515250 19572 catalog_manager.cc:5697] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.520488 20494 raft_consensus.cc:2955] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:13:40.539677 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 49213.5us
I20260709 12:13:40.548290 19750 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.550880 20433 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.557230 19668 raft_consensus.cc:2955] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.566671 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 5895f7d8826c4e48a39f2ead181ee1bd with delete_type TABLET_DATA_TOMBSTONED (TS ca42d3c27d2e46348120791d1282b193 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36920
I20260709 12:13:40.570216 19817 raft_consensus.cc:2955] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.591214 20433 raft_consensus.cc:2955] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.602757 19572 catalog_manager.cc:5697] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.585988 20532 tablet_replica.cc:333] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:13:40.589082 20510 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:40.615080 20532 raft_consensus.cc:2243] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.615269 20529 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:40.617734 20532 raft_consensus.cc:2272] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.630832 20532 ts_tablet_manager.cc:1916] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:40.649968 20510 raft_consensus.cc:2955] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.667943 20512 raft_consensus.cc:1064] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:40.670769 19750 consensus_queue.cc:237] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:40.681169 20512 consensus_queue.cc:237] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:40.688589 20532 ts_tablet_manager.cc:1929] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:40.689410 20532 log.cc:1199] T 5895f7d8826c4e48a39f2ead181ee1bd P ca42d3c27d2e46348120791d1282b193: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/wals/5895f7d8826c4e48a39f2ead181ee1bd
I20260709 12:13:40.692430 19559 catalog_manager.cc:5028] TS ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): tablet 5895f7d8826c4e48a39f2ead181ee1bd (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:40.707324 19673 raft_consensus.cc:2955] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.719067 19572 catalog_manager.cc:5697] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.720057 19750 raft_consensus.cc:2955] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.684005 19668 raft_consensus.cc:1275] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:40.705816 20431 raft_consensus.cc:2955] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.732892 20277 consensus_queue.cc:1048] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:40.683198 20433 raft_consensus.cc:1275] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:40.741851 20260 consensus_queue.cc:1048] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:40.751732 19819 consensus_queue.cc:237] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:40.767817 19668 raft_consensus.cc:2955] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.765419 20277 raft_consensus.cc:2955] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.774868 20432 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:40.780287 19748 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:40.781534 20432 raft_consensus.cc:1275] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.783638 20512 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.793663 20507 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:40.808360 20433 raft_consensus.cc:2955] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.812364 19750 raft_consensus.cc:1275] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.814126 19819 raft_consensus.cc:1275] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.816005 19559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a2ad2622957437eae185bfda331f538 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:40.816606 20386 raft_consensus.cc:2955] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.819674 20529 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:40.829282 20512 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.831947 19571 catalog_manager.cc:5697] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.824638 20432 raft_consensus.cc:2955] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.835513 20512 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:40.854672 19748 raft_consensus.cc:2955] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.873697 19557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f034c09c286a4ac3a1f560c84eb05120 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:40.887048 19805 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a2ad2622957437eae185bfda331f538 with delete_type TABLET_DATA_TOMBSTONED (TS 1f9fb1b1a86c4eb99abdbaf9d239e324 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56882
I20260709 12:13:40.886605 19570 catalog_manager.cc:5697] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.905090 20483 raft_consensus.cc:2955] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.909090 19750 raft_consensus.cc:2955] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.920359 19657 tablet_service.cc:1558] Processing DeleteTablet for tablet f034c09c286a4ac3a1f560c84eb05120 with delete_type TABLET_DATA_TOMBSTONED (TS f662c4f7d6a74013a1e58a5330a049b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48638
I20260709 12:13:40.944306 20432 raft_consensus.cc:2955] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.949453 20540 tablet_replica.cc:333] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:13:40.938596 19570 catalog_manager.cc:5697] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.954020 19819 raft_consensus.cc:2955] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:40.976858 19668 consensus_queue.cc:237] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:40.999306 20540 raft_consensus.cc:2243] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.000377 20540 raft_consensus.cc:2272] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.003213 20432 raft_consensus.cc:1275] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:41.007725 20533 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:41.005599 20540 ts_tablet_manager.cc:1916] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:41.022974 20483 raft_consensus.cc:2955] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:41.025094 20432 raft_consensus.cc:2955] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:41.027623 20541 tablet_replica.cc:333] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:13:41.029036 20541 raft_consensus.cc:2243] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.031492 19821 raft_consensus.cc:1275] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:41.033694 20512 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:41.037721 20541 raft_consensus.cc:2272] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.044698 20541 ts_tablet_manager.cc:1916] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:41.045879 19821 raft_consensus.cc:2955] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:41.052476 19558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1fed9282bd954e378bf04bb924e3e716 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:41.058301 20540 ts_tablet_manager.cc:1929] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:41.059022 20540 log.cc:1199] T 9a2ad2622957437eae185bfda331f538 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/wals/9a2ad2622957437eae185bfda331f538
I20260709 12:13:41.061283 19557 catalog_manager.cc:5028] TS 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): tablet 9a2ad2622957437eae185bfda331f538 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:41.068262 20541 ts_tablet_manager.cc:1929] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:41.069003 20541 log.cc:1199] T f034c09c286a4ac3a1f560c84eb05120 P f662c4f7d6a74013a1e58a5330a049b8: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/wals/f034c09c286a4ac3a1f560c84eb05120
I20260709 12:13:41.073192 19573 catalog_manager.cc:5697] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:41.077767 19558 catalog_manager.cc:5028] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): tablet f034c09c286a4ac3a1f560c84eb05120 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:41.087692 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fed9282bd954e378bf04bb924e3e716 with delete_type TABLET_DATA_TOMBSTONED (TS ca42d3c27d2e46348120791d1282b193 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36920
I20260709 12:13:41.088766 20532 tablet_replica.cc:333] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:13:41.089761 20532 raft_consensus.cc:2243] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.090695 20532 raft_consensus.cc:2272] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.093693 20532 ts_tablet_manager.cc:1916] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:41.106967 20532 ts_tablet_manager.cc:1929] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:41.107316 20532 log.cc:1199] T 1fed9282bd954e378bf04bb924e3e716 P ca42d3c27d2e46348120791d1282b193: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/wals/1fed9282bd954e378bf04bb924e3e716
I20260709 12:13:41.109234 19559 catalog_manager.cc:5028] TS ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): tablet 1fed9282bd954e378bf04bb924e3e716 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:42.166476 19748 consensus_queue.cc:237] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:42.173065 19819 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:42.174439 19715 consensus_peers.cc:597] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f055e0ff3254433f83caca3e0e190a4c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:42.175954 20542 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:42.183440 19673 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:42.185741 20505 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:42.188161 20542 raft_consensus.cc:2955] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.199045 19668 raft_consensus.cc:2955] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.218288 19570 catalog_manager.cc:5697] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:42.217422 19748 consensus_queue.cc:237] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:42.221534 19819 raft_consensus.cc:2955] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.232875 19821 raft_consensus.cc:1275] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:42.233625 19668 raft_consensus.cc:1275] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:42.235095 20545 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:13:42.238099 20546 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:42.245420 19715 consensus_peers.cc:597] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 199b867263264f1c8e61b1e410b2a082. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:42.274494 20506 raft_consensus.cc:2955] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.277861 19668 raft_consensus.cc:2955] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.293870 19821 raft_consensus.cc:2955] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.301240 19571 catalog_manager.cc:5697] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.304296 19748 consensus_queue.cc:237] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:42.326325 19668 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:42.327903 19715 consensus_peers.cc:597] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 09360ce480dc4631988b668a1a16fd23. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:42.329624 19821 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:42.331032 20545 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:42.332293 20506 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:42.343050 20506 raft_consensus.cc:2955] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.348413 19821 raft_consensus.cc:2955] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.348480 19673 raft_consensus.cc:2955] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.358369 19748 consensus_queue.cc:237] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:42.370309 19571 catalog_manager.cc:5697] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:42.378314 19821 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:42.379772 19715 consensus_peers.cc:597] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf852411f79143c4b7d9d087e57902ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:42.380102 20545 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:42.386070 19673 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:42.396140 20545 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:42.400822 20506 raft_consensus.cc:2955] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.403234 19821 raft_consensus.cc:2955] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.424206 19668 raft_consensus.cc:2955] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.430534 19570 catalog_manager.cc:5697] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:42.699800 20562 ts_tablet_manager.cc:933] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:42.702255 20562 tablet_copy_client.cc:323] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.194:46489
I20260709 12:13:42.704782 19760 tablet_copy_service.cc:140] P ca42d3c27d2e46348120791d1282b193: Received BeginTabletCopySession request for tablet f055e0ff3254433f83caca3e0e190a4c from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:40172)
I20260709 12:13:42.705341 19760 tablet_copy_service.cc:161] P ca42d3c27d2e46348120791d1282b193: Beginning new tablet copy session on tablet f055e0ff3254433f83caca3e0e190a4c from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:40172: session id = b12c250fb1a244ed9a49cf86950af1bf-f055e0ff3254433f83caca3e0e190a4c
I20260709 12:13:42.713032 19760 tablet_copy_source_session.cc:215] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:42.717202 20562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f055e0ff3254433f83caca3e0e190a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.735956 20562 tablet_copy_client.cc:806] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:42.736719 20562 tablet_copy_client.cc:670] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:42.745414 20562 tablet_copy_client.cc:538] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:42.760596 20562 tablet_bootstrap.cc:492] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:42.776944 20564 ts_tablet_manager.cc:933] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:42.782003 20564 tablet_copy_client.cc:323] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.194:46489
I20260709 12:13:42.784366 19760 tablet_copy_service.cc:140] P ca42d3c27d2e46348120791d1282b193: Received BeginTabletCopySession request for tablet 09360ce480dc4631988b668a1a16fd23 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:40172)
I20260709 12:13:42.785019 19760 tablet_copy_service.cc:161] P ca42d3c27d2e46348120791d1282b193: Beginning new tablet copy session on tablet 09360ce480dc4631988b668a1a16fd23 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:40172: session id = b12c250fb1a244ed9a49cf86950af1bf-09360ce480dc4631988b668a1a16fd23
I20260709 12:13:42.795984 20567 ts_tablet_manager.cc:933] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:42.799176 20562 tablet_bootstrap.cc:492] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:42.800405 20562 tablet_bootstrap.cc:492] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:42.801301 20562 ts_tablet_manager.cc:1403] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.008s
I20260709 12:13:42.806017 20562 raft_consensus.cc:359] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:42.807062 20562 raft_consensus.cc:740] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:42.807753 19760 tablet_copy_source_session.cc:215] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:42.807821 20562 consensus_queue.cc:260] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:42.808760 20567 tablet_copy_client.cc:323] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.194:46489
I20260709 12:13:42.811616 19759 tablet_copy_service.cc:140] P ca42d3c27d2e46348120791d1282b193: Received BeginTabletCopySession request for tablet 199b867263264f1c8e61b1e410b2a082 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:40172)
I20260709 12:13:42.812337 19759 tablet_copy_service.cc:161] P ca42d3c27d2e46348120791d1282b193: Beginning new tablet copy session on tablet 199b867263264f1c8e61b1e410b2a082 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:40172: session id = b12c250fb1a244ed9a49cf86950af1bf-199b867263264f1c8e61b1e410b2a082
I20260709 12:13:42.813500 20562 ts_tablet_manager.cc:1434] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:13:42.820320 19760 tablet_copy_service.cc:342] P ca42d3c27d2e46348120791d1282b193: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-f055e0ff3254433f83caca3e0e190a4c received from {username='slave'} at 127.0.0.1:40172
I20260709 12:13:42.820468 20564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09360ce480dc4631988b668a1a16fd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.820901 19760 tablet_copy_service.cc:434] P ca42d3c27d2e46348120791d1282b193: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-f055e0ff3254433f83caca3e0e190a4c on tablet f055e0ff3254433f83caca3e0e190a4c with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:42.823439 19759 tablet_copy_source_session.cc:215] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:42.828272 20567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199b867263264f1c8e61b1e410b2a082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.846680 20567 tablet_copy_client.cc:806] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:42.847299 20564 tablet_copy_client.cc:806] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:42.848069 20564 tablet_copy_client.cc:670] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:42.848191 20567 tablet_copy_client.cc:670] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:42.853042 20564 tablet_copy_client.cc:538] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:42.854501 20567 tablet_copy_client.cc:538] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:42.863121 20564 tablet_bootstrap.cc:492] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:42.863780 20567 tablet_bootstrap.cc:492] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:42.891240 20567 tablet_bootstrap.cc:492] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:42.894582 20567 tablet_bootstrap.cc:492] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:42.895390 20567 ts_tablet_manager.cc:1403] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.008s
I20260709 12:13:42.898478 20567 raft_consensus.cc:359] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:42.899443 20567 raft_consensus.cc:740] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:42.900159 20567 consensus_queue.cc:260] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:42.902626 20567 ts_tablet_manager.cc:1434] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:42.905357 19760 tablet_copy_service.cc:342] P ca42d3c27d2e46348120791d1282b193: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-199b867263264f1c8e61b1e410b2a082 received from {username='slave'} at 127.0.0.1:40172
I20260709 12:13:42.905779 19760 tablet_copy_service.cc:434] P ca42d3c27d2e46348120791d1282b193: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-199b867263264f1c8e61b1e410b2a082 on tablet 199b867263264f1c8e61b1e410b2a082 with peer b12c250fb1a244ed9a49cf86950af1bf
W20260709 12:13:42.929225 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 46828.5us
I20260709 12:13:42.953313 20564 tablet_bootstrap.cc:492] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:42.954203 20564 tablet_bootstrap.cc:492] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:42.955087 20564 ts_tablet_manager.cc:1403] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.092s	user 0.039s	sys 0.013s
I20260709 12:13:42.958155 20567 ts_tablet_manager.cc:933] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:42.959272 20564 raft_consensus.cc:359] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:42.961197 20564 raft_consensus.cc:740] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:42.962018 20564 consensus_queue.cc:260] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:42.970855 20564 ts_tablet_manager.cc:1434] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:13:42.977146 19760 tablet_copy_service.cc:342] P ca42d3c27d2e46348120791d1282b193: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-09360ce480dc4631988b668a1a16fd23 received from {username='slave'} at 127.0.0.1:40172
I20260709 12:13:42.977666 19760 tablet_copy_service.cc:434] P ca42d3c27d2e46348120791d1282b193: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-09360ce480dc4631988b668a1a16fd23 on tablet 09360ce480dc4631988b668a1a16fd23 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:42.988297 20567 tablet_copy_client.cc:323] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.194:46489
I20260709 12:13:42.990137 19760 tablet_copy_service.cc:140] P ca42d3c27d2e46348120791d1282b193: Received BeginTabletCopySession request for tablet cf852411f79143c4b7d9d087e57902ee from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:40172)
I20260709 12:13:42.990897 19760 tablet_copy_service.cc:161] P ca42d3c27d2e46348120791d1282b193: Beginning new tablet copy session on tablet cf852411f79143c4b7d9d087e57902ee from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:40172: session id = b12c250fb1a244ed9a49cf86950af1bf-cf852411f79143c4b7d9d087e57902ee
I20260709 12:13:42.999884 19760 tablet_copy_source_session.cc:215] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:43.003602 20567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf852411f79143c4b7d9d087e57902ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.022935 20567 tablet_copy_client.cc:806] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:43.023620 20567 tablet_copy_client.cc:670] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:43.029321 20567 tablet_copy_client.cc:538] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:43.038687 20567 tablet_bootstrap.cc:492] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:43.062765 20567 tablet_bootstrap.cc:492] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:43.063789 20567 tablet_bootstrap.cc:492] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:43.064489 20567 ts_tablet_manager.cc:1403] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.005s
I20260709 12:13:43.067549 20567 raft_consensus.cc:359] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:43.068431 20567 raft_consensus.cc:740] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:43.069350 20567 consensus_queue.cc:260] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:43.071861 20567 ts_tablet_manager.cc:1434] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:43.074939 19760 tablet_copy_service.cc:342] P ca42d3c27d2e46348120791d1282b193: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-cf852411f79143c4b7d9d087e57902ee received from {username='slave'} at 127.0.0.1:40172
I20260709 12:13:43.075513 19760 tablet_copy_service.cc:434] P ca42d3c27d2e46348120791d1282b193: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-cf852411f79143c4b7d9d087e57902ee on tablet cf852411f79143c4b7d9d087e57902ee with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:43.111123 20432 raft_consensus.cc:1217] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:43.190193 20432 raft_consensus.cc:1217] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:43.409686 20432 raft_consensus.cc:1217] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:43.446300 20432 raft_consensus.cc:1217] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:43.579522 20542 raft_consensus.cc:1064] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:43.582306 20542 consensus_queue.cc:237] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:43.604806 19821 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:43.604806 20432 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:43.612991 19668 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:43.618408 20546 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:43.620395 20506 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:43.628463 20506 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:43.645709 20506 raft_consensus.cc:2955] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.649857 20545 raft_consensus.cc:1064] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:43.655220 20545 consensus_queue.cc:237] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:43.651026 19821 raft_consensus.cc:2955] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.678967 20432 raft_consensus.cc:2955] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.704450 19573 catalog_manager.cc:5697] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.727404 20432 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:43.730034 19672 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:43.734469 20542 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:43.734972 19821 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:43.737442 20542 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:43.739238 19673 raft_consensus.cc:2955] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.747043 20581 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:43.793889 20581 raft_consensus.cc:2955] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.813536 19824 raft_consensus.cc:2955] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.825351 20542 raft_consensus.cc:1064] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:43.837780 20542 consensus_queue.cc:237] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:43.846412 19573 catalog_manager.cc:5697] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.849706 19747 consensus_queue.cc:237] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:43.860719 20432 raft_consensus.cc:2955] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.868615 19668 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:43.868798 20506 raft_consensus.cc:1064] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:43.869293 20433 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:43.870736 20582 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:43.871465 20506 consensus_queue.cc:237] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:43.876468 20582 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:43.879024 20545 raft_consensus.cc:2955] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.880354 19668 raft_consensus.cc:2955] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.890184 20433 raft_consensus.cc:2955] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.897459 19559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f055e0ff3254433f83caca3e0e190a4c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:43.900102 19747 consensus_queue.cc:237] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:43.910817 19824 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:43.913573 20582 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:43.918942 20432 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:43.920557 20583 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:43.921973 19668 raft_consensus.cc:2955] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.925536 20545 raft_consensus.cc:2955] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.928090 19824 raft_consensus.cc:2955] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.937561 20432 raft_consensus.cc:2955] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.954457 19573 catalog_manager.cc:5697] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.957185 20433 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:43.957185 19666 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:43.961050 20582 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:43.962061 19821 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:43.965243 20583 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:43.970554 19572 catalog_manager.cc:5697] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:43.972041 20546 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:43.982353 19559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 09360ce480dc4631988b668a1a16fd23 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:43.986240 19657 tablet_service.cc:1558] Processing DeleteTablet for tablet 09360ce480dc4631988b668a1a16fd23 with delete_type TABLET_DATA_TOMBSTONED (TS f662c4f7d6a74013a1e58a5330a049b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48638
I20260709 12:13:43.995390 20431 raft_consensus.cc:1275] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:43.997308 20542 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:44.003590 19805 tablet_service.cc:1558] Processing DeleteTablet for tablet f055e0ff3254433f83caca3e0e190a4c with delete_type TABLET_DATA_TOMBSTONED (TS 1f9fb1b1a86c4eb99abdbaf9d239e324 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56882
I20260709 12:13:44.014369 19821 raft_consensus.cc:1275] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:44.027170 20597 tablet_replica.cc:333] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:13:44.045579 20542 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:44.049156 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 52160.7us
I20260709 12:13:44.059577 19668 raft_consensus.cc:1275] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:44.065765 20597 raft_consensus.cc:2243] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.066936 20597 raft_consensus.cc:2272] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.078321 20598 tablet_replica.cc:333] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:13:44.081493 20598 raft_consensus.cc:2243] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.082311 20598 raft_consensus.cc:2272] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.092989 20582 raft_consensus.cc:2955] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.101192 20433 raft_consensus.cc:2955] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.115725 20598 ts_tablet_manager.cc:1916] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:44.120050 20581 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:44.129997 19572 catalog_manager.cc:5697] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.137943 20542 raft_consensus.cc:2955] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.144543 19821 raft_consensus.cc:2955] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.153366 19675 raft_consensus.cc:2955] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.155936 19824 raft_consensus.cc:2955] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.159123 20597 ts_tablet_manager.cc:1916] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:44.183154 20432 raft_consensus.cc:2955] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.220100 19573 catalog_manager.cc:5697] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.259413 20598 ts_tablet_manager.cc:1929] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:44.259763 20597 ts_tablet_manager.cc:1929] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:44.259948 20598 log.cc:1199] T f055e0ff3254433f83caca3e0e190a4c P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/wals/f055e0ff3254433f83caca3e0e190a4c
I20260709 12:13:44.260318 20597 log.cc:1199] T 09360ce480dc4631988b668a1a16fd23 P f662c4f7d6a74013a1e58a5330a049b8: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/wals/09360ce480dc4631988b668a1a16fd23
I20260709 12:13:44.261916 19557 catalog_manager.cc:5028] TS 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): tablet f055e0ff3254433f83caca3e0e190a4c (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:44.262351 19558 catalog_manager.cc:5028] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): tablet 09360ce480dc4631988b668a1a16fd23 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:44.264832 19672 raft_consensus.cc:2955] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.269724 19750 consensus_queue.cc:237] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:44.281817 20432 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:44.284123 20506 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:44.293272 20583 raft_consensus.cc:2955] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.296092 20433 raft_consensus.cc:2955] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.302871 19747 consensus_queue.cc:237] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:44.309151 19672 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:44.311111 20432 raft_consensus.cc:1275] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:44.313302 19821 raft_consensus.cc:1275] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:44.317989 20542 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:44.321825 20546 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:44.323829 19573 catalog_manager.cc:5697] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.325767 20582 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:44.338479 19805 tablet_service.cc:1558] Processing DeleteTablet for tablet cf852411f79143c4b7d9d087e57902ee with delete_type TABLET_DATA_TOMBSTONED (TS 1f9fb1b1a86c4eb99abdbaf9d239e324 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56882
I20260709 12:13:44.339637 20598 tablet_replica.cc:333] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:13:44.351572 20546 raft_consensus.cc:2955] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.364620 19559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf852411f79143c4b7d9d087e57902ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:44.362064 20432 raft_consensus.cc:2955] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.374502 19817 raft_consensus.cc:2955] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.380672 19559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 199b867263264f1c8e61b1e410b2a082 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:44.381523 20598 raft_consensus.cc:2243] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.382408 20598 raft_consensus.cc:2272] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.382802 19672 raft_consensus.cc:2955] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.394666 20598 ts_tablet_manager.cc:1916] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:44.389495 19573 catalog_manager.cc:5697] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:44.439973 19657 tablet_service.cc:1558] Processing DeleteTablet for tablet 199b867263264f1c8e61b1e410b2a082 with delete_type TABLET_DATA_TOMBSTONED (TS f662c4f7d6a74013a1e58a5330a049b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48638
I20260709 12:13:44.443650 20597 tablet_replica.cc:333] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:13:44.444741 20597 raft_consensus.cc:2243] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:44.445619 20597 raft_consensus.cc:2272] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.453328 20597 ts_tablet_manager.cc:1916] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:44.458534 20598 ts_tablet_manager.cc:1929] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:44.460109 20598 log.cc:1199] T cf852411f79143c4b7d9d087e57902ee P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/wals/cf852411f79143c4b7d9d087e57902ee
I20260709 12:13:44.461668 19557 catalog_manager.cc:5028] TS 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): tablet cf852411f79143c4b7d9d087e57902ee (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:44.478627 20597 ts_tablet_manager.cc:1929] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:44.479218 20597 log.cc:1199] T 199b867263264f1c8e61b1e410b2a082 P f662c4f7d6a74013a1e58a5330a049b8: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/wals/199b867263264f1c8e61b1e410b2a082
I20260709 12:13:44.480881 19558 catalog_manager.cc:5028] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): tablet 199b867263264f1c8e61b1e410b2a082 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:45.521606 19824 consensus_queue.cc:237] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:45.528367 19747 raft_consensus.cc:1275] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:45.528676 19789 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 798fecda3ed247f4941d585924251970. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.529364 19672 raft_consensus.cc:1275] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:45.529882 20573 consensus_queue.cc:1048] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:45.531127 20601 consensus_queue.cc:1048] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.544209 20606 raft_consensus.cc:2955] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.549793 19675 raft_consensus.cc:2955] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.550467 19747 raft_consensus.cc:2955] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.575683 19571 catalog_manager.cc:5697] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.577816 19747 consensus_queue.cc:237] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
W20260709 12:13:45.590380 19715 consensus_peers.cc:597] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ccab10bc1b5444482abde3bf4bced52. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.591606 19824 raft_consensus.cc:1275] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:45.593653 19672 raft_consensus.cc:1275] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:45.594254 20542 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:45.595830 20604 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:45.619632 20542 raft_consensus.cc:2955] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.623448 19672 raft_consensus.cc:2955] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.628142 19824 raft_consensus.cc:2955] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.655167 19824 consensus_queue.cc:237] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:45.661124 19573 catalog_manager.cc:5697] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.686117 19672 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:45.687304 19789 consensus_peers.cc:597] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8da80375ede34511af0e77afa09d8640. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.687337 19747 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:45.688103 20610 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.689713 20606 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.702366 20610 raft_consensus.cc:2955] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.703961 19671 raft_consensus.cc:2955] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.708365 19747 raft_consensus.cc:2955] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.725395 19572 catalog_manager.cc:5697] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.731462 19747 consensus_queue.cc:237] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:45.742085 19824 raft_consensus.cc:1275] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:45.743352 19671 raft_consensus.cc:1275] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:45.743889 20542 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:45.744946 19715 consensus_peers.cc:597] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a1b950de64348a69098644dcf9be21d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.746263 20581 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.753861 20581 raft_consensus.cc:2955] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.756650 19824 raft_consensus.cc:2955] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.760432 19671 raft_consensus.cc:2955] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:45.778550 19573 catalog_manager.cc:5697] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:46.145999 20626 ts_tablet_manager.cc:933] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:46.151207 20626 tablet_copy_client.cc:323] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.195:42991
I20260709 12:13:46.154006 19834 tablet_copy_service.cc:140] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Received BeginTabletCopySession request for tablet 798fecda3ed247f4941d585924251970 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:60644)
I20260709 12:13:46.154677 19834 tablet_copy_service.cc:161] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Beginning new tablet copy session on tablet 798fecda3ed247f4941d585924251970 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:60644: session id = b12c250fb1a244ed9a49cf86950af1bf-798fecda3ed247f4941d585924251970
I20260709 12:13:46.161616 20629 ts_tablet_manager.cc:933] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:46.167339 20629 tablet_copy_client.cc:323] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.195:42991
I20260709 12:13:46.170282 20628 ts_tablet_manager.cc:933] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:46.171196 19833 tablet_copy_service.cc:140] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Received BeginTabletCopySession request for tablet 8da80375ede34511af0e77afa09d8640 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:60644)
I20260709 12:13:46.171869 19833 tablet_copy_service.cc:161] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Beginning new tablet copy session on tablet 8da80375ede34511af0e77afa09d8640 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:60644: session id = b12c250fb1a244ed9a49cf86950af1bf-8da80375ede34511af0e77afa09d8640
I20260709 12:13:46.175416 19834 tablet_copy_source_session.cc:215] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:46.181587 20626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798fecda3ed247f4941d585924251970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:46.204291 20626 tablet_copy_client.cc:806] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:46.205211 20626 tablet_copy_client.cc:670] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:46.217845 20626 tablet_copy_client.cc:538] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:46.229357 20626 tablet_bootstrap.cc:492] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:46.234747 19833 tablet_copy_source_session.cc:215] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:46.243184 20629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da80375ede34511af0e77afa09d8640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:46.246449 20632 ts_tablet_manager.cc:933] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:46.260986 20628 tablet_copy_client.cc:323] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.194:46489
I20260709 12:13:46.269053 20632 tablet_copy_client.cc:323] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.194:46489
I20260709 12:13:46.269325 19760 tablet_copy_service.cc:140] P ca42d3c27d2e46348120791d1282b193: Received BeginTabletCopySession request for tablet 2ccab10bc1b5444482abde3bf4bced52 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:40172)
I20260709 12:13:46.270072 19760 tablet_copy_service.cc:161] P ca42d3c27d2e46348120791d1282b193: Beginning new tablet copy session on tablet 2ccab10bc1b5444482abde3bf4bced52 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:40172: session id = b12c250fb1a244ed9a49cf86950af1bf-2ccab10bc1b5444482abde3bf4bced52
I20260709 12:13:46.272832 19759 tablet_copy_service.cc:140] P ca42d3c27d2e46348120791d1282b193: Received BeginTabletCopySession request for tablet 3a1b950de64348a69098644dcf9be21d from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:40172)
I20260709 12:13:46.273524 19759 tablet_copy_service.cc:161] P ca42d3c27d2e46348120791d1282b193: Beginning new tablet copy session on tablet 3a1b950de64348a69098644dcf9be21d from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:40172: session id = b12c250fb1a244ed9a49cf86950af1bf-3a1b950de64348a69098644dcf9be21d
I20260709 12:13:46.277379 19760 tablet_copy_source_session.cc:215] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:46.282228 20628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ccab10bc1b5444482abde3bf4bced52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:46.290634 20629 tablet_copy_client.cc:806] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:46.291479 20629 tablet_copy_client.cc:670] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:46.300513 20629 tablet_copy_client.cc:538] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:46.313180 20626 tablet_bootstrap.cc:492] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:46.314390 19759 tablet_copy_source_session.cc:215] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:46.318991 20629 tablet_bootstrap.cc:492] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:46.319109 20632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1b950de64348a69098644dcf9be21d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:46.327262 20626 tablet_bootstrap.cc:492] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:46.328228 20626 ts_tablet_manager.cc:1403] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.008s
I20260709 12:13:46.346767 20632 tablet_copy_client.cc:806] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:46.347545 20632 tablet_copy_client.cc:670] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:46.332089 20626 raft_consensus.cc:359] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:46.381665 20626 raft_consensus.cc:740] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:46.383062 20628 tablet_copy_client.cc:806] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:46.382647 20626 consensus_queue.cc:260] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:46.383828 20628 tablet_copy_client.cc:670] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:46.390015 20626 ts_tablet_manager.cc:1434] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.061s	user 0.012s	sys 0.000s
I20260709 12:13:46.393740 20632 tablet_copy_client.cc:538] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:46.396376 19833 tablet_copy_service.cc:342] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-798fecda3ed247f4941d585924251970 received from {username='slave'} at 127.0.0.1:60644
I20260709 12:13:46.396912 19833 tablet_copy_service.cc:434] P 1f9fb1b1a86c4eb99abdbaf9d239e324: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-798fecda3ed247f4941d585924251970 on tablet 798fecda3ed247f4941d585924251970 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:46.398821 20628 tablet_copy_client.cc:538] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:46.403582 20629 tablet_bootstrap.cc:492] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:46.404758 20629 tablet_bootstrap.cc:492] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:46.405874 20629 ts_tablet_manager.cc:1403] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.087s	user 0.029s	sys 0.029s
I20260709 12:13:46.414551 20632 tablet_bootstrap.cc:492] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:46.418952 20629 raft_consensus.cc:359] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:46.420029 20629 raft_consensus.cc:740] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:46.420660 20628 tablet_bootstrap.cc:492] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:46.420806 20629 consensus_queue.cc:260] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:46.424459 20629 ts_tablet_manager.cc:1434] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:13:46.426857 19833 tablet_copy_service.cc:342] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-8da80375ede34511af0e77afa09d8640 received from {username='slave'} at 127.0.0.1:60644
I20260709 12:13:46.427738 19833 tablet_copy_service.cc:434] P 1f9fb1b1a86c4eb99abdbaf9d239e324: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-8da80375ede34511af0e77afa09d8640 on tablet 8da80375ede34511af0e77afa09d8640 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:46.500232 20628 tablet_bootstrap.cc:492] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:46.501473 20628 tablet_bootstrap.cc:492] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:46.507321 20628 ts_tablet_manager.cc:1403] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.038s
I20260709 12:13:46.510967 20628 raft_consensus.cc:359] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:46.511919 20628 raft_consensus.cc:740] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:46.512651 20628 consensus_queue.cc:260] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:46.513486 20632 tablet_bootstrap.cc:492] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:46.514524 20632 tablet_bootstrap.cc:492] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:46.515265 20632 ts_tablet_manager.cc:1403] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.101s	user 0.026s	sys 0.011s
I20260709 12:13:46.516088 20628 ts_tablet_manager.cc:1434] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:46.518831 20632 raft_consensus.cc:359] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:46.519793 20632 raft_consensus.cc:740] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:46.524361 20632 consensus_queue.cc:260] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:46.530936 20632 ts_tablet_manager.cc:1434] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.005s
I20260709 12:13:46.765031 20433 raft_consensus.cc:1217] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:46.817229 19759 tablet_copy_service.cc:342] P ca42d3c27d2e46348120791d1282b193: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-2ccab10bc1b5444482abde3bf4bced52 received from {username='slave'} at 127.0.0.1:40172
I20260709 12:13:46.817704 19759 tablet_copy_service.cc:434] P ca42d3c27d2e46348120791d1282b193: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-2ccab10bc1b5444482abde3bf4bced52 on tablet 2ccab10bc1b5444482abde3bf4bced52 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:46.818549 19760 tablet_copy_service.cc:342] P ca42d3c27d2e46348120791d1282b193: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-3a1b950de64348a69098644dcf9be21d received from {username='slave'} at 127.0.0.1:40172
I20260709 12:13:46.819068 19760 tablet_copy_service.cc:434] P ca42d3c27d2e46348120791d1282b193: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-3a1b950de64348a69098644dcf9be21d on tablet 3a1b950de64348a69098644dcf9be21d with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:46.845674 20433 raft_consensus.cc:1217] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:46.902140 20432 raft_consensus.cc:1217] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:46.903594 20431 raft_consensus.cc:1217] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:47.097780 20610 raft_consensus.cc:1064] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:47.100553 20610 consensus_queue.cc:237] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:47.109450 20432 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.109454 19748 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.110150 19675 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.111845 20610 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:47.113031 20653 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:47.113950 20639 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:47.143994 20651 raft_consensus.cc:1064] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:47.149827 20651 consensus_queue.cc:237] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:47.161273 20641 raft_consensus.cc:1064] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:47.221698 20624 raft_consensus.cc:1064] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:47.224539 20624 consensus_queue.cc:237] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:47.254658 19817 raft_consensus.cc:1275] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.258847 20432 raft_consensus.cc:1275] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.261313 20650 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:47.267498 20644 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:47.266562 19671 raft_consensus.cc:1275] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.290927 20604 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:47.367153 20432 raft_consensus.cc:1275] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.369666 19671 raft_consensus.cc:1275] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.373842 19817 raft_consensus.cc:1275] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.374184 20610 raft_consensus.cc:2955] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.369673 20624 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:13:47.383019 20650 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:47.384967 20542 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:47.385665 20648 raft_consensus.cc:2955] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.350601 20641 consensus_queue.cc:237] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:47.459344 19675 raft_consensus.cc:2955] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.468623 19822 raft_consensus.cc:2955] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.488610 20649 raft_consensus.cc:2955] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.495008 20431 raft_consensus.cc:2955] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.504721 20430 raft_consensus.cc:2955] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.508289 19572 catalog_manager.cc:5697] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.538075 19748 raft_consensus.cc:2955] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:13:47.556192 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 182530us
I20260709 12:13:47.556008 20431 raft_consensus.cc:2955] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.572736 19822 raft_consensus.cc:2955] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.575357 19672 raft_consensus.cc:2955] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:13:47.579361 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.604105 19675 raft_consensus.cc:2955] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:13:47.606689 19696 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf360 after lost signal to thread 18410
W20260709 12:13:47.608392 19696 debug-util.cc:398] Leaking SignalData structure 0x7b080019ebc0 after lost signal to thread 19607
W20260709 12:13:47.610419 19696 debug-util.cc:398] Leaking SignalData structure 0x7b08002f44c0 after lost signal to thread 19699
W20260709 12:13:47.613210 19696 debug-util.cc:398] Leaking SignalData structure 0x7b0800306040 after lost signal to thread 19774
W20260709 12:13:47.616091 19696 debug-util.cc:398] Leaking SignalData structure 0x7b080031c9e0 after lost signal to thread 19848
W20260709 12:13:47.624595 19696 debug-util.cc:398] Leaking SignalData structure 0x7b080031d4a0 after lost signal to thread 20457
W20260709 12:13:47.629693 19696 debug-util.cc:398] Leaking SignalData structure 0x7b0800317f60 after lost signal to thread 20607
I20260709 12:13:47.646327 19671 raft_consensus.cc:1275] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.649242 20432 raft_consensus.cc:1275] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.657546 20610 consensus_queue.cc:1048] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:47.674819 20610 consensus_queue.cc:1048] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:47.682626 19570 catalog_manager.cc:5697] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.716089 19748 raft_consensus.cc:1275] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:47.718478 20653 raft_consensus.cc:2955] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.732892 19671 raft_consensus.cc:2955] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.745358 20431 raft_consensus.cc:2955] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.750847 20610 consensus_queue.cc:1048] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:47.772104 19572 catalog_manager.cc:5697] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.801955 19573 catalog_manager.cc:5697] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.898124 19745 raft_consensus.cc:2955] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.916666 19824 consensus_queue.cc:237] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:47.919530 19822 consensus_queue.cc:237] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:47.931509 20432 raft_consensus.cc:1275] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:47.933208 20610 consensus_queue.cc:1048] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:47.934142 19671 raft_consensus.cc:1275] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:47.935639 20601 consensus_queue.cc:1048] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:47.938694 19672 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:47.942337 20431 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:47.942453 19742 consensus_queue.cc:237] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:47.944521 20601 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:47.949640 20641 raft_consensus.cc:2955] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.952425 20432 raft_consensus.cc:1275] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:47.953246 19822 raft_consensus.cc:1275] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:47.953639 20430 raft_consensus.cc:2955] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.993597 20624 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:48.005224 19557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 798fecda3ed247f4941d585924251970 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:47.981410 20665 raft_consensus.cc:2955] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:47.985064 20429 raft_consensus.cc:2955] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:48.016075 20644 raft_consensus.cc:2955] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:48.020130 20639 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:48.023247 20662 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:48.031268 19822 raft_consensus.cc:2955] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:48.039388 20432 raft_consensus.cc:2955] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:13:48.044546 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 55643.8us
I20260709 12:13:48.092196 19557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8da80375ede34511af0e77afa09d8640 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:48.109308 19673 raft_consensus.cc:2955] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:48.120102 19671 raft_consensus.cc:2955] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:48.213836 19745 consensus_queue.cc:237] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:48.248027 20430 raft_consensus.cc:1275] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:48.254559 20649 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:48.329195 19559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3a1b950de64348a69098644dcf9be21d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:48.334344 19668 raft_consensus.cc:1275] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:48.369225 20429 raft_consensus.cc:2955] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:48.375769 20662 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:48.418547 20648 raft_consensus.cc:2955] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:48.447129 19667 raft_consensus.cc:2955] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:48.459460 19571 catalog_manager.cc:5697] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.482224 19573 catalog_manager.cc:5697] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.500082 19559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ccab10bc1b5444482abde3bf4bced52 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:48.523682 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 798fecda3ed247f4941d585924251970 with delete_type TABLET_DATA_TOMBSTONED (TS ca42d3c27d2e46348120791d1282b193 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36920
I20260709 12:13:48.529320 19570 catalog_manager.cc:5697] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:48.567657 19657 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a1b950de64348a69098644dcf9be21d with delete_type TABLET_DATA_TOMBSTONED (TS f662c4f7d6a74013a1e58a5330a049b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48638
I20260709 12:13:48.573112 20688 tablet_replica.cc:333] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:13:48.574743 20688 raft_consensus.cc:2243] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.575702 20688 raft_consensus.cc:2272] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.598616 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 8da80375ede34511af0e77afa09d8640 with delete_type TABLET_DATA_TOMBSTONED (TS ca42d3c27d2e46348120791d1282b193 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36920
I20260709 12:13:48.602113 19571 catalog_manager.cc:5697] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.598825 20690 tablet_replica.cc:333] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:13:48.604487 20690 raft_consensus.cc:2243] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.605454 20690 raft_consensus.cc:2272] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.615185 20690 ts_tablet_manager.cc:1916] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:48.629688 19805 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ccab10bc1b5444482abde3bf4bced52 with delete_type TABLET_DATA_TOMBSTONED (TS 1f9fb1b1a86c4eb99abdbaf9d239e324 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56882
I20260709 12:13:48.641343 20691 tablet_replica.cc:333] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:13:48.642531 20691 raft_consensus.cc:2243] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.643355 20691 raft_consensus.cc:2272] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.646533 20691 ts_tablet_manager.cc:1916] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:48.646883 20688 ts_tablet_manager.cc:1916] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:48.661796 20690 ts_tablet_manager.cc:1929] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:48.662397 20690 log.cc:1199] T 3a1b950de64348a69098644dcf9be21d P f662c4f7d6a74013a1e58a5330a049b8: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/wals/3a1b950de64348a69098644dcf9be21d
I20260709 12:13:48.664336 19558 catalog_manager.cc:5028] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): tablet 3a1b950de64348a69098644dcf9be21d (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:48.665488 20691 ts_tablet_manager.cc:1929] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:48.665907 20691 log.cc:1199] T 2ccab10bc1b5444482abde3bf4bced52 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/wals/2ccab10bc1b5444482abde3bf4bced52
I20260709 12:13:48.667541 19557 catalog_manager.cc:5028] TS 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): tablet 2ccab10bc1b5444482abde3bf4bced52 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:48.669974 20688 ts_tablet_manager.cc:1929] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:48.670744 20688 log.cc:1199] T 798fecda3ed247f4941d585924251970 P ca42d3c27d2e46348120791d1282b193: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/wals/798fecda3ed247f4941d585924251970
I20260709 12:13:48.673883 20688 tablet_replica.cc:333] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:13:48.675009 19559 catalog_manager.cc:5028] TS ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): tablet 798fecda3ed247f4941d585924251970 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:48.675232 20688 raft_consensus.cc:2243] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.676345 20688 raft_consensus.cc:2272] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.681094 20688 ts_tablet_manager.cc:1916] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:48.702145 20688 ts_tablet_manager.cc:1929] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:48.702673 20688 log.cc:1199] T 8da80375ede34511af0e77afa09d8640 P ca42d3c27d2e46348120791d1282b193: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/wals/8da80375ede34511af0e77afa09d8640
I20260709 12:13:48.704521 19559 catalog_manager.cc:5028] TS ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): tablet 8da80375ede34511af0e77afa09d8640 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
W20260709 12:13:49.277272 20454 debug-util.cc:398] Leaking SignalData structure 0x7b08002003a0 after lost signal to thread 18410
W20260709 12:13:49.278479 20454 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4fe0 after lost signal to thread 19607
W20260709 12:13:49.279999 20454 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd480 after lost signal to thread 19699
W20260709 12:13:49.281358 20454 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff960 after lost signal to thread 19774
W20260709 12:13:49.282357 20454 debug-util.cc:398] Leaking SignalData structure 0x7b080024a380 after lost signal to thread 19848
W20260709 12:13:49.284260 20454 debug-util.cc:398] Leaking SignalData structure 0x7b080021c960 after lost signal to thread 20457
W20260709 12:13:49.433555 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 43671.8us
I20260709 12:13:49.774712 19667 consensus_queue.cc:237] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:49.872385 19817 raft_consensus.cc:1275] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:49.884847 19742 raft_consensus.cc:1275] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:49.940450 19640 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f602836b3181405ca03967cbb5c11bc2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:49.940632 20680 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:49.941376 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 77558.3us
I20260709 12:13:49.994701 20681 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:50.079470 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 52609.4us
I20260709 12:13:50.124634 20680 raft_consensus.cc:2955] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:50.133585 19746 raft_consensus.cc:2955] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:50.163046 19817 raft_consensus.cc:2955] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:50.200753 19667 consensus_queue.cc:237] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:50.207245 19573 catalog_manager.cc:5697] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:50.239596 19640 consensus_peers.cc:597] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c3fa3feedde422fbce04c9f6ab16f44. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.245337 19819 raft_consensus.cc:1275] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:50.247521 19747 raft_consensus.cc:1275] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:50.248832 20680 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:50.250125 20701 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:50.286966 20701 raft_consensus.cc:2955] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:50.292357 19747 raft_consensus.cc:2955] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
W20260709 12:13:50.301294 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 48063.2us
I20260709 12:13:50.344653 19819 raft_consensus.cc:2955] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:50.374028 20714 ts_tablet_manager.cc:933] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713)
I20260709 12:13:50.393636 19747 consensus_queue.cc:237] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:50.423664 20714 tablet_copy_client.cc:323] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.193:36713
I20260709 12:13:50.426431 19819 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:50.427474 19715 consensus_peers.cc:597] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 062f541ef1eb40229095ed423b256495. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.427410 19685 tablet_copy_service.cc:140] P f662c4f7d6a74013a1e58a5330a049b8: Received BeginTabletCopySession request for tablet f602836b3181405ca03967cbb5c11bc2 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:54544)
I20260709 12:13:50.430454 19685 tablet_copy_service.cc:161] P f662c4f7d6a74013a1e58a5330a049b8: Beginning new tablet copy session on tablet f602836b3181405ca03967cbb5c11bc2 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:54544: session id = b12c250fb1a244ed9a49cf86950af1bf-f602836b3181405ca03967cbb5c11bc2
I20260709 12:13:50.447129 20704 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:50.463461 19675 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:50.466207 20651 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:50.494124 20650 raft_consensus.cc:2955] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:50.502738 19685 tablet_copy_source_session.cc:215] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:50.490662 19572 catalog_manager.cc:5697] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.503386 19817 raft_consensus.cc:2955] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:50.510329 20714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f602836b3181405ca03967cbb5c11bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.564183 19572 catalog_manager.cc:5697] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.567626 19822 consensus_queue.cc:237] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:50.607570 19671 raft_consensus.cc:2955] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:50.620826 20714 tablet_copy_client.cc:806] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:50.632395 20714 tablet_copy_client.cc:670] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:50.625268 19669 raft_consensus.cc:1275] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:50.626353 19789 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20afb18f0c024945ab458d1b8f6c62aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.634617 19746 raft_consensus.cc:1275] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:50.639305 20707 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:50.644131 20707 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:50.642618 20714 tablet_copy_client.cc:538] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:50.678346 20707 raft_consensus.cc:2955] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:50.683908 19675 raft_consensus.cc:2955] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:50.726162 19573 catalog_manager.cc:5697] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:50.816051 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 64411.7us
I20260709 12:13:50.823944 20714 tablet_bootstrap.cc:492] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:50.851975 19747 raft_consensus.cc:2955] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:50.928998 20725 ts_tablet_manager.cc:933] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713)
I20260709 12:13:50.939605 20725 tablet_copy_client.cc:323] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.193:36713
I20260709 12:13:50.941663 19685 tablet_copy_service.cc:140] P f662c4f7d6a74013a1e58a5330a049b8: Received BeginTabletCopySession request for tablet 1c3fa3feedde422fbce04c9f6ab16f44 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:54544)
I20260709 12:13:50.942348 19685 tablet_copy_service.cc:161] P f662c4f7d6a74013a1e58a5330a049b8: Beginning new tablet copy session on tablet 1c3fa3feedde422fbce04c9f6ab16f44 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:54544: session id = b12c250fb1a244ed9a49cf86950af1bf-1c3fa3feedde422fbce04c9f6ab16f44
I20260709 12:13:50.969974 19685 tablet_copy_source_session.cc:215] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:50.973809 20725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3fa3feedde422fbce04c9f6ab16f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.975433 20714 tablet_bootstrap.cc:492] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:50.976660 20714 tablet_bootstrap.cc:492] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:50.977545 20714 ts_tablet_manager.cc:1403] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.154s	user 0.034s	sys 0.005s
I20260709 12:13:50.981592 20714 raft_consensus.cc:359] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:50.982570 20714 raft_consensus.cc:740] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:50.983353 20714 consensus_queue.cc:260] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:51.003587 20714 ts_tablet_manager.cc:1434] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.026s	user 0.014s	sys 0.001s
I20260709 12:13:51.007503 19685 tablet_copy_service.cc:342] P f662c4f7d6a74013a1e58a5330a049b8: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-f602836b3181405ca03967cbb5c11bc2 received from {username='slave'} at 127.0.0.1:54544
I20260709 12:13:51.008112 19685 tablet_copy_service.cc:434] P f662c4f7d6a74013a1e58a5330a049b8: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-f602836b3181405ca03967cbb5c11bc2 on tablet f602836b3181405ca03967cbb5c11bc2 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:51.032583 20714 ts_tablet_manager.cc:933] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:13:51.047564 20714 tablet_copy_client.cc:323] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.194:46489
I20260709 12:13:51.053161 19760 tablet_copy_service.cc:140] P ca42d3c27d2e46348120791d1282b193: Received BeginTabletCopySession request for tablet 062f541ef1eb40229095ed423b256495 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:40172)
I20260709 12:13:51.053921 19760 tablet_copy_service.cc:161] P ca42d3c27d2e46348120791d1282b193: Beginning new tablet copy session on tablet 062f541ef1eb40229095ed423b256495 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:40172: session id = b12c250fb1a244ed9a49cf86950af1bf-062f541ef1eb40229095ed423b256495
I20260709 12:13:51.145864 20725 tablet_copy_client.cc:806] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:51.159765 20725 tablet_copy_client.cc:670] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:51.160753 19760 tablet_copy_source_session.cc:215] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:51.165824 20725 tablet_copy_client.cc:538] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:51.171573 20714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062f541ef1eb40229095ed423b256495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.201588 20725 tablet_bootstrap.cc:492] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:51.211755 20714 tablet_copy_client.cc:806] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:51.212411 20714 tablet_copy_client.cc:670] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:51.217787 20714 tablet_copy_client.cc:538] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:51.229552 20714 tablet_bootstrap.cc:492] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:51.239609 20730 ts_tablet_manager.cc:933] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:51.253378 20725 tablet_bootstrap.cc:492] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:51.254405 20725 tablet_bootstrap.cc:492] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:51.264382 20725 ts_tablet_manager.cc:1403] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.008s
I20260709 12:13:51.267830 20725 raft_consensus.cc:359] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:51.268712 20725 raft_consensus.cc:740] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:51.270402 20730 tablet_copy_client.cc:323] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.195:42991
I20260709 12:13:51.275038 19833 tablet_copy_service.cc:140] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Received BeginTabletCopySession request for tablet 20afb18f0c024945ab458d1b8f6c62aa from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:60644)
I20260709 12:13:51.275771 19833 tablet_copy_service.cc:161] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Beginning new tablet copy session on tablet 20afb18f0c024945ab458d1b8f6c62aa from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:60644: session id = b12c250fb1a244ed9a49cf86950af1bf-20afb18f0c024945ab458d1b8f6c62aa
I20260709 12:13:51.277442 20725 consensus_queue.cc:260] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:51.281692 20725 ts_tablet_manager.cc:1434] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:13:51.284320 19685 tablet_copy_service.cc:342] P f662c4f7d6a74013a1e58a5330a049b8: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-1c3fa3feedde422fbce04c9f6ab16f44 received from {username='slave'} at 127.0.0.1:54544
I20260709 12:13:51.285413 19685 tablet_copy_service.cc:434] P f662c4f7d6a74013a1e58a5330a049b8: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-1c3fa3feedde422fbce04c9f6ab16f44 on tablet 1c3fa3feedde422fbce04c9f6ab16f44 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:51.392776 20432 raft_consensus.cc:1217] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:51.394016 19833 tablet_copy_source_session.cc:215] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:51.397958 20730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20afb18f0c024945ab458d1b8f6c62aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.402506 20432 raft_consensus.cc:1217] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:51.457508 20730 tablet_copy_client.cc:806] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:51.458125 20730 tablet_copy_client.cc:670] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:51.460783 20714 tablet_bootstrap.cc:492] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:51.461771 20714 tablet_bootstrap.cc:492] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:51.462466 20714 ts_tablet_manager.cc:1403] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.233s	user 0.062s	sys 0.061s
I20260709 12:13:51.471308 20730 tablet_copy_client.cc:538] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:51.470213 20714 raft_consensus.cc:359] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:51.480028 20714 raft_consensus.cc:740] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:51.480768 20714 consensus_queue.cc:260] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:51.497108 20714 ts_tablet_manager.cc:1434] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 12:13:51.500605 19760 tablet_copy_service.cc:342] P ca42d3c27d2e46348120791d1282b193: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-062f541ef1eb40229095ed423b256495 received from {username='slave'} at 127.0.0.1:40172
I20260709 12:13:51.501157 19760 tablet_copy_service.cc:434] P ca42d3c27d2e46348120791d1282b193: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-062f541ef1eb40229095ed423b256495 on tablet 062f541ef1eb40229095ed423b256495 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:51.504706 20730 tablet_bootstrap.cc:492] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:51.549026 20730 tablet_bootstrap.cc:492] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:51.550668 20730 tablet_bootstrap.cc:492] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:51.551391 20730 ts_tablet_manager.cc:1403] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.008s
I20260709 12:13:51.554430 20730 raft_consensus.cc:359] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:51.555397 20730 raft_consensus.cc:740] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:51.556056 20730 consensus_queue.cc:260] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:51.558756 20730 ts_tablet_manager.cc:1434] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:51.560971 19833 tablet_copy_service.cc:342] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-20afb18f0c024945ab458d1b8f6c62aa received from {username='slave'} at 127.0.0.1:60644
I20260709 12:13:51.561554 19833 tablet_copy_service.cc:434] P 1f9fb1b1a86c4eb99abdbaf9d239e324: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-20afb18f0c024945ab458d1b8f6c62aa on tablet 20afb18f0c024945ab458d1b8f6c62aa with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:51.570650 20432 raft_consensus.cc:1217] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:51.647691 20432 raft_consensus.cc:1217] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:51.830533 20734 raft_consensus.cc:1064] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:51.841562 20734 consensus_queue.cc:237] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:51.869836 20724 raft_consensus.cc:1064] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:51.889216 20724 consensus_queue.cc:237] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:52.052386 20432 raft_consensus.cc:1275] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.053589 19822 raft_consensus.cc:1275] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.057626 20737 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:52.063524 20737 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:52.071858 19817 raft_consensus.cc:1275] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.074215 20734 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:52.087656 20429 raft_consensus.cc:1275] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.099726 19747 raft_consensus.cc:1275] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.106587 19747 raft_consensus.cc:1275] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.108943 20734 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:52.114593 20724 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:52.137264 20724 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:52.144718 20734 raft_consensus.cc:2955] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.185566 20742 raft_consensus.cc:1064] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:52.189224 20742 consensus_queue.cc:237] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:52.210556 20430 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.214186 19817 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.215828 20707 raft_consensus.cc:1064] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:52.219259 20707 consensus_queue.cc:237] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:52.220950 20706 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:52.219830 20724 raft_consensus.cc:2955] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.230129 19747 raft_consensus.cc:2955] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.239594 19669 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.235205 20706 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:13:52.179589 20432 raft_consensus.cc:2955] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.265704 19746 raft_consensus.cc:2955] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.273974 19669 raft_consensus.cc:1275] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.257829 20742 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:13:52.279448 20433 raft_consensus.cc:1275] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.279625 19572 catalog_manager.cc:5697] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.280916 20736 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:52.286032 19747 raft_consensus.cc:1275] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:52.335461 19573 catalog_manager.cc:5697] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:52.340633 20429 raft_consensus.cc:2955] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:13:52.357775 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 75877us
I20260709 12:13:52.290051 20696 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 12:13:52.433398 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 64071.2us
I20260709 12:13:52.516280 19817 raft_consensus.cc:2955] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.533771 20762 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:52.521626 19822 raft_consensus.cc:2955] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.662022 19667 raft_consensus.cc:2955] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.645850 20764 raft_consensus.cc:2955] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.769063 20756 raft_consensus.cc:2955] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.771785 19742 raft_consensus.cc:2955] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:13:52.797196 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 148739us
I20260709 12:13:52.817868 19815 raft_consensus.cc:2955] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.832394 20429 raft_consensus.cc:2955] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.838982 20430 raft_consensus.cc:2955] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.876562 19667 raft_consensus.cc:2955] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.882112 19666 consensus_queue.cc:237] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:52.894757 20428 raft_consensus.cc:1275] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:52.901153 19746 raft_consensus.cc:1275] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:52.903848 20754 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:52.911423 20754 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:52.919937 20737 raft_consensus.cc:2955] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.931910 19746 raft_consensus.cc:2955] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.933459 19572 catalog_manager.cc:5697] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.925557 20428 raft_consensus.cc:2955] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.956409 19558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1c3fa3feedde422fbce04c9f6ab16f44 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:52.980134 19667 consensus_queue.cc:237] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:52.973968 19573 catalog_manager.cc:5697] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:52.991518 20429 raft_consensus.cc:1275] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:52.994052 19815 raft_consensus.cc:1275] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:52.996433 20724 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:53.010047 19572 catalog_manager.cc:5697] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:53.012497 20754 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:53.018527 20701 raft_consensus.cc:2955] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.028623 20429 raft_consensus.cc:2955] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.035343 19815 raft_consensus.cc:2955] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.064829 19558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f602836b3181405ca03967cbb5c11bc2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:53.081080 19573 catalog_manager.cc:5697] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.092002 19805 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c3fa3feedde422fbce04c9f6ab16f44 with delete_type TABLET_DATA_TOMBSTONED (TS 1f9fb1b1a86c4eb99abdbaf9d239e324 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56882
I20260709 12:13:53.099171 19746 consensus_queue.cc:237] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:53.118350 19815 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:53.118831 20428 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:53.121551 20741 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:53.123422 20706 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:53.128748 20782 tablet_replica.cc:333] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:13:53.144004 19815 raft_consensus.cc:2955] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.142454 20778 raft_consensus.cc:2955] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.179471 19817 consensus_queue.cc:237] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:53.203820 20782 raft_consensus.cc:2243] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:53.189932 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet f602836b3181405ca03967cbb5c11bc2 with delete_type TABLET_DATA_TOMBSTONED (TS ca42d3c27d2e46348120791d1282b193 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36920
I20260709 12:13:53.244306 20782 raft_consensus.cc:2272] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:53.256567 20785 tablet_replica.cc:333] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:13:53.169809 20429 raft_consensus.cc:2955] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.269709 20430 raft_consensus.cc:1275] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:53.262771 19671 raft_consensus.cc:1275] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:53.279879 20785 raft_consensus.cc:2243] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:53.287285 20756 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:53.302305 20785 raft_consensus.cc:2272] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:53.305908 20785 ts_tablet_manager.cc:1916] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:53.317619 20782 ts_tablet_manager.cc:1916] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:53.319828 19570 catalog_manager.cc:5697] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.326411 20755 raft_consensus.cc:2955] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.329556 19671 raft_consensus.cc:2955] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.338474 19559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 062f541ef1eb40229095ed423b256495 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:53.348412 19657 tablet_service.cc:1558] Processing DeleteTablet for tablet 062f541ef1eb40229095ed423b256495 with delete_type TABLET_DATA_TOMBSTONED (TS f662c4f7d6a74013a1e58a5330a049b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48638
W20260709 12:13:53.352015 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 100537us
I20260709 12:13:53.368885 19557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 20afb18f0c024945ab458d1b8f6c62aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:53.380017 20695 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:13:53.387811 19570 catalog_manager.cc:5697] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.400017 20433 raft_consensus.cc:2955] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:53.423753 20787 tablet_replica.cc:333] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:13:53.427536 20787 raft_consensus.cc:2243] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:53.428587 20787 raft_consensus.cc:2272] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:53.430197 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 20afb18f0c024945ab458d1b8f6c62aa with delete_type TABLET_DATA_TOMBSTONED (TS ca42d3c27d2e46348120791d1282b193 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36920
I20260709 12:13:53.445852 20785 ts_tablet_manager.cc:1929] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:53.450419 20785 log.cc:1199] T f602836b3181405ca03967cbb5c11bc2 P ca42d3c27d2e46348120791d1282b193: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/wals/f602836b3181405ca03967cbb5c11bc2
I20260709 12:13:53.449812 20787 ts_tablet_manager.cc:1916] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:53.471065 19559 catalog_manager.cc:5028] TS ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): tablet f602836b3181405ca03967cbb5c11bc2 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:53.469732 20785 tablet_replica.cc:333] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:13:53.507499 20782 ts_tablet_manager.cc:1929] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:53.510486 20785 raft_consensus.cc:2243] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:53.511730 20785 raft_consensus.cc:2272] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:53.508054 20782 log.cc:1199] T 1c3fa3feedde422fbce04c9f6ab16f44 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/wals/1c3fa3feedde422fbce04c9f6ab16f44
I20260709 12:13:53.516439 20785 ts_tablet_manager.cc:1916] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:53.522635 19557 catalog_manager.cc:5028] TS 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): tablet 1c3fa3feedde422fbce04c9f6ab16f44 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
W20260709 12:13:53.520290 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 45840.5us
I20260709 12:13:53.555150 20787 ts_tablet_manager.cc:1929] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:53.555742 20787 log.cc:1199] T 062f541ef1eb40229095ed423b256495 P f662c4f7d6a74013a1e58a5330a049b8: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/wals/062f541ef1eb40229095ed423b256495
I20260709 12:13:53.558264 19558 catalog_manager.cc:5028] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): tablet 062f541ef1eb40229095ed423b256495 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:53.559257 20785 ts_tablet_manager.cc:1929] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:53.559665 20785 log.cc:1199] T 20afb18f0c024945ab458d1b8f6c62aa P ca42d3c27d2e46348120791d1282b193: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/wals/20afb18f0c024945ab458d1b8f6c62aa
I20260709 12:13:53.561079 19559 catalog_manager.cc:5028] TS ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): tablet 20afb18f0c024945ab458d1b8f6c62aa (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:54.641960 19671 consensus_queue.cc:237] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
W20260709 12:13:54.650713 19640 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc8e96dba8054da2a8d0b930ae6a53a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:54.659757 19818 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:54.658686 19742 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:54.664211 20754 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:54.665416 20724 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:54.706346 19746 raft_consensus.cc:2955] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:54.707664 19823 raft_consensus.cc:2955] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:54.715386 20754 raft_consensus.cc:2955] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:54.749125 19815 consensus_queue.cc:237] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:54.746497 19570 catalog_manager.cc:5697] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:54.817180 19789 consensus_peers.cc:597] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38079882b39945f6b049a6e7401f7280. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:54.819864 19746 raft_consensus.cc:1275] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:54.823683 20777 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:54.829810 19667 raft_consensus.cc:1275] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:54.839049 20707 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:54.853365 20756 raft_consensus.cc:2955] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:54.868997 19742 raft_consensus.cc:2955] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:54.883352 19570 catalog_manager.cc:5697] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.884192 19815 consensus_queue.cc:237] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:54.899482 19669 raft_consensus.cc:2955] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:55.021341 19746 raft_consensus.cc:1275] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:55.028110 20777 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:55.034296 19675 raft_consensus.cc:1275] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:55.038008 20756 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:55.037194 19789 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 871f15effca34f488df4f83da15c1167. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.079525 20777 raft_consensus.cc:2955] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:55.086879 19675 raft_consensus.cc:2955] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:55.122058 19669 consensus_queue.cc:237] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:55.146082 19746 raft_consensus.cc:2955] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:55.149124 19570 catalog_manager.cc:5697] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:55.200613 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 88650.2us
W20260709 12:13:55.240162 19640 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9b26df664874fc9abfb63a819ba56f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.242343 19815 raft_consensus.cc:1275] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:55.255663 20804 consensus_queue.cc:1048] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:55.258376 19746 raft_consensus.cc:1275] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:55.260161 20804 consensus_queue.cc:1048] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:55.271935 20808 ts_tablet_manager.cc:933] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713)
I20260709 12:13:55.287092 20803 raft_consensus.cc:2955] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:55.291790 19742 raft_consensus.cc:2955] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:55.298671 19815 raft_consensus.cc:2955] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:55.335146 20808 tablet_copy_client.cc:323] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.193:36713
I20260709 12:13:55.337911 19685 tablet_copy_service.cc:140] P f662c4f7d6a74013a1e58a5330a049b8: Received BeginTabletCopySession request for tablet bc8e96dba8054da2a8d0b930ae6a53a0 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:54544)
I20260709 12:13:55.338521 19685 tablet_copy_service.cc:161] P f662c4f7d6a74013a1e58a5330a049b8: Beginning new tablet copy session on tablet bc8e96dba8054da2a8d0b930ae6a53a0 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:54544: session id = b12c250fb1a244ed9a49cf86950af1bf-bc8e96dba8054da2a8d0b930ae6a53a0
I20260709 12:13:55.342640 19573 catalog_manager.cc:5697] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:55.358659 19685 tablet_copy_source_session.cc:215] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:55.374850 20808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8e96dba8054da2a8d0b930ae6a53a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:55.412240 20812 ts_tablet_manager.cc:933] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:55.425540 20812 tablet_copy_client.cc:323] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.195:42991
I20260709 12:13:55.428560 19833 tablet_copy_service.cc:140] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Received BeginTabletCopySession request for tablet 38079882b39945f6b049a6e7401f7280 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:60644)
I20260709 12:13:55.429302 19833 tablet_copy_service.cc:161] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Beginning new tablet copy session on tablet 38079882b39945f6b049a6e7401f7280 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:60644: session id = b12c250fb1a244ed9a49cf86950af1bf-38079882b39945f6b049a6e7401f7280
I20260709 12:13:55.467327 20814 ts_tablet_manager.cc:933] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:55.489416 19833 tablet_copy_source_session.cc:215] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:55.545181 20812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38079882b39945f6b049a6e7401f7280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:55.579983 20808 tablet_copy_client.cc:806] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:55.580688 20812 tablet_copy_client.cc:806] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:55.581005 20808 tablet_copy_client.cc:670] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:55.582523 20814 tablet_copy_client.cc:323] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.195:42991
I20260709 12:13:55.583959 20812 tablet_copy_client.cc:670] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:55.587579 19833 tablet_copy_service.cc:140] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Received BeginTabletCopySession request for tablet 871f15effca34f488df4f83da15c1167 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:60644)
I20260709 12:13:55.588160 19833 tablet_copy_service.cc:161] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Beginning new tablet copy session on tablet 871f15effca34f488df4f83da15c1167 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:60644: session id = b12c250fb1a244ed9a49cf86950af1bf-871f15effca34f488df4f83da15c1167
I20260709 12:13:55.592012 20808 tablet_copy_client.cc:538] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:55.602027 19833 tablet_copy_source_session.cc:215] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:55.602885 20812 tablet_copy_client.cc:538] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:55.621505 20808 tablet_bootstrap.cc:492] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:55.624867 20814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871f15effca34f488df4f83da15c1167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:55.644141 20812 tablet_bootstrap.cc:492] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:55.712019 20814 tablet_copy_client.cc:806] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:55.712831 20814 tablet_copy_client.cc:670] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:55.720153 20814 tablet_copy_client.cc:538] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:55.736570 20814 tablet_bootstrap.cc:492] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:55.748159 20808 tablet_bootstrap.cc:492] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.749557 20808 tablet_bootstrap.cc:492] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:55.779838 20808 ts_tablet_manager.cc:1403] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.159s	user 0.026s	sys 0.014s
I20260709 12:13:55.796149 20808 raft_consensus.cc:359] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:55.799448 20818 ts_tablet_manager.cc:933] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713)
I20260709 12:13:55.811470 20808 raft_consensus.cc:740] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:55.813761 20812 tablet_bootstrap.cc:492] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.812223 20808 consensus_queue.cc:260] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:55.815604 20818 tablet_copy_client.cc:323] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.193:36713
I20260709 12:13:55.821601 19685 tablet_copy_service.cc:140] P f662c4f7d6a74013a1e58a5330a049b8: Received BeginTabletCopySession request for tablet b9b26df664874fc9abfb63a819ba56f7 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:54544)
I20260709 12:13:55.822157 19685 tablet_copy_service.cc:161] P f662c4f7d6a74013a1e58a5330a049b8: Beginning new tablet copy session on tablet b9b26df664874fc9abfb63a819ba56f7 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:54544: session id = b12c250fb1a244ed9a49cf86950af1bf-b9b26df664874fc9abfb63a819ba56f7
I20260709 12:13:55.830519 19685 tablet_copy_source_session.cc:215] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:55.832104 20808 ts_tablet_manager.cc:1434] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.001s
I20260709 12:13:55.841341 20818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b26df664874fc9abfb63a819ba56f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:55.841758 20433 raft_consensus.cc:1217] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:55.842078 19684 tablet_copy_service.cc:342] P f662c4f7d6a74013a1e58a5330a049b8: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-bc8e96dba8054da2a8d0b930ae6a53a0 received from {username='slave'} at 127.0.0.1:54544
I20260709 12:13:55.847546 19684 tablet_copy_service.cc:434] P f662c4f7d6a74013a1e58a5330a049b8: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-bc8e96dba8054da2a8d0b930ae6a53a0 on tablet bc8e96dba8054da2a8d0b930ae6a53a0 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:55.843488 20814 tablet_bootstrap.cc:492] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:55.832966 20812 tablet_bootstrap.cc:492] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:55.850883 20812 ts_tablet_manager.cc:1403] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.207s	user 0.023s	sys 0.021s
I20260709 12:13:55.852778 20814 tablet_bootstrap.cc:492] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:55.854121 20812 raft_consensus.cc:359] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:55.854113 20814 ts_tablet_manager.cc:1403] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.118s	user 0.022s	sys 0.004s
I20260709 12:13:55.855273 20812 raft_consensus.cc:740] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:55.872514 20812 consensus_queue.cc:260] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:55.878089 20812 ts_tablet_manager.cc:1434] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:13:55.887566 20814 raft_consensus.cc:359] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:55.890354 19833 tablet_copy_service.cc:342] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-38079882b39945f6b049a6e7401f7280 received from {username='slave'} at 127.0.0.1:60644
I20260709 12:13:55.890888 19833 tablet_copy_service.cc:434] P 1f9fb1b1a86c4eb99abdbaf9d239e324: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-38079882b39945f6b049a6e7401f7280 on tablet 38079882b39945f6b049a6e7401f7280 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:55.895927 20818 tablet_copy_client.cc:806] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:55.896698 20818 tablet_copy_client.cc:670] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:55.901221 20818 tablet_copy_client.cc:538] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:55.889474 20814 raft_consensus.cc:740] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:55.908119 20814 consensus_queue.cc:260] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:55.910903 20814 ts_tablet_manager.cc:1434] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.002s
I20260709 12:13:55.912896 19833 tablet_copy_service.cc:342] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-871f15effca34f488df4f83da15c1167 received from {username='slave'} at 127.0.0.1:60644
I20260709 12:13:55.913343 19833 tablet_copy_service.cc:434] P 1f9fb1b1a86c4eb99abdbaf9d239e324: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-871f15effca34f488df4f83da15c1167 on tablet 871f15effca34f488df4f83da15c1167 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:55.914757 20818 tablet_bootstrap.cc:492] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:13:55.973680 20433 raft_consensus.cc:1217] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:56.055424 20433 raft_consensus.cc:1217] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:56.096190 20818 tablet_bootstrap.cc:492] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:56.097398 20818 tablet_bootstrap.cc:492] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:13:56.099635 20818 ts_tablet_manager.cc:1403] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.185s	user 0.029s	sys 0.029s
W20260709 12:13:56.124042 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 57957us
I20260709 12:13:56.140874 20818 raft_consensus.cc:359] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:56.150303 20818 raft_consensus.cc:740] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:13:56.152823 20818 consensus_queue.cc:260] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:56.162572 20818 ts_tablet_manager.cc:1434] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.005s
I20260709 12:13:56.165429 19685 tablet_copy_service.cc:342] P f662c4f7d6a74013a1e58a5330a049b8: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-b9b26df664874fc9abfb63a819ba56f7 received from {username='slave'} at 127.0.0.1:54544
I20260709 12:13:56.165983 19685 tablet_copy_service.cc:434] P f662c4f7d6a74013a1e58a5330a049b8: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-b9b26df664874fc9abfb63a819ba56f7 on tablet b9b26df664874fc9abfb63a819ba56f7 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:13:56.179988 20433 raft_consensus.cc:1217] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:56.286398 20803 raft_consensus.cc:1064] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:56.288934 20803 consensus_queue.cc:237] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:56.426954 20799 raft_consensus.cc:1064] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:56.430106 20799 consensus_queue.cc:237] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:56.451705 20429 raft_consensus.cc:1275] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:56.452929 19746 raft_consensus.cc:1275] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:56.453886 20826 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:56.455981 20826 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:56.493929 20826 raft_consensus.cc:2955] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:56.525447 19671 raft_consensus.cc:1275] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:56.991281 19747 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:56.998811 20433 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:56.999393 20829 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:57.006029 20829 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:57.044410 20826 consensus_meta.cc:287] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.548s	user 0.005s	sys 0.013s
I20260709 12:13:57.055145 20431 raft_consensus.cc:2955] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.075860 20827 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:57.077488 20821 raft_consensus.cc:1064] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:57.080394 20821 consensus_queue.cc:237] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:57.118393 19572 catalog_manager.cc:5697] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.135784 19823 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:57.140269 19744 raft_consensus.cc:2955] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.178926 19673 raft_consensus.cc:2955] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.232077 20430 raft_consensus.cc:1275] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:57.232537 20806 raft_consensus.cc:2955] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.235652 19744 raft_consensus.cc:2955] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.238801 20828 consensus_queue.cc:1048] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:57.240532 20756 raft_consensus.cc:1064] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:13:57.244479 20756 consensus_queue.cc:237] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:57.295089 20829 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:57.295688 20431 raft_consensus.cc:2955] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.310583 19673 raft_consensus.cc:1275] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:57.311571 19744 raft_consensus.cc:1275] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:57.315135 20707 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:57.315217 20429 raft_consensus.cc:1275] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:57.318866 20707 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:57.323027 20838 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:57.326247 19823 raft_consensus.cc:2955] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.351740 19748 raft_consensus.cc:1275] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:57.354465 20829 consensus_queue.cc:1048] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:57.354475 19818 raft_consensus.cc:1275] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:57.361894 20856 consensus_queue.cc:1048] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:57.391099 19823 consensus_queue.cc:237] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:57.397835 20848 raft_consensus.cc:2955] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.397111 19569 catalog_manager.cc:5697] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.421631 19746 raft_consensus.cc:2955] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.429683 20431 raft_consensus.cc:1275] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:57.433197 20756 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:57.436856 19742 raft_consensus.cc:1275] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:57.452450 20756 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:57.454146 20756 raft_consensus.cc:2955] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.467820 19557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 38079882b39945f6b049a6e7401f7280 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:57.494091 20430 raft_consensus.cc:2955] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:13:57.514150 19696 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad0c0 after lost signal to thread 18410
W20260709 12:13:57.515461 19696 debug-util.cc:398] Leaking SignalData structure 0x7b080031cfc0 after lost signal to thread 19607
W20260709 12:13:57.516829 19696 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9dc0 after lost signal to thread 19699
I20260709 12:13:57.513995 20829 raft_consensus.cc:2955] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.516558 20431 raft_consensus.cc:2955] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:13:57.518064 19696 debug-util.cc:398] Leaking SignalData structure 0x7b080019ed00 after lost signal to thread 19774
I20260709 12:13:57.517949 19748 raft_consensus.cc:2955] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:13:57.520393 19696 debug-util.cc:398] Leaking SignalData structure 0x7b08002967c0 after lost signal to thread 19848
W20260709 12:13:57.522753 19696 debug-util.cc:398] Leaking SignalData structure 0x7b0800092a80 after lost signal to thread 20457
I20260709 12:13:57.537968 19747 raft_consensus.cc:2955] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.540218 19673 consensus_queue.cc:237] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:57.544924 19570 catalog_manager.cc:5697] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.575040 19748 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:57.576435 20856 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:57.580672 20429 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:13:57.583503 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 50692.2us
I20260709 12:13:57.596459 20803 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:57.582063 20431 raft_consensus.cc:2955] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.611999 19673 raft_consensus.cc:2955] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.624972 20430 raft_consensus.cc:2955] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.621690 20828 raft_consensus.cc:2955] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.602065 19572 catalog_manager.cc:5697] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.603066 19573 catalog_manager.cc:5697] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:57.653743 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 79825.8us
I20260709 12:13:57.662320 19657 tablet_service.cc:1558] Processing DeleteTablet for tablet 38079882b39945f6b049a6e7401f7280 with delete_type TABLET_DATA_TOMBSTONED (TS f662c4f7d6a74013a1e58a5330a049b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48638
I20260709 12:13:57.666179 19746 raft_consensus.cc:2955] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.671877 19817 raft_consensus.cc:2955] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.673429 19668 consensus_queue.cc:237] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:57.667507 19823 consensus_queue.cc:237] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:13:57.714404 19747 raft_consensus.cc:1275] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:57.719403 20431 raft_consensus.cc:1275] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:57.722030 20756 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:57.734163 19670 raft_consensus.cc:1275] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:57.737360 20841 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:57.740604 19558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc8e96dba8054da2a8d0b930ae6a53a0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:57.742236 20430 raft_consensus.cc:1275] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:57.718168 20856 consensus_queue.cc:1048] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:13:57.747252 20844 consensus_queue.cc:1048] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:57.754891 19573 catalog_manager.cc:5697] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.761417 20806 raft_consensus.cc:2955] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.762928 19670 raft_consensus.cc:2955] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.769934 19746 raft_consensus.cc:2955] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.770131 20841 raft_consensus.cc:2955] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.783468 20869 tablet_replica.cc:333] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:13:57.784695 20869 raft_consensus.cc:2243] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.784911 20429 raft_consensus.cc:2955] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.785568 20869 raft_consensus.cc:2272] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.808559 20430 raft_consensus.cc:2955] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.821760 19805 tablet_service.cc:1558] Processing DeleteTablet for tablet bc8e96dba8054da2a8d0b930ae6a53a0 with delete_type TABLET_DATA_TOMBSTONED (TS 1f9fb1b1a86c4eb99abdbaf9d239e324 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56882
I20260709 12:13:57.824508 20870 tablet_replica.cc:333] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:13:57.825747 20870 raft_consensus.cc:2243] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.826592 20870 raft_consensus.cc:2272] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.828011 19570 catalog_manager.cc:5697] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New cstate: current_term: 1 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.831296 20870 ts_tablet_manager.cc:1916] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:57.842131 19558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9b26df664874fc9abfb63a819ba56f7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:57.843406 20869 ts_tablet_manager.cc:1916] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:57.846858 19573 catalog_manager.cc:5697] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:13:57.862298 19557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 871f15effca34f488df4f83da15c1167 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:57.865641 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet 871f15effca34f488df4f83da15c1167 with delete_type TABLET_DATA_TOMBSTONED (TS ca42d3c27d2e46348120791d1282b193 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36920
I20260709 12:13:57.871416 20870 ts_tablet_manager.cc:1929] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:57.871901 20870 log.cc:1199] T bc8e96dba8054da2a8d0b930ae6a53a0 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/wals/bc8e96dba8054da2a8d0b930ae6a53a0
I20260709 12:13:57.874112 19557 catalog_manager.cc:5028] TS 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): tablet bc8e96dba8054da2a8d0b930ae6a53a0 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:57.886379 19805 tablet_service.cc:1558] Processing DeleteTablet for tablet b9b26df664874fc9abfb63a819ba56f7 with delete_type TABLET_DATA_TOMBSTONED (TS 1f9fb1b1a86c4eb99abdbaf9d239e324 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56882
I20260709 12:13:57.889909 20870 tablet_replica.cc:333] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:13:57.891394 20870 raft_consensus.cc:2243] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.892340 20870 raft_consensus.cc:2272] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.901717 20871 tablet_replica.cc:333] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:13:57.903805 20870 ts_tablet_manager.cc:1916] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:57.917232 20871 raft_consensus.cc:2243] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.918553 20871 raft_consensus.cc:2272] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.965327 20870 ts_tablet_manager.cc:1929] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:57.975103 20870 log.cc:1199] T b9b26df664874fc9abfb63a819ba56f7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/wals/b9b26df664874fc9abfb63a819ba56f7
I20260709 12:13:57.967787 20871 ts_tablet_manager.cc:1916] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:57.984350 19557 catalog_manager.cc:5028] TS 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): tablet b9b26df664874fc9abfb63a819ba56f7 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:57.987562 20869 ts_tablet_manager.cc:1929] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:57.988066 20869 log.cc:1199] T 38079882b39945f6b049a6e7401f7280 P f662c4f7d6a74013a1e58a5330a049b8: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/wals/38079882b39945f6b049a6e7401f7280
I20260709 12:13:57.990396 19558 catalog_manager.cc:5028] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): tablet 38079882b39945f6b049a6e7401f7280 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:58.020299 20871 ts_tablet_manager.cc:1929] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:58.021028 20871 log.cc:1199] T 871f15effca34f488df4f83da15c1167 P ca42d3c27d2e46348120791d1282b193: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/wals/871f15effca34f488df4f83da15c1167
I20260709 12:13:58.023345 19559 catalog_manager.cc:5028] TS ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): tablet 871f15effca34f488df4f83da15c1167 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:13:58.364133 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:58.508086 19823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:13:58.508834 19823 raft_consensus.cc:606] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:58.514678 19823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f69387176614121ab470bb58987f450"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:13:58.515272 19823 raft_consensus.cc:606] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:58.541667 19747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:13:58.542636 19747 raft_consensus.cc:606] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:58.551031 19823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:13:58.551702 19823 raft_consensus.cc:606] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:58.618450 19823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:13:58.619400 19823 raft_consensus.cc:606] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:58.663697 19823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:13:58.664464 19823 raft_consensus.cc:606] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:13:58.665884 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:58.667656 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:58.668753 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:58.702943 20841 raft_consensus.cc:993] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:13:58.703579 20841 raft_consensus.cc:1081] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:13:58.708325 19673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48662
I20260709 12:13:58.709033 19673 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:58.709429 19673 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:58.718859 19673 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:58.721873 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:58.722566 19747 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:58.760270 19673 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:58.760969 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:58.761727 19818 raft_consensus.cc:3055] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:58.762046 19818 raft_consensus.cc:740] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:58.763149 19818 consensus_queue.cc:260] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:58.764861 19818 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:58.770139 19747 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:13:58.776083 19818 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:13:58.776109 19640 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:58.780279 20828 raft_consensus.cc:2804] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:58.797284 20828 raft_consensus.cc:697] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:58.799088 20828 consensus_queue.cc:237] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:58.842310 19571 catalog_manager.cc:5697] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:58.975528 20838 raft_consensus.cc:993] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:13:58.976141 20838 raft_consensus.cc:1081] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:13:58.988521 19673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f69387176614121ab470bb58987f450"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48662
I20260709 12:13:58.989220 19673 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:58.989593 19673 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.017701 19673 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.020834 19673 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:59.021994 20838 raft_consensus.cc:993] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
W20260709 12:13:59.022545 19621 auto_rebalancer.cc:629] Failed to schedule move for tablet 9f633905374c40ef9d178aa3de255d6f: Remote error: Service unavailable: leader transfer in progress
I20260709 12:13:59.025400 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:59.026192 19746 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.028419 20872 raft_consensus.cc:993] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:13:59.029126 20872 raft_consensus.cc:1081] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:13:59.029521 19817 consensus_queue.cc:237] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:59.031049 19675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48662
I20260709 12:13:59.031665 19675 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:59.031991 19675 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.033972 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:59.034709 19818 raft_consensus.cc:3055] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:59.039712 19675 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.040171 19746 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:13:59.045463 19675 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:59.046121 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:59.046967 19823 raft_consensus.cc:3055] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:59.047299 19823 raft_consensus.cc:740] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:59.035068 19818 raft_consensus.cc:740] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:59.049511 19818 consensus_queue.cc:260] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.050985 19818 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.048197 19823 consensus_queue.cc:260] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.052469 19823 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.053372 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:59.043119 20838 raft_consensus.cc:1081] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:13:59.054037 19747 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.064107 19818 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:13:59.070120 19747 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:13:59.065752 19638 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:59.074041 19675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48662
I20260709 12:13:59.075346 19675 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:59.075762 19675 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.076400 19823 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:13:59.077907 20832 raft_consensus.cc:993] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:13:59.080374 20876 raft_consensus.cc:2804] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:59.081511 19640 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:59.101778 20832 raft_consensus.cc:1081] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:13:59.101869 20876 raft_consensus.cc:697] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:59.103145 20803 raft_consensus.cc:2804] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:59.103006 20876 consensus_queue.cc:237] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.103688 20803 raft_consensus.cc:697] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:59.091681 19675 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.104629 20803 consensus_queue.cc:237] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.106086 19675 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:59.107390 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:59.107939 19747 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:59.097661 19789 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d86cf843c11e474cb87f4e55acb4505d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.099040 19746 raft_consensus.cc:1275] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:59.111614 19673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48652
I20260709 12:13:59.112195 19675 raft_consensus.cc:1275] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:59.112221 19673 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:59.113211 19673 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.121631 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:59.113595 20872 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:59.122351 19818 raft_consensus.cc:3055] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:59.122758 19818 raft_consensus.cc:740] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:59.123129 20838 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:59.133507 19818 consensus_queue.cc:260] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.135998 19747 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:13:59.140817 19640 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:59.151437 20828 raft_consensus.cc:2804] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:59.152330 20828 raft_consensus.cc:697] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:59.151062 19673 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.155514 19673 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:59.156380 19818 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.161669 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:59.162416 19817 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.181274 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:59.170532 20828 consensus_queue.cc:237] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.181984 19746 raft_consensus.cc:3055] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:59.182312 19746 raft_consensus.cc:740] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:13:59.183122 19746 consensus_queue.cc:260] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.184398 19746 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.178375 19817 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:13:59.187851 19638 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:59.192793 19746 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:13:59.193159 20876 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:59.193712 20876 raft_consensus.cc:697] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:59.194697 20876 consensus_queue.cc:237] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.189461 19818 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:13:59.225615 20826 raft_consensus.cc:993] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:13:59.225910 20841 raft_consensus.cc:2955] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.229308 19571 catalog_manager.cc:5697] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.231038 19571 catalog_manager.cc:5697] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.231530 19668 raft_consensus.cc:2955] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.240016 19746 raft_consensus.cc:2955] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.236243 20838 raft_consensus.cc:1081] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:13:59.247884 19670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48662
I20260709 12:13:59.248804 19670 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:59.249322 19670 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.267144 19670 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.271909 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:13:59.272585 19747 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.275250 19573 catalog_manager.cc:5697] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.278568 19670 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:59.283203 19746 consensus_queue.cc:237] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:59.284546 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:13:59.285102 19817 raft_consensus.cc:3055] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:59.285404 19817 raft_consensus.cc:740] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:13:59.286031 19817 consensus_queue.cc:260] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.287425 19747 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:13:59.288844 19640 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:13:59.290140 20877 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:59.290653 20877 raft_consensus.cc:697] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:13:59.291548 20877 consensus_queue.cc:237] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:13:59.298943 19817 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.320452 19817 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:13:59.323321 19573 catalog_manager.cc:5697] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.341691 19573 catalog_manager.cc:5697] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 2 to 3, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.382607 19747 raft_consensus.cc:1275] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:59.387629 19823 raft_consensus.cc:1275] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:59.388026 19668 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:59.389163 20876 consensus_queue.cc:1048] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:59.389582 19573 catalog_manager.cc:5697] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.392736 20876 consensus_queue.cc:1048] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:59.396051 20852 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:59.397636 19715 consensus_peers.cc:597] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c9123f5829474284995dd8a5c8139d82. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.398223 19817 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:59.404536 20852 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:13:59.489590 20832 raft_consensus.cc:2955] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.491570 19817 raft_consensus.cc:2955] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.507643 19668 raft_consensus.cc:2955] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.535657 19817 raft_consensus.cc:1275] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:59.537431 19573 catalog_manager.cc:5697] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.543560 20876 consensus_queue.cc:1048] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:59.551348 20902 ts_tablet_manager.cc:933] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:13:59.567914 19746 consensus_queue.cc:237] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:13:59.600099 19668 raft_consensus.cc:1275] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:59.603030 19818 raft_consensus.cc:1275] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:59.602046 20832 consensus_queue.cc:1048] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:59.603746 19823 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:59.605491 20803 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:59.607520 20840 consensus_queue.cc:1048] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:59.611004 19715 consensus_peers.cc:597] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26992be39c764bb3bc020dd42bc74a55. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.619931 20902 tablet_copy_client.cc:323] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.195:42991
I20260709 12:13:59.622001 19833 tablet_copy_service.cc:140] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Received BeginTabletCopySession request for tablet d86cf843c11e474cb87f4e55acb4505d from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:60644)
I20260709 12:13:59.622611 19833 tablet_copy_service.cc:161] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Beginning new tablet copy session on tablet d86cf843c11e474cb87f4e55acb4505d from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:60644: session id = b12c250fb1a244ed9a49cf86950af1bf-d86cf843c11e474cb87f4e55acb4505d
I20260709 12:13:59.648595 19815 raft_consensus.cc:1275] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:59.654899 19746 raft_consensus.cc:1275] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:59.655095 20876 consensus_queue.cc:1048] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:59.660036 19833 tablet_copy_source_session.cc:215] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:59.661172 20876 consensus_queue.cc:1048] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:59.674593 20902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86cf843c11e474cb87f4e55acb4505d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:59.684707 20852 raft_consensus.cc:2955] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.695060 19748 raft_consensus.cc:1275] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:59.699342 20876 consensus_queue.cc:1048] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:59.704100 19744 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:59.708798 19823 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:59.711099 20878 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:13:59.713572 19670 raft_consensus.cc:2955] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.731320 19824 raft_consensus.cc:2955] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.721212 20828 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:13:59.778429 19744 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:59.778967 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:59.794646 20876 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:59.807159 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 70096.6us
I20260709 12:13:59.816748 19570 catalog_manager.cc:5697] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:13:59.823890 19815 raft_consensus.cc:1275] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:59.880414 19744 raft_consensus.cc:1275] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:59.892850 20918 consensus_queue.cc:1048] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:59.924470 20902 tablet_copy_client.cc:806] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:59.925272 20902 tablet_copy_client.cc:670] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
W20260709 12:13:59.943025 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 56030.4us
W20260709 12:13:59.971187 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 66856.7us
W20260709 12:13:59.997135 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 49271.3us
I20260709 12:14:00.031018 20828 consensus_queue.cc:1048] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:14:00.072793 20902 tablet_copy_client.cc:538] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:14:00.074131 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 54506.6us
W20260709 12:14:00.096961 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 77144.5us
I20260709 12:14:00.176551 20921 ts_tablet_manager.cc:933] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:00.205271 20902 tablet_bootstrap.cc:492] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
W20260709 12:14:00.243541 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 81036.1us
I20260709 12:14:00.381906 20921 tablet_copy_client.cc:323] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.194:46489
I20260709 12:14:00.396070 20932 ts_tablet_manager.cc:933] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:00.443789 20932 tablet_copy_client.cc:323] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.194:46489
I20260709 12:14:00.504644 19760 tablet_copy_service.cc:140] P ca42d3c27d2e46348120791d1282b193: Received BeginTabletCopySession request for tablet c9123f5829474284995dd8a5c8139d82 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:40172)
I20260709 12:14:00.507704 19760 tablet_copy_service.cc:161] P ca42d3c27d2e46348120791d1282b193: Beginning new tablet copy session on tablet c9123f5829474284995dd8a5c8139d82 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:40172: session id = b12c250fb1a244ed9a49cf86950af1bf-c9123f5829474284995dd8a5c8139d82
I20260709 12:14:00.507792 19759 tablet_copy_service.cc:140] P ca42d3c27d2e46348120791d1282b193: Received BeginTabletCopySession request for tablet 26992be39c764bb3bc020dd42bc74a55 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:40172)
I20260709 12:14:00.508636 19759 tablet_copy_service.cc:161] P ca42d3c27d2e46348120791d1282b193: Beginning new tablet copy session on tablet 26992be39c764bb3bc020dd42bc74a55 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:40172: session id = b12c250fb1a244ed9a49cf86950af1bf-26992be39c764bb3bc020dd42bc74a55
I20260709 12:14:00.515250 19742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "062f541ef1eb40229095ed423b256495"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:00.516569 19742 raft_consensus.cc:606] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:00.551841 19759 tablet_copy_source_session.cc:215] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:00.569832 20932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26992be39c764bb3bc020dd42bc74a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.571640 19746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:00.573663 19746 raft_consensus.cc:606] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:00.591585 19760 tablet_copy_source_session.cc:215] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:14:00.618585 19789 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.060s	sys 0.053s
W20260709 12:14:00.619961 19789 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.062s	sys 0.053s
I20260709 12:14:00.636071 20934 raft_consensus.cc:993] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:00.636974 20934 raft_consensus.cc:1081] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:00.660159 20832 raft_consensus.cc:993] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193: : Instructing follower b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:00.660797 20832 raft_consensus.cc:1081] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:00.663250 19818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:00.664091 19818 raft_consensus.cc:606] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:00.680631 20921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9123f5829474284995dd8a5c8139d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.687712 19824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56904
I20260709 12:14:00.688482 19824 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:00.688930 19824 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:00.756893 20430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "062f541ef1eb40229095ed423b256495"
dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:60840
I20260709 12:14:00.757540 20430 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:00.757886 20430 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:00.789438 20942 log.cc:927] Time spent T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:14:00.779241 20902 log.cc:927] Time spent T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:14:00.822569 20927 raft_consensus.cc:993] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:00.823293 20927 raft_consensus.cc:1081] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:00.826944 20902 tablet_bootstrap.cc:492] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.828197 20902 tablet_bootstrap.cc:492] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:14:00.828943 20902 ts_tablet_manager.cc:1403] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.627s	user 0.029s	sys 0.008s
I20260709 12:14:00.818351 19824 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:00.842099 20902 raft_consensus.cc:359] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:00.864388 20902 raft_consensus.cc:740] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:14:00.871567 19819 raft_consensus.cc:1240] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:00.885612 20924 consensus_queue.cc:1059] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:00.886804 20924 raft_consensus.cc:3055] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:00.887153 20924 raft_consensus.cc:740] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:00.888007 20924 consensus_queue.cc:260] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:00.889065 20924 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:00.868916 20430 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:00.893496 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 71328.7us
I20260709 12:14:00.902281 20429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd"
dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:60828
I20260709 12:14:00.903225 20429 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:00.903617 20429 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:00.912305 20932 tablet_copy_client.cc:806] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:00.913605 20932 tablet_copy_client.cc:670] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:00.865231 20902 consensus_queue.cc:260] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:00.919464 20429 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:00.938217 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:00.938958 19823 raft_consensus.cc:3055] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:00.939237 19823 raft_consensus.cc:740] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:00.939945 19823 consensus_queue.cc:260] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:00.941002 19823 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:00.933085 19824 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:00.935777 20430 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:00.943567 20429 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:00.951139 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:00.951853 19672 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:00.957242 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:00.981211 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:00.982036 19670 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:00.991200 19819 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.029069 19823 raft_consensus.cc:2468] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:01.038163 19672 raft_consensus.cc:2468] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:01.045730 19675 raft_consensus.cc:1240] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:01.056011 19670 raft_consensus.cc:2468] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
W20260709 12:14:01.063609 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 54468us
I20260709 12:14:01.089057 20396 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:01.101877 19819 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:01.107410 19822 raft_consensus.cc:1240] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:01.126035 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:01.154532 20932 tablet_copy_client.cc:538] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:01.165820 20953 raft_consensus.cc:2804] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.178617 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:01.196585 19744 raft_consensus.cc:3055] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:01.197110 19744 raft_consensus.cc:740] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:01.142472 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 53682.4us
W20260709 12:14:01.209735 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 50121.1us
W20260709 12:14:01.210952 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.216264 19668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:38020
I20260709 12:14:01.217509 19668 raft_consensus.cc:606] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:01.219242 19788 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:01.201586 20902 ts_tablet_manager.cc:1434] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.372s	user 0.036s	sys 0.044s
W20260709 12:14:01.219985 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 92726.5us
W20260709 12:14:01.221757 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 59818us
I20260709 12:14:01.227274 19824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:01.228015 19824 raft_consensus.cc:606] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:01.228754 20953 raft_consensus.cc:697] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:01.204439 19744 consensus_queue.cc:260] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:01.242705 20430 raft_consensus.cc:1217] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:01.243088 20951 raft_consensus.cc:2804] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:14:01.244328 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 72738.7us
I20260709 12:14:01.246075 20921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60840 (request call id 293) took 1360 ms. Trace:
I20260709 12:14:01.274747 20921 rpcz_store.cc:276] 0709 12:13:59.885695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.885842 (+   147us) service_pool.cc:224] Handling call
0709 12:14:00.176973 (+291131us) ts_tablet_manager.cc:934] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
0709 12:14:00.640356 (+463383us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:14:00.978356 (+338000us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:00.978505 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:14:01.245183 (+266678us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:14:01.245538 (+   355us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:01.245849 (+   311us) ts_tablet_manager.cc:989] Replica registered.
0709 12:14:01.245984 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":392,"tablet-copy.queue_time_us":215055,"thread_start_us":285480,"threads_started":2}
I20260709 12:14:01.276527 19747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:01.277256 19747 raft_consensus.cc:606] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:01.283334 20953 consensus_queue.cc:237] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:01.288054 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:14:01.202551 19742 raft_consensus.cc:2468] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:01.251084 19744 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.271198 20951 raft_consensus.cc:697] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:01.293535 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:01.293181 20951 consensus_queue.cc:237] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:01.276563 20921 tablet_copy_client.cc:806] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:01.322157 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:01.250658 20396 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
W20260709 12:14:01.325148 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 83958.3us
I20260709 12:14:01.327342 20932 tablet_bootstrap.cc:492] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:14:01.333864 20921 tablet_copy_client.cc:670] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:01.342970 20431 raft_consensus.cc:1240] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:01.355463 19833 tablet_copy_service.cc:342] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-d86cf843c11e474cb87f4e55acb4505d received from {username='slave'} at 127.0.0.1:60644
I20260709 12:14:01.389066 19744 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
W20260709 12:14:01.379225 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 94075.1us
I20260709 12:14:01.390446 20952 raft_consensus.cc:2804] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.391029 19833 tablet_copy_service.cc:434] P 1f9fb1b1a86c4eb99abdbaf9d239e324: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-d86cf843c11e474cb87f4e55acb4505d on tablet d86cf843c11e474cb87f4e55acb4505d with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:01.400357 20952 raft_consensus.cc:697] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
W20260709 12:14:01.259037 20933 consensus_queue.cc:1175] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:14:01.401247 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 80427.6us
I20260709 12:14:01.427481 20838 raft_consensus.cc:993] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:01.428215 20838 raft_consensus.cc:1081] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:01.405368 20952 consensus_queue.cc:237] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:01.443964 19573 catalog_manager.cc:5697] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 2 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.460690 20933 raft_consensus.cc:993] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: : Instructing follower b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:01.461599 20832 raft_consensus.cc:1081] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:01.463436 20428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c"
dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:60840
I20260709 12:14:01.464099 20428 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.464578 20428 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:01.510372 20959 log.cc:927] Time spent T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:14:01.535223 20428 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:01.540095 20431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120"
dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:60828
I20260709 12:14:01.540709 20431 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.541098 20431 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.546857 20929 raft_consensus.cc:993] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:01.549012 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:01.549635 19666 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.551025 20929 raft_consensus.cc:1081] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:01.555699 20431 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:01.556300 20428 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:01.561131 19666 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:01.567967 19819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56898
I20260709 12:14:01.568536 19819 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.569550 20397 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:01.570664 20953 raft_consensus.cc:2804] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.571221 20953 raft_consensus.cc:697] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:01.571269 20431 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:01.572317 20953 consensus_queue.cc:237] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:01.575673 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:01.576407 19822 raft_consensus.cc:3055] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:01.576721 19822 raft_consensus.cc:740] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:01.569576 19819 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.577570 19822 consensus_queue.cc:260] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:01.578531 19822 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.582512 20921 tablet_copy_client.cc:538] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:01.587738 19819 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:01.590878 19819 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:01.594370 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:01.595109 19666 raft_consensus.cc:3055] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:01.595433 19666 raft_consensus.cc:740] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:01.596213 19666 consensus_queue.cc:260] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:01.597472 19666 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.607298 20926 raft_consensus.cc:1064] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:14:01.613232 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:01.616379 19742 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.617908 19666 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:01.622344 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:01.623169 19745 raft_consensus.cc:3055] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:01.623484 19745 raft_consensus.cc:740] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:01.625365 19788 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:01.622357 20926 consensus_queue.cc:237] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:01.628500 19745 consensus_queue.cc:260] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:01.629998 19745 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.632905 19822 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:01.634320 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:01.635497 19746 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.638754 20951 raft_consensus.cc:2804] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.639366 20951 raft_consensus.cc:697] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:01.640249 20951 consensus_queue.cc:237] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:01.645730 19746 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:01.649078 19745 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:01.651443 20396 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:01.658253 19742 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:01.662003 20956 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.679232 20921 tablet_bootstrap.cc:492] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:14:01.717900 20956 raft_consensus.cc:697] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:01.748353 20431 raft_consensus.cc:1275] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.747605 20956 consensus_queue.cc:237] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:01.749758 20951 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.750720 19746 raft_consensus.cc:1275] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.755246 20872 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.759413 19666 raft_consensus.cc:1275] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.761811 20872 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.823942 19672 raft_consensus.cc:1275] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:01.830202 20932 tablet_bootstrap.cc:492] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:01.831434 20932 tablet_bootstrap.cc:492] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:14:01.828727 20872 consensus_queue.cc:1048] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:14:01.834411 19570 catalog_manager.cc:5697] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.838585 20932 ts_tablet_manager.cc:1403] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.542s	user 0.025s	sys 0.035s
I20260709 12:14:01.880148 19824 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:01.894294 20952 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:14:01.974072 19745 raft_consensus.cc:1275] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:01.984061 19571 catalog_manager.cc:5697] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 2 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.985836 19571 catalog_manager.cc:5697] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 2 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.011022 19571 catalog_manager.cc:5697] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 2 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.003787 19675 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:02.006688 20872 consensus_queue.cc:1048] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.007325 19819 raft_consensus.cc:1275] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:02.025709 19675 raft_consensus.cc:1275] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:02.037770 19745 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:02.039336 19746 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:02.050326 20952 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:14:02.045174 20956 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:14:02.070283 20956 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:02.063555 20932 raft_consensus.cc:359] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:02.072942 20932 raft_consensus.cc:740] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:14:02.073691 20932 consensus_queue.cc:260] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:02.045954 20966 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:02.108750 19746 raft_consensus.cc:1275] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.083175 20953 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:14:02.166488 20887 consensus_queue.cc:1048] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:14:02.167907 19673 raft_consensus.cc:2955] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:02.235461 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 100984us
I20260709 12:14:02.241859 19819 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:14:02.265884 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 152321us
I20260709 12:14:02.311589 19744 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:14:02.365646 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 54832.3us
I20260709 12:14:02.368956 20932 ts_tablet_manager.cc:1434] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.484s	user 0.009s	sys 0.001s
I20260709 12:14:02.423688 20982 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 12:14:02.434607 20429 raft_consensus.cc:2955] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:02.438683 20958 log.cc:927] Time spent T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:14:02.450950 20966 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:02.284850 20926 raft_consensus.cc:2955] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:02.467937 20978 log.cc:927] Time spent T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:14:02.549536 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:02.548173 20921 tablet_bootstrap.cc:492] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:02.624183 20921 tablet_bootstrap.cc:492] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
W20260709 12:14:02.675860 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 340125us
I20260709 12:14:02.675437 20921 ts_tablet_manager.cc:1403] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 1.007s	user 0.028s	sys 0.023s
I20260709 12:14:02.703485 19760 tablet_copy_service.cc:342] P ca42d3c27d2e46348120791d1282b193: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-26992be39c764bb3bc020dd42bc74a55 received from {username='slave'} at 127.0.0.1:40172
I20260709 12:14:02.704063 19760 tablet_copy_service.cc:434] P ca42d3c27d2e46348120791d1282b193: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-26992be39c764bb3bc020dd42bc74a55 on tablet 26992be39c764bb3bc020dd42bc74a55 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:02.736581 19673 raft_consensus.cc:1275] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:02.738289 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 53400.9us
W20260709 12:14:02.784921 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 43527.9us
I20260709 12:14:02.808133 20429 raft_consensus.cc:1217] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:14:02.849117 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 54515.5us
I20260709 12:14:02.867638 20927 consensus_queue.cc:1048] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:02.813324 19741 raft_consensus.cc:2955] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:02.914764 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 55692.9us
W20260709 12:14:02.949426 20980 log.cc:927] Time spent T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:14:03.010738 20921 raft_consensus.cc:359] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:03.011870 20921 raft_consensus.cc:740] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:14:03.012629 20921 consensus_queue.cc:260] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
W20260709 12:14:03.038472 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 92154.1us
W20260709 12:14:03.047156 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 50122.3us
I20260709 12:14:03.014711 20921 ts_tablet_manager.cc:1434] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.304s	user 0.005s	sys 0.000s
W20260709 12:14:03.102196 20926 consensus_meta.cc:287] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.002s
I20260709 12:14:03.083843 20838 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:03.103856 20838 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:03.106114 20838 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:03.113049 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:03.155867 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 45102.8us
W20260709 12:14:03.158154 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 47519.5us
I20260709 12:14:03.191196 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:03.219633 19760 tablet_copy_service.cc:342] P ca42d3c27d2e46348120791d1282b193: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-c9123f5829474284995dd8a5c8139d82 received from {username='slave'} at 127.0.0.1:40172
I20260709 12:14:03.220160 19760 tablet_copy_service.cc:434] P ca42d3c27d2e46348120791d1282b193: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-c9123f5829474284995dd8a5c8139d82 on tablet c9123f5829474284995dd8a5c8139d82 with peer b12c250fb1a244ed9a49cf86950af1bf
W20260709 12:14:03.268045 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 78890.4us
I20260709 12:14:03.292474 19789 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:03.293982 20887 raft_consensus.cc:2749] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:03.318627 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 118295us
I20260709 12:14:03.347716 19571 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53406 (request call id 98) took 1459 ms. Trace:
I20260709 12:14:03.357165 21003 raft_consensus.cc:1064] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:14:03.348927 19573 catalog_manager.cc:5697] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:03.362569 21003 consensus_queue.cc:237] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:03.353490 19571 rpcz_store.cc:276] 0709 12:14:01.887969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.888142 (+   173us) service_pool.cc:224] Handling call
0709 12:14:03.347620 (+1459478us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:02.106999 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:02.237780 (+130781us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:02.239441 (+  1661us) write_op.cc:435] Acquired schema lock
0709 12:14:02.242554 (+  3113us) tablet.cc:662] Decoding operations
0709 12:14:02.359562 (+117008us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:02.366987 (+  7425us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:02.371930 (+  4943us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:14:02.468663 (+ 96733us) tablet.cc:701] Row locks acquired
0709 12:14:02.468695 (+    32us) write_op.cc:260] PREPARE: finished
0709 12:14:02.468895 (+   200us) write_op.cc:270] Start()
0709 12:14:02.469026 (+   131us) write_op.cc:276] Timestamp: P: 1783599242468854 usec, L: 0
0709 12:14:02.469047 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:14:02.469768 (+   721us) log.cc:844] Serialized 1311 byte log entry
0709 12:14:03.120795 (+651027us) op_driver.cc:464] REPLICATION: finished
0709 12:14:03.267330 (+146535us) write_op.cc:301] APPLY: starting
0709 12:14:03.267429 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:03.267593 (+   164us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:03.281713 (+ 14120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:03.290040 (+  8327us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:03.290298 (+   258us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:14:03.290368 (+    70us) write_op.cc:312] APPLY: finished
0709 12:14:03.314396 (+ 24028us) log.cc:844] Serialized 35 byte log entry
0709 12:14:03.315360 (+   964us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:03.316162 (+   802us) write_op.cc:454] Released schema lock
0709 12:14:03.316208 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:03.316567 (+   359us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:03.316600 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2408,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":146230,"apply.run_cpu_time_us":3090,"apply.run_wall_time_us":49254,"num_ops":3,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":5298,"prepare.run_wall_time_us":365454,"replication_time_us":651520,"thread_start_us":78336,"threads_started":1}]]}
I20260709 12:14:03.388852 19816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:03.389504 19816 raft_consensus.cc:606] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:03.392954 19748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:03.393680 19748 raft_consensus.cc:606] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:03.397466 19748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:03.398239 19748 raft_consensus.cc:606] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:03.402092 19816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8da80375ede34511af0e77afa09d8640"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:03.402757 19816 raft_consensus.cc:606] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:03.409139 19669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:38020
I20260709 12:14:03.409813 19669 raft_consensus.cc:606] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:03.412789 19748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:03.413508 19748 raft_consensus.cc:606] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:03.419358 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:14:03.421059 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:03.421984 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:03.437114 20428 raft_consensus.cc:1275] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:03.439046 20840 consensus_queue.cc:1048] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:03.443864 19816 raft_consensus.cc:1275] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:03.445794 20933 consensus_queue.cc:1048] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:03.455294 20429 raft_consensus.cc:1217] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:03.491788 19669 raft_consensus.cc:1275] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:03.501358 21002 consensus_queue.cc:1048] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:03.525956 20428 raft_consensus.cc:2955] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:03.523597 20991 raft_consensus.cc:2955] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:03.542258 19570 catalog_manager.cc:5697] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.569891 19816 raft_consensus.cc:2955] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:03.581514 19570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47152 (request call id 220) took 1529 ms. Trace:
I20260709 12:14:03.582046 19570 rpcz_store.cc:276] 0709 12:14:02.052454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.052628 (+   174us) service_pool.cc:224] Handling call
0709 12:14:02.063455 (+ 10827us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b5400002490. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165b640 00007fadfa532846 00007fadfa63c90e 00007fadf8afd2a4 00007fadf8afd232 00007fadf8afd161 00007fadf8afd0dc 00007fadf8afc392 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:03.581435 (+1517980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:03.560831 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:03.561378 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:03.561417 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:14:03.561433 (+    16us) tablet.cc:662] Decoding operations
0709 12:14:03.561798 (+   365us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:03.561852 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:03.561883 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:14:03.562056 (+   173us) tablet.cc:701] Row locks acquired
0709 12:14:03.562074 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:14:03.562198 (+   124us) write_op.cc:270] Start()
0709 12:14:03.562308 (+   110us) write_op.cc:276] Timestamp: P: 1783599243562156 usec, L: 0
0709 12:14:03.562343 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:14:03.567558 (+  5215us) log.cc:844] Serialized 544 byte log entry
0709 12:14:03.569835 (+  2277us) op_driver.cc:464] REPLICATION: finished
0709 12:14:03.570392 (+   557us) write_op.cc:301] APPLY: starting
0709 12:14:03.570486 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:03.570574 (+    88us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b540010ead4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477ae28 00007fadf81b5581 00007fadf81b4d58 00007fadf81b99f1 00007fadf81b99a9 00007fadf81b9939 00007fadf81b9901 00007fadf81b8b2d 0000000000388634 0000000000388479
0709 12:14:03.570606 (+    32us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:03.570642 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:03.570987 (+   345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:03.571148 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:14:03.571319 (+   171us) write_op.cc:312] APPLY: finished
0709 12:14:03.573587 (+  2268us) log.cc:844] Serialized 23 byte log entry
0709 12:14:03.573835 (+   248us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:03.573952 (+   117us) write_op.cc:454] Released schema lock
0709 12:14:03.574000 (+    48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":5506304,"child_traces":[["op",{"apply.queue_time_us":334,"apply.run_wall_time_us":4012,"num_ops":1,"prepare.queue_time_us":10182,"prepare.run_cpu_time_us":5858,"prepare.run_wall_time_us":9936,"replication_time_us":7358,"spinlock_wait_cycles":17278464}]]}
I20260709 12:14:03.649796 19669 raft_consensus.cc:2955] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:03.652536 20872 raft_consensus.cc:993] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:03.663014 19572 catalog_manager.cc:5697] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:03.667078 20991 raft_consensus.cc:993] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:03.681257 20840 raft_consensus.cc:993] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:14:03.702858 20951 raft_consensus.cc:1081] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:03.687384 19816 consensus_queue.cc:237] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:03.703671 20999 raft_consensus.cc:993] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:03.704314 20926 raft_consensus.cc:1081] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:03.704450 20979 raft_consensus.cc:1081] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:14:03.704660 20991 raft_consensus.cc:1081] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:03.708077 19667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48652
I20260709 12:14:03.708699 19667 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:03.709057 19667 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.710844 20429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa"
dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:60828
I20260709 12:14:03.711445 20429 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:03.711763 20429 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.721720 20429 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:03.725327 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:03.726887 19675 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.729645 20429 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:03.717047 20428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8da80375ede34511af0e77afa09d8640"
dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:60828
I20260709 12:14:03.742208 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:03.742969 19819 raft_consensus.cc:3055] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:03.743289 19819 raft_consensus.cc:740] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:03.744858 19819 consensus_queue.cc:260] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:03.752977 19819 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.744212 20428 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:03.779273 20428 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.791393 19821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56904
I20260709 12:14:03.792042 19821 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:03.792414 19821 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.801093 19819 raft_consensus.cc:2468] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:03.810667 20396 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:03.812002 20982 raft_consensus.cc:2804] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.821007 20982 raft_consensus.cc:697] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:03.822104 20982 consensus_queue.cc:237] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:03.836185 20429 raft_consensus.cc:1275] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:03.839687 20838 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:14:03.863517 19667 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:03.867507 19667 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:03.866953 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:03.869472 19748 raft_consensus.cc:3055] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:03.869809 19748 raft_consensus.cc:740] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:03.870604 19748 consensus_queue.cc:260] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:03.871656 19748 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.892829 19748 raft_consensus.cc:2468] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:03.909802 19675 raft_consensus.cc:2468] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:03.893100 19669 raft_consensus.cc:1275] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:03.893463 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:03.918509 19640 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:03.922755 19821 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:03.923506 20840 raft_consensus.cc:993] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:03.926681 20840 raft_consensus.cc:1081] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:03.930951 20828 raft_consensus.cc:2804] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.931635 20828 raft_consensus.cc:697] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:03.932626 20828 consensus_queue.cc:237] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:03.922982 20838 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:14:03.923869 19820 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.939162 19816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56904
I20260709 12:14:03.940160 19816 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:03.940707 19816 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.970892 19821 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:04.073565 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:04.074481 19746 raft_consensus.cc:3055] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:04.074977 19746 raft_consensus.cc:740] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:04.076059 19746 consensus_queue.cc:260] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:04.089356 19746 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.088344 20428 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:04.200891 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 118907us
I20260709 12:14:04.207082 19748 consensus_queue.cc:237] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:04.244386 20930 raft_consensus.cc:993] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
W20260709 12:14:04.247535 21037 log.cc:927] Time spent T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:14:04.250411 20428 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:04.259965 19820 raft_consensus.cc:2468] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:04.268481 20431 raft_consensus.cc:1240] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:04.232975 19573 catalog_manager.cc:5697] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 2 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.277721 20974 raft_consensus.cc:1081] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:04.298892 19746 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:04.295850 19816 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:04.295303 20926 consensus_queue.cc:1059] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:14:04.311415 19816 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:04.311833 20926 raft_consensus.cc:3055] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:04.312412 20926 raft_consensus.cc:740] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:04.313447 20926 consensus_queue.cc:260] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:04.315270 19789 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:04.316222 20838 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:04.316780 20838 raft_consensus.cc:697] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:04.317833 20838 consensus_queue.cc:237] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:04.316694 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:04.319505 19750 raft_consensus.cc:3055] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:04.319904 19750 raft_consensus.cc:740] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:04.320647 19750 consensus_queue.cc:260] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:04.322093 19750 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.298935 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:04.323792 19675 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.331645 21036 raft_consensus.cc:2955] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:04.302233 19572 catalog_manager.cc:5697] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:04.339255 20428 raft_consensus.cc:2955] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:04.342439 20926 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.369199 19675 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:04.400123 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:04.403421 20397 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:04.405728 20953 raft_consensus.cc:2804] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:04.406704 20953 raft_consensus.cc:697] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:04.411036 19819 raft_consensus.cc:1275] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:04.409754 20953 consensus_queue.cc:237] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:04.416395 19821 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:04.424691 20982 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:04.467917 19667 raft_consensus.cc:1275] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:14:04.476687 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 517471us
I20260709 12:14:04.483635 20953 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:04.489609 20429 raft_consensus.cc:1275] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:04.497007 19557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d86cf843c11e474cb87f4e55acb4505d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:04.499960 19750 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:04.503686 19824 raft_consensus.cc:1275] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.508598 19667 raft_consensus.cc:1275] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:04.525437 19816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56898
I20260709 12:14:04.539011 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:04.540300 19669 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.543998 19572 catalog_manager.cc:5697] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 2 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.545171 19789 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:04.567191 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 59003.7us
I20260709 12:14:04.557796 19573 catalog_manager.cc:5697] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.571168 19669 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:04.568647 21036 raft_consensus.cc:2804] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:04.572307 21036 raft_consensus.cc:697] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:04.555943 19816 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:04.573076 19816 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:04.573395 21036 consensus_queue.cc:237] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:04.580539 19747 raft_consensus.cc:1275] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.591746 21046 raft_consensus.cc:1064] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:14:04.596781 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:04.556340 21041 consensus_queue.cc:1048] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:14:04.600035 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:04.606027 20991 consensus_queue.cc:1048] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:04.610452 19667 raft_consensus.cc:2955] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:04.621680 21046 consensus_queue.cc:237] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:04.614331 21003 raft_consensus.cc:2955] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:04.626528 19675 raft_consensus.cc:2955] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:04.635792 19669 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.628278 21042 consensus_queue.cc:1048] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:04.672302 21042 consensus_queue.cc:1048] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:04.666260 19572 catalog_manager.cc:5697] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 3 to 4, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New cstate: current_term: 1 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:04.694626 19669 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:04.676843 19816 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:04.731761 19559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 26992be39c764bb3bc020dd42bc74a55 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:04.762547 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet d86cf843c11e474cb87f4e55acb4505d with delete_type TABLET_DATA_TOMBSTONED (TS ca42d3c27d2e46348120791d1282b193 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36920
I20260709 12:14:04.766206 19747 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.804955 19569 catalog_manager.cc:5697] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.813318 20429 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 LEARNER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.801273 21036 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:14:04.815711 19820 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.857218 19816 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:04.858527 20933 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:04.859202 20933 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:04.859663 19669 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.862890 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:04.863551 19748 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:04.864694 21050 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:04.882112 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:04.874611 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:04.884932 19669 raft_consensus.cc:3055] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:04.885377 19669 raft_consensus.cc:740] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:04.886397 19669 consensus_queue.cc:260] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:04.886739 20979 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:04.894356 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:04.897076 19748 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:04.877919 20933 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:04.914992 19789 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:04.915973 19675 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.887905 19669 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:04.916981 20430 raft_consensus.cc:2955] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:04.925107 19715 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:04.925725 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:04.924144 19572 catalog_manager.cc:5697] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index 3 to 4, VOTER 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) evicted. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:04.953959 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 72436.9us
I20260709 12:14:04.933404 20926 raft_consensus.cc:2804] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:04.933538 21036 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:14:04.981904 21046 raft_consensus.cc:2749] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:04.983350 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 58333.6us
I20260709 12:14:04.977705 20926 raft_consensus.cc:697] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:04.994359 20926 consensus_queue.cc:237] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:04.999903 19675 raft_consensus.cc:1275] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.943428 21003 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:14:05.009919 21029 consensus_queue.cc:1048] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:14:05.010842 19669 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:05.019357 19816 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:05.010582 21070 tablet_replica.cc:333] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:05.031673 19748 raft_consensus.cc:1275] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:05.032711 20953 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:05.033856 21070 raft_consensus.cc:2243] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.035002 21070 raft_consensus.cc:2272] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.039780 20999 consensus_queue.cc:1048] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:05.064216 21070 ts_tablet_manager.cc:1916] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:05.118577 19744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:05.119577 19744 raft_consensus.cc:606] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:05.123139 19805 tablet_service.cc:1558] Processing DeleteTablet for tablet 26992be39c764bb3bc020dd42bc74a55 with delete_type TABLET_DATA_TOMBSTONED (TS 1f9fb1b1a86c4eb99abdbaf9d239e324 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56882
I20260709 12:14:05.187491 19747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:05.188549 19747 raft_consensus.cc:606] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:05.191727 19666 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:05.197886 21047 raft_consensus.cc:993] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:14:05.198452 21047 raft_consensus.cc:1081] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:14:05.201535 20953 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:05.216208 19569 catalog_manager.cc:5697] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 2 to 3, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 3 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.234681 19819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "798fecda3ed247f4941d585924251970"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:05.236101 19819 raft_consensus.cc:606] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:05.244349 20933 raft_consensus.cc:993] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:05.244827 20979 raft_consensus.cc:1081] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:05.247105 19669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48652
I20260709 12:14:05.247666 19669 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:05.248004 19669 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.261993 19819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56904
I20260709 12:14:05.262643 19819 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:05.263108 19819 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.285188 19747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:05.286012 19747 raft_consensus.cc:606] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:05.299573 19819 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:05.302474 19819 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:05.304231 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 52896.6us
I20260709 12:14:05.335676 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:05.336447 20430 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.352862 19669 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:05.366071 19669 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:05.370108 20430 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:05.361888 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:05.372817 19747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:05.374665 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:05.375350 19744 raft_consensus.cc:3055] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:05.375736 19744 raft_consensus.cc:740] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:05.383038 19747 raft_consensus.cc:606] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:05.388211 19741 raft_consensus.cc:3055] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:05.409322 19744 consensus_queue.cc:260] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:05.408339 19741 raft_consensus.cc:740] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:05.416911 21082 log.cc:927] Time spent T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:14:05.419216 21088 tablet_replica.cc:333] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:14:05.420678 21088 raft_consensus.cc:2243] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.420969 19670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:38020
I20260709 12:14:05.421639 21088 raft_consensus.cc:2272] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.422590 19744 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.421690 19670 raft_consensus.cc:606] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:05.438586 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:14:05.441514 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 92884.1us
I20260709 12:14:05.441753 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:05.445770 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:05.448060 19818 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.458318 19744 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:05.448707 19789 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
W20260709 12:14:05.502351 21083 log.cc:927] Time spent T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:14:05.503815 21088 ts_tablet_manager.cc:1916] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:05.516773 21050 raft_consensus.cc:2955] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:05.527695 19818 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:05.491925 19675 raft_consensus.cc:2955] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:05.538290 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 81625.9us
I20260709 12:14:05.540292 20430 raft_consensus.cc:1240] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:05.535790 19640 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:05.543291 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 94708.4us
I20260709 12:14:05.545364 20926 raft_consensus.cc:2804] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:05.546061 20926 raft_consensus.cc:697] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:05.547127 20926 consensus_queue.cc:237] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:05.584651 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 45341.3us
I20260709 12:14:05.598598 20828 raft_consensus.cc:2804] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:14:05.645033 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 89480.9us
W20260709 12:14:05.590516 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 184062us
I20260709 12:14:05.609381 21070 ts_tablet_manager.cc:1929] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:05.651674 20828 raft_consensus.cc:697] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:05.675012 20828 consensus_queue.cc:237] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:05.680564 20979 consensus_queue.cc:1059] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:14:05.679949 21070 log.cc:1199] T d86cf843c11e474cb87f4e55acb4505d P ca42d3c27d2e46348120791d1282b193: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/wals/d86cf843c11e474cb87f4e55acb4505d
I20260709 12:14:05.755414 19741 consensus_queue.cc:260] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:05.756999 19741 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.767867 20429 raft_consensus.cc:2955] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:05.896327 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 89275.1us
I20260709 12:14:05.956435 19741 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:05.721621 19559 catalog_manager.cc:5028] TS ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): tablet d86cf843c11e474cb87f4e55acb4505d (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
W20260709 12:14:05.959048 19559 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 237443us
W20260709 12:14:05.943380 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 185615us
I20260709 12:14:05.976280 21088 ts_tablet_manager.cc:1929] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:05.648293 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:05.998013 19815 raft_consensus.cc:2955] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:05.976969 21088 log.cc:1199] T 26992be39c764bb3bc020dd42bc74a55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/wals/26992be39c764bb3bc020dd42bc74a55
W20260709 12:14:06.017091 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 469197us
I20260709 12:14:06.023939 21054 raft_consensus.cc:993] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:06.029642 21112 raft_consensus.cc:993] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:06.033722 19573 catalog_manager.cc:5697] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index 2 to 3, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:06.037497 21043 raft_consensus.cc:1081] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:06.040346 19557 catalog_manager.cc:5028] TS 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): tablet 26992be39c764bb3bc020dd42bc74a55 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:14:06.041440 21112 raft_consensus.cc:1081] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:06.059566 19746 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:06.060868 20991 raft_consensus.cc:993] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:06.061621 20991 raft_consensus.cc:1081] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:06.081394 21103 raft_consensus.cc:993] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193: : Instructing follower b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:06.086867 19672 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:06.089337 20872 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:06.090152 21103 raft_consensus.cc:1081] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer b12c250fb1a244ed9a49cf86950af1bf to start an election
I20260709 12:14:06.091894 19816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56904
I20260709 12:14:06.092656 19816 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.097052 20428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee"
dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:60840
I20260709 12:14:06.097189 19816 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.097827 20428 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.098366 20428 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.139925 20428 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:06.193125 19818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56898
I20260709 12:14:06.197592 19818 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.198024 19818 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.217115 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:06.217829 19670 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.212320 19741 raft_consensus.cc:1275] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:06.226759 19670 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:06.229153 20397 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:06.230507 21102 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.230876 20428 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:06.230651 19816 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:06.232793 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:06.233081 19816 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:06.233453 19747 raft_consensus.cc:3055] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.235414 19747 raft_consensus.cc:740] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:06.233646 19820 raft_consensus.cc:1240] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:06.234331 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:06.236635 19672 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.231109 21102 raft_consensus.cc:697] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:06.237438 19821 raft_consensus.cc:1275] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:06.245246 21102 consensus_queue.cc:237] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:06.246539 19818 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:06.247838 19819 raft_consensus.cc:1240] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:06.248657 19818 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:06.249127 21003 consensus_queue.cc:1059] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:06.268494 21123 log.cc:927] Time spent T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 12:14:06.271073 19672 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:06.250639 19747 consensus_queue.cc:260] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:06.270300 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:06.272359 19670 raft_consensus.cc:3055] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.272770 19670 raft_consensus.cc:740] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:06.273751 19670 consensus_queue.cc:260] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:06.275166 19670 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.278023 20872 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:06.281028 20430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "798fecda3ed247f4941d585924251970"
dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:60828
I20260709 12:14:06.281579 20430 raft_consensus.cc:493] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.281921 20430 raft_consensus.cc:3060] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.272384 19747 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.282392 19570 catalog_manager.cc:5697] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.285856 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:06.286478 20429 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.289929 20430 raft_consensus.cc:515] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:06.291275 20428 raft_consensus.cc:1240] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:06.293242 20991 raft_consensus.cc:3055] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.293793 20991 raft_consensus.cc:740] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:06.299289 20991 consensus_queue.cc:260] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:06.300930 20991 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.302932 20429 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:06.311760 20428 raft_consensus.cc:1275] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:06.313539 21077 consensus_queue.cc:1048] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:06.316272 21096 consensus_queue.cc:1059] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:06.317144 19748 consensus_queue.cc:237] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:06.318282 19789 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:06.320111 21096 raft_consensus.cc:2804] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.320238 19746 raft_consensus.cc:1275] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:06.320830 21096 raft_consensus.cc:697] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:06.322384 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:06.321875 21096 consensus_queue.cc:237] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:06.326673 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:06.327360 20430 leader_election.cc:290] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:06.327382 19672 raft_consensus.cc:3060] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.317584 21112 raft_consensus.cc:3055] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.331563 21112 raft_consensus.cc:740] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:06.334321 19788 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:06.337550 19670 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:06.338369 19672 raft_consensus.cc:2468] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:06.349018 20397 leader_election.cc:304] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:06.350203 21101 raft_consensus.cc:2804] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.350876 21101 raft_consensus.cc:697] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:06.346993 19819 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:06.351209 20428 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:06.353751 20872 raft_consensus.cc:2804] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.354435 20872 raft_consensus.cc:697] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:06.356395 19747 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:06.359393 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:06.351990 21101 consensus_queue.cc:237] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:06.383273 20872 consensus_queue.cc:237] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:06.332594 21112 consensus_queue.cc:260] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:06.403307 21112 raft_consensus.cc:3060] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.409109 19672 raft_consensus.cc:1240] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:06.382597 21036 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:14:06.387610 21110 consensus_queue.cc:1048] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:14:06.386132 21104 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:14:06.472191 20933 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:06.460597 21111 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
W20260709 12:14:06.531759 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 112245us
I20260709 12:14:06.584232 21003 raft_consensus.cc:2955] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:06.607056 19819 raft_consensus.cc:2468] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:06.618407 19572 catalog_manager.cc:5697] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.634641 19569 catalog_manager.cc:5697] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 2 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:06.646451 19569 catalog_manager.cc:5697] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 2 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:06.697188 19559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c9123f5829474284995dd8a5c8139d82 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:06.729604 19746 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:06.731289 21101 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:06.748118 19670 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:06.751379 21101 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:06.778988 19670 raft_consensus.cc:1275] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:06.784547 19818 raft_consensus.cc:1275] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:06.787973 21095 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:06.790930 21101 consensus_queue.cc:1048] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:06.809044 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 127105us
I20260709 12:14:06.657828 19741 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:06.668207 20428 raft_consensus.cc:2955] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:06.673051 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 257577us
I20260709 12:14:06.676498 19820 raft_consensus.cc:2955] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:06.983505 20428 raft_consensus.cc:1275] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:06.987650 21140 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:07.026471 19672 raft_consensus.cc:1275] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:07.033552 21102 consensus_queue.cc:1048] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:07.061610 19572 catalog_manager.cc:5697] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:07.088956 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 136570us
I20260709 12:14:07.094357 19672 raft_consensus.cc:1275] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.096207 19745 raft_consensus.cc:1275] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:07.081020 21145 log.cc:927] Time spent T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 12:14:07.215935 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 98564.7us
W20260709 12:14:07.238142 21141 log.cc:927] Time spent T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 12:14:07.233687 21095 consensus_queue.cc:1048] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 12:14:07.304646 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 187685us
I20260709 12:14:07.337831 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:07.364583 21096 consensus_queue.cc:1048] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:14:07.520439 21168 log.cc:927] Time spent T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:14:07.593998 19573 catalog_manager.cc:5697] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 3 to 4, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:07.596240 19573 catalog_manager.cc:5697] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:07.638618 21042 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:07.639575 21042 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:07.643577 21042 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:07.643998 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:07.645622 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:07.652639 19640 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:07.653846 21042 raft_consensus.cc:2749] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:07.654049 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:07.699479 19657 tablet_service.cc:1558] Processing DeleteTablet for tablet c9123f5829474284995dd8a5c8139d82 with delete_type TABLET_DATA_TOMBSTONED (TS f662c4f7d6a74013a1e58a5330a049b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48638
I20260709 12:14:07.711091 21176 tablet_replica.cc:333] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:07.712327 21176 raft_consensus.cc:2243] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:07.713231 21176 raft_consensus.cc:2272] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:07.716382 21176 ts_tablet_manager.cc:1916] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:07.719436 19822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:07.720077 19822 raft_consensus.cc:606] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:07.723393 19742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5281957321c64f93988644f4841fbe35"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:07.724222 19742 raft_consensus.cc:606] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:07.727854 19668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f69387176614121ab470bb58987f450"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
mode: GRACEFUL
new_leader_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:38020
I20260709 12:14:07.728457 19668 raft_consensus.cc:606] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Received request to transfer leadership to TS ca42d3c27d2e46348120791d1282b193
I20260709 12:14:07.731940 19822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:07.732810 19822 raft_consensus.cc:606] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS ca42d3c27d2e46348120791d1282b193
I20260709 12:14:07.734364 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:14:07.751113 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:07.752182 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:07.767652 21176 ts_tablet_manager.cc:1929] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:07.768216 21176 log.cc:1199] T c9123f5829474284995dd8a5c8139d82 P f662c4f7d6a74013a1e58a5330a049b8: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/wals/c9123f5829474284995dd8a5c8139d82
I20260709 12:14:07.772171 19558 catalog_manager.cc:5028] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): tablet c9123f5829474284995dd8a5c8139d82 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:14:07.793385 21167 raft_consensus.cc:993] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:14:07.794185 21156 raft_consensus.cc:1081] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:14:07.797569 19668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48662
I20260709 12:14:07.798175 19668 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:07.798553 19668 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.798763 20977 raft_consensus.cc:993] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8: : Instructing follower ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:07.799335 21054 raft_consensus.cc:1081] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Signalling peer ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:07.801069 19746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f69387176614121ab470bb58987f450"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:36924
I20260709 12:14:07.801609 19746 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:07.801946 19746 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:07.813388 19746 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:07.815582 19746 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:07.817063 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:07.817842 19822 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:07.822654 19668 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:07.822880 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:07.823769 19675 raft_consensus.cc:3055] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:07.824178 19675 raft_consensus.cc:740] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:07.824723 19668 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:07.827365 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:07.828027 19742 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.833573 19675 consensus_queue.cc:260] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:07.838152 19742 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:07.835121 19675 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:07.839800 19640 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:07.840082 21166 raft_consensus.cc:993] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:07.840773 20977 raft_consensus.cc:2804] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:07.840770 21166 raft_consensus.cc:1081] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:07.841395 20977 raft_consensus.cc:697] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:07.842514 20977 consensus_queue.cc:237] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:07.846695 19815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5281957321c64f93988644f4841fbe35"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56904
I20260709 12:14:07.847447 19815 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:07.847815 19815 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.852049 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:07.854683 19816 raft_consensus.cc:3055] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:07.856262 19816 raft_consensus.cc:740] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:07.858736 19816 consensus_queue.cc:260] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:07.870741 19816 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.885878 19822 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:07.878621 19815 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:07.888118 19675 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:07.888780 19815 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:07.890133 19713 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:07.891180 21166 raft_consensus.cc:2804] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:07.891796 21166 raft_consensus.cc:697] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:07.892900 21166 consensus_queue.cc:237] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:07.895406 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:07.896085 19746 raft_consensus.cc:3055] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:07.896384 19746 raft_consensus.cc:740] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:07.897112 19746 consensus_queue.cc:260] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:07.898173 19746 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.902664 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:07.903483 19668 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.908427 19746 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:07.910207 19789 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:07.911684 21044 raft_consensus.cc:2804] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:07.913467 21044 raft_consensus.cc:697] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:07.911758 19816 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:07.914711 21044 consensus_queue.cc:237] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:07.917836 19668 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:07.925030 19573 catalog_manager.cc:5697] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.944509 19572 catalog_manager.cc:5697] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 2 to 3, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.991278 21156 raft_consensus.cc:993] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:07.991832 21156 raft_consensus.cc:1081] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:07.993602 19746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:36936
I20260709 12:14:07.994256 19746 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:07.994692 19746 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:08.003230 19572 catalog_manager.cc:5697] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.002398 19746 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:08.020118 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:08.020633 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:08.020887 19668 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:08.021347 19815 raft_consensus.cc:3055] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:08.021704 19815 raft_consensus.cc:740] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:08.022473 19815 consensus_queue.cc:260] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:08.023553 19815 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:08.034688 19668 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:08.039220 19714 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:08.040302 20991 raft_consensus.cc:2804] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:08.040894 20991 raft_consensus.cc:697] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:08.042526 20991 consensus_queue.cc:237] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:08.057181 19746 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:08.074025 19815 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:08.094389 19572 catalog_manager.cc:5697] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:08.283130 19815 raft_consensus.cc:1275] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:08.284763 21166 consensus_queue.cc:1048] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:08.296964 19668 raft_consensus.cc:1275] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:08.298877 21166 consensus_queue.cc:1048] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:08.377143 19672 raft_consensus.cc:1275] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:08.379351 21044 consensus_queue.cc:1048] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:08.407584 19742 raft_consensus.cc:1275] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:08.409317 21156 consensus_queue.cc:1048] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:08.413316 19746 raft_consensus.cc:1275] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:08.422811 21042 consensus_queue.cc:1048] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:08.436728 19815 raft_consensus.cc:1275] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:08.439109 21166 consensus_queue.cc:1048] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:08.457464 19822 raft_consensus.cc:1275] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:08.460354 21042 consensus_queue.cc:1048] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:08.509287 19668 raft_consensus.cc:1275] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:08.523051 21166 consensus_queue.cc:1048] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:08.763399 19746 consensus_queue.cc:237] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
W20260709 12:14:08.772703 19715 consensus_peers.cc:597] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 613b9bd906514e3684eb97813eda93a5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:08.774272 19822 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:08.775887 21166 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:08.776546 19675 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:08.778748 21166 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:08.788038 20991 raft_consensus.cc:2955] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:14:08.792695 19822 raft_consensus.cc:2955] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:14:08.821893 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:08.821642 19815 consensus_queue.cc:237] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:08.836357 19573 catalog_manager.cc:5697] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 1 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:08.829619 19675 raft_consensus.cc:2955] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
W20260709 12:14:08.889532 19789 consensus_peers.cc:597] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62ed1b9937fd41ab83a0000603a38fc9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:08.892741 19746 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:08.892943 19675 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:08.895380 21156 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:08.899544 21156 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:08.908636 19672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:38020
I20260709 12:14:08.909462 19672 raft_consensus.cc:606] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:08.924088 19816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5281957321c64f93988644f4841fbe35"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:08.924786 19816 raft_consensus.cc:606] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:08.933732 19742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:08.934592 19742 raft_consensus.cc:606] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:08.941285 19815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:08.940393 21096 raft_consensus.cc:2955] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:14:08.942015 19815 raft_consensus.cc:606] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Received request to transfer leadership to TS ca42d3c27d2e46348120791d1282b193
I20260709 12:14:08.947908 19672 raft_consensus.cc:2955] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:14:08.953102 19815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:08.953713 19815 raft_consensus.cc:606] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:08.956355 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:08.958598 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:08.965540 19742 raft_consensus.cc:2955] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
W20260709 12:14:09.031919 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 63179.2us
I20260709 12:14:09.042132 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:09.065979 19569 catalog_manager.cc:5697] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index -1 to 3, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:14:09.074740 19815 consensus_queue.cc:237] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:09.088812 19742 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:14:09.090392 19789 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a61494383461482b9ddf0e4f6ceb4323. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:09.091202 21167 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:09.102229 21207 raft_consensus.cc:993] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:14:09.102882 21096 raft_consensus.cc:1081] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:14:09.114751 19675 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:09.123027 19672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48662
I20260709 12:14:09.123778 19672 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.124122 19672 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.145279 19672 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:09.149760 19672 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:09.150818 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:09.151047 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:09.151487 19746 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.151697 19815 raft_consensus.cc:3055] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:09.152169 19815 raft_consensus.cc:740] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:09.152995 19815 consensus_queue.cc:260] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:09.154109 19815 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.149593 21207 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:14:09.167212 19746 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:09.168653 19640 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:09.169718 21194 raft_consensus.cc:2804] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:09.170315 21194 raft_consensus.cc:697] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:09.171288 21194 consensus_queue.cc:237] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:09.174765 19815 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:09.170595 21213 ts_tablet_manager.cc:933] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:09.179692 21096 raft_consensus.cc:993] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:09.180266 21096 raft_consensus.cc:1081] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Signalling peer ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:09.178462 21156 raft_consensus.cc:2955] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:14:09.184001 19746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:36936
I20260709 12:14:09.184657 19746 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.186654 19746 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.189029 20991 raft_consensus.cc:993] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:09.189816 21106 raft_consensus.cc:1081] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:09.193534 19822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56904
I20260709 12:14:09.194339 19822 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.194890 19822 raft_consensus.cc:3060] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.195923 19749 raft_consensus.cc:2955] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:14:09.198640 19746 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:09.201452 19746 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:09.201737 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:09.202450 19672 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.205839 19822 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:09.208433 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:09.209148 19815 raft_consensus.cc:3055] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:09.209447 19815 raft_consensus.cc:740] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:09.210186 19815 consensus_queue.cc:260] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:09.211382 19815 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.211069 19668 consensus_queue.cc:237] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:09.211125 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:09.214130 19670 raft_consensus.cc:3060] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.221226 19822 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:09.223266 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:09.223882 19746 raft_consensus.cc:3055] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:09.224166 19746 raft_consensus.cc:740] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:09.224855 19746 consensus_queue.cc:260] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:09.225967 19746 raft_consensus.cc:3060] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.228891 19672 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:09.231143 19714 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:09.232306 21106 raft_consensus.cc:2804] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:09.232865 21106 raft_consensus.cc:697] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:09.233413 19815 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:09.233758 21106 consensus_queue.cc:237] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:09.244539 19670 raft_consensus.cc:2468] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:09.246097 19788 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:09.248811 19746 raft_consensus.cc:2468] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:09.250046 21167 raft_consensus.cc:2804] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:09.250681 21167 raft_consensus.cc:697] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:09.251786 21167 consensus_queue.cc:237] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:09.263980 19569 catalog_manager.cc:5697] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index -1 to 4, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 3 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.267545 21213 tablet_copy_client.cc:323] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.194:46489
I20260709 12:14:09.281893 19572 catalog_manager.cc:5697] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 2 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.300539 21196 raft_consensus.cc:993] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:09.301214 21208 raft_consensus.cc:1081] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:09.304163 19822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56898
I20260709 12:14:09.304849 19822 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.305218 19822 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.324095 19569 catalog_manager.cc:5697] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 2 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.331578 19822 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:09.335062 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:09.335695 20428 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.339520 19822 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:09.345338 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:09.346163 19668 raft_consensus.cc:3055] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:09.346535 19668 raft_consensus.cc:740] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:09.350734 19668 consensus_queue.cc:260] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:09.353821 19668 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.362598 19760 tablet_copy_service.cc:140] P ca42d3c27d2e46348120791d1282b193: Received BeginTabletCopySession request for tablet 613b9bd906514e3684eb97813eda93a5 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:40172)
I20260709 12:14:09.363242 19760 tablet_copy_service.cc:161] P ca42d3c27d2e46348120791d1282b193: Beginning new tablet copy session on tablet 613b9bd906514e3684eb97813eda93a5 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:40172: session id = b12c250fb1a244ed9a49cf86950af1bf-613b9bd906514e3684eb97813eda93a5
I20260709 12:14:09.366705 19668 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:09.368602 20428 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:09.369920 19789 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:09.374763 19675 raft_consensus.cc:2955] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:14:09.382205 19815 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:09.391001 21194 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:09.371942 19572 catalog_manager.cc:5697] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.404243 21167 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:09.405236 21167 raft_consensus.cc:697] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:09.412118 21167 consensus_queue.cc:237] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:09.413651 19760 tablet_copy_source_session.cc:215] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:14:09.436000 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 85023.4us
I20260709 12:14:09.444525 21213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613b9bd906514e3684eb97813eda93a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.463541 21212 raft_consensus.cc:993] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
W20260709 12:14:09.465029 19640 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f633905374c40ef9d178aa3de255d6f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:09.465049 21211 raft_consensus.cc:1081] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:14:09.476796 19749 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:09.481163 21196 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:09.482949 19670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5281957321c64f93988644f4841fbe35"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48662
I20260709 12:14:09.483632 19670 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.483983 19670 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.495175 21213 tablet_copy_client.cc:806] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:09.495913 21213 tablet_copy_client.cc:670] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:09.496098 19670 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:09.502876 21213 tablet_copy_client.cc:538] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:09.516155 19670 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:09.516247 21225 ts_tablet_manager.cc:933] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:09.519129 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:09.519793 19749 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.523504 21196 raft_consensus.cc:2955] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:14:09.526986 19749 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:09.540902 19749 raft_consensus.cc:1240] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:09.542245 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:09.544199 19640 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:09.543252 19815 raft_consensus.cc:3055] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:09.545620 19815 raft_consensus.cc:740] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:09.547196 19815 consensus_queue.cc:260] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:09.548556 19815 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.551450 21192 raft_consensus.cc:2804] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:09.558532 21192 raft_consensus.cc:697] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:09.559470 21192 consensus_queue.cc:237] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:09.564287 19572 catalog_manager.cc:5697] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.579309 21213 tablet_bootstrap.cc:492] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:14:09.579209 19749 raft_consensus.cc:1275] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:09.581333 21222 consensus_queue.cc:1048] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:09.587651 21225 tablet_copy_client.cc:323] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.195:42991
I20260709 12:14:09.589972 19833 tablet_copy_service.cc:140] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Received BeginTabletCopySession request for tablet 62ed1b9937fd41ab83a0000603a38fc9 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:60644)
I20260709 12:14:09.590612 19833 tablet_copy_service.cc:161] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Beginning new tablet copy session on tablet 62ed1b9937fd41ab83a0000603a38fc9 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:60644: session id = b12c250fb1a244ed9a49cf86950af1bf-62ed1b9937fd41ab83a0000603a38fc9
I20260709 12:14:09.611106 19833 tablet_copy_source_session.cc:215] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:09.615581 19815 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:09.624197 21225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62ed1b9937fd41ab83a0000603a38fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.626727 19746 raft_consensus.cc:2955] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:14:09.652727 19569 catalog_manager.cc:5697] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 2 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.653470 19815 raft_consensus.cc:2955] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } } }
I20260709 12:14:09.654825 19569 catalog_manager.cc:5697] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index -1 to 3, NON_VOTER b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) added. New cstate: current_term: 3 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.682264 19675 raft_consensus.cc:1275] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:09.688355 21166 consensus_queue.cc:1048] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:14:09.711125 19822 raft_consensus.cc:1275] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:14:09.721760 19789 consensus_peers.cc:597] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Couldn't send request to peer b12c250fb1a244ed9a49cf86950af1bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:09.743888 21222 consensus_queue.cc:1048] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:14:09.753829 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 50842.9us
I20260709 12:14:09.747166 21225 tablet_copy_client.cc:806] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:09.765412 21225 tablet_copy_client.cc:670] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:09.766197 21238 ts_tablet_manager.cc:933] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:09.789057 19815 raft_consensus.cc:1275] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:09.791864 21166 consensus_queue.cc:1048] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:09.821918 20428 raft_consensus.cc:1275] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:09.830899 21238 tablet_copy_client.cc:323] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.195:42991
I20260709 12:14:09.832602 21211 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:09.835080 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 53477.2us
I20260709 12:14:09.839458 19834 tablet_copy_service.cc:140] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Received BeginTabletCopySession request for tablet a61494383461482b9ddf0e4f6ceb4323 from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:60644)
I20260709 12:14:09.840190 19834 tablet_copy_service.cc:161] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Beginning new tablet copy session on tablet a61494383461482b9ddf0e4f6ceb4323 from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:60644: session id = b12c250fb1a244ed9a49cf86950af1bf-a61494383461482b9ddf0e4f6ceb4323
I20260709 12:14:09.841207 21225 tablet_copy_client.cc:538] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:09.856601 19834 tablet_copy_source_session.cc:215] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:09.865852 21213 tablet_bootstrap.cc:492] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:09.870992 21213 tablet_bootstrap.cc:492] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:14:09.871953 21213 ts_tablet_manager.cc:1403] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.293s	user 0.016s	sys 0.019s
I20260709 12:14:09.874478 21238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a61494383461482b9ddf0e4f6ceb4323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.875626 21213 raft_consensus.cc:359] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:09.876739 21213 raft_consensus.cc:740] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:14:09.877497 21213 consensus_queue.cc:260] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:09.880155 21213 ts_tablet_manager.cc:1434] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:14:09.880648 21243 ts_tablet_manager.cc:933] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: Initiating tablet copy from peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713)
I20260709 12:14:09.888293 19672 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:09.889941 19760 tablet_copy_service.cc:342] P ca42d3c27d2e46348120791d1282b193: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-613b9bd906514e3684eb97813eda93a5 received from {username='slave'} at 127.0.0.1:40172
I20260709 12:14:09.890483 19760 tablet_copy_service.cc:434] P ca42d3c27d2e46348120791d1282b193: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-613b9bd906514e3684eb97813eda93a5 on tablet 613b9bd906514e3684eb97813eda93a5 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:09.897593 21212 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:09.901510 19746 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:09.906998 21167 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:09.908840 21225 tablet_bootstrap.cc:492] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:14:09.972376 19670 raft_consensus.cc:1275] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:09.984558 21096 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:10.040541 21243 tablet_copy_client.cc:323] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Beginning tablet copy session from remote peer at address 127.17.249.193:36713
I20260709 12:14:10.043661 19685 tablet_copy_service.cc:140] P f662c4f7d6a74013a1e58a5330a049b8: Received BeginTabletCopySession request for tablet 9f633905374c40ef9d178aa3de255d6f from peer b12c250fb1a244ed9a49cf86950af1bf ({username='slave'} at 127.0.0.1:54544)
I20260709 12:14:10.044317 19685 tablet_copy_service.cc:161] P f662c4f7d6a74013a1e58a5330a049b8: Beginning new tablet copy session on tablet 9f633905374c40ef9d178aa3de255d6f from peer b12c250fb1a244ed9a49cf86950af1bf at {username='slave'} at 127.0.0.1:54544: session id = b12c250fb1a244ed9a49cf86950af1bf-9f633905374c40ef9d178aa3de255d6f
I20260709 12:14:10.050010 19749 raft_consensus.cc:1275] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:10.051964 21222 consensus_queue.cc:1048] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.054096 19685 tablet_copy_source_session.cc:215] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:10.061374 21243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f633905374c40ef9d178aa3de255d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.078197 21225 tablet_bootstrap.cc:492] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:10.079332 21225 tablet_bootstrap.cc:492] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:14:10.080071 21225 ts_tablet_manager.cc:1403] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.171s	user 0.036s	sys 0.011s
I20260709 12:14:10.083174 21225 raft_consensus.cc:359] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:10.084033 21225 raft_consensus.cc:740] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:14:10.084738 21225 consensus_queue.cc:260] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:10.098276 21225 ts_tablet_manager.cc:1434] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:14:10.101684 19815 raft_consensus.cc:1275] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:10.112404 21238 tablet_copy_client.cc:806] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:10.113255 21238 tablet_copy_client.cc:670] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:10.114079 21243 tablet_copy_client.cc:806] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:10.114706 21243 tablet_copy_client.cc:670] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:10.127255 19833 tablet_copy_service.cc:342] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-62ed1b9937fd41ab83a0000603a38fc9 received from {username='slave'} at 127.0.0.1:60644
I20260709 12:14:10.127815 19833 tablet_copy_service.cc:434] P 1f9fb1b1a86c4eb99abdbaf9d239e324: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-62ed1b9937fd41ab83a0000603a38fc9 on tablet 62ed1b9937fd41ab83a0000603a38fc9 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:10.128180 21238 tablet_copy_client.cc:538] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:10.133725 21243 tablet_copy_client.cc:538] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:10.157512 21222 consensus_queue.cc:1048] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:10.170037 21243 tablet_bootstrap.cc:492] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
I20260709 12:14:10.179386 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:10.181147 21238 tablet_bootstrap.cc:492] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap starting.
W20260709 12:14:10.292431 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 51077.6us
I20260709 12:14:10.353010 21238 tablet_bootstrap.cc:492] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:10.354161 21238 tablet_bootstrap.cc:492] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:14:10.354956 21238 ts_tablet_manager.cc:1403] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.177s	user 0.064s	sys 0.051s
I20260709 12:14:10.358423 19746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:10.359118 19746 raft_consensus.cc:606] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:10.359644 21243 tablet_bootstrap.cc:492] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:10.360651 21243 tablet_bootstrap.cc:492] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: Bootstrap complete.
I20260709 12:14:10.361402 21243 ts_tablet_manager.cc:1403] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: Time spent bootstrapping tablet: real 0.192s	user 0.028s	sys 0.015s
I20260709 12:14:10.382140 21243 raft_consensus.cc:359] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:10.383234 21243 raft_consensus.cc:740] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:14:10.384121 21243 consensus_queue.cc:260] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:10.386327 21243 ts_tablet_manager.cc:1434] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:14:10.358335 21238 raft_consensus.cc:359] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:10.387766 21238 raft_consensus.cc:740] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Initialized, Role: LEARNER
I20260709 12:14:10.388602 21238 consensus_queue.cc:260] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: NON_VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: true } }
I20260709 12:14:10.391532 21238 ts_tablet_manager.cc:1434] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.002s
I20260709 12:14:10.395391 19833 tablet_copy_service.cc:342] P 1f9fb1b1a86c4eb99abdbaf9d239e324: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-a61494383461482b9ddf0e4f6ceb4323 received from {username='slave'} at 127.0.0.1:60644
I20260709 12:14:10.395925 19833 tablet_copy_service.cc:434] P 1f9fb1b1a86c4eb99abdbaf9d239e324: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-a61494383461482b9ddf0e4f6ceb4323 on tablet a61494383461482b9ddf0e4f6ceb4323 with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:10.396587 19685 tablet_copy_service.cc:342] P f662c4f7d6a74013a1e58a5330a049b8: Request end of tablet copy session b12c250fb1a244ed9a49cf86950af1bf-9f633905374c40ef9d178aa3de255d6f received from {username='slave'} at 127.0.0.1:54544
I20260709 12:14:10.397130 19685 tablet_copy_service.cc:434] P f662c4f7d6a74013a1e58a5330a049b8: ending tablet copy session b12c250fb1a244ed9a49cf86950af1bf-9f633905374c40ef9d178aa3de255d6f on tablet 9f633905374c40ef9d178aa3de255d6f with peer b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:10.436744 20428 raft_consensus.cc:1217] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:14:10.437115 19815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "186a44ea95974c119996690984996f55"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:10.437812 19815 raft_consensus.cc:606] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:10.493090 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 91737.7us
I20260709 12:14:10.628180 19815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:10.629884 19815 raft_consensus.cc:606] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Received request to transfer leadership to TS ca42d3c27d2e46348120791d1282b193
I20260709 12:14:10.677795 19675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
mode: GRACEFUL
new_leader_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:38020
I20260709 12:14:10.688792 19675 raft_consensus.cc:606] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Received request to transfer leadership to TS ca42d3c27d2e46348120791d1282b193
I20260709 12:14:10.697278 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:14:10.740990 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:14:10.742674 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 83413.2us
W20260709 12:14:10.744294 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 58254.7us
I20260709 12:14:10.784359 20429 raft_consensus.cc:1217] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:14:10.815708 21253 raft_consensus.cc:993] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:14:10.816412 21253 raft_consensus.cc:1081] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer f662c4f7d6a74013a1e58a5330a049b8 to start an election
I20260709 12:14:10.823736 21167 raft_consensus.cc:993] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324: : Instructing follower ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:10.824378 21167 raft_consensus.cc:1081] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Signalling peer ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:10.828606 20429 raft_consensus.cc:1217] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:14:10.842563 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:10.862171 19746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:36936
I20260709 12:14:10.863631 19746 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.864318 19746 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.901507 21259 raft_consensus.cc:993] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:10.910554 19746 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:10.916949 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:10.917814 19670 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.927597 21258 raft_consensus.cc:1081] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:10.933799 19668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "186a44ea95974c119996690984996f55"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
 from {username='slave'} at 127.0.0.1:48662
I20260709 12:14:10.934755 19668 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.935696 19668 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.941977 19746 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:10.969897 21234 raft_consensus.cc:993] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8: : Instructing follower ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:10.970574 21234 raft_consensus.cc:1081] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Signalling peer ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:10.983388 19820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56904
I20260709 12:14:10.984258 19820 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.984688 19820 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.989240 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:10.990060 19815 raft_consensus.cc:3055] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:10.990374 19815 raft_consensus.cc:740] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:10.991880 19815 consensus_queue.cc:260] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:10.997849 19815 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.003444 19668 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:11.017338 19815 raft_consensus.cc:2468] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:11.018384 19670 raft_consensus.cc:2468] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:11.029371 19668 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:11.044013 19746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:36924
I20260709 12:14:11.077517 19675 raft_consensus.cc:1240] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:11.077987 19746 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.047175 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:11.078428 19746 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:11.078725 19822 raft_consensus.cc:3055] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.079077 19822 raft_consensus.cc:740] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:11.079981 19822 consensus_queue.cc:260] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:11.081233 19822 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.082965 19713 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:11.084398 21166 raft_consensus.cc:2804] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.084934 21166 raft_consensus.cc:697] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:11.085964 21166 consensus_queue.cc:237] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:11.049986 19820 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:11.059697 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:11.091207 19749 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.092568 19820 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:11.096484 19746 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:11.097222 19822 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:11.103343 19638 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:11.103699 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:11.104318 19748 raft_consensus.cc:3055] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.104585 19748 raft_consensus.cc:740] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:11.105329 19748 consensus_queue.cc:260] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:11.106568 19748 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.108727 21211 raft_consensus.cc:1064] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:14:11.112138 21211 consensus_queue.cc:237] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:11.113353 19749 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:11.114655 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:11.118938 21212 raft_consensus.cc:1064] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:14:11.120559 21253 raft_consensus.cc:1064] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:14:11.121325 19748 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:11.123157 20429 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.132275 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:11.132898 19675 raft_consensus.cc:3055] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:11.133175 19675 raft_consensus.cc:740] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:11.133955 19675 consensus_queue.cc:260] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:11.126032 19746 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:11.127408 21212 consensus_queue.cc:237] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:11.137275 20429 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:11.140664 21253 consensus_queue.cc:237] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:11.143445 21233 raft_consensus.cc:2804] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.144107 21233 raft_consensus.cc:697] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:11.145041 21233 consensus_queue.cc:237] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:11.150930 19573 catalog_manager.cc:5697] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.156107 19675 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:11.162937 19789 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:11.164106 21236 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.164768 21236 raft_consensus.cc:697] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:11.165730 21236 consensus_queue.cc:237] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:11.178025 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:11.179127 19822 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:11.184630 19675 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:11.196938 19822 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:11.232816 19714 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:11.234169 21166 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:11.234756 21166 raft_consensus.cc:697] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:11.236985 21166 consensus_queue.cc:237] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:11.270059 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 93832.6us
I20260709 12:14:11.277084 20429 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEARNER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:14:11.283350 20429 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEARNER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:14:11.284345 20430 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEARNER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:11.301930 21279 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:11.301950 19570 catalog_manager.cc:5697] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.312274 19666 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:11.307801 19572 catalog_manager.cc:5697] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.319792 21253 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:11.339151 19675 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:14:11.349056 21279 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:14:11.390506 19670 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:14:11.395141 21211 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:14:11.391820 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 95103.4us
I20260709 12:14:11.401176 21279 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:11.404012 21167 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:11.410378 19748 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:11.410378 19746 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:14:11.411965 19749 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:14:11.451484 21279 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:11.452096 21253 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:11.454308 21279 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:14:11.459679 21262 raft_consensus.cc:1064] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8: attempting to promote NON_VOTER b12c250fb1a244ed9a49cf86950af1bf to VOTER
I20260709 12:14:11.464349 21262 consensus_queue.cc:237] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:11.478425 21211 raft_consensus.cc:2955] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.483940 19675 raft_consensus.cc:2955] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.500533 19815 raft_consensus.cc:1275] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.511168 21286 raft_consensus.cc:2955] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.512893 19572 catalog_manager.cc:5697] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 3 to 4, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 4 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.515753 21269 consensus_queue.cc:1048] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:11.504819 20430 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEARNER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:11.507372 19745 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:11.530746 21196 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:11.536674 19822 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:11.552451 21228 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:11.556421 21263 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:11.557358 19666 raft_consensus.cc:2955] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.556404 20430 raft_consensus.cc:2955] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.598536 19573 catalog_manager.cc:5697] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 4 to 5, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.609341 19745 raft_consensus.cc:2955] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.611462 21286 raft_consensus.cc:2955] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.618161 20429 raft_consensus.cc:2955] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.628804 19749 raft_consensus.cc:2955] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.635655 19666 raft_consensus.cc:1275] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.653409 20430 raft_consensus.cc:2955] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.661149 19675 raft_consensus.cc:1275] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:11.663622 19749 raft_consensus.cc:2955] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.665280 19744 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:11.657219 21165 consensus_queue.cc:1048] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 12:14:11.683506 21298 log.cc:927] Time spent T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:14:11.687706 19822 raft_consensus.cc:1275] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:11.687139 19572 catalog_manager.cc:5697] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 3 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.686632 19815 consensus_queue.cc:237] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:11.689064 19570 catalog_manager.cc:5697] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: config changed from index 2 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.691192 21258 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:14:11.692178 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 74740.7us
I20260709 12:14:11.702199 21165 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:11.711339 19749 raft_consensus.cc:1275] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.714295 21096 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:11.725060 19675 raft_consensus.cc:2955] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.748402 21262 raft_consensus.cc:2955] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:11.764567 20429 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:11.770853 19819 raft_consensus.cc:1275] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:11.809626 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 46160.7us
I20260709 12:14:11.866797 21275 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:14:11.813027 21261 consensus_queue.cc:1048] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:14:11.890100 20429 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:11.877974 21228 consensus_queue.cc:1048] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 12:14:11.903218 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 75154.6us
W20260709 12:14:11.911135 21303 log.cc:927] Time spent T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.121s	user 0.002s	sys 0.000s
I20260709 12:14:11.956825 21211 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 12:14:12.360140 19641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.015s
W20260709 12:14:12.360558 19641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.000s	sys 0.016s
I20260709 12:14:12.395991 19816 consensus_queue.cc:237] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:12.413429 20429 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:12.415999 21281 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:12.434684 19666 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:12.437008 21281 raft_consensus.cc:2955] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:12.451164 20429 raft_consensus.cc:2955] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:12.453981 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 501384us
I20260709 12:14:12.468830 21211 raft_consensus.cc:2955] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:12.484406 19557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 613b9bd906514e3684eb97813eda93a5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:12.487334 19557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a61494383461482b9ddf0e4f6ceb4323 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:12.509181 20429 raft_consensus.cc:2955] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:12.544057 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.577446 19742 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:14:12.604477 19640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.012s	sys 0.011s
W20260709 12:14:12.604892 19640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.012s	sys 0.011s
I20260709 12:14:12.615252 20430 raft_consensus.cc:2955] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:12.632575 19746 raft_consensus.cc:2955] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:12.824466 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:12.968889 21321 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:12.969890 21321 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.019757 21323 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:13.021050 21323 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:13.024802 21323 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:13.090330 21316 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:13.091148 21316 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:13.141763 21313 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:13.142732 21313 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.146271 21313 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.094491 21316 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:13.156898 21316 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:13.308202 21313 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:13.435264 21313 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.438297 21313 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.322865 21321 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.450368 21316 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.453315 21316 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.618144 21233 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:13.623049 21233 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:13.619889 19640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.000s	sys 0.010s
I20260709 12:14:13.618494 21316 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:13.625625 19640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.000s	sys 0.010s
I20260709 12:14:13.626060 21316 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.629633 21316 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.634075 21316 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:13.635285 21316 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.639369 21316 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.632690 21233 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.640617 21233 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:13.641542 21233 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:13.644650 21233 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:13.645972 21316 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:13.647364 21316 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.652765 21316 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.654217 21316 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:13.656561 21316 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.662591 21316 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.666478 21233 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:13.668305 21233 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.672909 21234 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:13.673635 21234 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:13.675796 21233 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.676481 21233 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:13.677106 21233 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.679644 21233 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.681504 21234 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:13.681579 19819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 1814) took 1020 ms. Trace:
I20260709 12:14:13.686196 19819 rpcz_store.cc:276] 0709 12:14:12.661026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.680602 (+1019576us) service_pool.cc:224] Handling call
0709 12:14:13.681010 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.681213 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.681242 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.681288 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:13.681323 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.681385 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.681501 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:13.695993 21321 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:13.666350 21316 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:13.698226 21316 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.697029 21321 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.702936 21316 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:13.715801 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 1.13903e+06us
I20260709 12:14:13.737501 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 1816) took 1062 ms. Trace:
I20260709 12:14:13.741092 21313 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:13.742023 21313 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:13.738157 19822 rpcz_store.cc:276] 0709 12:14:12.675609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.736322 (+1060713us) service_pool.cc:224] Handling call
0709 12:14:13.736811 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.737055 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.737093 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.737151 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:13.737191 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.737265 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.737418 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:13.748128 20429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 455) took 1135 ms. Trace:
I20260709 12:14:13.791692 20429 rpcz_store.cc:276] 0709 12:14:12.612805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.747119 (+1134314us) service_pool.cc:224] Handling call
0709 12:14:13.747536 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.747737 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.747763 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.747810 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:13.747840 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.747895 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.748020 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:13.750286 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 1812) took 1090 ms. Trace:
I20260709 12:14:13.728902 21321 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.793205 19816 rpcz_store.cc:276] 0709 12:14:12.660217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.749413 (+1089196us) service_pool.cc:224] Handling call
0709 12:14:13.749750 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.749941 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.749969 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.750010 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:13.750042 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.750098 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.750219 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:13.746915 21313 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:13.803301 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 84668.2us
I20260709 12:14:13.804759 21313 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:13.820798 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:13.822616 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:13.824327 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:13.832265 19824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 1817) took 1037 ms. Trace:
W20260709 12:14:13.839514 19771 debug-util.cc:398] Leaking SignalData structure 0x7b0800169460 after lost signal to thread 18410
I20260709 12:14:13.857865 19824 rpcz_store.cc:276] 0709 12:14:12.783317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.811078 (+1027761us) service_pool.cc:224] Handling call
0709 12:14:13.819706 (+  8628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.819920 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.819960 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.820014 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:13.820055 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.820131 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.820281 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:13.845161 21262 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:13.808280 21313 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:13.890420 21262 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:13.892885 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 139485us
I20260709 12:14:13.893734 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:13.895062 21311 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:13.896104 21313 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:13.907845 21313 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:13.908546 21313 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:13.899746 21286 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.291s	user 0.001s	sys 0.021s
I20260709 12:14:13.899012 21262 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:13.900669 21311 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:13.927326 21286 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.313s	user 0.002s	sys 0.021s
I20260709 12:14:13.952104 21311 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:13.984567 21337 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:13.992014 21313 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:13.996737 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 90324.6us
I20260709 12:14:13.990589 21335 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:13.985570 21332 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:13.994319 21331 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:13.993494 21329 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:14.002727 21313 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.021677 21341 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.027985 21340 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.025694 21333 raft_consensus.cc:493] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:14.026219 21313 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.019631 21332 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.022411 21341 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.024603 21329 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:14.040091 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 151078us
I20260709 12:14:14.010352 21337 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.021272 21331 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.014694 21335 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.088954 21313 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.090525 19823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 1819) took 1206 ms. Trace:
I20260709 12:14:14.091104 19823 rpcz_store.cc:276] 0709 12:14:12.884282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.089486 (+1205204us) service_pool.cc:224] Handling call
0709 12:14:14.089868 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.090050 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.090077 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:14.090120 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:14.090151 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.090206 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.090338 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:14.075572 21344 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
W20260709 12:14:14.100103 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 75223.3us
I20260709 12:14:14.101949 21335 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.100733 21332 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.081610 21329 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.088954 21331 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.104395 21341 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.032140 21340 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.109346 21345 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:14.119217 21340 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.122102 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.113082 21341 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.124046 21341 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.036702 21333 raft_consensus.cc:515] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.106536 21344 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.129863 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.130643 19672 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:14.116178 21339 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.127969 21341 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.126717 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.132772 21346 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.135049 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.161026 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.184011 19675 raft_consensus.cc:2468] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:14:14.150230 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.191823 21351 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.150333 21264 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.183694 19672 raft_consensus.cc:2468] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:14.151121 21337 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.192575 21351 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.192847 21264 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.131925 21343 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.194034 21341 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
W20260709 12:14:14.202018 19771 debug-util.cc:398] Leaking SignalData structure 0x7b0800169b40 after lost signal to thread 19607
I20260709 12:14:14.211876 21344 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.212569 21344 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:14.213416 19771 debug-util.cc:398] Leaking SignalData structure 0x7b08002da2c0 after lost signal to thread 19699
I20260709 12:14:14.213137 21344 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.203163 21334 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.195994 21331 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.211195 21341 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.121017 21345 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.201346 21347 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.210762 21349 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.133687 21339 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.228313 21329 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.223692 21331 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.236733 21329 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.238651 21349 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.240197 21329 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.242208 21349 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.242496 21331 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.232023 21344 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.202315 21346 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:14.255316 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 43988.1us
I20260709 12:14:14.256319 21351 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.224562 21334 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.244838 21341 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.262192 21350 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.262763 19714 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:14.220705 21343 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.268138 21334 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.233017 21347 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.275192 21259 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.278553 21331 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.275940 21259 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.291764 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.288415 21351 raft_consensus.cc:2804] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:14.296782 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.297073 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.300513 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.300872 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.302412 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.303154 19670 raft_consensus.cc:2468] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:14:14.294493 21351 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.303763 21351 raft_consensus.cc:3060] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.304350 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.307653 21259 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.307420 21346 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.315138 21352 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.315815 21339 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.318678 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.308549 21344 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:14.284458 21333 leader_election.cc:290] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.315946 21352 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.292920 21329 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.322140 21340 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.331867 21335 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:14.334111 21156 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
W20260709 12:14:14.336197 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.322564 21332 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.326653 20428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 456) took 1712 ms. Trace:
W20260709 12:14:14.337889 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 533433us
I20260709 12:14:14.343101 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.349581 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.347421 19816 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:14.345738 20428 rpcz_store.cc:276] 0709 12:14:12.613777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.613999 (+   222us) service_pool.cc:224] Handling call
0709 12:14:12.625591 (+ 11592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.326164 (+1700573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.326195 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:14.326237 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:14.326266 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.326340 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.326484 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:14.312126 21353 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.353344 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.354156 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:14.357237 19746 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:14.345875 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.358328 19824 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:14.357259 19815 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:14.361306 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:14.361929 19745 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:14.363029 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.363936 19819 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:14.364267 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:14.364904 19744 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:14.365113 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.365729 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:14.366343 19742 raft_consensus.cc:2468] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:14.337754 21212 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.298938 21331 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.363168 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:14.375337 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.376406 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.378036 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:14.399041 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 52326us
I20260709 12:14:14.378715 19670 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:14.401751 19818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 1818) took 1484 ms. Trace:
I20260709 12:14:14.402256 19818 rpcz_store.cc:276] 0709 12:14:12.883786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.367182 (+1483396us) service_pool.cc:224] Handling call
0709 12:14:14.367535 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.367741 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.367773 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:14.367817 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:14.367852 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.368021 (+   169us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.368155 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:14.321210 21344 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.273362 21350 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.367386 21212 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.351365 21335 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.347327 21340 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.373507 21308 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.372869 21341 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.398638 21334 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.413702 19714 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:14.404603 19771 debug-util.cc:398] Leaking SignalData structure 0x7b0800153d20 after lost signal to thread 19774
I20260709 12:14:14.357440 21332 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.383247 21156 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.403128 21264 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.420289 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.371613 21329 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.407351 21269 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.411796 21283 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.430639 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.457154 19822 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:14.418257 21281 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
W20260709 12:14:14.432747 19771 debug-util.cc:398] Leaking SignalData structure 0x7b080019b240 after lost signal to thread 19775
I20260709 12:14:14.468653 19714 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:14.430709 21346 raft_consensus.cc:2804] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:14.417474 21279 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.423700 21343 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.481057 21358 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.481117 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.487865 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.482110 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.369081 21353 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.482894 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.483455 21211 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.483755 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.484460 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.493498 19819 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:14:14.482770 21336 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.488670 19669 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:14.480159 21346 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.432345 21341 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.476853 21347 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.423466 21308 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.459051 21334 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.506470 21354 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.491091 21259 raft_consensus.cc:2804] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:14.490947 21343 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.506321 21355 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.476913 21281 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.489406 21356 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.486934 21279 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.516619 21344 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.517941 21212 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.468335 21269 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.477857 21283 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.500649 21352 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.505319 21346 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:14.529078 21259 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:14.499970 21358 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.531750 21362 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.555922 19817 raft_consensus.cc:2468] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:14:14.500327 21211 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:14.545336 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 133473us
I20260709 12:14:14.510541 21264 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.500448 21336 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.556747 19714 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:14.549278 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 119715us
I20260709 12:14:14.540319 21350 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.532544 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:14.548029 21339 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:14.575765 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:14.587239 20431 raft_consensus.cc:1813] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Handling vote request from an unknown peer ca42d3c27d2e46348120791d1282b193
I20260709 12:14:14.587955 20431 raft_consensus.cc:2410] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:14.585278 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:14.555538 21259 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:14.546181 21356 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.644878 21332 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.545557 21343 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.572180 21156 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.649545 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:14.572923 21333 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.583352 21362 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.644510 21363 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:14.549751 21212 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.647167 19816 raft_consensus.cc:2468] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:14.549039 21354 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.703886 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.648873 21275 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:14.646458 21331 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:14.707707 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 133637us
W20260709 12:14:14.696375 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 139700us
I20260709 12:14:14.585433 21264 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.677625 21329 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.720904 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.549698 21355 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.721990 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.695080 21339 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.712718 20428 raft_consensus.cc:2410] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:14:14.711405 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.711408 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.726265 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:14.732961 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 139680us
I20260709 12:14:14.695917 21367 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:14.720288 21212 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.740933 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.741168 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.720508 21340 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.725306 21339 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.740134 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.699421 21259 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.742185 19675 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:14.729007 21341 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.744500 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.770233 21354 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.728698 21353 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.787098 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.797048 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.718396 21275 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.744736 19668 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:14.801337 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.726892 21156 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:14:14.719956 21333 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.798707 21211 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.809883 21357 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:14.796025 21371 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.798745 21353 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
W20260709 12:14:14.747079 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 311787us
I20260709 12:14:14.740523 21283 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.800597 21281 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.816136 21212 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.819977 21333 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:14.820700 21264 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.808017 21279 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.802244 21364 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:14.818413 20397 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:14.803901 21334 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.739547 21308 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.802428 21359 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:14.829238 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.840791 20397 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:14.860895 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.864436 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:14.865244 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.853623 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:14.807569 21368 raft_consensus.cc:2804] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:14.729269 21363 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.810483 21357 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:14:14.866221 19673 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:14:14.866441 19669 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:14.868077 19666 raft_consensus.cc:2468] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:14.865945 19668 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:14:14.797981 21367 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.870558 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:14.864243 20398 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:14.869997 21279 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:14.805135 21358 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.802598 21269 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.861936 21354 raft_consensus.cc:2804] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:14.864863 21371 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:14.879416 19821 raft_consensus.cc:2955] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:15.065479 21343 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:15.066394 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.018631 21363 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.976547 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:14.874342 19638 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.726s (SENT) [suppressed 6 similar messages]
W20260709 12:14:15.050868 21326 log.cc:927] Time spent T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 1.070s	user 0.002s	sys 0.002s
I20260709 12:14:14.976392 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.042578 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.873219 21333 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.870559 21356 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:15.048511 21355 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:15.070061 21354 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.929890 21362 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.952306 20397 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:15.015482 21346 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:15.072446 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 120358us
I20260709 12:14:15.073746 21346 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.964195 21259 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:15.055083 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.074168 19570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53406 (request call id 124) took 2696 ms. Trace:
I20260709 12:14:15.043668 21357 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:15.070976 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1035) took 2454 ms. Trace:
W20260709 12:14:14.921523 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.075989 19749 rpcz_store.cc:276] 0709 12:14:12.616252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.616395 (+   143us) service_pool.cc:224] Handling call
0709 12:14:12.616736 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:12.632801 (+ 16065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:12.632836 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:12.655422 (+ 22586us) log.cc:844] Serialized 26 byte log entry
0709 12:14:12.918725 (+263303us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:12.918819 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.918933 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:15.049877 (+2130944us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:14:15.070457 (+ 20580us) raft_consensus.cc:1685] finished
0709 12:14:15.070483 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.070742 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9518,"raft.queue_time_us":22381,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":9548,"spinlock_wait_cycles":24301312,"thread_start_us":262750,"threads_started":1,"wal-append.queue_time_us":1298923}
I20260709 12:14:14.977177 21370 raft_consensus.cc:2804] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.079178 21370 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:15.079614 21370 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.079866 19667 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
W20260709 12:14:14.977520 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 142339us
I20260709 12:14:15.004153 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.081494 21286 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:15.081698 19666 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:15.070634 21354 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:15.074687 19570 rpcz_store.cc:276] 0709 12:14:12.377822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.378021 (+   199us) service_pool.cc:224] Handling call
0709 12:14:15.074053 (+2696032us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10311,"reported_tablets":1}
I20260709 12:14:15.069614 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.023869 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.044606 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.040428 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.877907 21368 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:15.097293 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.121093 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.886142 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.124394 20431 raft_consensus.cc:2468] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
W20260709 12:14:15.026044 21351 consensus_meta.cc:287] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.721s	user 0.016s	sys 0.000s
I20260709 12:14:15.127837 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:14.876911 21336 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:14.834304 21353 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:14.930287 21344 raft_consensus.cc:2804] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.066535 21371 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:15.051724 21367 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:15.149369 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.074576 21358 raft_consensus.cc:2804] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:14.815757 21365 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:14.973384 21339 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
W20260709 12:14:15.148032 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 54216us
I20260709 12:14:15.160545 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.151996 20397 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:14.928854 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 88971.3us
I20260709 12:14:15.163240 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.164590 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.165745 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.166002 21353 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:14.934530 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.173779 19714 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:15.175257 19714 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:15.175328 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:15.096830 21368 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:14.976824 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:14.920746 21279 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:15.181824 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 307668us
I20260709 12:14:15.069906 21333 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.180941 19818 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
W20260709 12:14:15.183405 20430 consensus_meta.cc:287] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 2.565s	user 0.028s	sys 0.013s
I20260709 12:14:15.181209 20397 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:15.151587 21344 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
W20260709 12:14:15.189774 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 315418us
I20260709 12:14:15.190848 21366 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.191340 21366 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:15.191746 21366 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.192054 21334 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.158649 21358 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:14.936676 21275 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:15.185010 21339 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.199602 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.150731 21351 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.201457 19816 raft_consensus.cc:2468] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:15.202184 19714 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:15.185250 21367 raft_consensus.cc:2804] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.208352 19672 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:15.212539 19715 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.213667 19788 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.192570 21334 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:15.193255 21344 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.196764 21358 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:14.875572 21364 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.218197 20430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60846 (request call id 226) took 2597 ms. Trace:
I20260709 12:14:15.167052 21365 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.225376 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.227385 19819 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:14.924482 21359 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.200191 20427 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:15.232738 19715 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:15.218953 19771 debug-util.cc:398] Leaking SignalData structure 0x7b08000b42c0 after lost signal to thread 19848
I20260709 12:14:15.237303 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.239357 19746 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:15.211548 21350 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.212113 21367 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:15.202078 20398 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.242426 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.243160 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.244984 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:15.242532 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 52030.3us
I20260709 12:14:15.221427 21334 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.247942 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.250022 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.250483 21241 raft_consensus.cc:2804] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.251080 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.250387 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.243263 19747 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:15.252324 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.250387 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.253763 19713 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.256361 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.258806 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.259459 19746 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
W20260709 12:14:15.244146 19771 debug-util.cc:398] Leaking SignalData structure 0x7b080032f500 after lost signal to thread 19849
I20260709 12:14:15.264164 19713 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.230268 21365 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:15.266957 21375 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:15.266993 19713 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:15.268085 21323 raft_consensus.cc:2749] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:15.268064 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.268396 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.268951 19713 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:15.269917 21323 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.270143 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.270342 19713 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.270355 21323 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:15.271029 21323 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.271162 21371 raft_consensus.cc:2804] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:15.271673 21371 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.272064 21371 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:15.273519 19713 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.274538 21324 raft_consensus.cc:2749] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:15.240620 21313 raft_consensus.cc:2804] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.239123 21341 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:15.278388 19713 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.280171 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.283452 19746 raft_consensus.cc:2468] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:14:15.280171 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.279284 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.247725 21367 raft_consensus.cc:3060] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.284757 19713 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.257141 21241 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.286355 21241 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.284686 19824 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:15.286259 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:15.291059 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.296221 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.282768 21353 raft_consensus.cc:2804] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.283684 21336 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:15.281847 21313 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:15.252854 21350 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.291990 21324 raft_consensus.cc:2804] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.327092 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.327834 19746 raft_consensus.cc:2468] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:14:15.325595 19668 raft_consensus.cc:2955] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:15.316781 21313 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.312995 21353 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.284162 20398 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.320106 21379 raft_consensus.cc:2804] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.330963 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.324002 21324 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.337806 21378 raft_consensus.cc:2804] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:15.337793 21374 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:15.338409 21378 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.328874 21373 raft_consensus.cc:2804] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.332602 21353 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.319415 21336 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.344460 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.221933 20430 rpcz_store.cc:276] 0709 12:14:12.614318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.614480 (+   162us) service_pool.cc:224] Handling call
0709 12:14:12.614884 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.615119 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:15.189304 (+2574185us) log.cc:844] Serialized 14 byte log entry
0709 12:14:15.211298 (+ 21994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:15.211350 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:15.211388 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.211458 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.211676 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":594,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":4590,"thread_start_us":21634,"threads_started":1}
I20260709 12:14:15.349961 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.342087 19638 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:15.351015 19746 raft_consensus.cc:2468] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:14:15.333630 21279 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:15.340622 21324 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.340051 21379 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:15.343510 21378 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:15.356755 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.357612 19747 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:15.358376 19817 raft_consensus.cc:2468] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:15.359460 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.355012 21339 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:15.349727 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 86171.5us
I20260709 12:14:15.350630 21373 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.354079 21329 raft_consensus.cc:2804] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.357940 21360 raft_consensus.cc:2804] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.355362 21379 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.367446 21359 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:15.370430 21360 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.371447 21360 raft_consensus.cc:3060] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.372613 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.373428 19824 raft_consensus.cc:2468] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:15.365377 21373 raft_consensus.cc:3060] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.365270 21329 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:15.383605 19746 raft_consensus.cc:1240] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:15.381131 21329 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.377938 21323 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.370298 21364 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:15.406039 21279 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:15.406636 21364 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:15.406255 19771 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7ee0 after lost signal to thread 20457
I20260709 12:14:15.406948 21279 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.407660 21333 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:15.406874 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.408695 21364 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:15.411247 19640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.785s	user 0.020s	sys 0.067s
W20260709 12:14:15.411665 19640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.785s	user 0.020s	sys 0.067s
I20260709 12:14:15.421559 21335 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:15.388847 21336 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:15.442158 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.435967 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.445340 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.447582 19816 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:15.448753 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.446728 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.449416 19816 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:15.451072 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.489494 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.491863 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.493474 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.516170 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.521365 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.523403 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.527323 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.525566 20427 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
W20260709 12:14:15.529927 21385 log.cc:927] Time spent T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:14:15.382987 21371 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.422364 20398 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.524942 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.534089 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.545436 21323 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:15.545702 21344 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.547580 21356 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:15.549235 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 144471us
I20260709 12:14:15.551097 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.445408 21354 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.553117 21344 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:15.565735 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 82117.7us
I20260709 12:14:15.566812 19713 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.558328 21279 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:15.573876 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.568068 19713 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:15.578284 19713 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.572641 21339 raft_consensus.cc:2804] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.579685 21339 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.580199 21339 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.565169 21364 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:15.590626 19713 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.596292 21375 raft_consensus.cc:2804] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.596807 21375 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.597378 21375 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.598874 19713 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:15.591892 21323 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:15.585467 21370 consensus_meta.cc:287] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.026s
I20260709 12:14:15.585484 21337 raft_consensus.cc:2749] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:15.607667 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 49144.5us
I20260709 12:14:15.611356 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.615211 20432 raft_consensus.cc:2393] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:15.602228 21347 raft_consensus.cc:2749] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:15.619300 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.622258 19824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:15.622540 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.623029 19824 raft_consensus.cc:606] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Received request to transfer leadership to TS b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:15.623492 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.587715 21345 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:15.631839 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.599817 21378 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.633205 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.623667 19743 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:15.634567 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.637943 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.642308 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.643081 21212 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:15.644132 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.644322 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 1829) took 1291 ms. Trace:
I20260709 12:14:15.643671 21364 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:15.644791 19822 rpcz_store.cc:276] 0709 12:14:14.349161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.349317 (+   156us) service_pool.cc:224] Handling call
0709 12:14:15.640783 (+1291466us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400262ad4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:15.640892 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245552512}
I20260709 12:14:15.645642 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.650447 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.643764 21212 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.652468 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.655813 19713 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:15.609076 21370 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.667096 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.668637 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.672289 19745 raft_consensus.cc:1240] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:15.631647 19747 raft_consensus.cc:2955] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:15.676143 21371 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:15.678225 21380 log.cc:927] Time spent T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.520s	user 0.000s	sys 0.010s
I20260709 12:14:15.654681 21324 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.645501 21364 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.678934 20426 raft_consensus.cc:1240] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:15.698758 20428 raft_consensus.cc:1240] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:15.634476 21334 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.682417 21390 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:15.704135 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.673373 21347 raft_consensus.cc:2804] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.671233 21358 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.725651 20432 raft_consensus.cc:1240] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:15.617158 21366 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.726440 19789 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:15.730007 19789 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:15.732872 19746 raft_consensus.cc:2393] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:15.732131 19789 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:15.738814 19789 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:15.739766 19789 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:15.732092 19640 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:15.740700 19789 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:15.742573 20433 raft_consensus.cc:1240] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:15.747159 19742 raft_consensus.cc:1240] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:15.748759 19640 leader_election.cc:304] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:15.748936 19638 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:15.726490 21347 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.728077 21354 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:15.745529 21359 raft_consensus.cc:2804] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.740809 21374 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.738363 21279 raft_consensus.cc:2804] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.741564 21167 raft_consensus.cc:2804] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.760012 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.752182 21281 raft_consensus.cc:2804] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:15.753999 21308 raft_consensus.cc:2804] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.760130 21359 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.758378 21347 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.740723 21313 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.778231 21388 raft_consensus.cc:2749] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:15.763649 21374 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.767304 21167 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.744601 21390 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.812361 21392 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:15.812999 21392 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:15.813480 21392 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:15.773144 21281 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.754446 21275 consensus_queue.cc:1059] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:14:15.767124 21279 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.757968 21156 consensus_queue.cc:1059] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:14:15.776870 21308 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:15.781106 21359 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.823441 21324 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:15.804674 21366 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:15.827589 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 95491.4us
I20260709 12:14:15.811506 21374 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.811168 21167 raft_consensus.cc:3060] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.820344 21281 raft_consensus.cc:3060] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.827490 21308 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.856901 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:15.825510 21279 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.863770 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.848553 21377 raft_consensus.cc:3055] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:14:15.867389 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 118175us
I20260709 12:14:15.869747 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:15.850381 21358 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:15.845916 21212 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:15.879576 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:15.880807 19638 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:15.885658 19667 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.887440 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.873070 21377 raft_consensus.cc:740] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:15.894981 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.896239 21377 consensus_queue.cc:260] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:15.898098 21386 raft_consensus.cc:2749] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:15.899525 21334 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:15.902621 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.903877 21375 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.904846 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.904177 21390 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:15.904630 21353 consensus_meta.cc:287] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.551s	user 0.015s	sys 0.001s
I20260709 12:14:15.898108 21377 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:15.891181 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 44564.3us
I20260709 12:14:15.868274 21364 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:15.868438 21370 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:15.904783 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.911849 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:15.913787 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 45182.8us
I20260709 12:14:15.928283 19638 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:15.928714 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:15.930915 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.911984 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.906273 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:15.908985 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:15.906350 21353 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:15.945777 19748 raft_consensus.cc:1240] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:15.946851 21353 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:15.947945 19672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 130) took 1656 ms (client timeout 1754 ms). Trace:
I20260709 12:14:15.948029 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:15.887428 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 129476us
I20260709 12:14:15.944540 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.932301 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:15.950133 19816 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
W20260709 12:14:15.893357 21367 consensus_meta.cc:287] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.018s
I20260709 12:14:15.953220 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:15.948576 19672 rpcz_store.cc:269] 0709 12:14:14.291391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.302040 (+ 10649us) service_pool.cc:224] Handling call
0709 12:14:15.066254 (+764214us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b5800003398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aeee 000000000036eb39 00007fadf96ce1e0 00007fadf97970c4 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:14:15.947741 (+881487us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400392954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:15.947845 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331971584}
I20260709 12:14:15.878480 21378 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:15.970599 21329 consensus_meta.cc:287] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.548s	user 0.004s	sys 0.007s
I20260709 12:14:15.943343 21375 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:15.972721 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.983070 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:15.986516 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:15.989082 20424 raft_consensus.cc:1240] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:15.977869 21387 raft_consensus.cc:2749] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:16.002281 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.993415 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.002995 19747 raft_consensus.cc:2468] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:16.003288 19672 raft_consensus.cc:3060] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.003280 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.007472 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:15.994339 21368 consensus_meta.cc:287] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.797s	user 0.013s	sys 0.022s
I20260709 12:14:15.909353 21339 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:15.973278 21379 consensus_meta.cc:287] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.000s
I20260709 12:14:15.971361 21329 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.017017 19638 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:16.018536 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:16.021559 19638 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:16.020299 19823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1008) took 1097 ms. Trace:
I20260709 12:14:16.016178 21313 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:16.023325 19823 rpcz_store.cc:276] 0709 12:14:14.923427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.923659 (+   232us) service_pool.cc:224] Handling call
0709 12:14:15.640926 (+717267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.641112 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:15.641128 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:15.641155 (+    27us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:15.641172 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.641206 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.020100 (+378894us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b5400262ad0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:16.020203 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549926272}
I20260709 12:14:16.026655 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.028322 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.028960 19745 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:16.029508 20398 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:16.029851 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:16.030160 21360 consensus_meta.cc:287] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.658s	user 0.012s	sys 0.004s
I20260709 12:14:16.031446 20398 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:16.031152 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.032570 21369 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.033146 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.033367 21369 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.034283 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.034380 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.034966 21383 raft_consensus.cc:2749] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.035363 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:15.998438 21347 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.035491 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:16.016682 21241 consensus_meta.cc:287] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.705s	user 0.007s	sys 0.007s
I20260709 12:14:16.040868 19789 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.049734 19789 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.050899 21212 raft_consensus.cc:2749] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:15.958240 21367 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:16.042987 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.057267 21392 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.057536 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.054384 19669 raft_consensus.cc:1240] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:16.054381 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.062155 19670 raft_consensus.cc:1240] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:16.064191 19640 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.011013 21357 consensus_queue.cc:1059] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:14:16.067554 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.036542 21331 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:16.066084 19667 raft_consensus.cc:2468] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:16.075465 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.014753 21368 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.079706 20430 raft_consensus.cc:1240] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.081326 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.051901 21156 raft_consensus.cc:2749] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.084944 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:16.086266 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.081575 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.087623 19748 raft_consensus.cc:2393] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 2: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:16.089227 19747 raft_consensus.cc:2393] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 2: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:16.022436 21379 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.030622 21360 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:16.094587 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.090176 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.090420 19715 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:16.035897 21281 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.097584 19715 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:16.047639 21364 consensus_queue.cc:1059] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:14:16.103708 21364 raft_consensus.cc:3055] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.104099 21364 raft_consensus.cc:740] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:16.105005 21364 consensus_queue.cc:260] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.105605 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.105746 21359 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.106678 19750 raft_consensus.cc:1240] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:16.107335 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.107909 19745 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:16.108400 21359 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:16.108695 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.109306 19745 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:16.109683 21353 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:16.110070 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:16.110258 21353 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:16.110834 21353 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:16.111240 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.112402 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.113055 21167 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.106307 19671 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.113541 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.088330 21387 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.114917 19672 raft_consensus.cc:2468] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:16.117317 21368 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:16.117550 19745 raft_consensus.cc:1240] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:16.119488 19743 raft_consensus.cc:1240] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:16.111299 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:16.122766 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 87405.3us
I20260709 12:14:16.131170 19671 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:16.063374 21241 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:16.137142 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.139607 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 84227us
I20260709 12:14:16.140035 19789 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.141137 20429 raft_consensus.cc:1240] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.100355 19715 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:16.143054 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.144057 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.144263 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.150290 19748 raft_consensus.cc:2393] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:16.148662 19821 raft_consensus.cc:1240] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.072058 20398 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:16.150003 19715 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:16.119561 19745 raft_consensus.cc:1240] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:16.131024 21378 raft_consensus.cc:2804] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:16.107925 21367 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:16.137755 21373 consensus_meta.cc:287] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.753s	user 0.003s	sys 0.010s
I20260709 12:14:16.167455 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:16.168546 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:16.147539 21364 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.158886 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:16.159718 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:16.187413 19818 raft_consensus.cc:2468] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:16.187677 19817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1024) took 1139 ms. Trace:
I20260709 12:14:16.159986 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:16.189821 19815 raft_consensus.cc:2468] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:16.082938 21308 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.160744 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:16.190889 19745 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.190948 19816 raft_consensus.cc:2468] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:16.161448 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:16.192230 19820 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:16.157702 19715 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:16.120534 21374 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.173563 19741 raft_consensus.cc:1240] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:16.174528 19675 raft_consensus.cc:1240] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.158528 21375 raft_consensus.cc:2749] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:16.145179 21368 raft_consensus.cc:2749] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:16.175930 21350 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:16.178823 20396 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.207741 19744 raft_consensus.cc:1240] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:16.191049 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 137893us
W20260709 12:14:16.208528 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 54273.1us
I20260709 12:14:16.179545 21281 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:16.180684 19674 raft_consensus.cc:1240] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.182893 19743 raft_consensus.cc:1240] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.183697 19823 raft_consensus.cc:1240] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.165082 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:16.160477 21378 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:16.188079 19817 rpcz_store.cc:276] 0709 12:14:15.047938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.281366 (+233428us) service_pool.cc:224] Handling call
0709 12:14:16.187459 (+906093us) spinlock_profiling.cc:243] Waited 66.6 ms on lock 0x7b540036b5d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:16.187604 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153253632}
I20260709 12:14:16.155926 21404 raft_consensus.cc:2749] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.147085 21357 consensus_queue.cc:1059] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:14:16.171212 21266 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:16.205054 21241 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:16.206285 21167 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:16.206905 21329 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:16.199875 21313 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:16.177230 21392 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:16.248809 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:16.214901 19822 raft_consensus.cc:1240] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:16.217155 19745 raft_consensus.cc:2468] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:16.217717 21350 raft_consensus.cc:2804] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:16.217944 21339 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:16.219859 21351 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:16.198068 20427 raft_consensus.cc:1240] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.270123 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:16.236073 19675 raft_consensus.cc:1240] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.270818 19743 raft_consensus.cc:3060] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.238345 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:16.252696 21360 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:16.253273 21404 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:16.171535 21373 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.254637 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:16.246409 21313 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:16.257121 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:16.258358 21379 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:16.258770 21347 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:16.277225 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.260285 21308 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:16.231475 21266 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:16.260950 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:16.226321 21378 raft_consensus.cc:3060] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.290736 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.264322 21365 raft_consensus.cc:3055] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.291589 21365 raft_consensus.cc:740] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:16.292583 21365 consensus_queue.cc:260] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.293627 21365 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.257925 21279 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.286484 19819 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:16.268507 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.268849 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.267755 21350 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:16.274704 19817 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.255419 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.274145 21404 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.250168 21353 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:16.276188 19823 raft_consensus.cc:2468] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:16.275203 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:16.283401 21373 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:16.297525 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 233398us
I20260709 12:14:16.287222 19820 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:16.287639 19675 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.309185 19640 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.287870 21266 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.288331 21374 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:16.290972 19573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47140 (request call id 230) took 3902 ms. Trace:
I20260709 12:14:16.263232 19638 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:16.296239 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:16.310928 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 47799.5us
I20260709 12:14:16.311120 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:16.311652 19638 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:16.312476 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:16.312949 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.300980 21279 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:16.281080 21313 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.306887 19749 raft_consensus.cc:1240] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:16.284693 20398 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.313143 19746 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:16.310318 19573 rpcz_store.cc:276] 0709 12:14:12.388357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.390722 (+  2365us) service_pool.cc:224] Handling call
0709 12:14:16.290905 (+3900183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2599228,"reported_tablets":5}
I20260709 12:14:16.302860 21350 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.312531 19638 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:16.317210 19817 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:16.323333 19638 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:16.322669 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.324657 19748 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:16.310491 19640 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.325414 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.325927 21404 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:16.326408 19743 raft_consensus.cc:2468] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:16.316953 21388 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.330797 21393 raft_consensus.cc:2804] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:16.332278 21393 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:16.332645 21393 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:16.333312 19638 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:16.321692 19745 raft_consensus.cc:3060] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.330825 21329 raft_consensus.cc:2804] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:16.316576 21308 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:16.331513 21331 raft_consensus.cc:2749] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:16.341207 19820 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:16.341974 19675 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:16.317134 21390 raft_consensus.cc:2804] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:16.330667 20398 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.349287 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.351140 19745 raft_consensus.cc:2468] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:16.354390 19746 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:16.354944 19640 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:16.355113 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:16.357074 19640 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.335556 21360 raft_consensus.cc:2749] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:16.364630 21408 raft_consensus.cc:2804] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:16.365140 21408 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:16.365566 21408 raft_consensus.cc:3060] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.367077 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:16.368722 19743 raft_consensus.cc:1240] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:16.369931 19743 raft_consensus.cc:1240] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:16.353562 21388 consensus_queue.cc:1059] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:14:16.361286 21405 consensus_queue.cc:1059] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:14:16.372036 21388 raft_consensus.cc:3055] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:16.372211 21405 raft_consensus.cc:3055] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:16.372444 21388 raft_consensus.cc:740] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:16.372843 21405 raft_consensus.cc:740] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:16.373456 21388 consensus_queue.cc:260] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.356175 21387 raft_consensus.cc:2804] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:16.375102 21387 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:16.375200 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.375521 21387 raft_consensus.cc:3060] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.375871 19675 raft_consensus.cc:3060] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.347841 21329 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:16.379494 19748 raft_consensus.cc:2393] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:16.379580 19640 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.352341 21390 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:16.359187 21394 raft_consensus.cc:2804] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:16.350006 21392 consensus_queue.cc:1059] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:14:16.359525 21369 raft_consensus.cc:2749] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:16.376379 21383 consensus_queue.cc:1059] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:14:16.361552 21386 raft_consensus.cc:2749] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.380955 19714 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:16.394752 19748 raft_consensus.cc:1240] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.384457 19675 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:16.374714 21388 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:16.382632 21329 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:16.397328 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:16.373843 21405 consensus_queue.cc:260] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.398340 19714 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:16.354614 21308 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:16.389890 21390 raft_consensus.cc:3060] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.407310 19714 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:16.408118 19742 raft_consensus.cc:1240] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:16.384230 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 53689us
I20260709 12:14:16.392632 21394 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:16.400113 21379 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:16.438313 19572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47138 (request call id 241) took 2543 ms. Trace:
I20260709 12:14:16.438769 19572 rpcz_store.cc:276] 0709 12:14:13.894819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.895055 (+   236us) service_pool.cc:224] Handling call
0709 12:14:14.979277 (+1084222us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5400002490. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165b0b2 00007fadfa5d4759 00007fadfa56ca76 00007fadfa53dd58 00007fadfa63c04e 00007fadf8afd2a4 00007fadf8afd232 00007fadf8afd161 00007fadf8afd0dc
0709 12:14:16.438245 (+1458968us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1206545,"reported_tablets":2,"spinlock_wait_cycles":4222208}
I20260709 12:14:16.403581 19743 raft_consensus.cc:1240] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:16.434768 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 55292.1us
I20260709 12:14:16.444203 19569 catalog_manager.cc:5697] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 5 to 6, VOTER ca42d3c27d2e46348120791d1282b193 (127.17.249.194) evicted. New cstate: current_term: 3 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.442140 19714 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:16.448103 19714 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:16.449424 19668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1724) took 1177 ms. Trace:
I20260709 12:14:16.448959 19569 catalog_manager.cc:5697] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: config changed from index 4 to 5, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.430191 21375 raft_consensus.cc:2749] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:16.451551 19714 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:16.449581 21386 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.455372 19640 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.450034 19668 rpcz_store.cc:276] 0709 12:14:15.270017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.270123 (+   106us) service_pool.cc:224] Handling call
0709 12:14:15.270629 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:15.270997 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:15.271024 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:15.272026 (+  1002us) log.cc:844] Serialized 508 byte log entry
0709 12:14:15.325452 (+ 53426us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:15.538848 (+213396us) log.cc:844] Serialized 14 byte log entry
0709 12:14:15.540390 (+  1542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.447294 (+906904us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b540033cfa0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf4782a02 00007fadf477fdde 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:14:16.447405 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.447459 (+    54us) raft_consensus.cc:1685] finished
0709 12:14:16.447559 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.447715 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":21798784,"thread_start_us":53109,"threads_started":1,"wal-append.queue_time_us":88173}
I20260709 12:14:16.433920 21394 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.464012 19824 raft_consensus.cc:1240] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:16.447584 21368 raft_consensus.cc:2749] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.473968 19714 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:16.465126 21345 raft_consensus.cc:2804] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.465855 21373 raft_consensus.cc:2804] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.461649 21396 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:16.483717 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.487118 21351 raft_consensus.cc:2804] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.469480 21339 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.471747 21308 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:16.492422 19789 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:16.452155 20398 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.476383 21353 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:16.503868 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.501852 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.503070 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.502576 19789 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:16.507108 19789 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:16.509441 19789 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:16.511864 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36936 (request call id 1601) took 1270 ms. Trace:
I20260709 12:14:16.498416 21337 consensus_queue.cc:1059] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:14:16.514286 21279 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:16.503265 21373 raft_consensus.cc:697] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:16.515106 21343 raft_consensus.cc:2749] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.515192 21279 raft_consensus.cc:697] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:16.506501 21351 raft_consensus.cc:697] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:16.515700 21373 consensus_queue.cc:237] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.516389 21279 consensus_queue.cc:237] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.516793 21351 consensus_queue.cc:237] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.500597 21345 raft_consensus.cc:697] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:16.479236 21379 consensus_queue.cc:1059] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:14:16.514392 21374 raft_consensus.cc:2804] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.523118 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.527438 19670 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:16.512220 19750 rpcz_store.cc:276] 0709 12:14:15.235981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.236155 (+   174us) service_pool.cc:224] Handling call
0709 12:14:15.242087 (+  5932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.107107 (+865020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.506426 (+399319us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b540007fdd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:16.506583 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987860224}
W20260709 12:14:16.521871 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 66595.5us
I20260709 12:14:16.500634 21417 raft_consensus.cc:2749] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.502929 21336 raft_consensus.cc:2804] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.512815 21404 raft_consensus.cc:2804] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.531972 19640 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.532995 19638 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:16.512617 21339 raft_consensus.cc:697] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:16.523345 21275 raft_consensus.cc:3055] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:16.537324 21275 raft_consensus.cc:740] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:16.537636 21345 consensus_queue.cc:237] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.538339 21275 consensus_queue.cc:260] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:16.540047 21275 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:16.509410 21364 consensus_queue.cc:1059] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:14:16.555634 21339 consensus_queue.cc:237] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.541188 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:16.546011 20397 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:16.548019 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.548811 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:16.560811 20397 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:16.561228 19675 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:16.526113 21333 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:16.562460 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:16.577749 20397 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:16.578328 19638 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:16.530112 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 89674.3us
I20260709 12:14:16.574143 21281 consensus_queue.cc:1059] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:14:16.574035 21360 raft_consensus.cc:2749] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:16.586882 21367 raft_consensus.cc:2749] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:16.534622 21374 raft_consensus.cc:697] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:16.530282 21378 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:16.542517 21336 raft_consensus.cc:697] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:16.527496 21407 consensus_queue.cc:1059] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:14:16.591482 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.577924 21358 raft_consensus.cc:2749] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.569959 21404 raft_consensus.cc:697] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
W20260709 12:14:16.597275 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 65406.7us
I20260709 12:14:16.619427 19640 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.602969 21414 raft_consensus.cc:2804] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:16.596745 21212 consensus_queue.cc:1059] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:14:16.604404 21408 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.605571 21281 raft_consensus.cc:3055] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:16.605909 21329 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.588534 21387 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.646358 19744 raft_consensus.cc:1240] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:16.620949 19640 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.582032 21283 consensus_queue.cc:1059] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:14:16.643748 19750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:16.607008 21417 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:16.649005 19750 raft_consensus.cc:606] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:16.649464 19640 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.652555 19640 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:16.580030 21333 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:16.664811 19640 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:16.580266 21419 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:16.646876 21281 raft_consensus.cc:740] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:16.669981 21415 raft_consensus.cc:2749] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.670843 21281 consensus_queue.cc:260] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.672292 21281 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:16.672494 21387 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:16.674314 21408 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:16.679543 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:16.680588 19819 raft_consensus.cc:3060] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.645081 21392 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:16.687417 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 106439us
I20260709 12:14:16.685169 19667 raft_consensus.cc:1240] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:16.604151 21390 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.691381 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:16.694693 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:16.598729 21377 consensus_queue.cc:1059] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:14:16.688638 20397 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:16.696390 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:16.700825 20397 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:16.701177 19817 raft_consensus.cc:3060] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.667564 21383 raft_consensus.cc:2749] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:16.684670 21211 raft_consensus.cc:3055] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:14:16.735487 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.695184 21419 raft_consensus.cc:697] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:16.711473 21211 raft_consensus.cc:740] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:16.697575 21266 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:16.900230 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.878331 21336 consensus_queue.cc:237] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.617198 21386 consensus_queue.cc:1059] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.185s
W20260709 12:14:17.017954 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 314949us
I20260709 12:14:16.859573 21374 consensus_queue.cc:237] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:16.705709 21343 raft_consensus.cc:2804] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.691412 21387 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:17.056445 21313 consensus_meta.cc:287] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.732s	user 0.006s	sys 0.014s
I20260709 12:14:17.089151 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:17.089195 19816 raft_consensus.cc:1240] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:17.049467 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 348668us
I20260709 12:14:16.873579 21404 consensus_queue.cc:237] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:17.051117 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 386379us
W20260709 12:14:17.052134 19670 consensus_meta.cc:287] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.012s
I20260709 12:14:17.102001 19670 raft_consensus.cc:2468] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:16.804486 21367 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:17.055088 19819 raft_consensus.cc:2468] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:17.058447 19671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0"
dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
mode: GRACEFUL
new_leader_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:38020
I20260709 12:14:17.065984 21211 consensus_queue.cc:260] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:17.069626 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.015792 21365 consensus_meta.cc:287] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.516s	user 0.000s	sys 0.012s
W20260709 12:14:17.074958 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.688820 21415 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:17.106743 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.112883 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.116554 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:17.117679 19817 raft_consensus.cc:2468] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:17.017092 20398 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:17.102969 19671 raft_consensus.cc:606] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Received request to transfer leadership to TS ca42d3c27d2e46348120791d1282b193
I20260709 12:14:17.056176 21392 consensus_queue.cc:1059] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:14:17.079535 21419 consensus_queue.cc:237] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.141112 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.121424 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.100790 21343 raft_consensus.cc:697] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:17.105304 21367 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:17.105660 21415 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:17.094630 21313 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:17.195890 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:17.246960 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:17.256403 19819 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:17.310523 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.311218 19824 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.195691 21211 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.215830 21367 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.221977 21378 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:17.213869 21241 raft_consensus.cc:2749] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:17.325872 21396 consensus_meta.cc:287] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.824s	user 0.006s	sys 0.004s
I20260709 12:14:17.326344 21396 raft_consensus.cc:2749] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:17.219837 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 202866us
I20260709 12:14:17.328351 20398 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:17.194885 21414 raft_consensus.cc:697] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:17.331923 21414 consensus_queue.cc:237] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:17.336194 21275 consensus_meta.cc:287] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.796s	user 0.012s	sys 0.002s
I20260709 12:14:17.217324 21415 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.362011 19824 raft_consensus.cc:2468] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:17.196946 21333 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:17.196496 21390 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:17.412539 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:17.413878 19746 raft_consensus.cc:2393] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:17.338670 21429 raft_consensus.cc:3055] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:17.419548 21429 raft_consensus.cc:740] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:17.419732 19673 raft_consensus.cc:1240] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:17.420964 19673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1734) took 1220 ms. Trace:
I20260709 12:14:17.383905 21241 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:17.426744 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1073) took 1453 ms. Trace:
I20260709 12:14:17.414476 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36936 (request call id 1638) took 1152 ms. Trace:
I20260709 12:14:17.441306 19749 rpcz_store.cc:276] 0709 12:14:15.972872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.189107 (+216235us) service_pool.cc:224] Handling call
0709 12:14:16.304854 (+115747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.318776 (+ 13922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.426409 (+1107633us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540015a4d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:17.426654 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265449728}
I20260709 12:14:17.421448 19673 rpcz_store.cc:276] 0709 12:14:16.200686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.418431 (+1217745us) service_pool.cc:224] Handling call
0709 12:14:17.418978 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.420529 (+  1551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.420866 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:17.441428 19746 rpcz_store.cc:276] 0709 12:14:16.261714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.412048 (+1150334us) service_pool.cc:224] Handling call
0709 12:14:17.414388 (+  2340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:17.445549 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:17.446767 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 327555us
W20260709 12:14:17.439615 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 337430us
I20260709 12:14:17.456717 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.457602 19819 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.381896 21360 consensus_queue.cc:1059] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:14:17.501845 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.502733 19824 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.444377 21402 raft_consensus.cc:3055] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:14:17.504174 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.426612 21356 consensus_queue.cc:1059] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:14:17.530949 19817 raft_consensus.cc:1240] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:17.531782 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.544556 19824 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:17.547854 21266 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:17.545576 21429 consensus_queue.cc:260] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.506033 21355 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:17.507664 21402 raft_consensus.cc:740] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
W20260709 12:14:17.568397 21281 consensus_meta.cc:287] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.896s	user 0.012s	sys 0.003s
I20260709 12:14:17.571448 21390 consensus_queue.cc:1059] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:14:17.575170 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 64872.8us
W20260709 12:14:17.521914 21350 consensus_meta.cc:287] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 1.183s	user 0.010s	sys 0.017s
I20260709 12:14:17.575145 19819 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:17.485260 21333 consensus_queue.cc:1059] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:14:17.585920 19824 raft_consensus.cc:1240] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:17.570462 21367 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:17.563421 21393 consensus_meta.cc:287] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.230s	user 0.018s	sys 0.004s
I20260709 12:14:17.498754 21386 consensus_queue.cc:1059] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
W20260709 12:14:17.577765 21394 consensus_meta.cc:287] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.105s	user 0.016s	sys 0.002s
I20260709 12:14:17.477223 21343 consensus_queue.cc:237] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:17.576714 21211 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.615026 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.631683 21413 raft_consensus.cc:3055] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:17.632302 21413 raft_consensus.cc:740] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:17.633358 21413 consensus_queue.cc:260] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.634420 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.634590 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.634687 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.635434 19821 raft_consensus.cc:2393] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 3: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
W20260709 12:14:17.636075 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.634008 19817 raft_consensus.cc:1240] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:17.645908 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.647229 19819 raft_consensus.cc:2393] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 3: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:17.649459 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.649518 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1894) took 1033 ms. Trace:
I20260709 12:14:17.652030 19669 rpcz_store.cc:276] 0709 12:14:16.615648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.615872 (+   224us) service_pool.cc:224] Handling call
0709 12:14:16.643996 (+ 28124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.705178 (+ 61182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.705209 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.705250 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:16.705286 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.649236 (+943950us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b540004ae54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:17.649288 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.649445 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140201344}
I20260709 12:14:17.666847 21437 raft_consensus.cc:993] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8: : Instructing follower ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:17.669817 19823 raft_consensus.cc:3055] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:17.596710 21355 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:17.677265 19819 raft_consensus.cc:1275] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:17.670277 19823 raft_consensus.cc:740] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:17.685187 19816 raft_consensus.cc:3055] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:17.613749 21350 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:17.686515 19816 raft_consensus.cc:740] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
W20260709 12:14:17.687958 19638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.029s	sys 0.093s
W20260709 12:14:17.689177 19638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.029s	sys 0.093s
I20260709 12:14:17.616225 21393 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.693095 19823 consensus_queue.cc:260] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.693194 19816 consensus_queue.cc:260] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.694195 19823 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.694432 21393 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:17.694737 19816 raft_consensus.cc:3060] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.699156 19741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36936 (request call id 1618) took 2112 ms. Trace:
I20260709 12:14:17.627363 21211 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.704609 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:17.705571 21349 raft_consensus.cc:3055] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:17.710148 19822 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:17.710508 21333 raft_consensus.cc:1081] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Signalling peer ca42d3c27d2e46348120791d1282b193 to start an election
I20260709 12:14:17.704668 19824 raft_consensus.cc:1275] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:17.629221 21431 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:17.668648 21241 raft_consensus.cc:3055] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:14:17.716118 19714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.012s	sys 0.047s
I20260709 12:14:17.720781 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:17.740180 19819 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
W20260709 12:14:17.741822 19714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.013s	sys 0.047s
I20260709 12:14:17.682852 21392 raft_consensus.cc:3055] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:17.726146 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.727032 19820 raft_consensus.cc:1240] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:17.728876 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:17.733314 19823 raft_consensus.cc:1275] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:17.702289 20425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 479) took 1020 ms. Trace:
I20260709 12:14:17.686869 21413 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:17.734835 20433 raft_consensus.cc:1240] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:17.724486 19638 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:17.743647 19666 raft_consensus.cc:1240] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:17.619768 21394 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.716599 21323 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:17.767201 19638 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:17.655930 21402 consensus_queue.cc:260] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.730809 21349 raft_consensus.cc:740] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:17.780295 19638 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:17.772164 20397 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.032s	sys 0.032s
W20260709 12:14:17.787727 20397 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.032s	sys 0.032s
I20260709 12:14:17.777205 21414 raft_consensus.cc:2804] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:17.739528 21241 raft_consensus.cc:740] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:17.750371 21392 raft_consensus.cc:740] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:17.681612 21433 consensus_queue.cc:1059] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.156s
I20260709 12:14:17.715231 19741 rpcz_store.cc:276] 0709 12:14:15.586557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.587564 (+  1007us) service_pool.cc:224] Handling call
0709 12:14:15.595946 (+  8382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.209580 (+613634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.698860 (+1489280us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54001ce8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:17.699086 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253697792}
I20260709 12:14:17.767498 21281 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:17.806036 21211 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:17.777597 21386 raft_consensus.cc:2804] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:17.808724 21414 raft_consensus.cc:697] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:17.824152 21435 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:17.777019 21323 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.824991 21435 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:17.831115 21386 raft_consensus.cc:697] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:17.767551 20425 rpcz_store.cc:276] 0709 12:14:16.681849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.684627 (+  2778us) service_pool.cc:224] Handling call
0709 12:14:17.701444 (+1016817us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b5800148b98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:14:17.701684 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.701922 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:17.701953 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:17.701997 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:17.702029 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.702090 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.702222 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6316416}
W20260709 12:14:17.844602 20398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.031s	sys 0.041s
W20260709 12:14:17.846352 20398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.031s	sys 0.042s
I20260709 12:14:17.826730 21331 raft_consensus.cc:2804] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:17.855166 19639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.018s	sys 0.054s
W20260709 12:14:17.927778 19639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.019s	sys 0.054s
W20260709 12:14:17.894549 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.833606 21349 consensus_queue.cc:260] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.944242 21399 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:17.945151 21399 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:17.946986 21363 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.837087 21379 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:17.898748 21333 raft_consensus.cc:3055] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:17.822817 21281 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:17.983103 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 311337us
I20260709 12:14:17.982578 21349 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.749787 21431 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.941864 21331 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:17.833987 21386 consensus_queue.cc:237] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:18.032254 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.947801 21419 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.031s	sys 0.063s
I20260709 12:14:18.034428 19816 raft_consensus.cc:1275] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:17.927297 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 596804us
I20260709 12:14:18.043395 20430 raft_consensus.cc:1240] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:18.043948 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 428480us
W20260709 12:14:18.044549 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.048234 21394 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:18.055617 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:18.080628 21414 consensus_queue.cc:237] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:18.052974 21419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.031s	sys 0.063s
I20260709 12:14:18.085584 19816 raft_consensus.cc:2468] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:18.055172 21355 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.087785 19638 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:18.088363 21355 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.086190 21419 consensus_queue.cc:1059] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:18.088992 21355 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:18.089977 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.044279 21331 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.079247 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:18.032711 21379 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } attrs { replace: true } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:18.088995 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.079645 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 47731.1us
I20260709 12:14:18.093681 19713 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:17.985122 21333 raft_consensus.cc:740] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
W20260709 12:14:18.094712 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.095247 20398 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:18.042492 21211 raft_consensus.cc:493] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:18.100800 21412 raft_consensus.cc:2804] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:18.101442 21412 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:18.101851 21412 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.101596 21211 raft_consensus.cc:515] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.105579 21211 leader_election.cc:290] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.107203 21388 raft_consensus.cc:3055] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:18.111641 21353 raft_consensus.cc:3055] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:18.115938 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1074) took 2100 ms. Trace:
I20260709 12:14:18.115935 19666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1898) took 1498 ms. Trace:
I20260709 12:14:18.117672 21375 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.204466 21388 raft_consensus.cc:740] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:18.118021 21337 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:18.118275 21364 raft_consensus.cc:3055] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:18.117985 19788 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:18.205993 21388 consensus_queue.cc:260] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:18.204771 19744 rpcz_store.cc:276] 0709 12:14:16.015218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.208721 (+193503us) service_pool.cc:224] Handling call
0709 12:14:16.244669 (+ 35948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.656828 (+412159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.115617 (+1458789us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540003fcd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:18.115845 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923054976}
W20260709 12:14:18.207724 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 89813.8us
I20260709 12:14:18.209640 19788 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:18.210465 21357 raft_consensus.cc:2749] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:18.211207 21357 raft_consensus.cc:2749] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:18.210988 21375 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:18.212566 21364 raft_consensus.cc:740] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:18.206000 21337 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.215718 21364 consensus_queue.cc:260] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.218047 19788 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:18.123639 21308 raft_consensus.cc:3055] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:18.125010 21366 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:18.126098 21264 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:18.126875 21407 raft_consensus.cc:3055] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.133473 21212 raft_consensus.cc:3055] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.151165 21333 consensus_queue.cc:260] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:18.052408 21399 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.087783 19667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1896) took 1471 ms. Trace:
I20260709 12:14:18.085327 21394 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.155917 21405 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.157336 20425 raft_consensus.cc:1240] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:18.161598 21383 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:18.172778 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:18.175235 21423 raft_consensus.cc:3055] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:18.176362 21156 consensus_queue.cc:1059] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:18.240913 21350 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:18.180383 21430 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.183632 21313 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.184839 21440 raft_consensus.cc:2749] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:14:18.185043 21401 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:14:18.185985 21343 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:18.188380 21369 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:18.190155 21335 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.193297 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
W20260709 12:14:18.193629 21421 log.cc:927] Time spent T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 1.332s	user 0.010s	sys 0.025s
I20260709 12:14:18.196318 21408 raft_consensus.cc:3055] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.199331 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:18.201624 21412 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.202584 21429 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.171310 21329 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:18.205305 21353 raft_consensus.cc:740] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:18.204850 19666 rpcz_store.cc:276] 0709 12:14:16.617522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.617632 (+   110us) service_pool.cc:224] Handling call
0709 12:14:16.617919 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.768507 (+1150588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.115661 (+347154us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400391a54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:18.115845 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2588193024}
I20260709 12:14:18.204385 20433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 477) took 1976 ms. Trace:
I20260709 12:14:18.221206 19788 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:17.978101 21363 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:18.217245 21364 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.248875 19667 rpcz_store.cc:276] 0709 12:14:16.616329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.616530 (+   201us) service_pool.cc:224] Handling call
0709 12:14:16.616969 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.689725 (+ 72756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.087536 (+1397811us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b540004b354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:18.087712 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156128768}
I20260709 12:14:18.240667 21323 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:18.240576 21308 raft_consensus.cc:740] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
W20260709 12:14:18.248533 19714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.007s	sys 0.025s
I20260709 12:14:18.280630 21383 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:18.252197 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.249231 19823 raft_consensus.cc:1240] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:17.947584 21392 consensus_queue.cc:260] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:17.947427 21241 consensus_queue.cc:260] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:18.241902 21404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.020s	sys 0.014s
I20260709 12:14:18.240736 21357 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:18.240298 21426 raft_consensus.cc:3055] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:18.363643 20429 raft_consensus.cc:2393] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 2: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:18.377573 21365 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:18.312811 21436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.041s	sys 0.058s
I20260709 12:14:18.378204 21365 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:18.378234 21436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.048s	sys 0.063s
I20260709 12:14:18.376199 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:18.370232 21418 consensus_queue.cc:1059] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:14:18.379554 21308 consensus_queue.cc:260] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.380630 21392 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.381230 21308 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.375622 21343 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.384825 21439 raft_consensus.cc:993] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193: : Instructing follower 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
W20260709 12:14:18.385670 19714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.008s	sys 0.025s
I20260709 12:14:18.292346 21156 consensus_queue.cc:1243] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer b12c250fb1a244ed9a49cf86950af1bf log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:18.246845 21212 raft_consensus.cc:740] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:18.409998 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:18.411059 19823 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.392241 20433 rpcz_store.cc:276] 0709 12:14:16.227631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.227804 (+   173us) service_pool.cc:224] Handling call
0709 12:14:16.252163 (+ 24359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.769084 (+1516921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.204067 (+434983us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54003eba54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:18.204303 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3409318656}
I20260709 12:14:18.270512 21399 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:18.391634 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 170537us
I20260709 12:14:18.417270 19788 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:18.275513 21394 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:18.420217 19788 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:18.252373 21366 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.243088 21407 raft_consensus.cc:740] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:18.283133 21333 raft_consensus.cc:3060] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:18.382907 21404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.020s	sys 0.014s
I20260709 12:14:18.407837 21211 raft_consensus.cc:2749] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:18.285552 21367 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:18.427896 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 323155us
I20260709 12:14:18.293905 21423 raft_consensus.cc:740] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:18.413388 21156 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.364802 21337 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.374646 21401 consensus_queue.cc:1059] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:14:18.378736 21426 raft_consensus.cc:740] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:18.386353 21437 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.433410 19714 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:18.315589 21430 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:18.503070 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 69749.9us
I20260709 12:14:18.398356 21343 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:18.378644 21412 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.369733 21281 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.385516 21408 raft_consensus.cc:740] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:18.360090 21355 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:18.366295 21379 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.437772 19788 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:18.596572 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:18.597172 19673 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:18.597436 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 159773us
I20260709 12:14:18.441154 19821 raft_consensus.cc:1240] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:18.441860 19713 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:18.376389 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:18.385407 21439 raft_consensus.cc:1081] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Signalling peer 1f9fb1b1a86c4eb99abdbaf9d239e324 to start an election
I20260709 12:14:18.406435 21390 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:18.445322 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 361603us
W20260709 12:14:18.447366 20396 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.003s
W20260709 12:14:18.609906 20396 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.008s	sys 0.003s
W20260709 12:14:18.610291 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 678970us
I20260709 12:14:18.368212 21435 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.612995 21452 consensus_queue.cc:1059] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:14:18.614364 21452 raft_consensus.cc:3055] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:18.412820 21375 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:18.310992 21331 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.448529 19666 raft_consensus.cc:1240] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:18.614933 21211 raft_consensus.cc:3055] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:18.615665 21211 raft_consensus.cc:740] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:18.616394 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:18.616854 21388 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.468981 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:18.617682 19744 raft_consensus.cc:2393] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 2: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:18.616936 21211 consensus_queue.cc:260] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.417668 21396 consensus_queue.cc:1059] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:14:18.618844 21396 consensus_queue.cc:1243] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:18.490813 21431 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:18.618860 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.393158 21433 consensus_queue.cc:1175] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:18.621992 21331 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.423215 21374 consensus_queue.cc:1059] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:14:18.623225 21435 raft_consensus.cc:3055] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:18.623869 21435 raft_consensus.cc:740] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:18.608892 21390 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:18.494371 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.375250 21335 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.494451 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:18.449357 21313 consensus_queue.cc:1059] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.150s
I20260709 12:14:18.631614 19746 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.500468 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:18.458122 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:18.633860 20428 raft_consensus.cc:2393] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 2: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:18.448570 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:18.423599 21428 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:18.376187 21369 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.643364 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:18.538375 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:18.539997 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:18.645426 20432 raft_consensus.cc:1813] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Handling vote request from an unknown peer ca42d3c27d2e46348120791d1282b193
I20260709 12:14:18.645977 20432 raft_consensus.cc:2393] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:18.540567 19672 raft_consensus.cc:1240] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:18.543056 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:18.649296 21241 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.584645 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:18.534564 21156 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.652598 21408 consensus_queue.cc:260] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:18.585947 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:18.654904 20433 raft_consensus.cc:2393] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 3: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:18.488786 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:18.550706 21339 raft_consensus.cc:2804] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:18.591862 19823 raft_consensus.cc:2468] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
W20260709 12:14:18.592141 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.593194 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 81720.2us
I20260709 12:14:18.643843 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:18.660409 19749 raft_consensus.cc:1240] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:18.661170 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:18.436546 21336 raft_consensus.cc:2749] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:18.596175 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 54887.6us
W20260709 12:14:18.599460 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 157702us
I20260709 12:14:18.673775 19713 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
W20260709 12:14:18.602532 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.675163 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.429179 21399 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:18.605391 21432 raft_consensus.cc:2749] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:18.468179 21451 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.617101 19666 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:18.467797 21454 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:18.638196 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:18.653072 21156 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.584986 21412 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.603223 21357 raft_consensus.cc:2749] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:18.661950 19750 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:18.588620 21407 consensus_queue.cc:260] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.685853 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:18.489502 21423 consensus_queue.cc:260] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.687904 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:18.689191 19745 raft_consensus.cc:1275] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:18.606007 21363 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:18.640290 21415 consensus_meta.cc:287] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.303s	user 0.008s	sys 0.008s
I20260709 12:14:18.614764 21452 raft_consensus.cc:740] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:18.537285 21437 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.470909 21353 consensus_queue.cc:260] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:18.963462 19638 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:18.775102 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 83216.3us
I20260709 12:14:18.969120 21415 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.970341 19668 raft_consensus.cc:1240] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:18.970484 21460 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.971210 21460 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:18.971644 21415 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:18.881495 21313 raft_consensus.cc:3055] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.972770 21313 raft_consensus.cc:740] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:18.973125 19669 raft_consensus.cc:1813] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Handling vote request from an unknown peer ca42d3c27d2e46348120791d1282b193
I20260709 12:14:18.973778 19669 raft_consensus.cc:2410] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:18.973929 21460 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:18.973827 21313 consensus_queue.cc:260] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:18.931934 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 258290us
I20260709 12:14:18.980890 19713 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:18.885915 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:18.987603 19673 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:18.976743 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:18.903338 21435 consensus_queue.cc:260] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:18.929458 19747 raft_consensus.cc:1240] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:18.928681 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 321771us
W20260709 12:14:18.933235 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.831662 19746 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:19.008534 19788 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:18.988202 19748 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:18.976034 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:18.671555 21349 consensus_meta.cc:287] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.000s
I20260709 12:14:19.008644 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:19.017887 19745 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.606894 21383 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:19.019481 21419 raft_consensus.cc:2804] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:19.019619 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:19.020066 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:18.656530 21369 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:19.007225 19666 raft_consensus.cc:1275] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.993642 20428 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:18.976003 21313 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:19.007800 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:19.014935 19713 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:19.015668 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 52346.8us
I20260709 12:14:18.989423 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:19.005841 19675 raft_consensus.cc:1240] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:18.886318 21264 raft_consensus.cc:2749] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:18.995348 21413 consensus_meta.cc:287] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.225s	user 0.007s	sys 0.007s
I20260709 12:14:19.032442 19675 raft_consensus.cc:1240] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.034086 19788 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:19.009299 21392 consensus_meta.cc:287] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.000s
I20260709 12:14:18.659539 21365 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.035967 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:18.720742 19743 raft_consensus.cc:1240] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.038712 20427 raft_consensus.cc:1240] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.015612 21412 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.001708 21460 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:19.040520 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:19.063419 19746 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:19.041496 19666 raft_consensus.cc:1240] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:19.042199 21399 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:18.718470 21212 consensus_queue.cc:260] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.042462 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:19.069401 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:19.044202 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.898003 21390 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:19.073838 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.074743 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:19.075917 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:18.888149 21335 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:18.968037 21408 raft_consensus.cc:3060] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.812542 21394 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:18.994735 21211 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.882018 21339 raft_consensus.cc:697] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:19.014695 21440 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.020084 21419 raft_consensus.cc:697] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:19.052068 19668 raft_consensus.cc:1240] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:19.094010 19714 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:19.053555 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:19.025020 21156 raft_consensus.cc:2749] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:18.722398 21366 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.097113 21212 raft_consensus.cc:3060] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:19.097524 21364 consensus_meta.cc:287] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.000s
I20260709 12:14:19.098688 21459 raft_consensus.cc:2804] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:19.099682 21456 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:19.099336 21390 consensus_queue.cc:1059] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:19.060091 19788 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:18.977329 21452 consensus_queue.cc:260] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.020839 21423 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.825006 21430 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.065265 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:18.889271 21442 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.066638 19745 raft_consensus.cc:2468] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:19.120069 19745 raft_consensus.cc:1240] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:19.121285 19745 raft_consensus.cc:1240] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.088769 21414 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:19.043196 21383 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:19.069780 19713 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:19.126080 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 57264.1us
I20260709 12:14:19.083241 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:19.060596 21357 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:19.085176 19672 raft_consensus.cc:1275] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:19.085191 20397 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:19.087128 19673 raft_consensus.cc:1275] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:19.062774 21435 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:19.099339 21459 raft_consensus.cc:697] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:19.067839 21415 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:19.090615 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.096242 19667 raft_consensus.cc:1275] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:19.143846 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.017279 21353 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:19.103470 19788 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:19.049373 20433 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:19.032786 21454 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.123826 19744 raft_consensus.cc:1240] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.158828 19824 raft_consensus.cc:1240] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:19.159440 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:19.159978 21454 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.160604 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:19.161696 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:19.126132 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:19.163126 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.163180 21339 consensus_queue.cc:237] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.164178 19789 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:19.166761 19819 raft_consensus.cc:1240] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.167124 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:19.167536 21365 raft_consensus.cc:2804] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:19.168021 21365 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.168378 21365 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:19.078547 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:19.169035 19747 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:19.126972 19713 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:19.169950 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:19.171384 19747 raft_consensus.cc:1240] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.171733 19713 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:19.022866 21426 consensus_queue.cc:260] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.069105 21460 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.093690 21374 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.173154 21374 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.174392 21460 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:19.100952 21428 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.074944 21264 consensus_queue.cc:1059] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 12:14:19.175387 21308 consensus_meta.cc:287] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.794s	user 0.013s	sys 0.000s
I20260709 12:14:19.175156 21428 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.172490 19747 raft_consensus.cc:1240] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.141031 21367 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.177435 21428 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:19.178539 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:19.178956 21454 consensus_queue.cc:1059] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:19.182386 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.182643 21349 raft_consensus.cc:2749] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:19.183207 19820 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:19.182456 19713 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:19.184439 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.104592 21399 raft_consensus.cc:3055] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:19.184912 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.185331 21399 raft_consensus.cc:740] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:19.185765 19815 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:19.068094 21407 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:19.190404 19815 raft_consensus.cc:1240] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:19.162686 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:19.139619 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.100286 21456 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.207616 19815 raft_consensus.cc:1275] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:19.090150 21335 consensus_queue.cc:1059] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:14:19.109661 21156 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.216172 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:19.100899 21390 consensus_queue.cc:1059] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:14:19.218995 19750 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:19.133327 21364 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:19.154167 21281 raft_consensus.cc:2749] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.120461 21355 raft_consensus.cc:2749] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.155306 19743 raft_consensus.cc:1240] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:19.156247 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.156548 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.156859 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:19.232771 19823 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:19.157326 19741 raft_consensus.cc:1240] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.158074 21402 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:19.168243 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:19.137290 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 52193.1us
I20260709 12:14:19.134280 19745 raft_consensus.cc:1240] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:19.196040 19789 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:19.195886 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:19.195814 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:19.175413 21374 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:19.209949 19818 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:18.977886 21451 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.138386 19714 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:19.259521 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 121207us
I20260709 12:14:19.260515 19714 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:19.146347 19749 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
 from {username='slave'} at 127.0.0.1:36924
I20260709 12:14:19.227139 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.261518 19749 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:19.129339 21442 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.103885 21392 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
W20260709 12:14:19.247107 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 52460us
I20260709 12:14:19.203501 21363 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:19.197306 19744 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
W20260709 12:14:19.227929 21436 log.cc:927] Time spent T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:14:19.250092 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:19.249080 20397 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:19.278177 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.280922 20397 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:19.257262 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.281313 19821 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:19.281769 19819 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:19.218135 21337 raft_consensus.cc:2749] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:19.101155 21440 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.262101 19749 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:19.289438 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:19.291257 21440 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:19.261632 19815 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:19.138011 21414 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.136389 21431 raft_consensus.cc:2804] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:19.289489 21343 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:19.293114 21335 raft_consensus.cc:2749] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.269600 19789 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:19.141351 21383 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.296473 21426 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:19.215320 21212 consensus_queue.cc:1048] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:14:19.208261 21415 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.299817 19789 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:19.285311 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.301497 19819 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:19.302711 21212 raft_consensus.cc:2804] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:19.291590 19572 catalog_manager.cc:5697] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 reported cstate change: config changed from index 3 to 4, b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:19.304414 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:19.303236 19638 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:19.306063 21464 raft_consensus.cc:2804] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:19.255898 21345 raft_consensus.cc:2804] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:19.280433 21363 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.244827 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:19.241576 21429 consensus_meta.cc:287] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.859s	user 0.002s	sys 0.010s
I20260709 12:14:19.295068 21281 raft_consensus.cc:2804] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:19.303287 21212 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.311637 21281 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:19.312148 20424 raft_consensus.cc:2393] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 2: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:19.312227 21281 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:19.313298 21363 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.313871 19824 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:19.310220 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:19.306408 19638 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:19.315092 19819 raft_consensus.cc:2376] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2. Re-sending same reply.
I20260709 12:14:19.316145 21433 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:19.316716 21433 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.317133 21433 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:19.306486 21464 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.319231 21464 raft_consensus.cc:3060] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:19.276170 21392 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.319235 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:19.219503 21413 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.280248 21394 consensus_queue.cc:1059] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:14:19.322086 21413 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.321380 21429 consensus_queue.cc:1059] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:14:19.323596 21429 raft_consensus.cc:3055] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:19.323971 21429 raft_consensus.cc:740] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:19.323837 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.324810 21429 consensus_queue.cc:260] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.325449 21212 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:19.326234 21429 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:19.263835 21156 raft_consensus.cc:2804] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:19.328701 21156 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.329156 21156 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:19.327102 21447 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.331274 21343 raft_consensus.cc:697] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:19.331532 21447 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.281162 21419 consensus_queue.cc:237] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.332424 21343 consensus_queue.cc:237] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.335270 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:19.262852 21388 consensus_meta.cc:287] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.000s
I20260709 12:14:19.336272 21440 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.336851 21440 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.337600 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:19.340839 21440 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:19.341429 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:19.292377 21369 consensus_queue.cc:1059] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:19.344082 19823 raft_consensus.cc:1275] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:19.306712 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:19.346539 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.347200 19823 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:19.347400 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:19.353919 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.354915 19823 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:19.322660 19749 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.212674 21452 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:19.345216 21459 consensus_queue.cc:237] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.242007 21364 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:19.376608 21333 consensus_meta.cc:287] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.938s	user 0.009s	sys 0.004s
I20260709 12:14:19.311235 21458 raft_consensus.cc:2749] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:19.364104 21367 raft_consensus.cc:3055] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:19.362355 21337 raft_consensus.cc:2749] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.435402 19821 raft_consensus.cc:1275] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:19.449793 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.440163 21264 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:19.485844 21462 log.cc:927] Time spent T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.379s	user 0.000s	sys 0.002s
I20260709 12:14:19.408303 21212 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.487085 21415 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:19.428922 21366 consensus_queue.cc:1059] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:14:19.471568 21414 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.501641 21456 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.507110 21437 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.509407 21460 raft_consensus.cc:3055] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:19.523769 21392 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.497485 21399 consensus_queue.cc:260] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.526328 21413 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:19.528064 19667 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:19.629410 19640 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:19.612812 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:19.630677 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.439478 21367 raft_consensus.cc:740] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:19.534236 19749 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.535851 19670 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:19.536707 19824 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:19.549381 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.632170 21367 consensus_queue.cc:260] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.632544 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.633374 21367 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:19.566044 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 276991us
I20260709 12:14:19.635412 19675 raft_consensus.cc:1275] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:19.635742 19823 raft_consensus.cc:1275] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:19.638067 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.566771 21472 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:19.638744 19823 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
W20260709 12:14:19.640115 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.433202 21440 consensus_queue.cc:1059] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 12:14:19.590965 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.594259 19666 raft_consensus.cc:1240] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:19.567534 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.568601 21431 raft_consensus.cc:697] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:19.651410 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 107566us
I20260709 12:14:19.569262 19669 raft_consensus.cc:1240] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.571631 19673 raft_consensus.cc:2468] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:19.572961 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.652688 20396 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
W20260709 12:14:19.579281 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 389703us
I20260709 12:14:19.653951 19788 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:19.544083 21264 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.654503 19713 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:19.577714 21435 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:19.642748 21405 consensus_meta.cc:287] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.354s	user 0.009s	sys 0.023s
I20260709 12:14:19.645531 19640 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:19.646303 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.627533 21366 consensus_queue.cc:1243] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer f662c4f7d6a74013a1e58a5330a049b8 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:19.649343 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.657197 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.688458 19815 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
W20260709 12:14:19.657451 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.659394 19788 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:19.673225 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.670854 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:19.585592 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:19.624941 21345 raft_consensus.cc:697] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:19.634433 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.713541 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:19.713873 21211 consensus_meta.cc:287] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.624s	user 0.014s	sys 0.006s
I20260709 12:14:19.714581 19670 raft_consensus.cc:2393] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 3: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:19.719832 21357 raft_consensus.cc:2749] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:19.682008 19640 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:19.648634 19672 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:19.723029 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.723596 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:19.724305 21423 consensus_meta.cc:287] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.002s
I20260709 12:14:19.724534 19672 raft_consensus.cc:2393] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 2: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:19.725441 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.725685 21390 raft_consensus.cc:3055] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:19.726089 21390 raft_consensus.cc:740] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:19.726979 21469 raft_consensus.cc:2804] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:19.727677 21469 raft_consensus.cc:697] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:19.728694 21469 consensus_queue.cc:237] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.680912 19823 raft_consensus.cc:2468] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:19.732409 21455 consensus_queue.cc:1059] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:19.733858 21455 raft_consensus.cc:3055] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:19.734236 21455 raft_consensus.cc:740] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:19.686336 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:19.689862 19742 raft_consensus.cc:1813] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Handling vote request from an unknown peer f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:19.677929 19713 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:19.689996 19750 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:19.691190 19667 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:19.640677 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:19.739537 19742 raft_consensus.cc:2410] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:14:19.726634 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.692970 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:19.742715 20425 raft_consensus.cc:2393] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 2: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:19.740116 21458 raft_consensus.cc:2749] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.693420 21281 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.678472 21399 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:19.693936 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.673836 21415 raft_consensus.cc:2749] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:19.650676 21363 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.695658 20426 raft_consensus.cc:1240] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:19.642493 21437 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:19.679085 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.715935 19638 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:19.718698 21413 consensus_queue.cc:1048] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:14:19.719249 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 59966.3us
I20260709 12:14:19.727057 21390 consensus_queue.cc:260] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.735286 20429 raft_consensus.cc:2393] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 3: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
W20260709 12:14:19.736318 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 58515.4us
I20260709 12:14:19.740931 21364 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:19.683416 21467 raft_consensus.cc:2749] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:19.692131 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:19.740818 19672 raft_consensus.cc:2468] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:19.674391 21264 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:19.743176 20424 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
W20260709 12:14:19.785569 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.627005 21460 raft_consensus.cc:740] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:19.746693 19817 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
W20260709 12:14:19.747692 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.748435 19668 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:19.681406 21374 raft_consensus.cc:2804] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:19.752457 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.756690 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.791823 19675 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
W20260709 12:14:19.774978 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 59193.1us
I20260709 12:14:19.793380 19638 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:19.774679 19713 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:19.684837 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:19.794649 20433 raft_consensus.cc:2393] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 3: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:19.740037 21383 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.774842 21451 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:19.807879 19569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47152 (request call id 257) took 5101 ms. Trace:
I20260709 12:14:19.683756 21435 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.785346 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.812778 19672 raft_consensus.cc:2393] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 4: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:19.683805 21456 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:19.674173 21392 consensus_queue.cc:1059] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:14:19.781957 19640 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
W20260709 12:14:19.779765 21353 consensus_meta.cc:287] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.632s	user 0.014s	sys 0.009s
I20260709 12:14:19.790639 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:19.792762 20427 raft_consensus.cc:2393] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 2: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:19.780110 21430 raft_consensus.cc:2804] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:19.755076 19741 raft_consensus.cc:3055] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:19.852946 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.778473 21367 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:19.775969 21343 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:19.809741 21374 raft_consensus.cc:697] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
W20260709 12:14:19.813537 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 160911us
I20260709 12:14:19.859496 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.859916 20396 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:19.758498 21363 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.860787 20396 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:19.821905 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.831132 20429 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:19.831301 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.744626 21455 consensus_queue.cc:260] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.837774 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.789613 21423 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.790087 21442 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:19.839293 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.775576 21437 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.848644 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.779222 21431 consensus_queue.cc:237] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.842805 19640 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:19.929558 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 164048us
W20260709 12:14:19.985782 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 143071us
I20260709 12:14:19.963544 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:19.943547 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:19.988226 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.782915 21458 consensus_queue.cc:1048] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:14:19.854344 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.807250 21281 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:19.812373 21388 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.849130 21339 consensus_queue.cc:1048] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.145s
I20260709 12:14:19.994081 21388 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:19.995433 19557 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 62ed1b9937fd41ab83a0000603a38fc9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f9fb1b1a86c4eb99abdbaf9d239e324 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:19.810770 19638 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:19.858857 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.838976 21470 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:19.861934 21433 consensus_meta.cc:287] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.008s
W20260709 12:14:19.924925 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 64215.7us
I20260709 12:14:19.841684 21417 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:19.826635 21467 raft_consensus.cc:2804] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:19.857972 21241 consensus_meta.cc:287] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 1.205s	user 0.014s	sys 0.000s
I20260709 12:14:20.017640 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:20.017889 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:19.814504 21345 consensus_queue.cc:237] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.019352 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:20.025031 19821 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:20.026979 20429 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
W20260709 12:14:20.022318 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.032110 19817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:56904
I20260709 12:14:20.032627 19817 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:20.032969 19817 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:19.952631 21479 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:20.019937 21440 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.034518 21440 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.987910 19672 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:19.991336 19746 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:20.037065 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 1078) took 1154 ms. Trace:
I20260709 12:14:20.037415 19747 raft_consensus.cc:1275] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:20.037547 19823 raft_consensus.cc:1275] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:20.039208 20396 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
W20260709 12:14:20.039880 21426 consensus_meta.cc:287] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.743s	user 0.014s	sys 0.007s
I20260709 12:14:20.040216 21472 raft_consensus.cc:2804] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:20.040621 21472 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.040966 21472 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.042946 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:20.044106 19742 raft_consensus.cc:1275] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:20.037417 19746 rpcz_store.cc:276] 0709 12:14:18.882610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.064033 (+181423us) service_pool.cc:224] Handling call
0709 12:14:20.036899 (+972866us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54000eced4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:20.037014 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1648054144}
I20260709 12:14:20.045620 21374 consensus_queue.cc:237] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.992698 19657 tablet_service.cc:1558] Processing DeleteTablet for tablet 613b9bd906514e3684eb97813eda93a5 with delete_type TABLET_DATA_TOMBSTONED (TS f662c4f7d6a74013a1e58a5330a049b8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:48638
W20260709 12:14:19.853583 19714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.014s	sys 0.009s
I20260709 12:14:19.833642 21383 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 12:14:19.856076 19741 raft_consensus.cc:740] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:20.003077 21434 raft_consensus.cc:2804] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:20.061355 21434 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.830494 21464 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:20.005452 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 194789us
I20260709 12:14:20.067291 19638 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:19.861722 21365 consensus_meta.cc:287] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.693s	user 0.013s	sys 0.000s
W20260709 12:14:20.006240 19557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 147478us
W20260709 12:14:19.863306 21407 consensus_meta.cc:287] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.677s	user 0.001s	sys 0.011s
I20260709 12:14:20.002444 21470 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:20.007875 21331 raft_consensus.cc:2804] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:20.007880 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:20.009052 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:19.922065 21335 raft_consensus.cc:2804] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:19.849382 21468 consensus_queue.cc:1048] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 12:14:20.010514 19819 raft_consensus.cc:2368] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4.
I20260709 12:14:20.094332 19638 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:19.848902 21430 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:19.810001 19569 rpcz_store.cc:276] 0709 12:14:14.689623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.699380 (+  9757us) service_pool.cc:224] Handling call
0709 12:14:19.790632 (+5091252us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:16.520050 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:16.665795 (+145745us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:16.672936 (+  7141us) write_op.cc:435] Acquired schema lock
0709 12:14:16.672956 (+    20us) tablet.cc:662] Decoding operations
0709 12:14:16.673393 (+   437us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:16.673487 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:16.673517 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:14:16.673842 (+   325us) tablet.cc:701] Row locks acquired
0709 12:14:16.673862 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:14:16.674001 (+   139us) write_op.cc:270] Start()
0709 12:14:16.674121 (+   120us) write_op.cc:276] Timestamp: P: 1783599256673961 usec, L: 0
0709 12:14:16.674146 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:14:16.825949 (+151803us) log.cc:844] Serialized 925 byte log entry
0709 12:14:18.492814 (+1666865us) op_driver.cc:464] REPLICATION: finished
0709 12:14:19.001005 (+508191us) write_op.cc:301] APPLY: starting
0709 12:14:19.001087 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:19.001204 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:19.001327 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:19.047775 (+ 46448us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:19.076407 (+ 28632us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:14:19.084437 (+  8030us) write_op.cc:312] APPLY: finished
0709 12:14:19.106551 (+ 22114us) log.cc:844] Serialized 29 byte log entry
0709 12:14:19.117343 (+ 10792us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:19.129146 (+ 11803us) write_op.cc:454] Released schema lock
0709 12:14:19.133260 (+  4114us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:19.246942 (+113682us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:19.251078 (+  4136us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":74395,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":507861,"apply.run_cpu_time_us":3383,"apply.run_wall_time_us":217304,"num_ops":2,"prepare.queue_time_us":29131,"prepare.run_cpu_time_us":35683,"prepare.run_wall_time_us":955774,"raft.queue_time_us":1057179,"raft.run_cpu_time_us":135072,"raft.run_wall_time_us":192923,"replication_time_us":1818420,"thread_start_us":1423836,"threads_started":5,"wal-append.queue_time_us":567613}]]}
I20260709 12:14:20.017303 21467 raft_consensus.cc:697] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:20.095295 19819 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:20.033730 21479 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
W20260709 12:14:19.920562 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:20.085789 21313 consensus_meta.cc:287] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 1.038s	user 0.022s	sys 0.003s
I20260709 12:14:20.083846 21470 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.048743 19823 raft_consensus.cc:1240] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:20.047749 19714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.014s	sys 0.009s
I20260709 12:14:20.083567 21392 raft_consensus.cc:2804] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:20.010416 21417 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.095050 21335 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.047940 21455 raft_consensus.cc:3060] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:19.862522 21343 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:19.952005 21423 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.056098 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:20.116194 21479 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.016201 21433 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:19.856592 21466 consensus_queue.cc:1048] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.216s
I20260709 12:14:20.124836 21392 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.092607 21363 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.061857 21434 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:20.049777 19715 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:20.128543 21417 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.141690 21313 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:20.122967 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 862480us
I20260709 12:14:19.952333 21396 consensus_queue.cc:1059] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.128s
I20260709 12:14:20.121608 21480 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:14:20.083266 21331 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:20.125365 19817 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.114028 21430 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.079864 21426 consensus_queue.cc:1048] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:14:20.113796 21419 raft_consensus.cc:2749] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:20.090121 21454 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.135282 19666 raft_consensus.cc:1240] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:20.087338 19818 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:20.080178 21365 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.047364 21460 consensus_queue.cc:260] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.124022 21407 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.167094 21407 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:20.141186 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 91532.5us
I20260709 12:14:20.118176 19713 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:20.096113 19638 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:20.130154 21335 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:20.135663 21402 consensus_meta.cc:287] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.878s	user 0.000s	sys 0.012s
I20260709 12:14:20.150918 21331 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:20.172549 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 54486.8us
I20260709 12:14:20.164597 19822 raft_consensus.cc:1240] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:20.166152 21156 consensus_meta.cc:287] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.837s	user 0.017s	sys 0.011s
I20260709 12:14:20.142470 21392 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:20.174503 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 78498.4us
I20260709 12:14:20.173508 19713 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:20.178077 19788 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:20.182689 19675 raft_consensus.cc:1275] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:20.185842 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.193861 21442 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.197096 19820 raft_consensus.cc:2368] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5.
I20260709 12:14:20.158998 21336 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.203800 19820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60644 (request call id 182) took 1008 ms. Trace:
I20260709 12:14:20.204646 19820 rpcz_store.cc:276] 0709 12:14:19.195143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.195588 (+   445us) service_pool.cc:224] Handling call
0709 12:14:20.198612 (+1003024us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400022454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:20.203714 (+  5102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184098688}
I20260709 12:14:20.159199 21313 raft_consensus.cc:697] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:20.185460 21469 raft_consensus.cc:2804] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:20.115175 19741 consensus_queue.cc:260] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.175578 21435 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.183951 21414 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.175966 21451 raft_consensus.cc:2749] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:20.157102 21366 consensus_queue.cc:1048] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:14:20.168423 21458 consensus_queue.cc:1059] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:14:20.194438 21442 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.172057 21454 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.181788 21485 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:20.199231 21337 consensus_queue.cc:1059] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
W20260709 12:14:20.341022 20396 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.729s (SENT) [suppressed 10 similar messages]
I20260709 12:14:20.195070 21156 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.268599 21469 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.367479 19714 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:20.195926 21467 consensus_queue.cc:237] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:20.294258 21408 consensus_meta.cc:287] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.207s	user 0.014s	sys 0.011s
I20260709 12:14:20.276800 21459 consensus_queue.cc:1059] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 12:14:20.231688 21486 raft_consensus.cc:2749] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:20.414913 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1096) took 1267 ms. Trace:
I20260709 12:14:20.223421 21336 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.411772 20397 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:20.412390 19788 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:20.419833 19788 leader_election.cc:304] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:20.413520 19671 raft_consensus.cc:2468] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:20.414034 19744 raft_consensus.cc:3055] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:20.405835 19820 raft_consensus.cc:1240] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:20.415495 19747 rpcz_store.cc:276] 0709 12:14:19.147750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.177894 (+ 30144us) service_pool.cc:224] Handling call
0709 12:14:20.037037 (+859143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.037992 (+   955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.408021 (+370029us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54000eced0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:20.414839 (+  6818us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975172864}
I20260709 12:14:20.421205 19744 raft_consensus.cc:740] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:20.411532 21429 consensus_meta.cc:287] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.045s	user 0.012s	sys 0.000s
I20260709 12:14:20.403713 21491 tablet_replica.cc:333] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:20.401023 21469 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.419122 21485 raft_consensus.cc:2749] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:20.417289 21458 consensus_queue.cc:1048] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:14:20.416913 21464 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.416023 21431 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:20.427350 21264 consensus_meta.cc:287] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.628s	user 0.006s	sys 0.005s
I20260709 12:14:20.427417 21407 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.354148 21313 consensus_queue.cc:237] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.427685 19788 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:20.423645 21459 consensus_queue.cc:1243] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Peer f662c4f7d6a74013a1e58a5330a049b8 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:20.445111 21423 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.278128 21414 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.436323 21365 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.434672 21369 raft_consensus.cc:2804] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:20.419219 21482 log.cc:927] Time spent T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 12:14:20.446537 21369 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.419931 21419 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.444967 21343 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.442737 21264 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.452196 19788 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:20.452621 21454 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.452963 21407 raft_consensus.cc:2804] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:20.439905 21433 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.432972 19744 consensus_queue.cc:260] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.434149 21435 raft_consensus.cc:2749] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:20.437274 21486 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:20.482733 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 97087.1us
I20260709 12:14:20.485244 21447 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.486290 21442 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.431597 21374 consensus_queue.cc:1048] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:14:20.458518 21369 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:20.489120 21487 log.cc:927] Time spent T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
W20260709 12:14:20.500551 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.501570 19714 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:20.501415 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 78850.4us
W20260709 12:14:20.503055 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 162083us
I20260709 12:14:20.512844 19714 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:20.514854 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.497958 21357 raft_consensus.cc:2804] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:20.497805 21281 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.517140 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:20.458976 21470 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.518956 19713 leader_election.cc:400] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) with higher term. Message: Invalid argument: T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4.
I20260709 12:14:20.499922 21407 raft_consensus.cc:697] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:20.500119 21365 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.483213 21419 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.500365 21363 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.571574 21363 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:20.575621 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.579260 19744 raft_consensus.cc:3060] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:20.502966 21486 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.524760 19713 leader_election.cc:403] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:20.528291 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:20.525710 21281 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.528327 21412 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.501642 21494 consensus_queue.cc:1048] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:14:20.532014 21489 log.cc:927] Time spent T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:14:20.532824 21337 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.538087 21392 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.539139 21156 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.541565 21417 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.520175 21396 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:20.543572 21331 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.527807 21434 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.545298 21369 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.545403 21470 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.546988 21407 consensus_queue.cc:237] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.505487 21451 consensus_queue.cc:1048] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:14:20.550016 21264 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.519929 21357 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:20.502758 21454 consensus_queue.cc:1048] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:14:20.564931 21447 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:20.565771 21419 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.568686 21355 raft_consensus.cc:2749] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:20.568708 21365 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:20.597121 21452 consensus_meta.cc:287] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 1.217s	user 0.007s	sys 0.008s
I20260709 12:14:20.603708 20427 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:20.587069 21363 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:20.615926 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 103111us
I20260709 12:14:20.666766 20398 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:20.619243 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 111752us
I20260709 12:14:20.585222 21486 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.673164 21442 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:20.623009 21396 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.623225 21374 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.675048 21374 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.676986 21374 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.679142 21335 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.615186 21467 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:14:20.621925 21472 consensus_meta.cc:287] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.004s
I20260709 12:14:20.654754 21369 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.640676 21331 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.640568 21447 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.641410 21392 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.641932 21281 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.694406 19744 raft_consensus.cc:1275] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:20.695266 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1103) took 1110 ms. Trace:
I20260709 12:14:20.695537 19744 rpcz_store.cc:276] 0709 12:14:19.584531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.584707 (+   176us) service_pool.cc:224] Handling call
0709 12:14:19.660511 (+ 75804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.413884 (+753373us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b54004a2020. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf47811c0 00007fadf4782231 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c
0709 12:14:20.578885 (+165001us) spinlock_profiling.cc:243] Waited 78.4 ms on lock 0x7b58001589d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46db0aa 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4
0709 12:14:20.694973 (+116088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.695217 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246864000}
I20260709 12:14:20.645395 21365 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.646055 19821 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
W20260709 12:14:20.650810 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.694073 21472 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.699102 21447 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.653658 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:20.639377 21430 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.634670 21357 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.700071 21335 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.700502 21472 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.701606 21430 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.702176 21431 raft_consensus.cc:2749] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:20.702381 19668 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:20.674475 21485 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:20.703131 21485 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.704360 19668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 182) took 1008 ms. Trace:
I20260709 12:14:20.704720 19668 rpcz_store.cc:276] 0709 12:14:19.696433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.009795 (+313362us) service_pool.cc:224] Handling call
0709 12:14:20.704183 (+694388us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400188dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:20.704301 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572400384}
W20260709 12:14:20.705156 21399 consensus_meta.cc:287] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.950s	user 0.013s	sys 0.001s
I20260709 12:14:20.705323 21485 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.683147 21156 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:20.706044 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:20.707012 19670 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:20.684306 21396 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:20.685139 21496 log.cc:927] Time spent T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:14:20.638520 21470 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:20.708571 21495 log.cc:927] Time spent T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.263s	user 0.000s	sys 0.002s
I20260709 12:14:20.708920 21470 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.709257 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:20.709827 19822 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:20.683398 21417 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.711112 21470 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.711185 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:20.711877 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:20.712692 21349 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:14:20.687625 19675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1754) took 1056 ms. Trace:
I20260709 12:14:20.706187 21156 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.713119 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:20.640374 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:20.713773 19819 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.658577 21479 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.713490 19675 rpcz_store.cc:276] 0709 12:14:19.631303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.081687 (+450384us) service_pool.cc:224] Handling call
0709 12:14:20.111760 (+ 30073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.183280 (+ 71520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.687339 (+504059us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b540004a954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:20.687550 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161472896}
I20260709 12:14:20.712013 19674 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:20.714956 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:20.719120 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:20.705924 21367 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.685487 21440 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.717239 19748 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:20.708523 19670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 180) took 1043 ms. Trace:
I20260709 12:14:20.725239 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:20.717468 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.725979 20429 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:20.714140 20425 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:20.727567 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:20.728245 20429 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:20.707031 19668 raft_consensus.cc:2468] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:20.719765 19675 raft_consensus.cc:2468] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:20.719849 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:20.725590 19822 raft_consensus.cc:2393] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 4: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:20.731976 19674 raft_consensus.cc:2393] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:20.724617 21367 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.732725 21156 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.732920 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:20.733592 19674 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:20.733942 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:20.725455 19670 rpcz_store.cc:276] 0709 12:14:19.664663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.722598 (+ 57935us) service_pool.cc:224] Handling call
0709 12:14:20.708344 (+985746us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54002387d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:20.708457 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260774784}
I20260709 12:14:20.734760 19822 raft_consensus.cc:2468] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:20.735347 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:20.735967 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:20.737376 21502 log.cc:927] Time spent T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:14:20.737670 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:20.727346 21434 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.738857 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:20.739192 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:20.740955 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:20.741634 21365 consensus_queue.cc:1059] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:20.736014 20433 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:20.744426 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 46156.2us
I20260709 12:14:20.747152 19823 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.734431 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:20.735460 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:20.750571 19674 raft_consensus.cc:3055] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:20.750775 19670 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.751237 21366 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.751825 21366 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.752804 20396 leader_election.cc:400] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Vote denied by peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) with higher term. Message: Invalid argument: T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5.
I20260709 12:14:20.753206 20396 leader_election.cc:403] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:14:20.754858 21440 consensus_queue.cc:1059] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:20.757258 21343 raft_consensus.cc:3055] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:20.757683 21343 raft_consensus.cc:740] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:20.750963 19674 raft_consensus.cc:740] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:20.758677 21212 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.758569 21343 consensus_queue.cc:260] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.759982 21343 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.754890 20396 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:20.766732 19715 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:20.767051 20396 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:20.768532 20396 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
W20260709 12:14:20.769601 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 76778.2us
I20260709 12:14:20.769918 19715 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:20.770200 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:20.771045 19821 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:20.771883 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:20.772406 19821 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.769066 21454 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:20.775676 21454 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.778030 21454 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.778348 21339 raft_consensus.cc:2804] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:20.779537 21357 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.782218 21339 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.782832 21339 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.773489 21156 raft_consensus.cc:3055] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:20.802510 19742 raft_consensus.cc:1240] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:20.802640 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:20.803007 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:20.803256 21335 raft_consensus.cc:2749] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:20.803422 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:20.806427 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:20.806553 19823 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:20.806995 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:20.807291 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:20.807634 20433 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
I20260709 12:14:20.807811 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:20.803753 19824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60644 (request call id 179) took 1642 ms (client timeout 1729 ms). Trace:
I20260709 12:14:20.783025 21478 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:20.804949 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:20.809466 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:20.810503 19747 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
I20260709 12:14:20.809001 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:20.803682 21442 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:20.808043 19750 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:20.812461 19749 raft_consensus.cc:3055] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:14:20.808543 19824 rpcz_store.cc:269] 0709 12:14:19.161354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.178280 (+ 16926us) service_pool.cc:224] Handling call
0709 12:14:20.803585 (+1625305us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400024254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:20.803693 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309381888}
I20260709 12:14:20.812966 19749 raft_consensus.cc:740] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:20.813596 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:20.812728 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:20.809994 21440 raft_consensus.cc:2749] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) with higher term. Message: Invalid argument: T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5.
I20260709 12:14:20.810120 21156 raft_consensus.cc:740] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:20.802640 19734 tablet_service.cc:1558] Processing DeleteTablet for tablet a61494383461482b9ddf0e4f6ceb4323 with delete_type TABLET_DATA_TOMBSTONED (TS ca42d3c27d2e46348120791d1282b193 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36920
I20260709 12:14:20.815062 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:20.821826 19824 raft_consensus.cc:1275] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:20.810381 21281 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.815752 21442 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:20.826912 21442 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.826728 21281 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.828193 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:20.828965 19824 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.829164 19747 raft_consensus.cc:1275] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:20.822320 19819 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:20.811667 21478 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.832472 21478 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.833084 21437 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.833238 21281 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.823469 19817 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.834113 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:20.836730 21357 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.828575 19743 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:20.818117 21156 consensus_queue.cc:260] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.825230 19823 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:20.825268 19822 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:20.811898 21313 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:20.830142 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:20.830907 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 61054.4us
I20260709 12:14:20.831470 20396 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:20.842134 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:20.825273 19821 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:20.811033 19742 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.828804 19749 consensus_queue.cc:260] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.834445 21485 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:20.868690 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:20.869379 19819 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:20.871233 19819 raft_consensus.cc:1240] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:20.868090 19789 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
W20260709 12:14:20.828131 21455 consensus_meta.cc:287] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.694s	user 0.007s	sys 0.006s
I20260709 12:14:20.872865 21313 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.727864 21407 consensus_queue.cc:1048] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.136s
I20260709 12:14:20.878453 19824 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:20.881829 19819 raft_consensus.cc:1240] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:20.882027 19789 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:20.850885 21494 raft_consensus.cc:2804] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:20.886987 21494 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.885164 21281 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:20.888602 21494 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.886408 19789 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:20.887030 21504 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:20.842163 21498 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:20.885502 21469 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.888911 21281 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.871105 21335 raft_consensus.cc:2804] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:20.893779 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:20.898383 20433 raft_consensus.cc:2393] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:20.896948 21281 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.899006 21367 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.901259 21367 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.906168 21467 raft_consensus.cc:2749] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) with higher term. Message: Invalid argument: T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4.
I20260709 12:14:20.872352 21485 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:20.908442 21469 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:20.883540 21476 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.916353 21313 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.891031 21504 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:20.917547 21504 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.897193 21357 raft_consensus.cc:2804] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:20.897749 21156 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:20.897413 21498 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.911835 21485 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.914443 21335 raft_consensus.cc:697] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:20.922577 21476 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.925711 21357 raft_consensus.cc:697] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:20.942256 21498 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:20.937827 21357 consensus_queue.cc:237] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.948009 21476 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:20.954965 21478 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:20.955196 21442 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:20.993000 19557 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 62ed1b9937fd41ab83a0000603a38fc9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f9fb1b1a86c4eb99abdbaf9d239e324 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:20.998414 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:21.001487 19668 raft_consensus.cc:2393] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 3: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:21.003734 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:21.005532 19668 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.759498 19674 consensus_queue.cc:260] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.010188 19674 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.003716 19638 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:21.014724 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 171132us
I20260709 12:14:21.017314 19638 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:21.019354 19638 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:21.022522 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.022603 19743 raft_consensus.cc:1275] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:21.022599 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.023900 19746 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:21.024636 19747 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:21.025374 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.026535 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.027429 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.029471 19670 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:21.027709 19744 raft_consensus.cc:2393] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:21.031572 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:21.032701 19670 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:21.035171 19670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1923) took 1372 ms. Trace:
I20260709 12:14:21.035308 19638 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:21.031625 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 163685us
I20260709 12:14:21.035707 19670 rpcz_store.cc:276] 0709 12:14:19.662275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.033601 (+1371326us) service_pool.cc:224] Handling call
0709 12:14:21.034245 (+   644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.034674 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.034703 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:21.034809 (+   106us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:21.034843 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.034936 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.035063 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:21.045660 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:21.047008 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:21.047240 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.046648 19823 raft_consensus.cc:2468] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:21.048658 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.049883 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:21.050805 19824 raft_consensus.cc:1240] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:21.051007 19823 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:14:21.054080 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.060643 21335 consensus_queue.cc:237] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.061997 20397 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:21.064884 21337 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:21.081269 19745 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:21.089067 21337 consensus_queue.cc:1059] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:21.065785 19750 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:21.091138 19742 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:21.066774 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:21.091228 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.092512 19750 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:21.083653 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:21.093811 20427 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:21.086599 21212 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:20.923121 21339 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.089457 19789 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:21.068380 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.075273 21329 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.111495 19744 raft_consensus.cc:2393] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:21.089686 19668 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:21.113912 21212 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.116168 21442 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.118741 21417 raft_consensus.cc:2804] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:21.119290 21478 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.119772 19747 raft_consensus.cc:1240] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:21.120306 21434 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:21.120906 21514 log.cc:927] Time spent T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:14:21.121085 21434 raft_consensus.cc:697] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:21.123533 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.124557 21437 consensus_queue.cc:1048] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:21.127303 21399 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:21.127696 21339 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:21.128152 21399 raft_consensus.cc:697] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
W20260709 12:14:21.112824 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 51344.1us
I20260709 12:14:21.119376 21417 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.116374 21476 raft_consensus.cc:2804] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:21.130060 19823 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:21.109851 19674 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:21.038635 19638 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:21.134534 19750 raft_consensus.cc:2393] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:21.137727 21329 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.145259 19670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 173) took 1477 ms. Trace:
I20260709 12:14:21.147624 19670 rpcz_store.cc:276] 0709 12:14:19.662584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.037489 (+1374905us) service_pool.cc:224] Handling call
0709 12:14:21.038391 (+   902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.133610 (+ 95219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.133656 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:21.139675 (+  6019us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:21.139980 (+   305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.140116 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.140337 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:21.129204 21431 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.154619 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:21.155659 20397 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:21.139123 21476 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.136746 21417 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:21.159392 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.128341 21494 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.162281 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:21.164739 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:21.164964 20398 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:21.164765 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 75805.3us
I20260709 12:14:21.168079 19823 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:21.170953 21431 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.173148 21472 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:21.172004 21437 raft_consensus.cc:2804] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:21.171048 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 132751us
I20260709 12:14:21.171291 21396 raft_consensus.cc:2804] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:21.176910 19746 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:21.176970 21329 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.180219 21337 raft_consensus.cc:3055] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:21.180383 21212 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:21.177027 21396 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.181289 21485 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:21.182242 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.176373 19638 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:21.184113 19638 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:21.184834 21500 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.186210 21500 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:21.186906 21456 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 3 is higher.
I20260709 12:14:21.180864 21337 raft_consensus.cc:740] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:21.185256 21469 raft_consensus.cc:2804] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:21.181345 21396 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:21.187486 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.178376 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.175235 21437 raft_consensus.cc:697] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:21.159832 21476 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.190495 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:21.192098 21335 raft_consensus.cc:2804] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:21.192710 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:21.193956 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:21.192976 19746 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:21.195479 21335 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.197611 21335 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.122660 21434 consensus_queue.cc:237] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.193948 21469 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.210944 21331 raft_consensus.cc:2804] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:21.211138 21500 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.212077 21331 raft_consensus.cc:697] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:21.213847 21331 consensus_queue.cc:237] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.215266 21494 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:21.219143 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.220391 19668 raft_consensus.cc:1240] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:21.221941 19744 raft_consensus.cc:2468] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:21.217331 21437 consensus_queue.cc:237] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.218734 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:21.248369 20433 raft_consensus.cc:2393] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:21.224632 19638 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:21.227011 20397 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:21.251236 21367 raft_consensus.cc:2804] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:21.251360 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 60320.5us
I20260709 12:14:21.252045 21367 raft_consensus.cc:697] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:21.229557 19668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 177) took 1562 ms. Trace:
I20260709 12:14:21.253686 21367 consensus_queue.cc:237] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.254810 19668 rpcz_store.cc:276] 0709 12:14:19.663789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.219539 (+1555750us) service_pool.cc:224] Handling call
0709 12:14:21.220074 (+   535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.225540 (+  5466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.225779 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:21.234256 19666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1759) took 1600 ms. Trace:
I20260709 12:14:20.961783 21504 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.286962 19741 raft_consensus.cc:3060] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:21.289857 21504 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:21.290020 21336 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:21.207618 21431 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:21.235733 21399 consensus_queue.cc:237] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.209386 21469 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.237226 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 181) took 1572 ms. Trace:
I20260709 12:14:21.295130 19669 rpcz_store.cc:276] 0709 12:14:19.664949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.235581 (+1570632us) service_pool.cc:224] Handling call
0709 12:14:21.236188 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.236646 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.236676 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:21.236745 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:21.236812 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.236874 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.237020 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:21.297892 19669 raft_consensus.cc:1275] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:14:21.238315 19667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48662 (request call id 1751) took 1629 ms (client timeout 1639 ms). Trace:
W20260709 12:14:21.299015 19667 rpcz_store.cc:269] 0709 12:14:19.608512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.630402 (+ 21890us) service_pool.cc:224] Handling call
0709 12:14:21.237885 (+1607483us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b5400286c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:21.238079 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137496448}
I20260709 12:14:21.301371 19667 raft_consensus.cc:1240] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:21.244649 19821 raft_consensus.cc:1275] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:21.239166 21281 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.245664 19672 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:21.306023 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:21.229102 21337 consensus_queue.cc:260] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.231406 20427 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:14:21.266530 19671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48652 (request call id 1915) took 2698 ms (client timeout 2476 ms). Trace:
I20260709 12:14:21.267421 21470 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.313488 21470 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.316480 21366 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:21.318584 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.319069 21469 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.322007 21469 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.322969 21414 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.323757 19789 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:21.294404 21390 raft_consensus.cc:3060] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:21.326399 19670 raft_consensus.cc:1240] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:21.327025 21337 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.327709 19670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 176) took 1664 ms. Trace:
I20260709 12:14:21.328156 19670 rpcz_store.cc:276] 0709 12:14:19.663511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.161883 (+1498372us) service_pool.cc:224] Handling call
0709 12:14:21.269121 (+107238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.327328 (+ 58207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.327612 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:21.330181 19670 raft_consensus.cc:1240] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:21.286724 19666 rpcz_store.cc:276] 0709 12:14:19.633228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.131179 (+497951us) service_pool.cc:224] Handling call
0709 12:14:20.131568 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:20.156222 (+ 24654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.233601 (+1077379us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b5400284954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:21.234003 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8008576}
I20260709 12:14:21.330977 21336 consensus_queue.cc:1059] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:14:21.310808 19671 rpcz_store.cc:269] 0709 12:14:18.579187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.637796 (+ 58609us) service_pool.cc:224] Handling call
0709 12:14:21.242155 (+2604359us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400251f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:21.242371 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3275918208}
I20260709 12:14:21.332360 21336 raft_consensus.cc:3055] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:21.332865 21336 raft_consensus.cc:740] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:21.333083 21494 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:21.333734 19671 raft_consensus.cc:1240] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:21.258376 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:21.285190 21329 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:21.284236 21392 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:21.336738 21329 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.337024 21392 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.301081 21433 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:21.338423 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:21.261168 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:21.339242 21433 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:21.339800 19818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1089) took 1982 ms (client timeout 1661 ms). Trace:
I20260709 12:14:21.340322 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:21.340184 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:21.341140 19815 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.341614 19819 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:21.341879 21433 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:21.340337 19818 rpcz_store.cc:269] 0709 12:14:19.526956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.548970 (+ 22014us) service_pool.cc:224] Handling call
0709 12:14:21.339403 (+1790433us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54003a75d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:21.339541 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046101376}
I20260709 12:14:21.310627 19672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 183) took 1275 ms. Trace:
I20260709 12:14:21.316672 21470 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.341967 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:21.332093 19666 raft_consensus.cc:1240] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:21.343776 19672 rpcz_store.cc:276] 0709 12:14:20.035242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.244530 (+1209288us) service_pool.cc:224] Handling call
0709 12:14:21.245082 (+   552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.306171 (+ 61089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.310525 (+  4354us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:21.326336 19789 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
W20260709 12:14:21.245112 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 111434us
I20260709 12:14:21.355340 21212 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:21.355504 19671 raft_consensus.cc:1240] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:21.356444 21212 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.358132 19671 raft_consensus.cc:1240] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:21.348518 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:21.345991 21414 raft_consensus.cc:2804] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:21.368535 19670 raft_consensus.cc:1240] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:21.375893 20433 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.390877 19816 raft_consensus.cc:1240] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:21.405282 19820 raft_consensus.cc:2368] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4.
I20260709 12:14:21.334457 21336 consensus_queue.cc:260] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.416821 19666 raft_consensus.cc:1275] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:21.371003 21414 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:21.418095 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 48945us
I20260709 12:14:21.419656 21481 raft_consensus.cc:3055] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:21.423787 19815 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:21.346233 21417 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.393563 19788 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:21.433962 21481 raft_consensus.cc:740] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:21.440697 21264 consensus_queue.cc:1059] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:14:21.436512 21504 raft_consensus.cc:2764] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:14:21.443925 21264 raft_consensus.cc:3055] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:21.444344 21264 raft_consensus.cc:740] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:21.445611 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 69806.2us
W20260709 12:14:21.445900 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 119861us
I20260709 12:14:21.447520 19671 raft_consensus.cc:1240] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:21.449064 21390 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.449255 21357 raft_consensus.cc:2804] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:21.450009 21357 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:21.450416 21357 raft_consensus.cc:3060] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.451671 21392 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.452193 21335 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.452780 21241 consensus_queue.cc:1059] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:14:21.454207 21519 raft_consensus.cc:3055] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:21.454641 21519 raft_consensus.cc:740] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:21.455411 19741 raft_consensus.cc:1275] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:21.456310 19741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1101) took 1872 ms. Trace:
I20260709 12:14:21.455888 21519 consensus_queue.cc:260] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.456705 19741 rpcz_store.cc:276] 0709 12:14:19.583754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.625349 (+ 41595us) service_pool.cc:224] Handling call
0709 12:14:19.748779 (+123430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.253351 (+1504572us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540003a820. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f4a1d 00007fadf46db1a4 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419
0709 12:14:21.455894 (+202543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.456224 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391847808}
I20260709 12:14:21.457360 19675 raft_consensus.cc:2468] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
W20260709 12:14:21.458523 21439 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:14:21.459005 21435 consensus_queue.cc:1048] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:21.461374 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:21.462342 19815 raft_consensus.cc:2368] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf for earlier term 3. Current term is 4.
I20260709 12:14:21.462584 21329 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.433658 21414 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.444186 21481 consensus_queue.cc:260] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.464031 21396 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.464956 21481 raft_consensus.cc:3060] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:21.469223 21212 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:21.470665 19669 raft_consensus.cc:1240] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:21.468755 21264 consensus_queue.cc:260] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.473455 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:21.457330 21519 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:21.482043 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.484854 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 141824us
I20260709 12:14:21.442010 21281 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:21.489418 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 264874us
I20260709 12:14:21.492069 19819 raft_consensus.cc:1275] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:21.492007 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:21.497498 19820 raft_consensus.cc:1240] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:21.499110 19815 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.498721 20396 leader_election.cc:400] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Vote denied by peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) with higher term. Message: Invalid argument: T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf for earlier term 3. Current term is 4.
I20260709 12:14:21.505892 20396 leader_election.cc:403] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:14:21.449640 21390 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.506865 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:21.513372 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 173625us
I20260709 12:14:21.516726 19714 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:21.517839 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.521414 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.521543 21336 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.524441 21390 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.528177 21491 raft_consensus.cc:2243] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.528837 21357 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:21.529438 21491 raft_consensus.cc:2272] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.533872 19820 raft_consensus.cc:1240] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:21.533702 19789 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:21.532384 21417 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.533524 21479 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.531783 21396 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:21.530629 21485 raft_consensus.cc:2749] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:21.549803 21432 raft_consensus.cc:2749] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:21.553431 19789 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:21.543974 19638 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:21.565871 19816 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.566080 21357 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:21.567591 19815 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:21.491200 21476 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:21.590523 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 73906.1us
I20260709 12:14:21.564083 19713 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:21.591511 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:21.516518 21335 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:21.592478 19819 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.530561 21509 tablet_replica.cc:333] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:21.532126 21388 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:21.623493 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 132431us
W20260709 12:14:21.632721 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 89143.3us
I20260709 12:14:21.634038 19713 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:21.613960 21504 raft_consensus.cc:2804] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:21.664333 20433 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:21.622092 21281 raft_consensus.cc:2804] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:21.673449 19714 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:21.677181 19713 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:21.678188 20398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.672669 21353 raft_consensus.cc:3055] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:21.684660 21353 raft_consensus.cc:740] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:21.653825 21472 consensus_queue.cc:1059] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:14:21.686499 21472 raft_consensus.cc:3055] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:21.686966 21472 raft_consensus.cc:740] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:21.687574 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:21.688508 19668 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:21.688017 21472 consensus_queue.cc:260] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.689828 21472 raft_consensus.cc:3060] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.669898 20425 raft_consensus.cc:2393] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:21.696354 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:21.616542 21357 consensus_queue.cc:1048] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:14:21.660761 21431 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:21.654470 21504 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:21.709569 19666 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:21.671396 21281 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:21.725566 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.726864 21343 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:21.730098 21515 log.cc:927] Time spent T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.767s	user 0.003s	sys 0.000s
I20260709 12:14:21.730906 21486 raft_consensus.cc:2749] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:21.731599 19788 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:21.732455 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:21.717664 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:21.671975 21530 raft_consensus.cc:2804] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:21.747025 19667 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:21.721485 21281 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:21.750530 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.756297 19821 raft_consensus.cc:1275] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:21.758498 19675 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:21.707727 21431 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.711817 21504 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:21.762933 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.766238 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 143727us
I20260709 12:14:21.743634 19640 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:21.680852 21335 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 12:14:21.762290 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 139859us
I20260709 12:14:21.744375 21432 raft_consensus.cc:2804] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:21.779678 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 48173.1us
I20260709 12:14:21.782122 20397 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:21.764395 21431 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:21.804356 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.807601 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 47998.6us
I20260709 12:14:21.810983 19674 raft_consensus.cc:1240] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:21.773140 21530 raft_consensus.cc:697] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:21.738828 21442 consensus_queue.cc:1059] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:14:21.749179 21485 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:21.794032 21432 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
W20260709 12:14:21.836850 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 183531us
I20260709 12:14:21.838014 19714 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:21.848990 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:21.842486 21407 raft_consensus.cc:2749] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:21.854317 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1100) took 1025 ms. Trace:
I20260709 12:14:21.854882 21454 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.854700 21345 consensus_queue.cc:1048] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:21.856848 19672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1938) took 1163 ms. Trace:
W20260709 12:14:21.854681 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.861371 21156 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:21.862298 19666 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
I20260709 12:14:21.864066 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:21.864465 21491 ts_tablet_manager.cc:1916] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:21.865015 19666 raft_consensus.cc:2393] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 4: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:21.866391 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:21.871397 21442 consensus_queue.cc:1243] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Peer f662c4f7d6a74013a1e58a5330a049b8 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:21.854532 21417 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:21.862360 21536 log.cc:927] Time spent T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.068s	user 0.001s	sys 0.001s
I20260709 12:14:21.859239 19672 rpcz_store.cc:276] 0709 12:14:20.687117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.347388 (+660271us) service_pool.cc:224] Handling call
0709 12:14:21.393274 (+ 45886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:21.444080 (+ 50806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.444111 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:21.484988 (+ 40877us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.621362 (+136374us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:21.621421 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.621512 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.846249 (+224737us) raft_consensus.cc:1685] finished
0709 12:14:21.846269 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.850633 (+  4364us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8423,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":99776,"threads_started":1,"wal-append.queue_time_us":239225}
I20260709 12:14:21.880839 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:21.882061 19672 raft_consensus.cc:2393] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 3: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:21.888172 21460 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.904229 21264 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.855489 21497 raft_consensus.cc:2804] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:21.877794 19818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 1913) took 1069 ms. Trace:
I20260709 12:14:21.912875 19668 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:21.918651 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:21.920728 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:21.956980 19819 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:21.921770 19816 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
W20260709 12:14:21.919993 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.981721 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 59416.1us
W20260709 12:14:21.989084 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 184844us
I20260709 12:14:21.850903 21432 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:21.857638 19822 rpcz_store.cc:276] 0709 12:14:20.730187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.864772 (+134585us) service_pool.cc:224] Handling call
0709 12:14:20.865129 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:20.868160 (+  3031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.868206 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:20.868773 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.732868 (+864095us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54002ff920. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e9090 00007fadf46f66b8 00007fadf477f92b 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c
0709 12:14:21.732973 (+   105us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:21.733022 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.733153 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.733196 (+    43us) raft_consensus.cc:1685] finished
0709 12:14:21.733212 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.755591 (+ 22379us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2077,"raft.queue_time_us":5968,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":5367,"spinlock_wait_cycles":292140288,"thread_start_us":173963,"threads_started":1,"wal-append.queue_time_us":88693}
I20260709 12:14:21.916769 19818 rpcz_store.cc:276] 0709 12:14:20.808667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.404427 (+595760us) service_pool.cc:224] Handling call
0709 12:14:21.423577 (+ 19150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:21.424144 (+   567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.424172 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:21.438000 (+ 13828us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.653665 (+215665us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:21.653704 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.653785 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.877514 (+223729us) raft_consensus.cc:1685] finished
0709 12:14:21.877534 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.877725 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":266,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":6558,"thread_start_us":186333,"threads_started":1,"wal-append.queue_time_us":236467}
I20260709 12:14:21.999044 19640 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:21.999679 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.000839 19675 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
W20260709 12:14:21.998421 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 44556.4us
I20260709 12:14:22.003541 19672 raft_consensus.cc:2393] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 3: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:21.915453 21367 raft_consensus.cc:2804] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:21.915077 21476 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:21.947032 21474 raft_consensus.cc:2804] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:22.010449 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:22.013368 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.009063 21417 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:22.017118 19745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36936 (request call id 1661) took 1239 ms. Trace:
I20260709 12:14:22.017513 19714 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:22.017634 19745 rpcz_store.cc:276] 0709 12:14:20.777568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.802360 (+ 24792us) service_pool.cc:224] Handling call
0709 12:14:22.016828 (+1214468us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54001fb654. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:22.016980 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511648512}
I20260709 12:14:22.018711 21486 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:22.023370 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.024008 19668 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:22.026091 19670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1935) took 1354 ms. Trace:
I20260709 12:14:22.020401 19714 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:22.026475 19670 rpcz_store.cc:276] 0709 12:14:20.671991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.331189 (+659198us) service_pool.cc:224] Handling call
0709 12:14:21.331829 (+   640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:21.371766 (+ 39937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.025797 (+654031us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b5400182754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:22.026001 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83410432}
I20260709 12:14:22.027462 21486 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:22.027825 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:22.029052 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.029583 19670 raft_consensus.cc:2468] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:14:22.021755 20396 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:21.982427 21458 consensus_queue.cc:1059] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:14:22.032932 20396 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:22.033151 21458 raft_consensus.cc:3055] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:22.033727 21458 raft_consensus.cc:740] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:22.034379 21369 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:22.035953 21440 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:22.037101 19749 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:22.037859 21369 raft_consensus.cc:697] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:22.038578 21530 consensus_queue.cc:237] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.039064 21369 consensus_queue.cc:237] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:22.039521 19748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 1087) took 3058 ms (client timeout 1829 ms). Trace:
W20260709 12:14:22.039999 19748 rpcz_store.cc:269] 0709 12:14:18.980769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.046369 (+ 65600us) service_pool.cc:224] Handling call
0709 12:14:22.039085 (+2992716us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400050ad4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:22.039286 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3674827008}
I20260709 12:14:22.044945 21439 consensus_queue.cc:1048] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:14:22.046101 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:22.049343 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.049587 21366 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.050709 21366 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.055009 21366 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:22.055096 21467 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.055816 21467 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.058176 21467 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:22.060369 21486 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:22.060626 21156 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:22.061214 21156 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.063058 21467 consensus_queue.cc:1059] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:22.064082 19674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1928) took 1394 ms. Trace:
I20260709 12:14:22.064157 21467 consensus_queue.cc:1059] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:22.064675 19674 rpcz_store.cc:276] 0709 12:14:20.669836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.257027 (+587191us) service_pool.cc:224] Handling call
0709 12:14:21.257449 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.811485 (+554036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.063801 (+252316us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540002d854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:22.064019 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272527104}
I20260709 12:14:22.066026 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:22.066536 19674 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:14:22.069193 21414 consensus_meta.cc:287] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
W20260709 12:14:22.069940 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 119981us
I20260709 12:14:22.070386 19673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1752) took 2445 ms. Trace:
I20260709 12:14:22.071478 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:22.071187 21458 consensus_queue.cc:260] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:22.073911 21535 log.cc:927] Time spent T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:14:22.098918 21439 consensus_queue.cc:1059] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:22.099350 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:22.100266 19640 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:22.101282 21357 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:22.102195 20397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.101956 21357 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.102843 19674 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:22.103065 19672 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.103312 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:22.102887 21456 raft_consensus.cc:2749] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:22.104852 21472 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:22.105473 21472 raft_consensus.cc:697] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:22.105609 20424 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:22.105542 21357 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:22.107746 19815 raft_consensus.cc:1275] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:22.109822 21343 raft_consensus.cc:2749] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) with higher term. Message: Invalid argument: T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf for earlier term 3. Current term is 4.
I20260709 12:14:22.075168 21345 raft_consensus.cc:3055] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:22.075484 21353 consensus_queue.cc:260] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.077057 21466 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.111714 21353 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.111562 21466 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.113096 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:22.113875 19821 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:22.114012 21466 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:22.115365 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:22.116291 20425 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:22.078054 21431 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:21.860821 21337 consensus_queue.cc:1059] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.146s
I20260709 12:14:21.998747 21435 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.030725 19670 raft_consensus.cc:1240] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:22.092495 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.011389 21367 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.095785 19823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 204) took 1321 ms. Trace:
I20260709 12:14:22.110574 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:22.110951 21345 raft_consensus.cc:740] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:22.075265 21504 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.117995 20397 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:22.022904 21519 consensus_meta.cc:287] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.531s	user 0.004s	sys 0.007s
I20260709 12:14:22.104903 19674 raft_consensus.cc:1275] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:22.125844 21156 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.154461 19820 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:14:21.954190 21454 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:22.093557 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 60757.9us
I20260709 12:14:22.086344 19673 rpcz_store.cc:276] 0709 12:14:19.625161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.021937 (+396776us) service_pool.cc:224] Handling call
0709 12:14:21.242503 (+1220566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.468579 (+226076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:21.468610 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:21.475762 (+  7152us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:21.475799 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.481799 (+  6000us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:22.070082 (+588283us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400251f50. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:22.070217 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25398,"raft.queue_time_us":82487,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":166,"spinlock_wait_cycles":2805714304,"thread_start_us":89799,"threads_started":1}
I20260709 12:14:22.153856 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:22.153571 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:22.158407 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.013017 21474 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.160501 21435 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.161890 21431 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:22.003106 21485 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.163160 19675 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
W20260709 12:14:22.163856 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 46180.4us
I20260709 12:14:22.164005 21343 raft_consensus.cc:2804] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:22.154199 19823 rpcz_store.cc:276] 0709 12:14:20.774238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.391560 (+617322us) service_pool.cc:224] Handling call
0709 12:14:21.392007 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.392399 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:21.849170 (+456771us) log.cc:844] Serialized 14 byte log entry
0709 12:14:22.095357 (+246187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:22.095426 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:22.095484 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.095562 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:22.095720 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9719,"prepare.queue_time_us":650668,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":16865,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":674716,"threads_started":2}
I20260709 12:14:22.166030 21345 consensus_queue.cc:260] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.168272 19667 raft_consensus.cc:1275] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:22.170293 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:22.172423 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 81017.1us
I20260709 12:14:22.187644 21156 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:22.195329 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1931) took 1524 ms. Trace:
W20260709 12:14:22.177762 21481 consensus_meta.cc:287] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.708s	user 0.015s	sys 0.001s
W20260709 12:14:22.196792 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 43909us
I20260709 12:14:22.154181 21367 raft_consensus.cc:3060] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.106446 21472 consensus_queue.cc:237] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:22.209491 19672 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:22.118001 21414 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.195364 21486 raft_consensus.cc:3055] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:22.216885 19669 rpcz_store.cc:276] 0709 12:14:20.670773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.314441 (+643668us) service_pool.cc:224] Handling call
0709 12:14:21.344370 (+ 29929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.471254 (+126884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.194956 (+723702us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540004cc54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:22.195247 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286243200}
I20260709 12:14:22.219810 19674 raft_consensus.cc:1275] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:22.225699 20397 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:22.232721 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:22.233335 19666 raft_consensus.cc:2393] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 4: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:22.207053 21466 consensus_queue.cc:1059] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:14:22.210120 21474 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.257061 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:22.260432 19823 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:22.225878 21343 raft_consensus.cc:697] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:22.224364 21486 raft_consensus.cc:740] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:22.237713 21345 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:22.237239 21504 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:22.282565 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:22.290078 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 58419.1us
W20260709 12:14:22.291528 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 192091us
I20260709 12:14:22.299759 21509 raft_consensus.cc:2243] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:22.300616 21509 raft_consensus.cc:2272] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:22.301072 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:22.258347 21431 consensus_queue.cc:1048] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:14:22.308801 21414 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:22.262041 21440 consensus_queue.cc:1048] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:14:22.311708 21459 raft_consensus.cc:3055] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:22.312496 21459 raft_consensus.cc:740] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:22.314618 21479 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.315212 21479 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:22.317536 21281 consensus_meta.cc:287] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.001s
I20260709 12:14:22.318058 21281 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.320776 19817 raft_consensus.cc:1240] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:22.319250 19640 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:22.298198 21454 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:22.318900 21349 consensus_queue.cc:1048] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 12:14:22.327849 21414 raft_consensus.cc:2764] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:22.337585 21509 ts_tablet_manager.cc:1916] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:22.346975 19823 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:22.347740 21485 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:22.348250 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:22.348800 21423 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.349603 21423 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:22.359951 19819 raft_consensus.cc:1240] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:22.361204 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:22.362357 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:22.349112 19823 raft_consensus.cc:2393] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 2: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:22.363915 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:22.364684 19823 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:22.364255 21343 consensus_queue.cc:237] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:22.367795 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 48067.8us
W20260709 12:14:22.383734 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 94718.8us
I20260709 12:14:22.387032 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:22.391295 19749 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:22.287329 21476 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:22.406208 19819 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:22.407019 19816 raft_consensus.cc:2393] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:22.404505 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:22.415660 21540 log.cc:927] Time spent T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:14:22.416320 21486 consensus_queue.cc:260] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.417894 21486 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:22.419204 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:22.419492 20425 raft_consensus.cc:1240] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 3. Ops: []
I20260709 12:14:22.420163 20433 raft_consensus.cc:2410] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:22.421273 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:22.422366 21476 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.422863 21476 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:22.423338 19640 connection.cc:256] RPC call timeout handler was delayed by -2.0693083750002188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 12:14:22.423861 19640 connection.cc:256] RPC call timeout handler was delayed by -1.9793083750000733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
I20260709 12:14:22.426620 21414 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.427366 21414 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.428996 21423 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:22.429288 21435 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:22.429803 21414 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:22.432905 21414 consensus_queue.cc:1048] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:22.435899 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:22.313930 21459 consensus_queue.cc:260] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.448220 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.455363 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:22.455992 19745 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:22.456290 19674 raft_consensus.cc:2393] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
W20260709 12:14:22.449127 19749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36936 (request call id 1667) took 1647 ms (client timeout 1667 ms). Trace:
I20260709 12:14:22.462823 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:22.463641 19816 raft_consensus.cc:2468] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:22.463672 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:22.459554 19749 rpcz_store.cc:269] 0709 12:14:20.801660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.808701 (+  7041us) service_pool.cc:224] Handling call
0709 12:14:22.035965 (+1227264us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b58000740d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46db0aa 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf478327c 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c
0709 12:14:22.449025 (+413060us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578694528}
I20260709 12:14:22.468968 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:22.472677 19671 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:22.475162 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.476416 19748 raft_consensus.cc:2410] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:22.482613 19667 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.457477 21497 raft_consensus.cc:697] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:22.506812 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.503512 19823 raft_consensus.cc:2468] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:22.513628 19741 raft_consensus.cc:1240] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:22.504946 19674 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:22.515566 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.516884 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.506242 21432 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:22.518010 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.488068 21459 raft_consensus.cc:3060] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.520314 21432 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:22.522423 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:22.522984 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 45201.5us
I20260709 12:14:22.518699 19674 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:22.526315 19816 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.528034 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.536494 19669 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:22.539476 19745 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
W20260709 12:14:22.540982 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.492842 21530 consensus_queue.cc:1048] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
W20260709 12:14:22.553256 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 556310us
I20260709 12:14:22.522053 19743 raft_consensus.cc:1275] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:22.556052 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.476930 21491 ts_tablet_manager.cc:1929] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:14:22.475088 21456 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:14:22.477432 21435 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:14:22.492111 21437 consensus_queue.cc:1048] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:14:22.505798 21367 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:22.544571 21432 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.583918 19674 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:22.555603 21431 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.591037 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.592243 21497 consensus_queue.cc:237] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:22.593071 21367 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:22.593255 21491 log.cc:1199] T 613b9bd906514e3684eb97813eda93a5 P f662c4f7d6a74013a1e58a5330a049b8: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/wals/613b9bd906514e3684eb97813eda93a5
I20260709 12:14:22.593906 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.574445 20425 raft_consensus.cc:1275] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:22.598078 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.613405 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:22.598610 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.600852 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:22.608670 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 304204us
I20260709 12:14:22.622552 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.626701 20397 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:22.598140 21432 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:22.629263 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.631410 19819 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:22.579182 21466 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.640014 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:22.659536 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 319402us
I20260709 12:14:22.693598 19672 raft_consensus.cc:3060] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.633013 19749 raft_consensus.cc:1275] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:22.633000 19750 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:22.693181 19747 raft_consensus.cc:2368] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4.
W20260709 12:14:22.697315 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 70784.8us
I20260709 12:14:22.699668 19748 raft_consensus.cc:2410] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:14:22.704392 20397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.706501 21423 raft_consensus.cc:2804] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:22.706588 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:22.707424 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.713985 19745 raft_consensus.cc:2393] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:22.714188 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:22.712241 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.716768 19638 leader_election.cc:400] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Vote denied by peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) with higher term. Message: Invalid argument: T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4.
I20260709 12:14:22.717522 19638 leader_election.cc:403] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:14:22.717412 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.720595 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.721913 21466 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.723038 21474 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.725407 21474 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:22.727456 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:22.728708 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:22.729341 19669 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:22.731297 19669 raft_consensus.cc:1240] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:22.732803 19669 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:22.733688 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.733723 19789 leader_election.cc:400] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4.
I20260709 12:14:22.734923 19789 leader_election.cc:403] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:14:22.737534 19750 raft_consensus.cc:2393] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:22.743427 19816 raft_consensus.cc:1275] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:22.745193 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.746219 19745 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:22.748637 21156 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:22.739181 19713 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.028s	sys 0.038s
W20260709 12:14:22.749475 19713 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.029s	sys 0.038s
I20260709 12:14:22.748879 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.749366 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.749423 21156 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.750651 19749 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:22.755707 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:22.750303 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 553259us
I20260709 12:14:22.757758 19714 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:22.719650 19743 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:22.740998 20427 consensus_meta.cc:287] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.625s	user 0.014s	sys 0.000s
I20260709 12:14:22.765715 21156 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:22.769760 19714 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:22.760274 19742 raft_consensus.cc:2410] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:22.762964 19667 raft_consensus.cc:1275] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:22.630627 21431 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.780555 19816 raft_consensus.cc:1275] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:14:22.764050 19557 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 62ed1b9937fd41ab83a0000603a38fc9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f9fb1b1a86c4eb99abdbaf9d239e324 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:22.782033 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.782261 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.783939 19747 raft_consensus.cc:3060] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.781903 19638 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:22.786598 19638 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:22.740710 21423 raft_consensus.cc:697] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:22.790175 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.791177 19749 raft_consensus.cc:2393] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:22.793087 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:22.797040 19823 raft_consensus.cc:1240] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:22.799616 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:22.759533 21504 raft_consensus.cc:2749] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4.
I20260709 12:14:22.802366 19816 raft_consensus.cc:1240] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:22.801882 19714 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:22.803540 19788 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:22.807672 19638 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:22.801849 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 45084.9us
I20260709 12:14:22.818512 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.819402 19749 raft_consensus.cc:2468] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:22.821647 21156 raft_consensus.cc:2749] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:22.756956 21485 consensus_queue.cc:1048] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:14:22.824582 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.798978 21414 raft_consensus.cc:2804] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:22.825435 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 44204.1us
I20260709 12:14:22.795872 21345 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:22.826957 19748 raft_consensus.cc:2468] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:22.831593 19714 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:22.764853 20427 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
W20260709 12:14:22.834101 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.829016 21486 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.837201 19824 raft_consensus.cc:1275] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:22.837026 21486 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:22.839174 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:22.840602 19788 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:22.841017 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:22.841759 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:22.842967 19823 raft_consensus.cc:2393] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:22.845182 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.789718 21353 consensus_queue.cc:1059] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 12:14:22.847218 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 376471us
I20260709 12:14:22.846808 19714 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:22.851445 19744 raft_consensus.cc:2393] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:22.857792 20426 raft_consensus.cc:1240] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:22.823005 21543 raft_consensus.cc:2804] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:22.805137 21439 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:14:22.833982 21414 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.804404 21437 consensus_queue.cc:1048] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:14:22.869853 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:22.871120 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.832162 21264 raft_consensus.cc:2749] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:22.870748 19816 raft_consensus.cc:2393] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 5: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:22.840814 21367 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.874962 19818 raft_consensus.cc:1240] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:22.867146 19745 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
W20260709 12:14:22.879809 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.880054 19748 raft_consensus.cc:2393] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 2: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:22.879272 19640 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
W20260709 12:14:22.864259 21369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.007s	sys 0.016s
W20260709 12:14:22.869325 21481 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.005s	sys 0.016s
I20260709 12:14:22.889392 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.862637 21345 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.891219 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:22.864957 21456 raft_consensus.cc:2749] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) with higher term. Message: Invalid argument: T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4.
I20260709 12:14:22.877454 21414 raft_consensus.cc:3060] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.902357 19745 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:22.905423 19744 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:22.864742 21543 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.870492 21504 raft_consensus.cc:2749] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:22.903316 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:22.896328 21369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.008s	sys 0.017s
I20260709 12:14:22.899984 21509 ts_tablet_manager.cc:1929] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
W20260709 12:14:22.901932 21481 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.006s	sys 0.016s
I20260709 12:14:22.924607 21530 raft_consensus.cc:2804] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:22.932601 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 85894.1us
I20260709 12:14:22.934762 19817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1098) took 2204 ms. Trace:
I20260709 12:14:22.935031 21454 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:22.950893 19672 raft_consensus.cc:2468] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
W20260709 12:14:22.952004 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 92056.3us
W20260709 12:14:22.919730 21559 log.cc:927] Time spent T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:14:22.956285 19714 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:22.955874 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:22.996392 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 192167us
I20260709 12:14:22.901499 21553 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.931129 21264 raft_consensus.cc:2804] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:22.955837 19817 rpcz_store.cc:276] 0709 12:14:20.729877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.901088 (+1171211us) service_pool.cc:224] Handling call
0709 12:14:21.901612 (+   524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:22.321238 (+419626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.934263 (+613025us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54001f0754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:22.934647 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962993536}
I20260709 12:14:23.004972 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:23.001464 19788 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:22.897179 21367 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:22.996325 21545 log.cc:927] Time spent T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.274s	user 0.000s	sys 0.002s
I20260709 12:14:22.929749 21543 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:22.952555 21544 raft_consensus.cc:2804] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:22.952559 21357 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:22.998747 21509 log.cc:1199] T a61494383461482b9ddf0e4f6ceb4323 P ca42d3c27d2e46348120791d1282b193: Deleting WAL directory at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/wals/a61494383461482b9ddf0e4f6ceb4323
I20260709 12:14:22.955777 21560 raft_consensus.cc:2804] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:23.007009 21343 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:23.065379 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 64036.6us
I20260709 12:14:23.071715 19788 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:23.067083 19822 raft_consensus.cc:1240] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:23.054246 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 147350us
I20260709 12:14:23.070297 19746 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
W20260709 12:14:23.070910 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 114711us
I20260709 12:14:23.008087 21472 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:23.080973 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:23.073318 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:23.082067 19744 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:23.082403 19746 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:23.065040 21550 log.cc:927] Time spent T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 12:14:23.081777 19788 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:22.999094 21345 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:23.098526 21156 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:23.095451 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 225828us
I20260709 12:14:23.096669 19714 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
W20260709 12:14:23.053550 21536 log.cc:927] Time spent T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:23.000593 21454 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.070504 21544 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.102173 20398 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:23.049901 21504 raft_consensus.cc:2749] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:23.117874 21509 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36920 (request call id 77) took 2356 ms. Trace:
I20260709 12:14:23.008338 21369 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:14:23.071902 21560 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.118830 21509 rpcz_store.cc:276] 0709 12:14:20.775085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.802360 (+ 27275us) service_pool.cc:224] Handling call
0709 12:14:21.529226 (+726866us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b1800187420. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:14:21.529581 (+   355us) ts_tablet_manager.cc:1151] Deleting tablet a61494383461482b9ddf0e4f6ceb4323
0709 12:14:21.529734 (+   153us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:14:22.420150 (+890416us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:22.874148 (+453998us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:23.117717 (+243569us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":617477,"spinlock_wait_cycles":464140672,"tablet-delete.queue_time_us":86368,"thread_start_us":53772,"threads_started":1}
I20260709 12:14:23.120990 21560 raft_consensus.cc:3060] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:23.074998 21491 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48638 (request call id 71) took 3194 ms. Trace:
I20260709 12:14:23.105230 19788 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:22.952137 21423 consensus_queue.cc:237] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.123162 21544 raft_consensus.cc:3060] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:23.077495 21357 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:23.143468 21549 log.cc:927] Time spent T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.310s	user 0.000s	sys 0.002s
I20260709 12:14:23.144363 21367 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:23.144878 21281 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:23.145918 21241 raft_consensus.cc:2749] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:23.154523 21345 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:23.156222 19713 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:23.080214 21343 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.157186 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:23.157935 20424 raft_consensus.cc:2468] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:23.158704 21343 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:23.159614 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 65271.5us
W20260709 12:14:23.144918 21561 log.cc:927] Time spent T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:14:23.161676 20397 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:23.164636 21476 consensus_meta.cc:287] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.741s	user 0.009s	sys 0.002s
I20260709 12:14:23.165067 21476 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.165876 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:23.167016 21432 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:23.169571 21479 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:23.173801 19747 raft_consensus.cc:2468] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
W20260709 12:14:23.160696 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.134742 19746 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:23.099288 21485 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:23.179431 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:23.180226 19747 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.032764 21553 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.188007 21156 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.188349 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:23.189424 21156 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:23.097533 21472 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.134336 21417 raft_consensus.cc:2804] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:23.193532 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:23.194556 19672 raft_consensus.cc:2368] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3.
I20260709 12:14:23.194352 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:23.135726 21369 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:23.196718 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 97723.4us
I20260709 12:14:23.201534 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:23.202474 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 65702.5us
I20260709 12:14:23.202312 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:23.203639 19640 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:23.203688 19745 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:23.205205 19670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1778) took 1482 ms. Trace:
W20260709 12:14:23.204974 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 48864.5us
I20260709 12:14:23.205542 19670 rpcz_store.cc:276] 0709 12:14:21.723016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.163287 (+440271us) service_pool.cc:224] Handling call
0709 12:14:22.163745 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:22.164263 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:22.164298 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:22.164845 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:14:22.576224 (+411379us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:22.576280 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.576373 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:23.204971 (+628598us) raft_consensus.cc:1685] finished
0709 12:14:23.204991 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.205136 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15917,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":12813,"thread_start_us":410866,"threads_started":1,"wal-append.queue_time_us":615193}
I20260709 12:14:23.140077 21567 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.210184 19746 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:23.186064 21504 raft_consensus.cc:2804] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:23.211433 21156 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:23.188735 21530 raft_consensus.cc:697] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:23.216607 19747 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 6.
I20260709 12:14:23.186146 19741 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:23.199657 21281 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.191953 21575 raft_consensus.cc:2804] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:23.224735 19742 raft_consensus.cc:2468] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:23.225548 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:23.204393 21349 raft_consensus.cc:2749] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:23.229238 21454 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:23.229789 21357 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:23.210976 21582 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.233315 21281 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:23.252874 19671 raft_consensus.cc:1240] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:23.223996 21494 raft_consensus.cc:2804] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:23.257874 21494 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.258353 21494 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:23.259671 21564 log.cc:927] Time spent T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:14:23.260336 19743 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:23.226109 21572 raft_consensus.cc:2749] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:23.223860 21417 raft_consensus.cc:697] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:23.262838 21417 consensus_queue.cc:237] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:23.266490 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:23.267343 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:23.254726 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 48298.7us
I20260709 12:14:23.237690 19747 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:23.244596 21530 consensus_queue.cc:237] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:23.246176 21485 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:23.253913 19666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48662 (request call id 1773) took 1563 ms (client timeout 1817 ms). Trace:
I20260709 12:14:23.253074 21281 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:23.222558 21476 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:23.221021 21504 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:23.207926 21369 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:23.274942 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.271564 19745 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:23.132128 21491 rpcz_store.cc:276] 0709 12:14:19.849642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.921361 (+ 71719us) service_pool.cc:224] Handling call
0709 12:14:20.209625 (+288264us) ts_tablet_manager.cc:1151] Deleting tablet 613b9bd906514e3684eb97813eda93a5
0709 12:14:20.273691 (+ 64066us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:14:22.162109 (+1888418us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:22.466830 (+304721us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:23.006076 (+539246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1082684,"tablet-delete.queue_time_us":122045,"thread_start_us":79279,"threads_started":1}
W20260709 12:14:23.271490 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 53206.1us
I20260709 12:14:23.298300 19713 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:23.234500 21574 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
W20260709 12:14:23.297495 19666 rpcz_store.cc:269] 0709 12:14:21.691329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.866029 (+174700us) service_pool.cc:224] Handling call
0709 12:14:23.252111 (+1386082us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400391554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:23.253841 (+  1730us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841496960}
I20260709 12:14:23.337598 19745 raft_consensus.cc:1240] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 1. Current term is 3. Ops: []
I20260709 12:14:23.268030 19743 raft_consensus.cc:2468] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:23.253399 21414 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:23.342578 19788 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:23.305907 21504 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.251286 21582 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.345569 19745 raft_consensus.cc:1240] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:23.353121 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 54924.1us
I20260709 12:14:23.217938 21567 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.273455 21479 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:23.298504 21519 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:23.306675 21575 raft_consensus.cc:697] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
W20260709 12:14:23.356385 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 101353us
I20260709 12:14:23.340725 21579 raft_consensus.cc:2804] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:23.388154 21587 consensus_queue.cc:1059] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:23.389829 21587 raft_consensus.cc:3055] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:23.390271 21587 raft_consensus.cc:740] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:23.391820 21587 consensus_queue.cc:260] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.394011 21587 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:23.399471 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:23.353904 21435 raft_consensus.cc:2804] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:23.402660 19820 raft_consensus.cc:2393] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 6: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:23.351625 20426 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:23.406613 21553 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:23.346503 21574 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:23.408448 21558 log.cc:927] Time spent T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.539s	user 0.003s	sys 0.001s
I20260709 12:14:23.338649 21485 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
W20260709 12:14:23.421170 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 51167us
I20260709 12:14:23.422313 19640 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:23.420562 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:23.410560 21574 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:23.501703 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 504155us
I20260709 12:14:23.357084 21581 raft_consensus.cc:2749] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:23.506362 21156 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:23.503818 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 195795us
I20260709 12:14:23.325076 19747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d"
dest_uuid: "ca42d3c27d2e46348120791d1282b193"
mode: GRACEFUL
new_leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
 from {username='slave'} at 127.0.0.1:50322
I20260709 12:14:23.504782 19638 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:23.403306 21435 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:23.403002 21431 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:23.372179 21479 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:23.508534 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 86301.9us
I20260709 12:14:23.511948 21156 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:23.420135 21568 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.510711 19747 raft_consensus.cc:606] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Received request to transfer leadership to TS 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:23.400259 21579 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.384253 21519 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.358978 21572 consensus_queue.cc:1059] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.152s
I20260709 12:14:23.525784 19640 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:23.501477 21417 consensus_queue.cc:1048] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:14:23.517374 21435 raft_consensus.cc:3060] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.539705 21156 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:23.547856 21156 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:23.516497 21574 raft_consensus.cc:2749] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:23.551533 21574 raft_consensus.cc:2749] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:23.548573 21156 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.553017 21582 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:23.554797 21156 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:23.555666 21156 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.556270 21156 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:23.553154 21581 raft_consensus.cc:3055] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:14:23.565392 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.565949 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.525573 21472 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:23.530702 21437 raft_consensus.cc:2804] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:23.516851 21357 consensus_queue.cc:1048] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:14:23.528929 21568 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.529346 21579 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:23.568364 21156 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:23.699267 21414 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:23.577816 21575 consensus_queue.cc:237] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.684719 21567 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:23.703423 21593 log.cc:927] Time spent T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:14:23.641175 21485 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:23.557907 21544 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:23.675272 19744 consensus_meta.cc:287] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 12:14:23.710386 19744 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:23.710425 19671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1954) took 1226 ms. Trace:
I20260709 12:14:23.722713 19671 rpcz_store.cc:276] 0709 12:14:22.483723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.552847 (+ 69124us) service_pool.cc:224] Handling call
0709 12:14:23.252574 (+699727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.253362 (+   788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.710080 (+456718us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400391550. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:23.710314 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552943360}
I20260709 12:14:23.728307 19748 raft_consensus.cc:2368] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
W20260709 12:14:23.551802 21565 log.cc:927] Time spent T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
W20260709 12:14:23.656706 20398 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.962s (SENT)
W20260709 12:14:23.763041 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 106370us
W20260709 12:14:23.654943 21562 log.cc:927] Time spent T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
W20260709 12:14:23.762521 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 236833us
I20260709 12:14:23.767987 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:23.767277 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 248754us
W20260709 12:14:23.577623 21583 log.cc:927] Time spent T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:14:23.768775 20429 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:23.769232 21485 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.786518 19638 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:23.770390 19744 raft_consensus.cc:1275] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:14:23.786607 21485 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.787478 19744 pending_rounds.cc:85] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193: Aborting all ops after (but not including) 1
I20260709 12:14:23.787922 19744 pending_rounds.cc:107] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:14:23.788331 19744 raft_consensus.cc:2889] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:23.789094 21485 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:23.789278 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1136) took 1049 ms. Trace:
I20260709 12:14:23.789947 19744 rpcz_store.cc:276] 0709 12:14:22.739732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.748965 (+1009233us) service_pool.cc:224] Handling call
0709 12:14:23.762278 (+ 13313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:23.788964 (+ 26686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.789207 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:23.790993 21587 raft_consensus.cc:2804] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:23.791886 21587 raft_consensus.cc:697] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:23.792836 21587 consensus_queue.cc:237] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:23.683770 21369 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:23.565157 21581 raft_consensus.cc:740] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:23.541675 21577 consensus_queue.cc:1059] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.474s
I20260709 12:14:23.686036 21479 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:23.804631 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:23.805298 20429 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:23.663702 21494 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:23.802268 19714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.005s	sys 0.015s
I20260709 12:14:23.905841 19744 raft_consensus.cc:1275] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:14:23.851339 21600 consensus_queue.cc:1048] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:23.792868 21568 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:23.750373 21437 raft_consensus.cc:697] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:23.911521 19640 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:23.924579 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:23.914004 19714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.007s	sys 0.016s
I20260709 12:14:23.925608 19672 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:23.926090 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 829423us
I20260709 12:14:23.913765 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:23.913036 19744 pending_rounds.cc:85] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193: Aborting all ops after (but not including) 1
I20260709 12:14:23.927259 19744 pending_rounds.cc:107] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:14:23.927598 19744 raft_consensus.cc:2889] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:23.915082 19750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 1126) took 1304 ms (client timeout 1533 ms). Trace:
I20260709 12:14:23.928382 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1137) took 1172 ms. Trace:
I20260709 12:14:23.928795 19744 rpcz_store.cc:276] 0709 12:14:22.755957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.797689 (+1041732us) service_pool.cc:224] Handling call
0709 12:14:23.905445 (+107756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:23.928102 (+ 22657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.928326 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:23.924594 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 417183us
I20260709 12:14:23.930567 19788 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:23.933038 19640 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:23.928578 19750 rpcz_store.cc:269] 0709 12:14:22.610846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.717144 (+106298us) service_pool.cc:224] Handling call
0709 12:14:23.854227 (+1137083us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b54003507d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:23.914993 (+ 60766us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42424704}
I20260709 12:14:23.935900 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36936 (request call id 1697) took 1207 ms. Trace:
I20260709 12:14:23.938831 19666 raft_consensus.cc:1275] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:23.940263 19668 raft_consensus.cc:3055] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:23.942421 19668 raft_consensus.cc:740] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:23.943769 19668 consensus_queue.cc:260] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:23.945269 19671 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:23.948783 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:23.956780 19670 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
W20260709 12:14:23.945088 19742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.000s	sys 0.043s
W20260709 12:14:23.957633 19742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.002s	sys 0.043s
I20260709 12:14:23.948550 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:23.961233 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36936 (request call id 1690) took 1271 ms. Trace:
I20260709 12:14:23.962356 19742 rpcz_store.cc:276] 0709 12:14:22.689791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.409524 (+719733us) service_pool.cc:224] Handling call
0709 12:14:23.409882 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:23.410144 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:23.410488 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 12:14:23.960499 (+550011us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:23.960642 (+   143us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:23.960770 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.960879 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.961105 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":711,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":1858,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":123,"thread_start_us":547190,"threads_started":1}
I20260709 12:14:23.921378 21264 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:23.971764 21264 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:23.973965 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 43510.5us
I20260709 12:14:23.968482 19674 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:23.979487 19673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 198) took 1608 ms. Trace:
I20260709 12:14:23.982075 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:23.933947 19741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 1115) took 1390 ms. Trace:
W20260709 12:14:23.946513 21423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.012s	sys 0.024s
W20260709 12:14:23.999115 21543 consensus_meta.cc:287] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.922s	user 0.014s	sys 0.002s
I20260709 12:14:23.945950 21568 consensus_queue.cc:1059] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:14:23.999598 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.000207 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:24.000507 19669 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:24.000717 21568 raft_consensus.cc:2749] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:24.000950 19819 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:24.001502 21568 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:24.001674 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.002053 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:24.002202 21568 consensus_queue.cc:1048] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:23.980006 19673 rpcz_store.cc:276] 0709 12:14:22.370680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.370838 (+   158us) service_pool.cc:224] Handling call
0709 12:14:22.441172 (+ 70334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:22.475911 (+ 34739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:22.475960 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:22.523399 (+ 47439us) log.cc:844] Serialized 26 byte log entry
0709 12:14:22.864551 (+341152us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:22.864610 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.864689 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:23.979225 (+1114536us) raft_consensus.cc:1685] finished
0709 12:14:23.979251 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.979408 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14327,"raft.queue_time_us":26122,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":22639,"thread_start_us":282878,"threads_started":1,"wal-append.queue_time_us":655179}
I20260709 12:14:24.006516 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:23.949586 21485 raft_consensus.cc:2749] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:24.011400 19672 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:24.011546 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:23.986016 19572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47140 (request call id 231) took 7488 ms. Trace:
I20260709 12:14:23.975385 19743 raft_consensus.cc:1240] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:23.971812 21486 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:23.550305 19558 catalog_manager.cc:5028] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): tablet 613b9bd906514e3684eb97813eda93a5 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:14:23.949002 19668 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.007434 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:23.988741 21357 consensus_queue.cc:1048] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:14:24.033651 19820 raft_consensus.cc:1275] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:24.034354 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:23.985347 19674 raft_consensus.cc:2410] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:14:24.006064 20397 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:24.050848 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 44871.3us
I20260709 12:14:24.053202 20397 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:24.055159 19821 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:23.972738 21437 consensus_queue.cc:237] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.056111 20397 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:23.984124 19741 rpcz_store.cc:276] 0709 12:14:22.537769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.552732 (+ 14963us) service_pool.cc:224] Handling call
0709 12:14:23.861063 (+1308331us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001fac54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:23.927901 (+ 66838us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242672000}
I20260709 12:14:24.010391 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:24.076951 19823 raft_consensus.cc:2410] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:14:23.995702 21423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.012s	sys 0.025s
I20260709 12:14:23.987224 21466 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:23.931655 21435 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:24.083734 21560 consensus_meta.cc:287] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.962s	user 0.010s	sys 0.004s
I20260709 12:14:24.095682 21560 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.097572 21472 raft_consensus.cc:2804] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:24.075703 21241 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:14:24.098021 21560 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:24.049345 21486 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.999668 21543 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:24.024865 19558 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 604522us
I20260709 12:14:24.099038 21486 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.099871 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:24.075646 21440 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:14:24.100682 21543 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:24.024659 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:24.101320 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.101624 21486 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:24.017772 21585 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.083524 19750 raft_consensus.cc:1240] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:24.103868 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.103884 19559 catalog_manager.cc:5028] TS ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): tablet a61494383461482b9ddf0e4f6ceb4323 (table test-workload [id=831db38b38d04314a1d3345bb96f0999]) successfully deleted
I20260709 12:14:24.104161 21585 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.104643 19750 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
W20260709 12:14:24.104828 19559 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 89656.5us
I20260709 12:14:24.015290 21581 consensus_queue.cc:260] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.035251 21600 raft_consensus.cc:3055] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:24.105656 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:24.105903 21600 raft_consensus.cc:740] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:24.106334 19750 raft_consensus.cc:2376] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2. Re-sending same reply.
I20260709 12:14:24.075579 21369 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:24.101745 19824 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:24.106616 21585 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:24.080945 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:24.107967 20427 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60828 (request call id 436) took 2006 ms (client timeout 1637 ms). Trace:
I20260709 12:14:24.034976 21544 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:24.110816 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36936 (request call id 1685) took 1508 ms. Trace:
I20260709 12:14:24.102519 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:24.089772 19673 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:24.119156 19744 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.091274 20397 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:24.083542 21479 raft_consensus.cc:2804] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:24.013814 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.048076 21458 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:24.116472 19669 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 5.
W20260709 12:14:24.133983 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 201032us
I20260709 12:14:24.157964 19640 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:24.159693 19640 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:24.118664 19748 rpcz_store.cc:276] 0709 12:14:22.602199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.952135 (+349936us) service_pool.cc:224] Handling call
0709 12:14:24.110608 (+1158473us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b540037d2d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:24.110724 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608398592}
I20260709 12:14:24.124509 21479 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.097535 21264 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:24.120047 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 213702us
I20260709 12:14:24.097476 21435 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:24.088521 21485 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:24.129010 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.116884 21369 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:24.051646 21579 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.164143 21156 raft_consensus.cc:493] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:24.111346 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.126030 21567 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:24.166544 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.098208 21472 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:24.137797 21595 log.cc:927] Time spent T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:14:24.203464 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:24.118381 20427 rpcz_store.cc:269] 0709 12:14:22.101125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.103004 (+  1879us) service_pool.cc:224] Handling call
0709 12:14:24.107757 (+2004753us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b5400489754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:24.107867 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17050496}
W20260709 12:14:24.209514 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 45081.1us
I20260709 12:14:24.214322 20397 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:24.218278 19748 raft_consensus.cc:2376] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4. Re-sending same reply.
I20260709 12:14:24.012557 19572 rpcz_store.cc:276] 0709 12:14:16.497232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.497430 (+   198us) service_pool.cc:224] Handling call
0709 12:14:16.670733 (+173303us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b5400002490. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165b0b2 00007fadfa5d4759 00007fadfa56ca76 00007fadfa53dd58 00007fadfa63c04e 00007fadf8afd2a4 00007fadf8afd232 00007fadf8afd161 00007fadf8afd0dc
0709 12:14:23.985733 (+7315000us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:19.562377 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:19.563074 (+   697us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:19.563127 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:14:19.563156 (+    29us) tablet.cc:662] Decoding operations
0709 12:14:19.563608 (+   452us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:19.563684 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:19.563712 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:14:19.563904 (+   192us) tablet.cc:701] Row locks acquired
0709 12:14:19.563923 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:14:19.564066 (+   143us) write_op.cc:270] Start()
0709 12:14:19.564176 (+   110us) write_op.cc:276] Timestamp: P: 1783599259564019 usec, L: 0
0709 12:14:19.564197 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:14:19.713404 (+149207us) log.cc:844] Serialized 603 byte log entry
0709 12:14:20.020179 (+306775us) op_driver.cc:464] REPLICATION: finished
0709 12:14:20.028163 (+  7984us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b540010ead4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477ae28 00007fadf81b5581 00007fadf81b4d58 00007fadf81b99f1 00007fadf81b99a9 00007fadf81b9939 00007fadf81b9901 00007fadf81b8b2d 0000000000388634 0000000000388479
0709 12:14:20.153674 (+125511us) write_op.cc:301] APPLY: starting
0709 12:14:20.158649 (+  4975us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:20.171501 (+ 12852us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:20.171524 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:20.288356 (+116832us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:20.369564 (+ 81208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:14:20.382317 (+ 12753us) write_op.cc:312] APPLY: finished
0709 12:14:20.435102 (+ 52785us) log.cc:844] Serialized 23 byte log entry
0709 12:14:20.440356 (+  5254us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:20.440466 (+   110us) write_op.cc:454] Released schema lock
0709 12:14:20.440514 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:20.444155 (+  3641us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:20.446079 (+  1924us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":55216,"reported_tablets":6,"spinlock_wait_cycles":4163328,"child_traces":[["op",{"apply.queue_time_us":115142,"apply.run_cpu_time_us":3455,"apply.run_wall_time_us":293793,"num_ops":1,"prepare.queue_time_us":239898,"prepare.run_cpu_time_us":6385,"prepare.run_wall_time_us":465999,"replication_time_us":441306,"spinlock_wait_cycles":143297792,"thread_start_us":321631,"threads_started":2}]]}
I20260709 12:14:24.224812 20397 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:24.191565 21479 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.227268 21156 raft_consensus.cc:515] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:24.239168 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:24.240543 19748 raft_consensus.cc:2393] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:24.210570 21369 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.216980 21456 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:24.215763 21357 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:24.215869 21472 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.198853 21560 raft_consensus.cc:2804] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:24.221527 21494 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:24.221002 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:24.278965 19742 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
W20260709 12:14:24.283295 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.306354 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 65738.9us
I20260709 12:14:24.229710 21435 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.233908 21423 raft_consensus.cc:2804] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:24.211372 21485 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.340932 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.351662 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.352808 19742 raft_consensus.cc:2393] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:24.343569 21423 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.246480 21587 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.342190 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:24.380105 21605 log.cc:927] Time spent T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:14:24.380297 21494 consensus_queue.cc:1059] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:24.383338 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.307744 21560 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.409114 19744 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:24.348342 19748 raft_consensus.cc:2468] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:24.414618 19640 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:24.421203 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:24.446578 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:24.404734 21606 log.cc:927] Time spent T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:14:24.446997 19742 raft_consensus.cc:2393] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:24.402544 21460 raft_consensus.cc:2804] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:24.457149 19744 raft_consensus.cc:2468] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:24.340549 21357 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:24.458039 21156 leader_election.cc:290] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:24.465746 21156 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:24.346474 21435 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:24.433840 21604 log.cc:927] Time spent T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 12:14:24.422942 21423 raft_consensus.cc:3060] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.372725 21417 consensus_queue.cc:1059] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:14:24.448091 21560 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:24.462965 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 47165.5us
I20260709 12:14:24.476290 19714 leader_election.cc:400] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Vote denied by peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713) with higher term. Message: Invalid argument: T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3.
I20260709 12:14:24.476663 19714 leader_election.cc:403] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:14:24.466359 21156 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:24.468442 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.469122 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:24.469830 19638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.029s	sys 0.042s
W20260709 12:14:24.480433 19638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.030s	sys 0.042s
I20260709 12:14:24.480487 19742 raft_consensus.cc:2376] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4. Re-sending same reply.
W20260709 12:14:24.481285 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 544436us
I20260709 12:14:24.433378 21431 consensus_queue.cc:1048] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:14:24.406841 21530 consensus_queue.cc:1048] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:14:24.461117 21579 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:24.456810 21460 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:24.479769 19748 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:24.486346 19714 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:24.464851 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:24.526455 20426 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:24.490350 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.528888 19744 raft_consensus.cc:2368] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf for earlier term 3. Current term is 4.
I20260709 12:14:24.524155 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.530370 19742 raft_consensus.cc:2393] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:24.528469 19715 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:24.460022 21456 consensus_queue.cc:1048] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:14:24.472256 21612 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:24.534113 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 48354.5us
I20260709 12:14:24.445014 21587 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:24.545626 21587 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:24.535313 21366 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:24.551869 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:24.553009 19822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 1944) took 1476 ms (client timeout 1547 ms). Trace:
W20260709 12:14:24.553457 19822 rpcz_store.cc:269] 0709 12:14:23.076187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.551493 (+1475306us) service_pool.cc:224] Handling call
0709 12:14:24.552930 (+  1437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:24.553731 21479 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:24.555025 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:24.555778 20432 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:24.557678 21485 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:24.527390 21607 log.cc:927] Time spent T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:14:24.558362 21485 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:24.540551 21608 log.cc:927] Time spent T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:14:24.540755 21417 consensus_queue.cc:1059] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:24.543118 21466 raft_consensus.cc:2804] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:24.560369 21367 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:24.560649 21466 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.561225 21466 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.561633 21435 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:24.562288 21435 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.557601 19715 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:24.535938 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 48254.4us
I20260709 12:14:24.565065 19788 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:24.567004 21544 raft_consensus.cc:2804] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:24.567459 21577 consensus_queue.cc:1059] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:24.568080 21570 raft_consensus.cc:3055] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:24.568588 21577 raft_consensus.cc:3055] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:24.568723 21570 raft_consensus.cc:740] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:24.569199 21456 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.569765 21456 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:24.569911 21570 consensus_queue.cc:260] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.488746 21494 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713) with higher term. Message: Invalid argument: T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for earlier term 2. Current term is 3.
I20260709 12:14:24.571453 21494 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:24.571684 19746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40172 (request call id 156) took 1841 ms (client timeout 2209 ms). Trace:
I20260709 12:14:24.571969 21494 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:24.572157 19746 rpcz_store.cc:269] 0709 12:14:22.730079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.187485 (+457406us) service_pool.cc:224] Handling call
0709 12:14:24.571489 (+1384004us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54000ed8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:24.571613 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45819136}
I20260709 12:14:24.573382 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:24.573836 21573 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:24.573971 19746 raft_consensus.cc:2376] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3. Re-sending same reply.
I20260709 12:14:24.574312 21494 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:24.570135 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.575127 19742 raft_consensus.cc:2468] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:24.561187 21367 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:24.575855 19713 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:24.568145 19714 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:24.578186 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.600247 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.600442 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:24.601806 19746 raft_consensus.cc:2393] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:24.582144 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:24.605376 19748 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.606467 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.606943 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:24.607350 19672 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:24.607802 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.608247 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:23.940814 19747 rpcz_store.cc:276] 0709 12:14:22.728048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.592840 (+864792us) service_pool.cc:224] Handling call
0709 12:14:23.593163 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:23.593381 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:23.593734 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 12:14:23.935375 (+341641us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:23.935454 (+    79us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:23.935544 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.935644 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.935821 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":696,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":19816,"raft.queue_time_us":1700,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":5784,"thread_start_us":340792,"threads_started":1}
I20260709 12:14:24.608513 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:24.609076 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.609242 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:24.609673 21543 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:24.609879 19742 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:24.610123 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.611085 19714 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:24.611436 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.612707 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.613382 19674 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:24.612793 21543 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:24.613705 21456 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:24.614218 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.614459 21543 raft_consensus.cc:2749] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:24.610090 19747 raft_consensus.cc:3060] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:24.615653 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:24.616632 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.617413 19666 raft_consensus.cc:2368] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
I20260709 12:14:24.560436 21417 raft_consensus.cc:3055] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:24.609189 19672 raft_consensus.cc:2376] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4. Re-sending same reply.
I20260709 12:14:24.618669 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 1948) took 1262 ms. Trace:
I20260709 12:14:24.582207 21479 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:24.619127 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:24.621774 21504 consensus_meta.cc:287] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 1.263s	user 0.013s	sys 0.001s
I20260709 12:14:24.619581 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.622325 21504 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.623543 21357 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:24.623958 21264 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:24.624264 21357 raft_consensus.cc:2804] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:24.624794 21357 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.624964 21504 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:24.625226 21357 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:24.611287 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:24.609386 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:24.623071 19672 raft_consensus.cc:2393] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 3: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:24.574617 21573 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.618251 21466 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:24.797258 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:24.656258 19746 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:24.825798 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.800662 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:24.836647 20433 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60840 (request call id 519) took 2068 ms (client timeout 1886 ms). Trace:
I20260709 12:14:24.583760 21156 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:24.620776 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 45004.7us
I20260709 12:14:24.826187 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.805126 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36936 (request call id 1687) took 2176 ms. Trace:
I20260709 12:14:24.618274 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:24.765172 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:24.703724 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:24.958019 19744 raft_consensus.cc:2393] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:24.619141 19816 rpcz_store.cc:276] 0709 12:14:23.356205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.356412 (+   207us) service_pool.cc:224] Handling call
0709 12:14:23.371366 (+ 14954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:23.510461 (+139095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.510498 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:23.510560 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:23.510596 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.618387 (+1107791us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54002616d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:24.618435 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.618577 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319149312}
W20260709 12:14:24.941691 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.879174 19673 raft_consensus.cc:2376] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2. Re-sending same reply.
I20260709 12:14:24.849215 21454 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.949882 19667 raft_consensus.cc:2376] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5. Re-sending same reply.
I20260709 12:14:24.532972 21460 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.950101 19750 raft_consensus.cc:2368] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf for earlier term 3. Current term is 4.
W20260709 12:14:24.698575 21598 log.cc:927] Time spent T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.647s	user 0.001s	sys 0.007s
W20260709 12:14:24.950234 19787 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.020s	sys 0.009s
I20260709 12:14:24.882421 19675 raft_consensus.cc:2368] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
I20260709 12:14:24.675693 21485 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:24.736157 20432 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:24.882618 21156 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:24.966007 21156 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.650208 21369 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:24.950737 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.623541 19674 raft_consensus.cc:2393] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 3: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:24.618731 21417 raft_consensus.cc:740] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:24.803244 20426 raft_consensus.cc:1240] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:24.675264 19789 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:25.003847 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 328675us
I20260709 12:14:24.673029 19747 raft_consensus.cc:2468] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:24.824107 21560 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.569144 21577 raft_consensus.cc:740] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:24.674196 21567 raft_consensus.cc:697] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:24.567523 21544 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:24.771912 20398 leader_election.cc:336] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.556s (SENT)
I20260709 12:14:24.625675 21504 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.375s
W20260709 12:14:25.083601 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 311771us
W20260709 12:14:25.084992 20398 leader_election.cc:336] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.655s (SENT)
W20260709 12:14:24.955183 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 69763.5us
I20260709 12:14:25.085752 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.085922 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:24.958364 19666 raft_consensus.cc:2368] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
I20260709 12:14:24.961570 19788 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:24.882294 20433 rpcz_store.cc:269] 0709 12:14:22.768325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.768577 (+   252us) service_pool.cc:224] Handling call
0709 12:14:24.836311 (+2067734us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400348fd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:24.836529 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3058040192}
I20260709 12:14:24.763051 21367 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:24.676307 21570 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.971712 19672 raft_consensus.cc:2393] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 4: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:24.803246 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:24.804224 21519 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:25.000582 19750 raft_consensus.cc:1275] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:14:24.970635 19787 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.020s	sys 0.009s
W20260709 12:14:25.074566 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.077272 19744 raft_consensus.cc:1240] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:25.097507 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:24.988636 21568 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.079988 21577 consensus_queue.cc:260] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.080814 21369 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:25.081540 21567 consensus_queue.cc:237] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.085412 19748 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
W20260709 12:14:25.091961 21458 consensus_meta.cc:287] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.927s	user 0.014s	sys 0.008s
W20260709 12:14:25.085767 20398 leader_election.cc:336] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.528s (SENT)
I20260709 12:14:24.603971 21435 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:24.988564 21597 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.090646 19789 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:25.092525 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:24.972060 21454 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:25.098951 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.082487 21544 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:25.102461 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.103883 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:25.105635 19640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.019s	sys 0.035s
W20260709 12:14:25.088395 20396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.014s	sys 0.094s
I20260709 12:14:25.109534 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:25.160558 19640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.019s	sys 0.035s
I20260709 12:14:25.122051 19789 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:25.111490 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:25.161793 19750 raft_consensus.cc:2368] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
I20260709 12:14:24.827857 21600 consensus_queue.cc:260] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.092332 21366 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.112779 20398 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:25.118288 19749 raft_consensus.cc:2410] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:25.094138 20424 raft_consensus.cc:1240] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:25.120255 19744 raft_consensus.cc:1240] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:14:25.160683 20396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.014s	sys 0.094s
I20260709 12:14:24.956219 19743 rpcz_store.cc:276] 0709 12:14:22.629122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.347047 (+717925us) service_pool.cc:224] Handling call
0709 12:14:23.926638 (+579591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.018047 (+ 91409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.804812 (+786765us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54003507d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:24.805035 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236941696}
I20260709 12:14:25.160576 19666 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:25.105281 21626 raft_consensus.cc:2804] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:25.178560 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:25.179715 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 57669.5us
I20260709 12:14:25.168797 21353 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.185956 21353 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.174536 21366 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.187508 19640 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:25.189363 21366 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:25.191489 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.119087 21596 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:25.174424 19745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36936 (request call id 1689) took 2485 ms. Trace:
I20260709 12:14:25.120564 21577 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:25.215426 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.208168 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.190204 19640 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:25.118399 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.182757 19674 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.150108 21620 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:25.216337 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.195514 19789 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:25.156152 21597 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.107811 21568 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.158210 21417 consensus_queue.cc:260] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:25.400017 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 209906us
I20260709 12:14:25.295616 19666 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:25.400775 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:25.259473 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.533313 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:25.561774 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:25.400692 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 439191us
I20260709 12:14:25.468758 19822 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:14:25.542753 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 267012us
I20260709 12:14:25.217401 19750 raft_consensus.cc:1275] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:14:25.563985 19750 pending_rounds.cc:85] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193: Aborting all ops after (but not including) 2
I20260709 12:14:25.543294 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:25.564338 19750 pending_rounds.cc:107] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:25.564771 19750 raft_consensus.cc:2889] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:25.565124 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 479331us
I20260709 12:14:25.400133 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:25.417515 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 460570us
I20260709 12:14:25.212815 21485 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:25.331455 21600 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:25.205547 21472 consensus_meta.cc:287] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.862s	user 0.010s	sys 0.002s
W20260709 12:14:25.202497 21423 consensus_meta.cc:287] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.004s
I20260709 12:14:25.197165 21613 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:25.647898 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:25.635093 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 70882.2us
I20260709 12:14:25.197501 21622 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:25.219247 19671 raft_consensus.cc:2468] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:25.635288 19816 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:25.276134 21369 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:25.201310 21630 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.199852 19745 rpcz_store.cc:276] 0709 12:14:22.689412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.354239 (+664827us) service_pool.cc:224] Handling call
0709 12:14:23.354550 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.371790 (+ 17240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.371830 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.399378 (+ 27548us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.815919 (+416541us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:23.907524 (+ 91605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.907595 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.614160 (+706565us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:14:25.163926 (+549766us) raft_consensus.cc:1685] finished
0709 12:14:25.163954 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.174331 (+ 10377us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2836,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":30341,"spinlock_wait_cycles":44578048,"thread_start_us":291152,"threads_started":1,"wal-append.queue_time_us":466871}
I20260709 12:14:25.558394 21431 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.637353 21345 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.175441 21626 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.350824 21504 raft_consensus.cc:2804] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.191349 21602 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:25.637094 20396 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
W20260709 12:14:25.729050 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 92046.9us
W20260709 12:14:25.640354 20398 leader_election.cc:336] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.753s (SENT)
I20260709 12:14:25.641136 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:25.731618 19667 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:25.475040 21357 consensus_meta.cc:287] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.849s	user 0.010s	sys 0.004s
W20260709 12:14:25.273228 21612 consensus_meta.cc:287] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.711s	user 0.012s	sys 0.000s
W20260709 12:14:25.275667 21627 log.cc:927] Time spent T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:14:25.638376 19673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48662 (request call id 1802) took 1056 ms. Trace:
I20260709 12:14:25.737286 19673 rpcz_store.cc:276] 0709 12:14:24.581535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.094487 (+512952us) service_pool.cc:224] Handling call
0709 12:14:25.638279 (+543792us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.198623 21456 raft_consensus.cc:2749] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:25.493867 21624 log.cc:927] Time spent T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.276s	user 0.000s	sys 0.000s
W20260709 12:14:25.276494 21625 log.cc:927] Time spent T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 12:14:25.646093 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 103751us
I20260709 12:14:25.199759 21596 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.753001 21596 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:25.753489 21353 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:25.558634 21466 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:25.211706 21573 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:25.756095 21573 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:25.208019 21560 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:25.648891 19666 raft_consensus.cc:2393] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:25.759097 21636 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:25.759473 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.759855 21636 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.760699 19666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48662 (request call id 1798) took 1180 ms. Trace:
I20260709 12:14:25.761219 19666 rpcz_store.cc:276] 0709 12:14:24.580431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.759069 (+1178638us) service_pool.cc:224] Handling call
0709 12:14:25.760610 (+  1541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.762323 21636 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:25.212858 21435 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:25.651721 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.474287 21494 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.664785 19671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48652 (request call id 1976) took 1008 ms. Trace:
I20260709 12:14:25.645536 21620 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.663802 21621 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:14:25.670166 21460 consensus_meta.cc:287] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.000s
I20260709 12:14:25.664800 21472 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.671002 21423 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.653479 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:25.673099 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:25.675307 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:25.677294 21597 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:25.677740 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.723289 21486 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.725744 21458 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:25.679792 19788 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:25.727068 21504 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:25.680387 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:25.725147 21431 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.681294 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:25.681628 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:25.682155 20424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 528) took 1194 ms. Trace:
I20260709 12:14:25.682363 19817 raft_consensus.cc:1240] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:25.684178 21568 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:25.727277 21626 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:25.687311 19824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56882 (request call id 84) took 1270 ms. Trace:
I20260709 12:14:25.723271 21581 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:25.707080 21622 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.708071 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1151) took 1206 ms. Trace:
I20260709 12:14:25.540808 21454 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:25.717211 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:25.637737 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:25.718732 19746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.017s	sys 0.034s
I20260709 12:14:25.719691 21156 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:25.723845 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.756857 21573 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.268704 21623 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.447s
I20260709 12:14:25.733789 20396 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:25.666083 21485 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:25.808167 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1144) took 1309 ms. Trace:
I20260709 12:14:25.808403 21485 raft_consensus.cc:697] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:25.808682 19748 rpcz_store.cc:276] 0709 12:14:24.498246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.109431 (+611185us) service_pool.cc:224] Handling call
0709 12:14:25.109840 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.178154 (+ 68314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.178701 (+   547us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:25.183999 (+  5298us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.639907 (+455908us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:25.639948 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.640016 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.807923 (+167907us) raft_consensus.cc:1685] finished
0709 12:14:25.807945 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.808094 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56227,"raft.queue_time_us":116541,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"thread_start_us":370309,"threads_started":1,"wal-append.queue_time_us":620995}
W20260709 12:14:25.810164 21577 consensus_meta.cc:287] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.000s
I20260709 12:14:25.809671 21485 consensus_queue.cc:237] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.763962 21494 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.763447 21435 raft_consensus.cc:2804] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:25.813203 21544 consensus_meta.cc:287] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.002s
I20260709 12:14:25.813392 21435 raft_consensus.cc:697] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:25.813665 21544 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.796393 21369 raft_consensus.cc:2804] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:25.678967 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:25.815591 19819 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:25.816746 19569 catalog_manager.cc:5697] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 3 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:25.690140 19749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 1124) took 3080 ms (client timeout 2000 ms). Trace:
W20260709 12:14:25.819002 19749 rpcz_store.cc:269] 0709 12:14:22.610158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.874137 (+263979us) service_pool.cc:224] Handling call
0709 12:14:25.689822 (+2815685us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54002e1654. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:25.690037 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5033743232}
I20260709 12:14:25.764834 21460 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:25.821192 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 87499.5us
I20260709 12:14:25.821784 21621 raft_consensus.cc:2749] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:25.790030 21612 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:25.823241 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:25.770006 21486 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.824885 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:25.826119 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:25.764101 19671 rpcz_store.cc:276] 0709 12:14:24.656477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.215121 (+558644us) service_pool.cc:224] Handling call
0709 12:14:25.664696 (+449575us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.764858 19818 raft_consensus.cc:2410] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:25.767094 20429 raft_consensus.cc:1240] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:25.767495 19823 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
W20260709 12:14:25.771071 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 91372.9us
I20260709 12:14:25.642459 21629 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:25.773413 19820 raft_consensus.cc:2393] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:25.831722 19640 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:25.762699 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.776302 19750 rpcz_store.cc:276] 0709 12:14:24.501470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.167802 (+666332us) service_pool.cc:224] Handling call
0709 12:14:25.199340 (+ 31538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.645294 (+445954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.707670 (+ 62376us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b54003593d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:25.707981 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40450432}
I20260709 12:14:25.776808 19822 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
W20260709 12:14:25.777123 19746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.017s	sys 0.035s
I20260709 12:14:25.834431 19666 raft_consensus.cc:2393] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:25.777493 21156 raft_consensus.cc:2804] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:25.829406 19817 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
W20260709 12:14:25.788812 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 148533us
I20260709 12:14:25.768114 19815 raft_consensus.cc:3060] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:25.782301 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 213) took 1574 ms. Trace:
I20260709 12:14:25.769476 21474 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:25.771443 21504 raft_consensus.cc:3060] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.775007 19824 rpcz_store.cc:276] 0709 12:14:24.416571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.416888 (+   317us) service_pool.cc:224] Handling call
0709 12:14:25.686877 (+1269989us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b540036b0d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf4785735 00007fadf477d9fa 00007fadf97454c9 00007fadf2cc1c54 00007fadf2cc1be2 00007fadf2cc1b11 00007fadf2cc1a8c 00007fadf2cc0d42 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:25.687192 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1169096960}
I20260709 12:14:25.721083 21613 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.778172 21622 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:25.773649 21431 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:25.807636 20425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60840 (request call id 530) took 1229 ms. Trace:
I20260709 12:14:25.814499 21435 consensus_queue.cc:237] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.751892 21602 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.826303 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:25.828294 19788 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:25.772106 19821 raft_consensus.cc:2468] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:25.723788 21630 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.778537 19668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 214) took 1560 ms. Trace:
W20260709 12:14:25.836917 20398 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 2.209s (SENT) [suppressed 29 similar messages]
I20260709 12:14:25.835211 21156 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:25.748189 21345 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.836279 19669 rpcz_store.cc:276] 0709 12:14:24.208223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.217251 (+  9028us) service_pool.cc:224] Handling call
0709 12:14:24.217679 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.243388 (+ 25709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.243428 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.344235 (+100807us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.708558 (+364323us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:24.708643 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.708764 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.782039 (+1073275us) raft_consensus.cc:1685] finished
0709 12:14:25.782068 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.782226 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18126,"raft.queue_time_us":27770,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":60506,"thread_start_us":330907,"threads_started":1,"wal-append.queue_time_us":735810}
W20260709 12:14:25.850530 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.747280 21357 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.770376 21458 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.765903 21620 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:25.879288 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.845081 19569 catalog_manager.cc:5697] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 3, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:25.851428 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.830065 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:25.830404 21621 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.861353 19673 raft_consensus.cc:2393] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 3: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:25.853829 21466 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.864516 19668 rpcz_store.cc:276] 0709 12:14:24.218309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.218534 (+   225us) service_pool.cc:224] Handling call
0709 12:14:24.218884 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.307124 (+ 88240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.307169 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.347145 (+ 39976us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.787312 (+440167us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:24.787368 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.787487 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.778253 (+990766us) raft_consensus.cc:1685] finished
0709 12:14:25.778286 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.778457 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24782,"raft.queue_time_us":84163,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":34549,"thread_start_us":363850,"threads_started":1,"wal-append.queue_time_us":601160}
I20260709 12:14:25.866196 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.865281 21156 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:25.867447 19667 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:25.773572 20424 rpcz_store.cc:276] 0709 12:14:24.487757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.491178 (+  3421us) service_pool.cc:224] Handling call
0709 12:14:24.548762 (+ 57584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.185392 (+636630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.681823 (+496431us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b540074b154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:25.682054 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213826432}
I20260709 12:14:25.873364 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:25.873466 19714 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:25.876660 19750 raft_consensus.cc:1275] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:25.877221 19674 raft_consensus.cc:2468] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:25.878278 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:25.896039 19745 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:25.860487 19819 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:25.882678 19666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48662 (request call id 1818) took 1230 ms. Trace:
W20260709 12:14:25.866853 19557 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 62ed1b9937fd41ab83a0000603a38fc9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f9fb1b1a86c4eb99abdbaf9d239e324 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:25.883985 19673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48652 (request call id 1972) took 1229 ms. Trace:
I20260709 12:14:25.884186 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:25.885383 19671 raft_consensus.cc:2393] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:25.846886 21369 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.888927 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:25.890021 19675 raft_consensus.cc:2468] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:14:25.893522 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.909638 19669 raft_consensus.cc:1240] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:14:25.909442 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 81296us
I20260709 12:14:25.910352 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1805) took 1309 ms. Trace:
I20260709 12:14:25.838306 21612 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:14:25.897725 19821 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:25.897449 19673 rpcz_store.cc:276] 0709 12:14:24.654928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.780526 (+1125598us) service_pool.cc:224] Handling call
0709 12:14:25.883922 (+103396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.916229 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:25.916955 19745 raft_consensus.cc:2468] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:25.897812 19674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48662 (request call id 1820) took 1245 ms. Trace:
I20260709 12:14:25.897321 19666 rpcz_store.cc:276] 0709 12:14:24.652282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.835172 (+1182890us) service_pool.cc:224] Handling call
0709 12:14:25.882585 (+ 47413us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.902285 19815 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:25.905694 19671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48652 (request call id 1978) took 1248 ms. Trace:
I20260709 12:14:25.910909 19788 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:25.918396 19674 rpcz_store.cc:276] 0709 12:14:24.652881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.177832 (+524951us) service_pool.cc:224] Handling call
0709 12:14:25.897751 (+719919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.864437 21640 raft_consensus.cc:2804] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.918836 19671 rpcz_store.cc:276] 0709 12:14:24.657017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.827116 (+1170099us) service_pool.cc:224] Handling call
0709 12:14:25.905602 (+ 78486us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.912503 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.913018 19744 raft_consensus.cc:1240] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:25.911765 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:25.910698 19669 rpcz_store.cc:276] 0709 12:14:24.601365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.909067 (+1307702us) service_pool.cc:224] Handling call
0709 12:14:25.909410 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.910102 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.910301 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.920625 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:25.921104 19819 raft_consensus.cc:1240] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:25.859072 20425 rpcz_store.cc:276] 0709 12:14:24.577732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.615323 (+ 37591us) service_pool.cc:224] Handling call
0709 12:14:25.807363 (+1192040us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54006973d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:25.807558 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492809088}
I20260709 12:14:25.924443 19824 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:25.926191 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.926280 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:25.927486 19673 raft_consensus.cc:2468] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:25.880880 19569 catalog_manager.cc:5697] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 2 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 3 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:25.929725 19788 leader_election.cc:400] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713) with higher term. Message: Invalid argument: T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
I20260709 12:14:25.883828 21456 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:25.935029 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:25.937602 19668 raft_consensus.cc:2468] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:25.899120 21336 raft_consensus.cc:2804] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:25.940172 21628 log.cc:927] Time spent T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.614s	user 0.003s	sys 0.003s
I20260709 12:14:25.879199 21431 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:14:25.932070 21560 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:25.977931 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 782908us
I20260709 12:14:25.943686 21357 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:25.906895 21466 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.933943 21568 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.946722 21458 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:25.956910 21494 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:25.948558 19743 raft_consensus.cc:1240] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:25.949055 21423 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:25.951615 21573 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:25.862718 21474 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.952216 21592 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.953234 21456 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:25.954695 19675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48662 (request call id 1817) took 1302 ms. Trace:
I20260709 12:14:25.954938 21544 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:25.957998 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:25.962024 19788 leader_election.cc:400] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Vote denied by peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713) with higher term. Message: Invalid argument: T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
I20260709 12:14:26.018877 19788 leader_election.cc:403] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:14:25.925556 21620 raft_consensus.cc:2764] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:14:25.929653 19569 catalog_manager.cc:5697] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 2 to 4, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 4 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:25.911377 21369 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:25.966225 20429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 523) took 1794 ms. Trace:
I20260709 12:14:25.966347 19714 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:25.920958 21353 raft_consensus.cc:2804] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:25.969831 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:26.031456 19674 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:26.032471 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 66203.2us
I20260709 12:14:26.033185 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:25.976971 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:26.033986 19669 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:25.979334 19789 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:25.969417 20397 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:25.928014 21640 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:25.944494 21630 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:25.992875 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:25.934587 21577 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.921350 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:26.005632 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:26.008658 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:26.044353 19815 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:26.011502 21568 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:26.012755 21156 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:25.893325 21621 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:25.994871 21634 log.cc:927] Time spent T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:14:26.019068 19819 raft_consensus.cc:2468] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:26.017881 19675 rpcz_store.cc:276] 0709 12:14:24.651999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.216095 (+564096us) service_pool.cc:224] Handling call
0709 12:14:25.954490 (+738395us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b540004ae54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:25.954627 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750436736}
W20260709 12:14:26.019490 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 107525us
W20260709 12:14:26.019973 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 58139.3us
W20260709 12:14:26.055361 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.025766 20429 rpcz_store.cc:276] 0709 12:14:24.172377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.203086 (+ 30709us) service_pool.cc:224] Handling call
0709 12:14:24.230301 (+ 27215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.827356 (+1597055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.965962 (+138606us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54005a4454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:25.966160 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3533536000}
I20260709 12:14:25.995512 21336 raft_consensus.cc:697] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:26.044142 21544 raft_consensus.cc:2804] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:25.992571 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:26.058506 21544 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.059103 21544 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.059854 21336 consensus_queue.cc:237] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.060864 21626 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.041311 21640 raft_consensus.cc:3060] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.062130 19816 raft_consensus.cc:2393] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 3: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:26.066177 19675 pending_rounds.cc:85] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Aborting all ops after (but not including) 5
I20260709 12:14:26.066677 19675 pending_rounds.cc:107] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:14:26.067039 19675 raft_consensus.cc:2889] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:26.068552 21596 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.033358 19714 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:26.071115 21620 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:26.035231 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 65905.4us
I20260709 12:14:26.071839 21620 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:26.073264 20397 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:25.980845 19821 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:26.034164 19818 raft_consensus.cc:2410] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:14:26.037003 19713 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:25.992515 21560 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.038221 21423 raft_consensus.cc:2804] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:26.042066 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 62785.4us
I20260709 12:14:26.048566 19823 raft_consensus.cc:1240] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:26.022575 21281 raft_consensus.cc:2749] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713) with higher term. Message: Invalid argument: T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
I20260709 12:14:26.055238 19788 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.012708 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:26.024168 21592 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.057292 21156 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:25.974572 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:26.107893 19673 raft_consensus.cc:3060] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.075933 19667 raft_consensus.cc:1240] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:14:26.055646 19668 raft_consensus.cc:1240] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:26.111817 19667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1973) took 1456 ms. Trace:
I20260709 12:14:26.112125 19668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1808) took 1510 ms. Trace:
I20260709 12:14:26.112409 19667 rpcz_store.cc:276] 0709 12:14:24.655569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.045497 (+1389928us) service_pool.cc:224] Handling call
0709 12:14:26.075695 (+ 30198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.111391 (+ 35696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.111716 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.112962 19668 rpcz_store.cc:276] 0709 12:14:24.602189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.038550 (+1436361us) service_pool.cc:224] Handling call
0709 12:14:26.055377 (+ 16827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.111671 (+ 56294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.112045 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.077696 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:26.115288 20429 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:26.121043 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1141) took 1623 ms. Trace:
I20260709 12:14:26.041381 20433 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:26.048604 21642 raft_consensus.cc:2804] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:26.031116 21353 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.088155 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:26.131799 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 263523us
W20260709 12:14:26.132084 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 76955.3us
I20260709 12:14:26.095395 21474 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:26.096401 19789 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:26.097250 21602 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:26.048112 21577 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.101199 21568 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:26.101830 21560 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:26.038424 21581 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:14:26.083405 21567 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:26.103895 21621 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:26.105089 21494 consensus_queue.cc:1059] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:26.106915 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 163) took 2013 ms. Trace:
I20260709 12:14:26.163497 19742 rpcz_store.cc:276] 0709 12:14:24.093786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.632702 (+538916us) service_pool.cc:224] Handling call
0709 12:14:24.633103 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.705150 (+ 72047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.705197 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.956645 (+251448us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.505775 (+549130us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:25.505839 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.505971 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.106603 (+600632us) raft_consensus.cc:1685] finished
0709 12:14:26.106625 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.106832 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141818,"raft.queue_time_us":80300,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":428613,"threads_started":1,"wal-append.queue_time_us":803431}
I20260709 12:14:26.168520 21640 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:26.125669 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 288734us
I20260709 12:14:26.078732 19674 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:26.172820 19674 raft_consensus.cc:1275] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:26.173606 19674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 218) took 1430 ms. Trace:
I20260709 12:14:26.174194 19674 rpcz_store.cc:276] 0709 12:14:24.743634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.171899 (+1428265us) service_pool.cc:224] Handling call
0709 12:14:26.172344 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.173306 (+   962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.173536 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.165405 19669 raft_consensus.cc:2468] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 6.
I20260709 12:14:26.174629 20397 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:26.178678 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 219) took 1420 ms. Trace:
I20260709 12:14:26.179762 19674 raft_consensus.cc:1275] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:26.181435 19674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 220) took 1356 ms. Trace:
I20260709 12:14:26.182181 19674 rpcz_store.cc:276] 0709 12:14:24.824691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.177958 (+1353267us) service_pool.cc:224] Handling call
0709 12:14:26.178835 (+   877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.180792 (+  1957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.181309 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.186343 19674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 221) took 1361 ms. Trace:
I20260709 12:14:26.132266 19671 raft_consensus.cc:2468] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:26.096098 21345 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:26.154573 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 117656us
I20260709 12:14:26.149482 21353 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.156140 21156 raft_consensus.cc:2749] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.156859 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:26.160642 19788 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:26.254801 19666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1806) took 1652 ms. Trace:
W20260709 12:14:26.370307 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 209717us
I20260709 12:14:26.335337 19673 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:26.243425 21620 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:26.317480 19713 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.189221 21640 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:26.190920 20398 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:26.192232 19640 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
W20260709 12:14:26.193753 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 108735us
I20260709 12:14:26.194964 21612 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:26.123870 21596 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:26.155831 21642 raft_consensus.cc:697] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:26.115348 21281 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.158334 21474 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.127344 19746 rpcz_store.cc:276] 0709 12:14:24.497366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.963466 (+466100us) service_pool.cc:224] Handling call
0709 12:14:24.963841 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.997111 (+ 33270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.997162 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:25.013796 (+ 16634us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.834747 (+820951us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:26.117766 (+283019us) log.cc:844] Serialized 14 byte log entry
0709 12:14:26.118054 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.119510 (+  1456us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.119588 (+    78us) raft_consensus.cc:1685] finished
0709 12:14:26.119609 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.119854 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18000,"raft.queue_time_us":36882,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":73473,"thread_start_us":940915,"threads_started":2,"wal-append.queue_time_us":871150}
I20260709 12:14:26.194342 21585 raft_consensus.cc:2749] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:26.311142 19674 rpcz_store.cc:276] 0709 12:14:24.825195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.184077 (+1358882us) service_pool.cc:224] Handling call
0709 12:14:26.185182 (+  1105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.185566 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.185605 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.185713 (+   108us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:26.185785 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.185926 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.186204 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:26.262549 21600 consensus_meta.cc:287] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.615s	user 0.003s	sys 0.008s
W20260709 12:14:26.378166 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 184890us
I20260709 12:14:26.326448 21567 raft_consensus.cc:697] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:26.342577 20429 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
W20260709 12:14:26.305817 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 249084us
I20260709 12:14:26.439863 19789 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:26.254315 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 122506us
I20260709 12:14:26.462604 19715 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.356503 21592 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:26.441421 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 249260us
W20260709 12:14:26.444881 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 127493us
I20260709 12:14:26.448066 19671 raft_consensus.cc:1240] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.450582 19668 raft_consensus.cc:1240] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:14:26.356458 21646 log.cc:927] Time spent T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:14:26.225147 19638 leader_election.cc:336] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.661s (SENT)
I20260709 12:14:26.473796 19713 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.372517 19788 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:26.260336 21456 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:26.476920 19671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1979) took 1514 ms. Trace:
I20260709 12:14:26.261093 21631 raft_consensus.cc:2804] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:26.155246 21423 raft_consensus.cc:697] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:26.458747 20397 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:26.440722 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 249895us
I20260709 12:14:26.262961 21466 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:26.460301 19674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1984) took 1252 ms. Trace:
I20260709 12:14:26.498675 19674 rpcz_store.cc:276] 0709 12:14:25.202848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.453833 (+1250985us) service_pool.cc:224] Handling call
0709 12:14:26.454143 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.454338 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.454362 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.454407 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:26.454443 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.454500 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.454630 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.499423 19715 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:26.500489 19674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1985) took 1297 ms. Trace:
I20260709 12:14:26.500902 19674 rpcz_store.cc:276] 0709 12:14:25.203237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.499689 (+1296452us) service_pool.cc:224] Handling call
0709 12:14:26.499995 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.500177 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.500201 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.500241 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:26.500275 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.500324 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.500439 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.502298 19674 raft_consensus.cc:1240] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:14:26.227767 21637 log.cc:927] Time spent T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:14:26.160707 21650 raft_consensus.cc:2804] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:26.438907 21643 raft_consensus.cc:2804] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:26.482836 21596 raft_consensus.cc:2804] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:26.192306 21622 consensus_queue.cc:1059] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.299s
I20260709 12:14:26.179927 19669 rpcz_store.cc:276] 0709 12:14:24.757969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.177425 (+1419456us) service_pool.cc:224] Handling call
0709 12:14:26.177923 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.178159 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.178200 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.178258 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:26.178339 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.178416 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.178603 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.227983 21454 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:26.371519 21626 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:26.447381 21573 raft_consensus.cc:2804] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:26.474071 19638 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:26.165366 21437 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:26.256165 21460 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:26.102640 21544 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.265472 21577 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:26.476955 19789 leader_election.cc:400] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
W20260709 12:14:26.535914 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 69795.7us
I20260709 12:14:26.537709 19789 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.479015 19640 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:26.475574 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 103136us
I20260709 12:14:26.538888 21156 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:26.539650 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 60749.9us
I20260709 12:14:26.541668 19640 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:26.475019 19668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1980) took 1508 ms. Trace:
I20260709 12:14:26.542673 19668 rpcz_store.cc:276] 0709 12:14:24.966338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.371328 (+1404990us) service_pool.cc:224] Handling call
0709 12:14:26.450357 (+ 79029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.474647 (+ 24290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.474943 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.328353 21623 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 12:14:26.484257 19671 rpcz_store.cc:276] 0709 12:14:24.962964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.370973 (+1408009us) service_pool.cc:224] Handling call
0709 12:14:26.447879 (+ 76906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.476500 (+ 28621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.476818 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.261865 21431 consensus_queue.cc:1059] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.204s
I20260709 12:14:26.448709 21651 raft_consensus.cc:2749] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:26.484632 21435 raft_consensus.cc:2804] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.504508 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:26.505307 20398 leader_election.cc:400] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf for earlier term 3. Current term is 4.
I20260709 12:14:26.512921 21345 raft_consensus.cc:2804] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:26.505998 19674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1986) took 1227 ms. Trace:
I20260709 12:14:26.559844 19674 rpcz_store.cc:276] 0709 12:14:25.279064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.501773 (+1222709us) service_pool.cc:224] Handling call
0709 12:14:26.502077 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.502618 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.505882 (+  3264us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:26.560262 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 67479.4us
I20260709 12:14:26.561124 19674 raft_consensus.cc:1240] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.508791 19713 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.562461 20398 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:26.476363 21585 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:26.525395 21573 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.359627 21504 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.458083 21474 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.524869 19669 raft_consensus.cc:1240] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:26.456594 21612 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:26.525900 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 300775us
I20260709 12:14:26.611871 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:26.612453 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.612561 19817 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.511409 21668 consensus_queue.cc:1059] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:14:26.550410 19789 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.556344 19668 raft_consensus.cc:1240] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.522250 21596 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.447770 21336 consensus_queue.cc:1059] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:14:26.562660 19674 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:26.543512 21486 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:26.625056 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:26.534562 21663 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.533874 21466 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.545670 21643 raft_consensus.cc:697] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:26.552737 21592 raft_consensus.cc:2804] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:26.563980 21640 consensus_queue.cc:1048] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:14:26.528644 21661 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:26.549994 21456 raft_consensus.cc:2749] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:26.611137 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 102434us
I20260709 12:14:26.571409 21568 consensus_queue.cc:1059] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:14:26.622025 21366 raft_consensus.cc:2804] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:26.513875 21650 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.616393 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:26.552470 21435 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:26.621877 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 59534.1us
W20260709 12:14:26.650019 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 105789us
I20260709 12:14:26.565145 21620 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.498172 21423 consensus_queue.cc:237] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:26.526517 21454 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.628386 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:26.565356 21357 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:26.569028 21626 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.625628 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:26.754377 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 92841.1us
I20260709 12:14:26.755041 19674 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:26.570281 21345 raft_consensus.cc:697] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:26.634023 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 83719.4us
I20260709 12:14:26.757085 19789 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.543332 21437 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:14:26.576826 21573 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.534675 21600 raft_consensus.cc:2749] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.574821 21669 raft_consensus.cc:2804] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:26.560628 21560 consensus_queue.cc:1059] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:14:26.555114 21460 raft_consensus.cc:2804] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:26.505411 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:26.784715 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.620483 21670 consensus_queue.cc:1048] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:14:26.625196 21596 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.623973 21631 raft_consensus.cc:697] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:26.648813 19670 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
W20260709 12:14:26.650978 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.646513 19713 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.669500 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:26.669699 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:26.799645 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:26.800881 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:26.667891 21456 consensus_queue.cc:1048] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:14:26.651734 21431 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.645326 21485 raft_consensus.cc:2804] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:26.637518 21651 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
W20260709 12:14:26.723832 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 55007.6us
I20260709 12:14:26.646051 21666 raft_consensus.cc:2749] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.742899 21667 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 12:14:26.674757 21659 log.cc:927] Time spent T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:14:26.747078 19817 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:26.646481 21661 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:26.670558 21435 raft_consensus.cc:3060] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:26.748962 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 186887us
I20260709 12:14:26.834820 21494 raft_consensus.cc:2804] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:26.835631 21494 raft_consensus.cc:697] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:26.664362 21650 raft_consensus.cc:3060] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:26.656785 21369 consensus_meta.cc:287] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.003s
I20260709 12:14:26.836637 21369 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:26.836900 21494 consensus_queue.cc:237] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.839260 21369 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:26.839395 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:26.656996 21652 log.cc:927] Time spent T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 12:14:26.840106 19818 raft_consensus.cc:3060] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.758484 19789 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:26.826642 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:26.675231 21568 raft_consensus.cc:3055] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:26.843457 19746 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:26.636804 21663 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.641985 21466 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.611918 21567 consensus_queue.cc:237] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:26.736261 21472 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:26.613313 21642 consensus_queue.cc:237] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.798259 19674 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
W20260709 12:14:26.822755 21657 log.cc:927] Time spent T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:14:26.802239 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:26.675712 21620 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.675431 21357 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:26.814136 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 167729us
I20260709 12:14:26.868785 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:26.868882 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 110483us
I20260709 12:14:26.662667 21366 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.801898 21629 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.826370 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:26.874574 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:26.832125 19748 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:26.833086 21156 raft_consensus.cc:3055] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:26.877282 21156 raft_consensus.cc:740] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
W20260709 12:14:26.833926 21673 log.cc:927] Time spent T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:14:26.788360 21460 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:26.844776 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:26.845481 20398 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:26.846066 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:26.796779 21669 raft_consensus.cc:697] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 6 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:26.847141 21661 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.847725 21544 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:26.846714 21568 raft_consensus.cc:740] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:26.864221 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:26.888995 19674 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:26.802347 19667 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.004s	sys 0.026s
W20260709 12:14:26.891758 19667 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.004s	sys 0.026s
I20260709 12:14:26.868882 19713 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.786934 21622 raft_consensus.cc:2804] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:26.870183 19789 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.811687 21676 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:26.870894 19818 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:26.874689 21336 raft_consensus.cc:2804] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:26.878523 19745 raft_consensus.cc:2393] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:26.880570 19819 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:26.779031 21626 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:26.866179 21417 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.835855 19640 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:26.914083 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 78286.9us
I20260709 12:14:26.813484 21431 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.872083 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:26.863667 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:26.881402 21156 consensus_queue.cc:260] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.897357 19713 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.874920 21366 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.869712 19668 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:26.821925 21353 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.903224 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:26.885283 20427 raft_consensus.cc:2393] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:26.905428 19675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 215) took 2220 ms. Trace:
I20260709 12:14:26.905174 21685 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.883255 21460 raft_consensus.cc:3060] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.859892 21678 consensus_queue.cc:1048] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:14:26.847258 21485 raft_consensus.cc:697] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:26.867596 21592 raft_consensus.cc:697] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:26.925460 19674 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:26.977885 19673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1983) took 1814 ms. Trace:
I20260709 12:14:26.931456 19818 raft_consensus.cc:2393] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:26.931699 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:26.931126 19675 rpcz_store.cc:276] 0709 12:14:24.685000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.065466 (+1380466us) service_pool.cc:224] Handling call
0709 12:14:26.065937 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.068005 (+  2068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.068039 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.068742 (+   703us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.154102 (+ 85360us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:26.154174 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.154257 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.905142 (+750885us) raft_consensus.cc:1685] finished
0709 12:14:26.905172 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.905343 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":84850,"threads_started":1,"wal-append.queue_time_us":415785}
I20260709 12:14:26.896229 21622 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:26.978432 19673 rpcz_store.cc:276] 0709 12:14:25.163517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.374672 (+1211155us) service_pool.cc:224] Handling call
0709 12:14:26.375196 (+   524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.376056 (+   860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.376105 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.376773 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.498651 (+121878us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:26.498697 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.498801 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.977645 (+478844us) raft_consensus.cc:1685] finished
0709 12:14:26.977669 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.977816 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":134,"thread_start_us":121352,"threads_started":1,"wal-append.queue_time_us":262076}
I20260709 12:14:26.980583 19675 raft_consensus.cc:1240] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:26.896131 21474 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:26.953804 21668 consensus_queue.cc:1059] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:26.908846 21585 raft_consensus.cc:2804] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:26.961373 21156 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.962572 19713 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:26.909122 21504 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:26.828744 21651 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:26.966692 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 58766.5us
I20260709 12:14:26.908277 21568 consensus_queue.cc:260] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:27.006989 20396 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:26.928596 21600 consensus_queue.cc:1059] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:14:26.872803 21345 consensus_queue.cc:237] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:26.920378 21472 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:27.000043 19673 raft_consensus.cc:1275] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:26.951467 21544 raft_consensus.cc:2804] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:26.920089 21688 raft_consensus.cc:2804] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:27.089901 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 82987.1us
I20260709 12:14:26.983698 21622 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.088934 19823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 1966) took 1268 ms. Trace:
I20260709 12:14:27.090539 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:27.005309 19667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 216) took 2303 ms. Trace:
I20260709 12:14:27.091578 19823 rpcz_store.cc:276] 0709 12:14:25.820490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.828801 (+  8311us) service_pool.cc:224] Handling call
0709 12:14:25.829002 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.085288 (+256286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.088639 (+1003351us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400023354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:27.088867 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501211904}
I20260709 12:14:26.887166 21629 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.960927 21685 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:27.000911 21585 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:27.172091 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.099156 20396 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:27.246282 21423 raft_consensus.cc:2804] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:27.247031 21423 raft_consensus.cc:697] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:27.247920 21423 consensus_queue.cc:237] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:27.119362 21485 consensus_queue.cc:237] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:27.251322 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 152275us
I20260709 12:14:26.875973 21643 consensus_queue.cc:237] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:26.899047 21631 consensus_queue.cc:237] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:27.084156 21612 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:26.911489 21676 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:27.090693 21472 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.094596 21504 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:27.098560 21667 raft_consensus.cc:2749] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.093483 21688 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:27.286424 21472 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:27.276636 21592 consensus_queue.cc:237] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:27.233980 21668 raft_consensus.cc:2749] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:27.269304 21568 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:27.286012 21650 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:27.337894 21675 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:27.347927 21686 log.cc:927] Time spent T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 12:14:26.372097 19666 rpcz_store.cc:276] 0709 12:14:24.601697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.935079 (+1333382us) service_pool.cc:224] Handling call
0709 12:14:25.958696 (+ 23617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.967762 (+  9066us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:26.190759 (+222997us) log.cc:844] Serialized 14 byte log entry
0709 12:14:26.253287 (+ 62528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.253604 (+   317us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:26.253663 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.253747 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.253900 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":473700,"raft.queue_time_us":401,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":55390,"thread_start_us":259856,"threads_started":2}
I20260709 12:14:27.357314 21454 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:27.377292 21651 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:27.376952 21675 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:27.383512 21676 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:27.089818 21669 consensus_queue.cc:237] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:27.360430 21629 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:27.372315 21620 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:27.311856 21688 raft_consensus.cc:3060] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.375211 21612 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.290313 21437 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:27.288550 21504 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.359962 21623 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:14:27.400812 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 470897us
W20260709 12:14:27.401626 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 498011us
W20260709 12:14:27.420370 20398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.020s
W20260709 12:14:27.421135 20398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.005s	sys 0.021s
W20260709 12:14:27.421830 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 576386us
I20260709 12:14:27.419126 19789 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:27.471138 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 52145.1us
W20260709 12:14:27.490753 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 528225us
I20260709 12:14:27.259960 21585 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:27.392105 21612 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:27.496737 19789 leader_election.cc:400] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
I20260709 12:14:27.403916 21504 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.506222 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:27.519570 21336 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.081s	sys 0.119s
W20260709 12:14:27.519948 21666 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.015s
I20260709 12:14:27.422096 21353 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:27.493074 19713 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:28.102710 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:28.079119 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.085700 19671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 1989) took 2220 ms. Trace:
W20260709 12:14:28.104895 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.105216 19671 rpcz_store.cc:276] 0709 12:14:25.865153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.544923 (+679770us) service_pool.cc:224] Handling call
0709 12:14:26.556903 (+ 11980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.804139 (+247236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.804189 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.804274 (+    85us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:26.804327 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.085313 (+1280986us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400251054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:28.085382 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.085614 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567967488}
W20260709 12:14:28.106940 21485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.009s	sys 0.009s
W20260709 12:14:28.107635 21485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.009s	sys 0.009s
I20260709 12:14:28.113098 19714 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:27.095515 19667 rpcz_store.cc:276] 0709 12:14:24.702335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.131274 (+1428939us) service_pool.cc:224] Handling call
0709 12:14:26.159347 (+ 28073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.159608 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:26.892432 (+732824us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.004804 (+112372us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.004886 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:27.004967 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.005065 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.005231 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26459,"prepare.queue_time_us":295836,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":118579,"thread_start_us":750883,"threads_started":2}
W20260709 12:14:27.877674 19788 leader_election.cc:336] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 2.204s (SENT)
W20260709 12:14:28.027041 19557 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 62ed1b9937fd41ab83a0000603a38fc9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1f9fb1b1a86c4eb99abdbaf9d239e324 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:27.857777 19670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48662 (request call id 1815) took 3206 ms (client timeout 2204 ms). Trace:
W20260709 12:14:28.118366 19557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 91416.3us
W20260709 12:14:28.118490 19670 rpcz_store.cc:269] 0709 12:14:24.651449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.220098 (+568649us) service_pool.cc:224] Handling call
0709 12:14:27.857442 (+2637344us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540002e754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:27.857649 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950685568}
W20260709 12:14:28.119892 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 623257us
W20260709 12:14:27.689010 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.122148 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.116882 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 623838us
W20260709 12:14:27.520375 21336 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.081s	sys 0.119s
I20260709 12:14:28.127889 19713 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:28.127079 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 249454us
W20260709 12:14:28.130528 19816 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.001s	sys 0.021s
I20260709 12:14:28.136596 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:28.131672 20428 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.002s	sys 0.023s
I20260709 12:14:28.252242 21336 raft_consensus.cc:697] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:27.797564 21612 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:28.288905 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:27.520567 21666 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.013s	sys 0.016s
I20260709 12:14:27.793507 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:28.142311 21664 raft_consensus.cc:2804] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:28.270501 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:28.142023 21458 raft_consensus.cc:2804] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:28.253317 21485 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.272329 21600 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:28.272987 21704 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:27.853003 21691 log.cc:927] Time spent T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f: Append to log took a long time: real 0.360s	user 0.002s	sys 0.000s
W20260709 12:14:28.274960 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.972258 21656 log.cc:927] Time spent T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 1.490s	user 0.004s	sys 0.002s
W20260709 12:14:27.761415 21435 consensus_meta.cc:287] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.927s	user 0.015s	sys 0.004s
W20260709 12:14:27.991125 21460 consensus_meta.cc:287] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 1.007s	user 0.011s	sys 0.002s
I20260709 12:14:28.275749 21581 raft_consensus.cc:3055] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:27.922109 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:28.276538 21692 consensus_queue.cc:1059] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:27.494326 21620 raft_consensus.cc:2804] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:28.278714 19749 raft_consensus.cc:2410] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:14:28.398808 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 277855us
I20260709 12:14:28.336771 21353 raft_consensus.cc:2804] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:28.338346 21664 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:28.114523 19714 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:28.056600 21417 consensus_meta.cc:287] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.140s	user 0.008s	sys 0.005s
I20260709 12:14:28.081539 21703 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:27.800274 21596 consensus_meta.cc:287] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.988s	user 0.009s	sys 0.003s
W20260709 12:14:27.732023 21573 consensus_meta.cc:287] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.943s	user 0.011s	sys 0.002s
W20260709 12:14:27.919963 21644 log.cc:927] Time spent T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 1.824s	user 0.007s	sys 0.003s
W20260709 12:14:27.660033 21281 consensus_meta.cc:287] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 1.199s	user 0.022s	sys 0.000s
I20260709 12:14:28.281644 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:28.292145 19816 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.001s	sys 0.034s
W20260709 12:14:28.288954 20428 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.008s	sys 0.027s
W20260709 12:14:28.250419 20396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.017s	sys 0.017s
I20260709 12:14:27.509508 21431 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:28.412490 21622 consensus_meta.cc:287] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 1.240s	user 0.009s	sys 0.005s
W20260709 12:14:27.637602 21366 consensus_meta.cc:287] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.000s
I20260709 12:14:28.296337 19675 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:28.110242 21663 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:28.419950 21664 raft_consensus.cc:3060] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:28.430812 21696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.022s	sys 0.060s
I20260709 12:14:27.609184 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:27.871999 21486 raft_consensus.cc:3055] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:14:28.110564 21592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.004s	sys 0.012s
W20260709 12:14:27.653837 21661 consensus_meta.cc:287] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.000s
I20260709 12:14:27.796133 21613 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:28.311474 19788 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:28.314980 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 187219us
W20260709 12:14:28.488466 21696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.023s	sys 0.060s
I20260709 12:14:28.307132 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:27.766052 20427 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60840 (request call id 533) took 1903 ms (client timeout 2193 ms). Trace:
W20260709 12:14:28.023370 21687 log.cc:927] Time spent T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.605s	user 0.002s	sys 0.000s
I20260709 12:14:28.141784 21474 raft_consensus.cc:3055] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:28.325026 19748 raft_consensus.cc:2410] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:28.269754 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:28.453732 21573 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.499298 20426 raft_consensus.cc:3060] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.977375 21577 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.109432 21650 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:27.629333 21357 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:27.895496 21685 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:27.643916 21544 raft_consensus.cc:697] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:28.128803 21626 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:28.295207 21690 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.350205 20398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.016s	sys 0.024s
W20260709 12:14:28.584283 20398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.017s	sys 0.024s
W20260709 12:14:28.584640 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 1.16e+06us
I20260709 12:14:28.338291 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:28.353454 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.654126 21670 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.669s
I20260709 12:14:27.703490 21472 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:28.509888 20427 rpcz_store.cc:269] 0709 12:14:25.862385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.872795 (+ 10410us) service_pool.cc:224] Handling call
0709 12:14:27.765741 (+1892946us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b540074de54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:27.765955 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1825604864}
I20260709 12:14:28.633296 21472 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:28.337565 21458 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.296504 21612 raft_consensus.cc:493] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:28.634182 21458 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:27.534849 21675 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:28.380443 20430 raft_consensus.cc:2468] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
W20260709 12:14:28.058175 21456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.008s	sys 0.007s
I20260709 12:14:28.411633 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:28.434414 19672 raft_consensus.cc:2410] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:14:28.453792 20396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.018s	sys 0.017s
I20260709 12:14:28.084251 21602 raft_consensus.cc:3055] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:28.379765 21581 raft_consensus.cc:740] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:28.477830 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:28.667740 19674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1823) took 2053 ms. Trace:
I20260709 12:14:28.397955 21620 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:27.765992 21665 log.cc:927] Time spent T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 1.206s	user 0.000s	sys 0.007s
I20260709 12:14:28.483647 19668 raft_consensus.cc:2393] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 3: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:28.484803 21366 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.299057 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:28.361380 21600 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:28.495622 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1147) took 3993 ms. Trace:
I20260709 12:14:28.694010 19747 rpcz_store.cc:276] 0709 12:14:24.499239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.154574 (+655335us) service_pool.cc:224] Handling call
0709 12:14:25.220272 (+ 65698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.278266 (+ 57994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.278301 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:25.559468 (+281167us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.996498 (+437030us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:25.996558 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.996659 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.894546 (+1897887us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b24002836e8. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15189c4 00007fadf1516acb 00007fadf16d1dc9 00007fadf16d1a55 00007fadf16d109d 00007fadf430310e 00007fadf431a88c 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221
0709 12:14:28.485551 (+591005us) raft_consensus.cc:1685] finished
0709 12:14:28.485574 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.492410 (+  6836us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57543,"raft.queue_time_us":59653,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":41001344,"thread_start_us":331803,"threads_started":1,"wal-append.queue_time_us":453906}
I20260709 12:14:28.381341 21435 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.411325 21701 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:28.374429 21704 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.712937 21704 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:28.716228 21366 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:28.471822 21281 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:28.686002 21620 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:28.387986 21460 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:28.503665 19713 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:28.316576 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:28.506554 19744 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:28.496343 21486 raft_consensus.cc:740] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:28.448624 21692 consensus_queue.cc:1059] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 12:14:28.487519 21567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.070s	sys 0.089s
I20260709 12:14:28.431773 21596 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:28.497138 21592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.008s	sys 0.026s
I20260709 12:14:27.767544 21636 raft_consensus.cc:3055] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:28.446861 21703 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:28.260758 21621 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.952s	user 0.018s	sys 0.024s
I20260709 12:14:28.522203 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:28.486070 21622 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:28.517402 21688 consensus_meta.cc:287] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.128s	user 0.012s	sys 0.002s
I20260709 12:14:28.515735 21474 raft_consensus.cc:740] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:28.521709 19741 raft_consensus.cc:2368] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4.
I20260709 12:14:28.493522 21336 consensus_queue.cc:237] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:28.595369 21696 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.513587 21661 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.664367 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:28.634418 21612 raft_consensus.cc:515] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:28.668208 19674 rpcz_store.cc:276] 0709 12:14:26.614427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.977385 (+362958us) service_pool.cc:224] Handling call
0709 12:14:26.977852 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.978157 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.978199 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.997706 (+ 19507us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.102600 (+1104894us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:28.666989 (+564389us) log.cc:844] Serialized 14 byte log entry
0709 12:14:28.667327 (+   338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.667445 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.667492 (+    47us) raft_consensus.cc:1685] finished
0709 12:14:28.667501 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.667667 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":827979,"threads_started":2,"wal-append.queue_time_us":1437118}
W20260709 12:14:28.634758 21568 consensus_meta.cc:287] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.266s	user 0.006s	sys 0.007s
I20260709 12:14:28.778555 21474 consensus_queue.cc:260] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.780000 21474 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.780445 21458 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.763579 21688 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.782994 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 235) took 2107 ms. Trace:
I20260709 12:14:28.668862 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:28.783568 19816 rpcz_store.cc:276] 0709 12:14:26.676066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.774625 (+ 98559us) service_pool.cc:224] Handling call
0709 12:14:26.775566 (+   941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:27.229281 (+453715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.229414 (+   133us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:27.240220 (+ 10806us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.452885 (+1212665us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:28.452938 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.529436 (+ 76498us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003a75d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:28.529505 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.782596 (+253091us) raft_consensus.cc:1685] finished
0709 12:14:28.782622 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.782914 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":356896,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"spinlock_wait_cycles":408561536,"thread_start_us":1412328,"threads_started":2,"wal-append.queue_time_us":1458976}
I20260709 12:14:28.785274 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:28.641711 21456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.248s	user 0.010s	sys 0.007s
I20260709 12:14:28.639204 21711 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.525585 21577 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.704623 20424 raft_consensus.cc:2393] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 5: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:28.668464 21630 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.705034 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:28.765380 21692 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.705538 19672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48652 (request call id 1977) took 4048 ms (client timeout 1977 ms). Trace:
I20260709 12:14:28.705787 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:28.719439 19749 raft_consensus.cc:2393] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:28.661792 21602 raft_consensus.cc:740] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:28.720773 19824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 233) took 2089 ms. Trace:
I20260709 12:14:28.375157 21485 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:28.805768 21721 log.cc:927] Time spent T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:14:28.775832 21544 consensus_queue.cc:237] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:28.735738 21718 log.cc:927] Time spent T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:14:28.688380 21472 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:28.807904 21472 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:28.750325 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 246713us
I20260709 12:14:28.751253 19666 raft_consensus.cc:2393] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 2: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
W20260709 12:14:28.752094 21567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.070s	sys 0.090s
I20260709 12:14:28.642419 21690 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:28.815622 21602 consensus_queue.cc:260] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.817137 21602 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:28.818015 21690 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:28.752662 21707 log.cc:927] Time spent T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:14:28.819501 19741 raft_consensus.cc:1275] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:28.819854 21466 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:28.822531 21458 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:28.824019 21688 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:28.825188 21504 consensus_meta.cc:287] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 1.254s	user 0.013s	sys 0.000s
I20260709 12:14:28.826205 21661 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:28.825990 21504 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.827088 20429 raft_consensus.cc:1240] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:28.829351 21504 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:28.831645 21573 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:28.763873 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:28.833434 19673 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.016s	sys 0.006s
W20260709 12:14:28.833863 19673 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.016s	sys 0.006s
W20260709 12:14:28.757872 21621 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.482s	user 0.019s	sys 0.024s
I20260709 12:14:28.777575 21486 consensus_queue.cc:260] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:28.689599 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:28.839584 19668 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:28.757082 21366 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.787739 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:28.848728 19748 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:28.789178 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:28.753315 21636 raft_consensus.cc:740] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:28.795789 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:28.766865 21643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.107s	user 0.022s	sys 0.008s
W20260709 12:14:28.767848 21720 log.cc:927] Time spent T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:14:28.798795 19750 raft_consensus.cc:2368] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4.
W20260709 12:14:28.799031 19672 rpcz_store.cc:269] 0709 12:14:24.656742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.097161 (+440419us) service_pool.cc:224] Handling call
0709 12:14:28.705308 (+3608147us) spinlock_profiling.cc:243] Waited 3.34 s on lock 0x7b5400391a54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:28.705445 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7671395072}
I20260709 12:14:28.731395 21701 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.733669 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:28.802250 19824 rpcz_store.cc:276] 0709 12:14:26.631502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.632010 (+   508us) service_pool.cc:224] Handling call
0709 12:14:26.651932 (+ 19922us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.652185 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.652212 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.652741 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.918914 (+266173us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:26.918956 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.919045 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.720499 (+1801454us) raft_consensus.cc:1685] finished
0709 12:14:28.720527 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.720697 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":175765,"threads_started":1,"wal-append.queue_time_us":600289}
I20260709 12:14:28.798167 21711 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.786633 21696 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:28.829707 20429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 541) took 1940 ms. Trace:
I20260709 12:14:28.747028 21626 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:28.874305 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:28.790336 21353 raft_consensus.cc:697] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:28.876348 20429 rpcz_store.cc:276] 0709 12:14:26.888960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.889105 (+   145us) service_pool.cc:224] Handling call
0709 12:14:26.889450 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.827789 (+1938339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.829352 (+  1563us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b540074b154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:28.829611 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4455447808}
I20260709 12:14:28.753438 21581 consensus_queue.cc:260] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:28.879343 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:28.891137 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:28.893345 19675 raft_consensus.cc:1240] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:14:28.879454 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:28.850750 19748 raft_consensus.cc:1240] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:28.882076 19674 raft_consensus.cc:2393] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:28.895841 19675 raft_consensus.cc:1275] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:14:28.900913 19667 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.009s	sys 0.017s
W20260709 12:14:28.901566 19667 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.009s	sys 0.017s
I20260709 12:14:28.901965 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:28.902822 19816 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
W20260709 12:14:28.882408 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 268383us
I20260709 12:14:28.885241 21650 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:28.889204 21458 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.890156 21661 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:28.891111 21642 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:28.891506 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 491638us
I20260709 12:14:28.907919 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:28.918103 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 361254us
I20260709 12:14:28.919162 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:28.921154 19674 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:28.922274 19821 raft_consensus.cc:1240] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.922757 19674 raft_consensus.cc:1275] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:28.891284 21643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.024s	sys 0.009s
W20260709 12:14:28.928759 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.933094 19742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.000s	sys 0.028s
W20260709 12:14:28.933236 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.933372 19666 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:28.933640 19742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.000s	sys 0.028s
W20260709 12:14:28.934712 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.935315 19789 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:28.935668 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.940125 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.813349 21630 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:28.882897 21437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.009s	sys 0.039s
W20260709 12:14:28.947510 19640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.021s	sys 0.034s
W20260709 12:14:28.948011 19640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.021s	sys 0.034s
I20260709 12:14:28.948951 19640 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:28.949528 19789 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:28.950599 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:28.952083 19640 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:28.945923 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:28.954476 19815 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:28.946805 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:28.947096 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:28.952244 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.955468 19821 raft_consensus.cc:3060] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:28.945119 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 633690us
I20260709 12:14:28.901223 21626 raft_consensus.cc:697] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:28.959429 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:28.943679 19668 raft_consensus.cc:2468] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:28.925690 21486 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.968698 19671 raft_consensus.cc:2410] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:28.926187 21581 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:28.965564 19788 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:28.973398 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.973575 19824 raft_consensus.cc:2393] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 3: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:28.975401 19789 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:28.978955 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:28.814316 21692 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:28.962651 21437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.010s	sys 0.039s
I20260709 12:14:28.946415 21456 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:28.959887 21573 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.986617 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:28.984547 19640 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:28.991107 19824 raft_consensus.cc:3060] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:28.988741 19816 raft_consensus.cc:1240] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.984125 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:28.989017 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.992936 19820 raft_consensus.cc:2468] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
W20260709 12:14:28.993225 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.964429 21568 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.917811 21458 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.994379 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:28.996765 21725 log.cc:927] Time spent T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.148s	user 0.000s	sys 0.002s
I20260709 12:14:28.997757 21596 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:28.918674 21650 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:28.994160 21568 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.929180 21661 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:29.001739 21485 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:28.877481 21636 consensus_queue.cc:260] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:29.026288 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:29.001586 21600 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:29.028695 19748 raft_consensus.cc:1240] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:29.026641 19747 pending_rounds.cc:85] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: Aborting all ops after (but not including) 2
I20260709 12:14:29.085044 19747 pending_rounds.cc:107] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:29.085440 19747 raft_consensus.cc:2889] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:28.999909 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:29.085427 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:28.990672 21456 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:28.943840 21642 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:14:29.077335 19821 raft_consensus.cc:2468] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:28.991271 21435 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:29.035209 21734 raft_consensus.cc:2764] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:14:29.078584 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:29.023535 21573 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:29.087169 19822 raft_consensus.cc:2468] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:29.090065 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:29.091570 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:29.114874 19714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.015s	sys 0.035s
W20260709 12:14:29.115513 19714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.015s	sys 0.035s
I20260709 12:14:29.094897 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:29.116482 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 1.00196e+06us
I20260709 12:14:29.035118 21643 raft_consensus.cc:2764] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:14:29.086124 21709 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.119447 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:29.094133 21661 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:28.996850 21577 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:29.072309 21472 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:29.123117 20428 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.017s	sys 0.040s
I20260709 12:14:29.070907 21596 raft_consensus.cc:2804] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:29.141482 20428 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.017s	sys 0.040s
I20260709 12:14:29.108029 19715 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:29.142760 20428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60846 (request call id 271) took 1653 ms. Trace:
I20260709 12:14:29.108325 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:29.110183 19815 raft_consensus.cc:2468] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:29.111630 21701 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:29.151916 21691 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.003s
W20260709 12:14:29.152421 21691 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.000s	sys 0.003s
W20260709 12:14:29.114259 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 441246us
I20260709 12:14:28.996843 21458 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:29.098086 19640 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:28.998473 21353 consensus_queue.cc:237] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:29.123443 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:28.994383 21705 consensus_queue.cc:1059] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.256s
W20260709 12:14:29.134953 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.071596 21592 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:29.146420 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:29.094133 21711 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:29.099534 21626 consensus_queue.cc:237] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:29.185036 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 67202.5us
I20260709 12:14:29.382478 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:29.115046 21636 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:29.292373 19745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.039s	sys 0.054s
I20260709 12:14:29.143139 20428 rpcz_store.cc:276] 0709 12:14:27.489660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.489864 (+   204us) service_pool.cc:224] Handling call
0709 12:14:27.493084 (+  3220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.453337 (+960253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.453371 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.464423 (+ 11052us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.517303 (+ 52880us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:29.142137 (+624834us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.142442 (+   305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.142515 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.142553 (+    38us) raft_consensus.cc:1685] finished
0709 12:14:29.142563 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.142700 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":313340,"prepare.queue_time_us":271118,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":265094,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":9435,"thread_start_us":1530230,"threads_started":3,"wal-append.queue_time_us":283337}
I20260709 12:14:29.387195 19818 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:29.313503 19824 raft_consensus.cc:2468] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:29.164749 20396 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:29.371102 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:29.396843 19815 raft_consensus.cc:2393] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:29.391141 20433 raft_consensus.cc:1275] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:14:29.390924 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 292890us
W20260709 12:14:29.398962 21474 consensus_meta.cc:287] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.005s
W20260709 12:14:29.365988 20424 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60840 (request call id 540) took 2570 ms (client timeout 2081 ms). Trace:
I20260709 12:14:29.397365 21670 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:29.126576 21664 consensus_meta.cc:287] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.002s
I20260709 12:14:29.367349 21622 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:29.154392 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:29.405644 19822 raft_consensus.cc:2468] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:29.126152 21612 leader_election.cc:290] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:29.364857 21740 log.cc:927] Time spent T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:14:29.413486 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 248852us
W20260709 12:14:29.411953 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.419375 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.393363 19745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.041s	sys 0.055s
I20260709 12:14:29.403496 19640 leader_election.cc:400] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4.
I20260709 12:14:29.315356 21345 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.307665 21431 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.003s	sys 0.025s
I20260709 12:14:29.121431 21703 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:29.424787 19640 leader_election.cc:403] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:29.425491 19745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 186) took 1313 ms. Trace:
W20260709 12:14:29.400161 20424 rpcz_store.cc:269] 0709 12:14:26.795862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.797476 (+  1614us) service_pool.cc:224] Handling call
0709 12:14:29.365664 (+2568188us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400489754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:29.365864 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3942651264}
I20260709 12:14:29.155066 21577 raft_consensus.cc:2804] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:29.367079 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.171540 21596 raft_consensus.cc:697] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:29.370553 21460 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:29.458897 19748 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:29.355388 21568 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:29.435913 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:29.393412 21592 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:29.437590 21431 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.003s	sys 0.033s
W20260709 12:14:29.412982 21736 log.cc:927] Time spent T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.306s	user 0.000s	sys 0.002s
I20260709 12:14:29.413208 21567 raft_consensus.cc:2749] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:29.450542 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.451246 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 52542.5us
W20260709 12:14:29.506964 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.455281 21743 log.cc:927] Time spent T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:14:29.464686 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 184) took 1353 ms. Trace:
I20260709 12:14:29.521821 19746 rpcz_store.cc:276] 0709 12:14:28.111758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.112606 (+   848us) service_pool.cc:224] Handling call
0709 12:14:28.112932 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.113187 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.113212 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.298431 (+185219us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.766462 (+468031us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:28.766504 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.766571 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.464418 (+697847us) raft_consensus.cc:1685] finished
0709 12:14:29.464447 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.464621 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":392884,"threads_started":1,"wal-append.queue_time_us":789632}
I20260709 12:14:29.465260 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 183) took 1354 ms. Trace:
I20260709 12:14:29.431943 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:29.399955 21670 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:29.464099 21612 raft_consensus.cc:3060] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:14:29.480456 21592 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:29.458428 20426 consensus_meta.cc:287] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.930s	user 0.012s	sys 0.000s
I20260709 12:14:29.483479 21573 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:29.485011 21692 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:29.490042 21630 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:29.441887 19745 rpcz_store.cc:276] 0709 12:14:28.112538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.142169 (+ 29631us) service_pool.cc:224] Handling call
0709 12:14:28.297487 (+155318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.297807 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:28.665140 (+367333us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.425023 (+759883us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:29.425097 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:29.425162 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.425246 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.425422 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":644514,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":56,"raft.queue_time_us":130,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":9613,"thread_start_us":1063927,"threads_started":2}
I20260709 12:14:29.523957 19742 rpcz_store.cc:276] 0709 12:14:28.111324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.111499 (+   175us) service_pool.cc:224] Handling call
0709 12:14:28.111914 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.112195 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.112223 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.143075 (+ 30852us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.934543 (+791468us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:28.934582 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.934656 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.465056 (+530400us) raft_consensus.cc:1685] finished
0709 12:14:29.465072 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.465203 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":658211,"threads_started":1,"wal-append.queue_time_us":1186014}
I20260709 12:14:29.508208 19640 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:29.531832 19640 leader_election.cc:400] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4.
I20260709 12:14:29.532193 19640 leader_election.cc:403] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:14:29.532399 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.450582 21456 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:29.537889 19638 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.513s (SENT)
I20260709 12:14:29.538203 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:29.539064 19815 raft_consensus.cc:2393] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:29.538849 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:29.140627 21709 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:29.545758 19713 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:29.546859 19640 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:29.534962 21585 consensus_meta.cc:287] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 2.042s	user 0.011s	sys 0.006s
I20260709 12:14:29.551683 19713 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:29.533833 21600 raft_consensus.cc:2764] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:14:29.411773 21664 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:29.565634 21456 consensus_queue.cc:1059] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:14:29.566756 21456 raft_consensus.cc:3055] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:29.544341 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:29.534155 21650 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:29.533385 21620 consensus_meta.cc:287] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.003s
I20260709 12:14:29.551126 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:29.449291 21577 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
W20260709 12:14:29.540820 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 67973.8us
I20260709 12:14:29.444074 21345 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:29.533222 21486 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:14:29.527438 21701 consensus_queue.cc:1059] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:14:29.592455 19714 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:29.623689 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:29.624547 19748 raft_consensus.cc:2468] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:29.625530 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:29.626392 19748 raft_consensus.cc:2410] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:29.552948 21728 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:29.554914 21727 consensus_queue.cc:1059] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:14:29.555022 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:29.555358 21661 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:29.545186 19746 raft_consensus.cc:2393] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:29.645179 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:29.645855 19746 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:29.533840 20426 raft_consensus.cc:2468] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:29.548437 21630 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4.
I20260709 12:14:29.611685 21474 raft_consensus.cc:3055] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:29.661839 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:29.608667 21642 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:29.590176 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.592399 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:29.554628 19638 leader_election.cc:336] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.679s (SENT)
I20260709 12:14:29.634048 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:29.635035 19674 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:29.638422 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:29.638882 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:29.716951 19742 raft_consensus.cc:2468] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:29.555286 21581 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:29.567188 21456 raft_consensus.cc:740] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:29.518153 19818 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:29.650053 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:29.528647 21568 consensus_queue.cc:1048] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 12:14:29.664330 20426 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60846 (request call id 273) took 2165 ms (client timeout 1699 ms). Trace:
W20260709 12:14:29.664835 21710 log.cc:927] Time spent T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 1.147s	user 0.006s	sys 0.002s
I20260709 12:14:29.558209 21585 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:29.577241 21620 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:29.642668 21460 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:14:29.620919 21650 consensus_queue.cc:1059] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:14:29.667501 20425 raft_consensus.cc:1240] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:29.631559 21573 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.592957 21596 consensus_queue.cc:237] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:29.671021 20428 raft_consensus.cc:2393] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:29.592927 21577 raft_consensus.cc:3060] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.630697 21664 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:29.687070 21714 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 12:14:29.694195 21366 consensus_meta.cc:287] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.000s
I20260709 12:14:29.694937 20424 raft_consensus.cc:2393] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 2: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:29.702226 21345 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:29.703894 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:29.649402 21675 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:14:29.644528 21661 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.710768 21670 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:29.715947 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 161348us
I20260709 12:14:29.578963 19713 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:29.734653 19640 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:29.645205 21466 raft_consensus.cc:2804] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:29.739151 19746 raft_consensus.cc:1275] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:14:29.740068 19744 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.024s	sys 0.048s
I20260709 12:14:29.745792 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:29.704067 21602 consensus_meta.cc:287] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.886s	user 0.015s	sys 0.000s
I20260709 12:14:29.826762 21600 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:29.826946 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 92426.5us
W20260709 12:14:29.827714 19638 leader_election.cc:336] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.711s (SENT)
I20260709 12:14:29.828161 19638 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:29.828977 21600 raft_consensus.cc:2749] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:29.829202 19640 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
W20260709 12:14:29.829622 19744 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.025s	sys 0.048s
I20260709 12:14:29.830447 19640 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:29.831797 19640 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:29.818207 21685 raft_consensus.cc:3055] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:29.594928 21696 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:29.748538 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:29.735092 21724 raft_consensus.cc:3055] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:14:29.798094 19669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.411s	user 0.003s	sys 0.037s
W20260709 12:14:29.841892 19669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.455s	user 0.004s	sys 0.037s
I20260709 12:14:29.763880 19748 raft_consensus.cc:3060] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.660826 21474 raft_consensus.cc:740] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:29.745502 21631 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.009s	sys 0.028s
I20260709 12:14:29.808027 19816 raft_consensus.cc:2393] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 5: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:29.809576 19749 raft_consensus.cc:1240] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:14:29.840730 19638 leader_election.cc:336] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.805s (SENT)
I20260709 12:14:29.844905 19638 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:29.846585 19638 leader_election.cc:336] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.909s (SENT)
W20260709 12:14:29.802109 21560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.015s	sys 0.057s
I20260709 12:14:29.817922 21366 raft_consensus.cc:2749] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:29.822852 21744 log.cc:927] Time spent T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
I20260709 12:14:29.824278 20432 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:29.836220 19745 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
I20260709 12:14:29.840700 20430 raft_consensus.cc:2393] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 5: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
W20260709 12:14:29.840857 19670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.175s	user 0.017s	sys 0.020s
I20260709 12:14:29.897755 19638 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:29.804967 21573 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:29.833482 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 254581us
I20260709 12:14:29.832762 19640 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:29.897806 19823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.007s	sys 0.024s
W20260709 12:14:29.908525 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.941347 19670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.275s	user 0.019s	sys 0.021s
I20260709 12:14:29.826089 21728 raft_consensus.cc:3055] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:14:29.942814 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 96227us
I20260709 12:14:29.825503 21712 raft_consensus.cc:3055] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:29.833330 21711 raft_consensus.cc:2804] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:29.958103 19746 raft_consensus.cc:1240] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:29.901317 19673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.013s	sys 0.041s
W20260709 12:14:29.944319 19675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.000s	sys 0.044s
W20260709 12:14:29.959185 19675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.000s	sys 0.045s
I20260709 12:14:29.838475 21602 raft_consensus.cc:2804] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:29.957616 19823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.008s	sys 0.024s
W20260709 12:14:29.745121 20426 rpcz_store.cc:269] 0709 12:14:27.494962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.496895 (+  1933us) service_pool.cc:224] Handling call
0709 12:14:29.659913 (+2163018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:29.832751 21661 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:29.958694 19673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.013s	sys 0.045s
I20260709 12:14:29.977756 19673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 232) took 1697 ms. Trace:
I20260709 12:14:29.838217 21345 raft_consensus.cc:2804] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:29.956708 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 124011us
I20260709 12:14:29.961310 21704 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:29.962199 21670 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
W20260709 12:14:29.847436 19743 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.005s	sys 0.021s
I20260709 12:14:29.833508 21466 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:29.923583 21560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.015s	sys 0.059s
I20260709 12:14:29.973799 19748 raft_consensus.cc:2468] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
W20260709 12:14:29.958864 19789 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.010s	sys 0.041s
W20260709 12:14:30.158862 19789 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.011s	sys 0.041s
W20260709 12:14:30.159780 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 1.18435e+06us
W20260709 12:14:29.957545 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.161026 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.161492 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.977985 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:29.978125 19673 rpcz_store.cc:276] 0709 12:14:28.279927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.280058 (+   131us) service_pool.cc:224] Handling call
0709 12:14:28.280427 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.280709 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:28.834252 (+553543us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.977322 (+1143070us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:29.977384 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:29.977436 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.977583 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.977699 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":524836,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"thread_start_us":1658887,"threads_started":2}
W20260709 12:14:29.846752 21631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.010s	sys 0.028s
I20260709 12:14:29.808420 21456 consensus_queue.cc:260] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:29.847491 21727 raft_consensus.cc:2749] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:29.956197 21728 raft_consensus.cc:740] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
W20260709 12:14:29.959105 21494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.459s	user 0.019s	sys 0.017s
W20260709 12:14:29.957777 19741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.024s	sys 0.020s
I20260709 12:14:29.954439 21630 raft_consensus.cc:2749] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:29.844486 21690 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:29.841572 21724 raft_consensus.cc:740] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:30.193169 21724 consensus_queue.cc:260] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:29.833225 21685 raft_consensus.cc:740] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:30.076332 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:30.154440 21670 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:30.195698 19815 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:29.974761 21602 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.196563 21602 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.143433 21701 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.197801 21701 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:29.969892 21621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.013s	sys 0.030s
W20260709 12:14:30.199054 21621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.297s	user 0.014s	sys 0.031s
I20260709 12:14:29.957983 21712 raft_consensus.cc:740] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:29.976683 21504 raft_consensus.cc:2804] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:29.961308 21711 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.981050 21568 raft_consensus.cc:2804] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:30.200413 21701 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:30.200619 21568 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.179212 21577 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:30.201423 21568 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:30.202636 21456 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:30.200433 21711 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:30.206108 19741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.024s	sys 0.020s
I20260709 12:14:30.095988 19713 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:30.207688 21585 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:30.208038 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 112133us
I20260709 12:14:30.209017 21560 consensus_queue.cc:1048] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:30.209429 19713 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:30.195873 21636 consensus_meta.cc:287] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.003s
I20260709 12:14:30.104386 21661 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:30.113171 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 482251us
I20260709 12:14:30.233148 19714 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:30.115345 21709 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:30.122934 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1174) took 1983 ms. Trace:
I20260709 12:14:30.124311 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 1992) took 1066 ms. Trace:
I20260709 12:14:30.234962 19816 rpcz_store.cc:276] 0709 12:14:29.058245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.082945 (+ 24700us) service_pool.cc:224] Handling call
0709 12:14:30.123989 (+1041044us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400022e54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:30.124226 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589677824}
I20260709 12:14:30.079084 21474 consensus_queue.cc:260] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:30.147007 19747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.027s	sys 0.027s
W20260709 12:14:30.239120 19747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.028s	sys 0.028s
I20260709 12:14:30.210542 19713 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:30.167470 19745 raft_consensus.cc:1240] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:30.076300 21345 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:30.154649 19743 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.005s	sys 0.029s
W20260709 12:14:30.188858 21749 log.cc:927] Time spent T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:14:30.217274 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.183594 21494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.687s	user 0.020s	sys 0.017s
I20260709 12:14:30.158205 21466 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.252678 19750 raft_consensus.cc:1240] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:14:30.255965 21494 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.257274 21685 consensus_queue.cc:260] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:30.256850 21494 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:30.201963 21670 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:30.265151 21494 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:30.234297 19749 rpcz_store.cc:276] 0709 12:14:28.139734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.832466 (+692732us) service_pool.cc:224] Handling call
0709 12:14:28.832979 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:29.844719 (+1011740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.122451 (+277732us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54003593d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:30.122839 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245098880}
I20260709 12:14:30.211043 21366 raft_consensus.cc:2804] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:30.247097 19713 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:30.237813 21544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.423s	user 0.016s	sys 0.031s
I20260709 12:14:30.273316 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 1185) took 1197 ms. Trace:
I20260709 12:14:30.275483 19748 rpcz_store.cc:276] 0709 12:14:29.076086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.638092 (+562006us) service_pool.cc:224] Handling call
0709 12:14:30.273107 (+635015us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b5400358ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:30.273248 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104618368}
W20260709 12:14:30.277549 20396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.013s	sys 0.017s
W20260709 12:14:30.278051 20396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.013s	sys 0.017s
W20260709 12:14:30.278558 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 850759us
I20260709 12:14:30.279024 19714 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:30.210883 21724 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:30.290987 19788 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.303s	user 0.009s	sys 0.023s
W20260709 12:14:30.291625 19788 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.304s	user 0.009s	sys 0.023s
W20260709 12:14:30.292114 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 1.32648e+06us
W20260709 12:14:30.295909 20427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.000s	sys 0.032s
W20260709 12:14:30.275069 21544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.465s	user 0.016s	sys 0.032s
I20260709 12:14:30.270627 21345 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:30.266680 21585 raft_consensus.cc:2804] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:30.270252 21650 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:30.272454 21685 raft_consensus.cc:3060] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.275178 21581 raft_consensus.cc:2804] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:30.289625 21485 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.011s	sys 0.019s
W20260709 12:14:30.345023 19667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.443s	user 0.000s	sys 0.035s
I20260709 12:14:30.347867 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1182) took 1274 ms. Trace:
I20260709 12:14:30.429976 19750 rpcz_store.cc:276] 0709 12:14:29.073153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.081465 (+  8312us) service_pool.cc:224] Handling call
0709 12:14:29.098538 (+ 17073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:30.253186 (+1154648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.347401 (+ 94215us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400050ad4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:30.347766 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653428480}
I20260709 12:14:30.356837 21699 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:30.359234 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:30.291952 21620 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:30.387857 21544 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.297864 21474 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:30.316941 21709 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.383016 19821 raft_consensus.cc:1275] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:30.439139 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.389536 19822 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:30.367352 21437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.024s	sys 0.037s
W20260709 12:14:30.441951 19671 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.002s	sys 0.030s
W20260709 12:14:30.442418 19671 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.003s	sys 0.030s
I20260709 12:14:30.280422 21494 raft_consensus.cc:2804] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:30.399580 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:30.333808 20427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.000s	sys 0.032s
W20260709 12:14:30.401278 19672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.458s	user 0.014s	sys 0.023s
W20260709 12:14:30.497622 19672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.555s	user 0.014s	sys 0.023s
I20260709 12:14:30.310878 21636 consensus_queue.cc:1059] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:14:30.431831 19819 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.211699 21728 consensus_queue.cc:260] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:30.431939 19667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.530s	user 0.000s	sys 0.041s
W20260709 12:14:30.479202 21612 consensus_meta.cc:287] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.943s	user 0.005s	sys 0.008s
W20260709 12:14:30.408434 21750 log.cc:927] Time spent T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:14:30.437956 21592 consensus_meta.cc:287] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.897s	user 0.008s	sys 0.005s
I20260709 12:14:30.362165 21642 consensus_queue.cc:1048] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 12:14:30.416458 21485 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.012s	sys 0.021s
I20260709 12:14:30.415885 21581 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:30.457895 21585 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
W20260709 12:14:30.444343 21437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.025s	sys 0.037s
W20260709 12:14:30.389565 21431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.057s	sys 0.127s
I20260709 12:14:30.444990 21494 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.519563 19667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 227) took 2267 ms. Trace:
W20260709 12:14:30.382602 21626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.006s	sys 0.035s
I20260709 12:14:30.474284 21600 raft_consensus.cc:2804] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:30.528023 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:30.524323 21612 raft_consensus.cc:2749] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4.
I20260709 12:14:30.535074 19675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 234) took 1860 ms. Trace:
I20260709 12:14:30.575522 19675 rpcz_store.cc:276] 0709 12:14:28.674502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.899209 (+224707us) service_pool.cc:224] Handling call
0709 12:14:28.930380 (+ 31171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.931161 (+   781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.931213 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.948901 (+ 17688us) log.cc:844] Serialized 26 byte log entry
0709 12:14:29.959735 (+1010834us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:29.959789 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.960021 (+   232us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.534766 (+574745us) raft_consensus.cc:1685] finished
0709 12:14:30.534816 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.534996 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":177,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":146,"thread_start_us":978268,"threads_started":1,"wal-append.queue_time_us":1429772}
W20260709 12:14:30.519884 21336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.008s	sys 0.029s
W20260709 12:14:30.519464 21764 log.cc:927] Time spent T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 12:14:30.570358 21626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.006s	sys 0.036s
I20260709 12:14:30.572108 21494 raft_consensus.cc:3060] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:30.582634 20399 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.010s	sys 0.063s
I20260709 12:14:30.444582 21709 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:30.564420 19819 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 5.
I20260709 12:14:30.566073 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:30.629693 19670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.007s	sys 0.027s
I20260709 12:14:30.521342 21688 raft_consensus.cc:2749] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:30.565644 19667 rpcz_store.cc:276] 0709 12:14:28.252068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.275358 (+ 23290us) service_pool.cc:224] Handling call
0709 12:14:28.275699 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.275911 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:28.902110 (+626199us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.518984 (+1616874us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:30.519069 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:30.519137 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.519242 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.519452 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":529368,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":44,"thread_start_us":2242126,"threads_started":2}
I20260709 12:14:30.553926 21728 raft_consensus.cc:3060] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:30.551287 21585 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.536171 21581 raft_consensus.cc:3060] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:30.551971 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.555972 21431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.057s	sys 0.130s
I20260709 12:14:30.531587 21711 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:30.578979 21336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.008s	sys 0.029s
W20260709 12:14:30.589752 21751 log.cc:927] Time spent T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 12:14:30.590620 21762 log.cc:927] Time spent T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:14:30.592887 21766 log.cc:927] Time spent T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 12:14:30.593518 21758 log.cc:927] Time spent T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 12:14:30.594305 21759 log.cc:927] Time spent T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:14:30.595572 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:30.670626 19817 raft_consensus.cc:2468] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:30.596693 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:30.598644 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:30.599957 19741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1173) took 2460 ms. Trace:
I20260709 12:14:30.580387 21661 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:30.553449 21592 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:30.556038 20397 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.011s	sys 0.030s
W20260709 12:14:30.682950 20397 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.011s	sys 0.030s
W20260709 12:14:30.683339 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 1.02176e+06us
W20260709 12:14:30.611038 19744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.008s	sys 0.030s
W20260709 12:14:30.684141 19744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.009s	sys 0.031s
I20260709 12:14:30.602726 21602 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:30.688411 21767 log.cc:927] Time spent T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:14:30.611925 20399 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.010s	sys 0.063s
I20260709 12:14:30.582370 20427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 546) took 1474 ms. Trace:
I20260709 12:14:30.723788 21626 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.633227 19822 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
W20260709 12:14:30.633800 19742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.006s	sys 0.008s
W20260709 12:14:30.533650 21353 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.044s	sys 0.043s
W20260709 12:14:30.634518 19670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.008s	sys 0.027s
I20260709 12:14:30.732687 19670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 228) took 2455 ms. Trace:
I20260709 12:14:30.733114 19670 rpcz_store.cc:276] 0709 12:14:28.277045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.294869 (+ 17824us) service_pool.cc:224] Handling call
0709 12:14:28.295378 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.295619 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:28.661497 (+365878us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.732221 (+2070724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:30.732297 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:30.732355 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.732449 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.732600 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22736,"prepare.queue_time_us":510147,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":214921,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":26225,"thread_start_us":2354322,"threads_started":3,"wal-append.queue_time_us":1773707}
I20260709 12:14:30.632434 19824 raft_consensus.cc:3055] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:30.734977 19824 raft_consensus.cc:740] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
W20260709 12:14:30.638123 19640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.010s	sys 0.016s
I20260709 12:14:30.640967 20396 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
W20260709 12:14:30.735842 19640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.011s	sys 0.016s
W20260709 12:14:30.654515 20433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.009s	sys 0.007s
W20260709 12:14:30.736943 20433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.010s	sys 0.008s
W20260709 12:14:30.655062 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.673436 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 401044us
W20260709 12:14:30.718640 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.726382 19820 raft_consensus.cc:3055] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:30.727298 19816 raft_consensus.cc:2468] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
W20260709 12:14:30.728073 19742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.007s	sys 0.008s
I20260709 12:14:30.748183 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1189) took 1195 ms. Trace:
I20260709 12:14:30.748728 19742 rpcz_store.cc:276] 0709 12:14:29.553239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.736941 (+183702us) service_pool.cc:224] Handling call
0709 12:14:29.737378 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.737658 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:29.794734 (+ 57076us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.747688 (+952954us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:30.747769 (+    81us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:30.747839 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.747950 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.748108 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":235184,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":1999,"thread_start_us":952462,"threads_started":1}
I20260709 12:14:30.728458 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1175) took 2463 ms. Trace:
W20260709 12:14:30.669426 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 273863us
W20260709 12:14:30.736274 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 660766us
I20260709 12:14:30.750733 19744 rpcz_store.cc:276] 0709 12:14:28.265348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.834198 (+568850us) service_pool.cc:224] Handling call
0709 12:14:28.883256 (+ 49058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.883609 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:29.830044 (+946435us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.684600 (+854556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:30.728065 (+ 43465us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:30.728129 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.728222 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.728395 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":198643,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":279,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":1765466,"threads_started":2}
W20260709 12:14:30.753528 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.754256 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.758632 19744 raft_consensus.cc:1240] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:30.627353 21621 consensus_queue.cc:1048] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:14:30.752701 19820 raft_consensus.cc:740] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:30.767416 19640 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:30.735632 21727 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:30.654472 21755 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.009s	sys 0.007s
I20260709 12:14:30.769047 19668 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 5: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:30.768146 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 230) took 2489 ms. Trace:
I20260709 12:14:30.766861 21456 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:30.790656 21472 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:30.791601 21472 raft_consensus.cc:697] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 5 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:30.792721 21472 consensus_queue.cc:237] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:30.793629 21602 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:30.793818 21573 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:30.691764 19741 rpcz_store.cc:276] 0709 12:14:28.139129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.820542 (+681413us) service_pool.cc:224] Handling call
0709 12:14:28.820995 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.879150 (+ 58155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.880604 (+  1454us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.978736 (+ 98132us) log.cc:844] Serialized 26 byte log entry
0709 12:14:30.206892 (+1228156us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:30.206959 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.207078 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.599660 (+392582us) raft_consensus.cc:1685] finished
0709 12:14:30.599679 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.599860 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20000,"raft.queue_time_us":27170,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":32107,"thread_start_us":1127179,"threads_started":1,"wal-append.queue_time_us":1358189}
I20260709 12:14:30.790518 21675 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:30.795789 21600 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:30.786115 21755 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.016s	sys 0.007s
I20260709 12:14:30.779618 19824 consensus_queue.cc:260] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:30.797523 19824 raft_consensus.cc:3060] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:30.778177 21727 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:30.780154 21612 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:30.799219 21612 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:30.800733 19823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 1981) took 1880 ms. Trace:
I20260709 12:14:30.801874 21727 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:30.802217 21612 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:30.781345 21756 log.cc:927] Time spent T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:14:30.731884 21353 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.045s	sys 0.044s
I20260709 12:14:30.785493 19669 rpcz_store.cc:276] 0709 12:14:28.278261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.278382 (+   121us) service_pool.cc:224] Handling call
0709 12:14:28.278708 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.279076 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.279116 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.315950 (+ 36834us) log.cc:844] Serialized 26 byte log entry
0709 12:14:29.842566 (+1526616us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:29.842801 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.842979 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.767872 (+924893us) raft_consensus.cc:1685] finished
0709 12:14:30.767905 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.768067 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":175094,"raft.run_cpu_time_us":562,"raft.run_wall_time_us":26419,"thread_start_us":1455558,"threads_started":1,"wal-append.queue_time_us":1938953}
I20260709 12:14:30.804685 21592 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:30.732254 21664 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:30.795518 21675 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:30.806468 21664 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:30.790514 21456 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:30.809248 21664 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:30.731938 21663 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:30.763413 21466 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:30.780777 19640 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:30.814706 21456 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:30.815083 21777 raft_consensus.cc:2749] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:30.817380 21650 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:30.771855 21771 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:14:30.801206 19823 rpcz_store.cc:276] 0709 12:14:28.920440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.920562 (+   122us) service_pool.cc:224] Handling call
0709 12:14:28.920958 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.926816 (+  5858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.926846 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.951658 (+ 24812us) log.cc:844] Serialized 26 byte log entry
0709 12:14:29.965750 (+1014092us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:29.965801 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.966617 (+   816us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.800487 (+833870us) raft_consensus.cc:1685] finished
0709 12:14:30.800509 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.800664 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20800,"raft.queue_time_us":7026,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":27249,"thread_start_us":966984,"threads_started":1,"wal-append.queue_time_us":1447330}
I20260709 12:14:30.796420 21600 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:30.823129 21504 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:30.823685 21504 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:30.825402 21581 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:30.778729 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:30.827394 19750 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
W20260709 12:14:30.768765 21568 consensus_meta.cc:287] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.000s
I20260709 12:14:30.830078 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1180) took 1804 ms. Trace:
I20260709 12:14:30.830914 19713 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:30.849033 19713 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:30.788707 19820 consensus_queue.cc:260] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:30.850198 19820 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.809379 21675 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:30.827625 19638 leader_election.cc:336] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.979s (SENT)
I20260709 12:14:30.846563 19747 rpcz_store.cc:276] 0709 12:14:29.025660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.025839 (+   179us) service_pool.cc:224] Handling call
0709 12:14:29.026354 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:29.086284 (+ 59930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:29.086319 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:29.087670 (+  1351us) log.cc:844] Serialized 26 byte log entry
0709 12:14:30.239888 (+1152218us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:30.239958 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.240078 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.829759 (+589681us) raft_consensus.cc:1685] finished
0709 12:14:30.829790 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.829990 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1122643,"threads_started":1,"wal-append.queue_time_us":1483929}
I20260709 12:14:30.854269 19638 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:30.851739 19713 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:30.854256 19824 raft_consensus.cc:1275] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:14:30.857329 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 76668.4us
W20260709 12:14:30.844911 21366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.003s	sys 0.036s
I20260709 12:14:30.814597 21466 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:30.859563 19713 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:30.855345 21701 raft_consensus.cc:2804] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:30.784052 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 185) took 2671 ms. Trace:
I20260709 12:14:30.746740 21626 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:30.865476 21485 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:14:30.903863 19713 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:30.887605 21581 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:30.889182 19672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 233) took 2215 ms. Trace:
I20260709 12:14:30.853430 21486 raft_consensus.cc:2804] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:30.863476 21366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.003s	sys 0.036s
I20260709 12:14:30.869163 19743 rpcz_store.cc:276] 0709 12:14:28.112149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.251720 (+139571us) service_pool.cc:224] Handling call
0709 12:14:28.352138 (+100418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.434111 (+ 81973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.455259 (+ 21148us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.512705 (+ 57446us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.946497 (+433792us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:30.290197 (+1343700us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.679719 (+389522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.713074 (+ 33355us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.731492 (+ 18418us) raft_consensus.cc:1685] finished
0709 12:14:30.749797 (+ 18305us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.774218 (+ 24421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"prepare.queue_time_us":160981,"prepare.run_cpu_time_us":158,"prepare.run_wall_time_us":7666,"raft.queue_time_us":340918,"raft.run_cpu_time_us":624,"raft.run_wall_time_us":38955,"thread_start_us":1897520,"threads_started":3,"wal-append.queue_time_us":884195}
I20260709 12:14:30.891021 21630 consensus_queue.cc:1059] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:30.892159 19816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5"
dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
mode: GRACEFUL
new_leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:14:30.893245 21585 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:30.846608 19714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.015s	sys 0.021s
W20260709 12:14:30.945091 19714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.016s	sys 0.021s
W20260709 12:14:30.945809 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 666870us
I20260709 12:14:30.868708 21701 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.895134 21792 raft_consensus.cc:2804] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:30.895608 21592 raft_consensus.cc:2749] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:30.896432 19640 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:30.896624 21783 consensus_queue.cc:1059] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:30.897564 21709 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:30.864948 21728 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.905047 21626 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:30.866768 19638 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 2.072s (SENT) [suppressed 22 similar messages]
I20260709 12:14:30.907950 19713 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:30.970386 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.910611 19668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54544 (request call id 240) took 1277 ms. Trace:
I20260709 12:14:30.971132 19668 rpcz_store.cc:276] 0709 12:14:29.633521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.633698 (+   177us) service_pool.cc:224] Handling call
0709 12:14:30.910293 (+1276595us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400286254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:30.910518 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420830976}
I20260709 12:14:30.913720 19823 raft_consensus.cc:1240] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:30.898494 21345 consensus_meta.cc:287] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 12:14:30.853587 21568 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:30.926403 19819 raft_consensus.cc:1240] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:30.924278 19672 rpcz_store.cc:276] 0709 12:14:28.674161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.897919 (+223758us) service_pool.cc:224] Handling call
0709 12:14:28.899416 (+  1497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.899935 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.899970 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.912991 (+ 13021us) log.cc:844] Serialized 26 byte log entry
0709 12:14:30.519410 (+1606419us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:30.519455 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.519537 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.888930 (+369393us) raft_consensus.cc:1685] finished
0709 12:14:30.888948 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.889099 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":26627,"thread_start_us":1555479,"threads_started":1,"wal-append.queue_time_us":1954639}
I20260709 12:14:30.935395 19815 raft_consensus.cc:1240] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:30.937860 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:30.941324 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:30.979156 19669 raft_consensus.cc:2393] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 2: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:30.942865 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:30.943671 19821 raft_consensus.cc:1240] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:30.979859 19822 raft_consensus.cc:2368] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3.
I20260709 12:14:30.949538 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:30.957123 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:30.972971 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 332135us
I20260709 12:14:30.935667 21685 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:31.004336 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 108001us
I20260709 12:14:30.862939 21494 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:30.923631 21790 raft_consensus.cc:3060] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:31.007627 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:31.010113 21585 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:30.935539 21366 raft_consensus.cc:697] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:31.006173 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:30.944770 21486 raft_consensus.cc:697] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:30.724016 20427 rpcz_store.cc:276] 0709 12:14:29.106678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.123001 (+ 16323us) service_pool.cc:224] Handling call
0709 12:14:29.174823 (+ 51822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.182616 (+  7793us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:29.183025 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 12:14:30.528516 (+1345491us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:30.550553 (+ 22037us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:30.558146 (+  7593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.572494 (+ 14348us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.580888 (+  8394us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4009,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":4752,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":20095,"thread_start_us":1327212,"threads_started":1,"wal-append.queue_time_us":1474779}
I20260709 12:14:30.974124 21704 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:31.456966 21724 consensus_meta.cc:287] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 1.159s	user 0.014s	sys 0.001s
W20260709 12:14:31.051975 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.973320 21728 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.006978 21685 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.471863 21728 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.245420 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:31.472405 21685 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.955410 21701 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:31.215229 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 348475us
I20260709 12:14:31.474908 19816 raft_consensus.cc:606] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Received request to transfer leadership to TS b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:31.475672 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:31.476845 19672 raft_consensus.cc:2410] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:14:31.474900 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.480264 19668 raft_consensus.cc:1240] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:31.028643 21688 raft_consensus.cc:2804] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:31.006134 21345 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.486688 19714 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:31.081185 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
W20260709 12:14:31.029244 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 121413us
I20260709 12:14:31.245847 21711 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:31.494611 19820 consensus_meta.cc:287] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.002s
I20260709 12:14:31.512005 19669 raft_consensus.cc:1240] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:31.505316 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:31.506167 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:31.455746 21504 consensus_meta.cc:287] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.632s	user 0.013s	sys 0.000s
I20260709 12:14:31.513911 19668 raft_consensus.cc:2410] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:14:31.506376 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 489106us
I20260709 12:14:31.079201 21494 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:31.521241 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:31.351064 21577 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:31.516567 19673 raft_consensus.cc:1240] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 4. Ops: []
I20260709 12:14:31.076397 21791 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:31.320159 21775 log.cc:927] Time spent T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 12:14:31.520170 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:31.319137 21782 log.cc:927] Time spent T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:14:31.525117 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:31.548671 19816 raft_consensus.cc:2393] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 2: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:31.028460 21792 raft_consensus.cc:697] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:31.484086 21704 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:31.525741 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:31.505636 21789 raft_consensus.cc:2749] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:31.547459 21494 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.549706 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:31.551677 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.548879 20424 raft_consensus.cc:3060] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:31.526377 21504 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:31.542028 21466 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:31.568248 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:31.571015 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.572211 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:31.573225 19816 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:31.521484 21631 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.352365 21712 consensus_queue.cc:260] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.575114 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:31.567234 21366 consensus_queue.cc:237] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.567756 21494 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.555815 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:31.574657 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:31.582564 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 55051us
I20260709 12:14:31.562803 21568 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:31.561878 21688 raft_consensus.cc:697] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:31.581822 21626 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.591574 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:31.562175 21486 consensus_queue.cc:237] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.586434 20426 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:31.598275 21792 consensus_queue.cc:237] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.599345 21688 consensus_queue.cc:237] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.602059 20433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 557) took 1867 ms. Trace:
I20260709 12:14:31.584017 21466 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:31.602550 20433 rpcz_store.cc:276] 0709 12:14:29.734574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.734757 (+   183us) service_pool.cc:224] Handling call
0709 12:14:29.735259 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:30.849295 (+1114036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:30.849329 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:30.855588 (+  6259us) log.cc:844] Serialized 26 byte log entry
0709 12:14:31.463536 (+607948us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:31.463602 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.463693 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:31.601787 (+138094us) raft_consensus.cc:1685] finished
0709 12:14:31.601810 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:31.601977 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97512,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":6582,"thread_start_us":1443691,"threads_started":2,"wal-append.queue_time_us":682920}
I20260709 12:14:31.589344 21712 raft_consensus.cc:3060] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:31.588596 21631 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:31.617350 21790 consensus_meta.cc:287] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.003s
I20260709 12:14:31.605178 21626 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:31.631229 21701 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.632262 21626 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:31.632452 21504 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:31.624130 21630 raft_consensus.cc:3055] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:31.633898 21630 raft_consensus.cc:740] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:31.634955 21630 consensus_queue.cc:260] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.635396 21690 raft_consensus.cc:3055] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:31.635972 21690 raft_consensus.cc:740] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:31.636340 21630 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:31.637833 21631 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:31.637161 21690 consensus_queue.cc:260] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.638859 21690 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:31.641904 21600 consensus_meta.cc:287] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.819s	user 0.011s	sys 0.000s
I20260709 12:14:31.624636 21790 raft_consensus.cc:2749] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:31.682229 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 163159us
W20260709 12:14:31.685633 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.545848 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:31.529753 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:31.691079 19674 raft_consensus.cc:3060] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:31.692746 19666 raft_consensus.cc:1240] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:31.523766 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:31.529194 19742 raft_consensus.cc:1240] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:31.527673 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:31.709416 19673 raft_consensus.cc:2368] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4.
I20260709 12:14:31.696072 19668 raft_consensus.cc:2468] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
I20260709 12:14:31.530611 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:31.711606 19669 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:31.703966 19816 raft_consensus.cc:2410] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:31.720046 20425 raft_consensus.cc:1240] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 6 LEADER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:31.714157 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:31.723287 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:31.724835 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:31.725489 20426 raft_consensus.cc:1240] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:31.726202 20433 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:31.727483 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:31.728547 20428 raft_consensus.cc:2376] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2. Re-sending same reply.
I20260709 12:14:31.744293 21626 consensus_queue.cc:1059] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:31.745555 19674 raft_consensus.cc:2468] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:31.747038 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:31.749022 19789 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60644 dropped due to backpressure: service queue is full with 50 items
I20260709 12:14:31.749469 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:31.750581 19816 raft_consensus.cc:3060] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:14:31.758996 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 241965us
W20260709 12:14:31.765079 21812 log.cc:927] Time spent T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:14:31.776312 21704 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:31.777705 19638 leader_election.cc:336] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 3.157s (SENT)
I20260709 12:14:31.779199 21592 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:31.780493 21592 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:31.781188 19820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 1996) took 2662 ms. Trace:
I20260709 12:14:31.783396 21573 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.784494 21573 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.785034 21345 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:31.642500 21600 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:31.788939 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:31.790354 19823 raft_consensus.cc:2393] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:31.791314 21711 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.792268 21711 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.795375 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:31.790197 21600 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:31.797042 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:31.799166 21504 raft_consensus.cc:3055] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:31.799865 21504 raft_consensus.cc:740] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:31.803202 21675 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:31.807464 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:31.798561 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:31.808597 19674 raft_consensus.cc:2468] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:31.809316 19673 raft_consensus.cc:2410] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:14:31.809595 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.810487 19640 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:31.811615 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 53755.5us
I20260709 12:14:31.812812 21688 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:31.813356 21688 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.813736 21688 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:31.746516 21626 consensus_queue.cc:1059] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:14:31.749694 19789 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60644 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2019)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2016)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60644 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2010)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2009)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 256)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1153)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 258)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 259)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 260)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2013)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2017)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2018)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1177)
I20260709 12:14:31.824982 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:31.781713 19820 rpcz_store.cc:276] 0709 12:14:29.118924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.119067 (+   143us) service_pool.cc:224] Handling call
0709 12:14:29.119416 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.529774 (+2410358us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:31.529810 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:31.529849 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:31.529885 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.780531 (+250646us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54004623d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:31.780604 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:31.780929 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3112,"raft.queue_time_us":16553,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7922,"spinlock_wait_cycles":3693953920}
I20260709 12:14:31.800333 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:31.856109 19668 raft_consensus.cc:2468] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:31.841466 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:31.801700 21504 consensus_queue.cc:260] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:31.843587 20396 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:31.845983 19789 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:56898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2019)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2016)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60644 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2010)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2009)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 256)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1153)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 258)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 259)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 260)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2013)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2017)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2018)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 263)
I20260709 12:14:31.879074 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:31.881238 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:31.881439 20424 raft_consensus.cc:2468] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:31.882483 19675 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 5: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:31.882964 21612 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:31.884644 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 107196us
I20260709 12:14:31.891039 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:31.892582 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.892854 19669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:31.836315 21704 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:31.848853 21466 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:31.843402 21626 consensus_queue.cc:1243] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer f662c4f7d6a74013a1e58a5330a049b8 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:31.863708 21711 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:31.918056 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:31.927105 19668 raft_consensus.cc:3060] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:31.927456 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 84257.5us
I20260709 12:14:31.928610 20396 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:31.830756 21791 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:31.933607 21592 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:31.938881 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:31.939711 19669 raft_consensus.cc:2410] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:31.940074 19673 raft_consensus.cc:2393] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:31.941558 19673 raft_consensus.cc:1240] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:31.954116 19668 raft_consensus.cc:2468] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:31.955782 19816 raft_consensus.cc:2468] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:31.957981 19675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:31.993252 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:32.007858 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.138979 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 92170.4us
W20260709 12:14:32.020653 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.061836 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.140895 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.063782 19675 raft_consensus.cc:2410] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:31.993434 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:32.064113 19640 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821): Timed out: RequestConsensusVote RPC to 127.17.249.196:38821 timed out after 1.699s (SENT)
W20260709 12:14:32.088099 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.032277 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.994957 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:32.368316 19671 consensus_meta.cc:287] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.001s
I20260709 12:14:32.567277 19671 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:32.093917 19789 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:56898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2019)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2016)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60644 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2010)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2009)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 256)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1153)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 258)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 259)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 260)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2013)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2017)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2018)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 263)
I20260709 12:14:32.067292 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:32.135583 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1199) took 1378 ms. Trace:
W20260709 12:14:32.367095 19672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.005s	sys 0.011s
W20260709 12:14:32.459506 19669 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.007s	sys 0.017s
W20260709 12:14:32.453919 20396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.011s	sys 0.016s
W20260709 12:14:32.587008 19672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.009s	sys 0.023s
W20260709 12:14:32.587592 19669 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.011s	sys 0.019s
W20260709 12:14:32.587958 20396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.013s	sys 0.017s
I20260709 12:14:32.576558 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:32.588871 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.147379 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:32.047005 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:32.575304 19742 rpcz_store.cc:276] 0709 12:14:30.756583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.768638 (+ 12055us) service_pool.cc:224] Handling call
0709 12:14:30.769693 (+  1055us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:31.707447 (+937754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.033468 (+326021us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54000eddd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:32.135279 (+101811us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745489792}
I20260709 12:14:32.019922 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:32.019416 21728 consensus_meta.cc:287] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.544s	user 0.015s	sys 0.005s
I20260709 12:14:31.976907 21592 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.594364 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:32.151582 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:32.146149 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:32.047153 21581 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.019479 21474 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.019702 21626 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.994305 21466 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.603771 19667 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.003s	sys 0.010s
I20260709 12:14:31.993886 21612 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:32.021353 21781 raft_consensus.cc:2804] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:32.149914 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:32.594623 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.362349 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:32.065948 21685 consensus_meta.cc:287] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.593s	user 0.005s	sys 0.014s
W20260709 12:14:32.599365 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.603704 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:32.063812 21701 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:32.598991 20430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60828 (request call id 453) took 1020 ms. Trace:
I20260709 12:14:32.602735 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:32.128931 20424 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:32.148090 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:32.627923 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:32.607566 19820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1166) took 1052 ms. Trace:
I20260709 12:14:32.649101 19820 rpcz_store.cc:276] 0709 12:14:31.555492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.942834 (+387342us) service_pool.cc:224] Handling call
0709 12:14:32.607446 (+664612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.047473 21820 raft_consensus.cc:2804] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:32.596196 19640 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:32.625782 21366 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:32.657718 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:32.658715 19823 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:32.659485 19823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1167) took 1095 ms. Trace:
I20260709 12:14:32.659655 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:31.977236 21791 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.139242 21504 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:32.636313 19667 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.005s	sys 0.011s
W20260709 12:14:32.604276 19818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1141) took 1670 ms (client timeout 1711 ms). Trace:
I20260709 12:14:32.659904 19823 rpcz_store.cc:276] 0709 12:14:31.564151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.657168 (+1093017us) service_pool.cc:224] Handling call
0709 12:14:32.659410 (+  2242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.146397 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:32.643540 19816 raft_consensus.cc:2410] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:32.134474 21688 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:32.633692 21581 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:32.651392 19749 raft_consensus.cc:2393] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:32.650807 21626 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:32.651772 20432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60828 (request call id 449) took 1145 ms. Trace:
I20260709 12:14:32.647635 20430 rpcz_store.cc:276] 0709 12:14:31.579123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.834332 (+255209us) service_pool.cc:224] Handling call
0709 12:14:32.598920 (+764588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.656388 21494 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:32.657274 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:32.658329 21366 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:32.597151 19817 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:32.685459 19817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1164) took 1142 ms. Trace:
I20260709 12:14:32.685959 19668 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:32.603658 19715 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:32.633810 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:32.666253 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 737680us
I20260709 12:14:32.669278 20431 raft_consensus.cc:2468] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:32.689668 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:32.685859 19817 rpcz_store.cc:276] 0709 12:14:31.543040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.942934 (+399894us) service_pool.cc:224] Handling call
0709 12:14:32.685387 (+742453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.678881 20432 rpcz_store.cc:276] 0709 12:14:31.506048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.602218 (+1096170us) service_pool.cc:224] Handling call
0709 12:14:32.651673 (+ 49455us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.676594 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1155) took 1219 ms. Trace:
I20260709 12:14:32.630568 21711 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:32.670773 19818 rpcz_store.cc:269] 0709 12:14:30.934172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.934398 (+   226us) service_pool.cc:224] Handling call
0709 12:14:31.936295 (+1001897us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b5800013898. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:14:32.604167 (+667872us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15773824}
I20260709 12:14:32.686328 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:32.699496 19668 raft_consensus.cc:1240] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:32.701112 21791 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:32.703955 21791 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:32.705592 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:32.706359 20426 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:32.706569 19638 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.501s (SENT)
I20260709 12:14:32.683481 21466 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:32.702370 21366 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:32.626744 21728 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:32.710523 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:32.708146 19745 raft_consensus.cc:2410] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:32.697801 19816 rpcz_store.cc:276] 0709 12:14:31.476401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.008449 (+532048us) service_pool.cc:224] Handling call
0709 12:14:32.676401 (+667952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.719762 19815 raft_consensus.cc:2393] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:32.720304 19815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1168) took 1140 ms. Trace:
I20260709 12:14:32.720608 19815 rpcz_store.cc:276] 0709 12:14:31.579660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.923843 (+344183us) service_pool.cc:224] Handling call
0709 12:14:32.686043 (+762200us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b5800013898. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ae9c 00007fadf165aa5b 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:14:32.720231 (+ 34188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13500800}
I20260709 12:14:32.708053 19747 raft_consensus.cc:2468] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:32.672854 21781 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:32.716100 19638 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:32.684181 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:32.596534 19787 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:56904 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2019)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2016)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60644 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2010)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2009)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 256)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1153)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 258)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 259)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 260)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2013)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2017)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2018)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 263)
I20260709 12:14:32.717794 19743 raft_consensus.cc:2368] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5.
I20260709 12:14:32.718217 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:32.718758 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:32.722538 19674 raft_consensus.cc:2368] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for earlier term 5. Current term is 6.
I20260709 12:14:32.718115 19824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 244) took 2360 ms. Trace:
I20260709 12:14:32.732159 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:32.736747 19746 raft_consensus.cc:2468] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
W20260709 12:14:32.736876 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 133509us
I20260709 12:14:32.737320 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:32.727200 21781 raft_consensus.cc:3060] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.740283 21494 raft_consensus.cc:2804] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:32.740896 21494 raft_consensus.cc:697] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:32.743310 21626 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:32.744252 21612 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:32.745256 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:32.742151 21494 consensus_queue.cc:237] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:32.659974 21474 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:32.746495 19746 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.748338 21474 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:32.732785 19824 rpcz_store.cc:276] 0709 12:14:30.357784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.360650 (+  2866us) service_pool.cc:224] Handling call
0709 12:14:30.360975 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:30.856660 (+495685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.717635 (+1860975us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400022454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:32.717945 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623915776}
I20260709 12:14:32.711621 21711 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:32.752658 21711 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:32.675791 21685 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:32.691733 21820 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:32.755436 21820 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:32.752841 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:32.757599 19743 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:32.759549 19670 raft_consensus.cc:1240] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:14:32.760134 21466 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:32.762892 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:32.768754 19666 raft_consensus.cc:2410] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:32.677714 21592 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:32.782215 19746 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:32.761209 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:32.789147 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 111600us
W20260709 12:14:32.786860 19787 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:56904 dropped due to backpressure: service queue is full with 50 items [suppressed 4 similar messages]
I20260709 12:14:32.792232 19819 raft_consensus.cc:1240] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:32.794545 19819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1143) took 1850 ms. Trace:
I20260709 12:14:32.794987 19819 rpcz_store.cc:276] 0709 12:14:30.944404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.001032 (+ 56628us) service_pool.cc:224] Handling call
0709 12:14:32.773439 (+1772407us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5800013898. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:14:32.775909 (+  2470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.794161 (+ 18252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.794472 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32005376}
I20260709 12:14:32.767352 21366 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:32.789814 21685 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:32.790550 19787 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:56904 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60644 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2010)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2022)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2009)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 256)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1153)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 258)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 259)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 260)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2013)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2017)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2018)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 263)
I20260709 12:14:32.786206 21612 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:32.788725 21711 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:32.821432 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:32.833935 19670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1852) took 1316 ms. Trace:
I20260709 12:14:32.834381 19670 rpcz_store.cc:276] 0709 12:14:31.517640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.685819 (+168179us) service_pool.cc:224] Handling call
0709 12:14:31.703224 (+ 17405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.760027 (+1056803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.833611 (+ 73584us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540002d354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:32.833839 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428421888}
I20260709 12:14:32.856802 19746 raft_consensus.cc:1240] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:32.858985 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 2024) took 1009 ms. Trace:
W20260709 12:14:32.858182 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 241839us
I20260709 12:14:32.859625 19669 rpcz_store.cc:276] 0709 12:14:31.850064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.940563 (+ 90499us) service_pool.cc:224] Handling call
0709 12:14:31.941030 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.941453 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:32.588427 (+646974us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.858603 (+270176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:32.858667 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:32.858719 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.858799 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.858921 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":656668,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":198,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":163,"thread_start_us":900680,"threads_started":2,"wal-append.queue_time_us":254812}
I20260709 12:14:32.865922 21827 consensus_queue.cc:1048] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:32.869134 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 254) took 1886 ms. Trace:
I20260709 12:14:32.871815 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:32.870844 19822 rpcz_store.cc:276] 0709 12:14:30.982363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.006724 (+ 24361us) service_pool.cc:224] Handling call
0709 12:14:31.849047 (+842323us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b5800013898. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:14:31.849388 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.849874 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:32.253449 (+403575us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.868432 (+614983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:32.868501 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:32.868571 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.868670 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.868870 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":908067,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":41,"raft.queue_time_us":169511,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":13032320,"thread_start_us":825090,"threads_started":3,"wal-append.queue_time_us":543332}
I20260709 12:14:32.828140 19743 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:32.855759 21728 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:32.842204 21366 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:32.893474 21366 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:32.892794 19787 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:56904 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60644 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2010)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2025)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2028)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2022)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2030)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2024)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2009)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 256)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1153)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 258)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 259)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 260)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2013)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2017)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2018)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 265)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2026)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2027)
I20260709 12:14:32.901216 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:32.900439 19667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 247) took 1963 ms. Trace:
I20260709 12:14:32.887576 21688 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:32.913985 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:32.914624 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:32.919018 19672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1853) took 1401 ms. Trace:
I20260709 12:14:32.921509 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:32.921756 21833 log.cc:927] Time spent T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:14:32.922354 19748 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.919526 19672 rpcz_store.cc:276] 0709 12:14:31.517985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.689519 (+171534us) service_pool.cc:224] Handling call
0709 12:14:31.711676 (+ 22157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:31.712458 (+   782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:31.712490 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:31.713499 (+  1009us) log.cc:844] Serialized 26 byte log entry
0709 12:14:32.588397 (+874898us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:32.588501 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.595315 (+  6814us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:32.918638 (+323323us) raft_consensus.cc:1685] finished
0709 12:14:32.918671 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.918950 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49223,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":31843,"thread_start_us":874250,"threads_started":1,"wal-append.queue_time_us":1115376}
I20260709 12:14:32.923398 19749 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:32.924438 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1144) took 1932 ms. Trace:
I20260709 12:14:32.924922 19821 rpcz_store.cc:276] 0709 12:14:30.949430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.980289 (+ 30859us) service_pool.cc:224] Handling call
0709 12:14:31.846821 (+866532us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5800013898. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:14:31.847229 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.847743 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:32.128224 (+280481us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.874324 (+746100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:32.874386 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:32.881047 (+  6661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.881159 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.881358 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":886222,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":217374,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":186,"spinlock_wait_cycles":31300864,"thread_start_us":741999,"threads_started":3,"wal-append.queue_time_us":483431}
I20260709 12:14:32.927819 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:32.928591 19821 raft_consensus.cc:2468] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:32.929102 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1169) took 1345 ms. Trace:
I20260709 12:14:32.929497 19821 rpcz_store.cc:276] 0709 12:14:31.583359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.927468 (+1344109us) service_pool.cc:224] Handling call
0709 12:14:32.929049 (+  1581us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.930459 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:32.907254 19667 rpcz_store.cc:276] 0709 12:14:30.936565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.936724 (+   159us) service_pool.cc:224] Handling call
0709 12:14:30.971773 (+ 35049us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:31.508202 (+536429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:31.508264 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:31.521857 (+ 13593us) log.cc:844] Serialized 52 byte log entry
0709 12:14:31.922118 (+400261us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:32.670233 (+748115us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.882030 (+211797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.885888 (+  3858us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:32.885938 (+    50us) raft_consensus.cc:1685] finished
0709 12:14:32.885947 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.900372 (+ 14425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88418,"prepare.queue_time_us":675640,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":639546,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":9901,"thread_start_us":1093611,"threads_started":3,"wal-append.queue_time_us":324048}
I20260709 12:14:32.931483 19821 raft_consensus.cc:2468] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:32.932011 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1182) took 1087 ms. Trace:
I20260709 12:14:32.932349 19821 rpcz_store.cc:276] 0709 12:14:31.844504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.930157 (+1085653us) service_pool.cc:224] Handling call
0709 12:14:32.931955 (+  1798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.932705 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:32.904251 21830 log.cc:927] Time spent T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:14:32.936269 19675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48652 (request call id 2026) took 1058 ms. Trace:
I20260709 12:14:32.933532 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:32.941001 19675 rpcz_store.cc:276] 0709 12:14:31.893425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.913879 (+ 20454us) service_pool.cc:224] Handling call
0709 12:14:32.917006 (+1003127us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b540004d654. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:32.936189 (+ 19183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126680960}
I20260709 12:14:32.937268 19744 raft_consensus.cc:2468] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:32.947475 19818 raft_consensus.cc:2393] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 2: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:32.951745 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:32.952771 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:32.953003 19745 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:32.906159 20426 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:32.907742 21592 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:32.955446 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:32.963476 19821 raft_consensus.cc:3060] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.965840 19746 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.967917 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:32.968595 19744 raft_consensus.cc:1240] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:32.970323 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:32.973073 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1158) took 1495 ms. Trace:
I20260709 12:14:32.964268 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:32.974751 19822 rpcz_store.cc:276] 0709 12:14:31.477483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.905532 (+1428049us) service_pool.cc:224] Handling call
0709 12:14:32.973003 (+ 67471us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:32.979457 21822 log.cc:927] Time spent T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:14:32.979200 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:32.989969 20398 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.789s (SENT)
I20260709 12:14:32.990746 20398 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:32.991446 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.991879 21796 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:33.006569 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.006934 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:33.011222 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.011777 19749 raft_consensus.cc:2468] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:33.012377 19822 raft_consensus.cc:2410] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:33.013067 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1175) took 1289 ms. Trace:
I20260709 12:14:33.013474 19822 rpcz_store.cc:276] 0709 12:14:31.723610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.975684 (+1252074us) service_pool.cc:224] Handling call
0709 12:14:33.012988 (+ 37304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.009009 19815 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:33.016055 19815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1176) took 1292 ms. Trace:
I20260709 12:14:33.016496 19815 rpcz_store.cc:276] 0709 12:14:31.726999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.951241 (+1224242us) service_pool.cc:224] Handling call
0709 12:14:33.015975 (+ 64734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.020577 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.022440 19713 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:33.023031 19818 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:33.023720 19818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60644 (request call id 264) took 1307 ms. Trace:
I20260709 12:14:33.024994 21494 raft_consensus.cc:2804] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:33.025679 21494 raft_consensus.cc:697] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:33.027081 21494 consensus_queue.cc:237] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:33.028162 21620 raft_consensus.cc:3055] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:33.028627 21620 raft_consensus.cc:740] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:33.029646 21620 consensus_queue.cc:260] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:33.024085 19818 rpcz_store.cc:276] 0709 12:14:31.716980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.951656 (+1234676us) service_pool.cc:224] Handling call
0709 12:14:33.023649 (+ 71993us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:33.038405 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.045017 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.044086 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.048939 19822 raft_consensus.cc:2468] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:33.049621 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1181) took 1205 ms. Trace:
W20260709 12:14:33.050743 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 77891.9us
I20260709 12:14:33.050037 19822 rpcz_store.cc:276] 0709 12:14:31.844028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.014297 (+1170269us) service_pool.cc:224] Handling call
0709 12:14:33.049531 (+ 35234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.049831 19746 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
I20260709 12:14:33.052568 19745 raft_consensus.cc:2410] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:33.030718 21620 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:33.053071 19820 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:33.052431 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:33.058519 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.058854 19815 raft_consensus.cc:2393] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:33.058763 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.059499 19815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1180) took 1330 ms. Trace:
I20260709 12:14:33.059867 19815 rpcz_store.cc:276] 0709 12:14:31.728887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.017321 (+1288434us) service_pool.cc:224] Handling call
0709 12:14:33.059434 (+ 42113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.060370 19749 raft_consensus.cc:1240] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:33.060758 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:33.060652 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 354115us
I20260709 12:14:33.057925 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.063843 19815 raft_consensus.cc:2410] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:14:33.065543 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:33.066817 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 1.00268e+06us
I20260709 12:14:33.071830 19674 raft_consensus.cc:1240] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:14:33.074838 19668 raft_consensus.cc:1240] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:33.076347 19747 raft_consensus.cc:1240] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:33.078099 19815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1178) took 1350 ms. Trace:
I20260709 12:14:33.063931 20432 raft_consensus.cc:2468] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:33.079741 19820 raft_consensus.cc:2468] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:33.079948 19815 rpcz_store.cc:276] 0709 12:14:31.728057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.060532 (+1332475us) service_pool.cc:224] Handling call
0709 12:14:33.078036 (+ 17504us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:33.080329 19820 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2019) took 1506 ms (client timeout 1900 ms). Trace:
W20260709 12:14:33.082063 19820 rpcz_store.cc:269] 0709 12:14:31.574016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.006148 (+1432132us) service_pool.cc:224] Handling call
0709 12:14:33.080278 (+ 74130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.083557 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:33.083595 19638 leader_election.cc:336] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.515s (SENT)
I20260709 12:14:33.041539 21820 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:33.080305 19821 raft_consensus.cc:2468] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:33.091468 19638 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:33.092880 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.100147 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2011) took 1527 ms. Trace:
I20260709 12:14:33.100680 19821 rpcz_store.cc:276] 0709 12:14:31.572561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.933090 (+1360529us) service_pool.cc:224] Handling call
0709 12:14:33.100059 (+166969us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.102010 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.086030 21573 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:33.103099 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.093549 19822 raft_consensus.cc:2468] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:32.639953 19789 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:56898 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2016)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2015)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2011)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60644 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2014)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2010)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1185)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2022)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2009)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 256)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1148)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1153)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1157)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 258)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 259)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 260)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2013)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2017)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2018)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 263)
I20260709 12:14:33.165814 19820 raft_consensus.cc:2393] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
W20260709 12:14:33.171128 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 87578us
I20260709 12:14:33.103775 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:33.166465 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:33.137008 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.176172 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:33.176892 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2014) took 1603 ms. Trace:
W20260709 12:14:33.175113 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.108208 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1179) took 1379 ms. Trace:
I20260709 12:14:33.177758 19820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1186) took 1132 ms. Trace:
I20260709 12:14:33.103891 19815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2010) took 1531 ms. Trace:
I20260709 12:14:33.178140 19820 rpcz_store.cc:276] 0709 12:14:32.045643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.083275 (+1037632us) service_pool.cc:224] Handling call
0709 12:14:33.177700 (+ 94425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.178278 19815 rpcz_store.cc:276] 0709 12:14:31.572388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.081513 (+1509125us) service_pool.cc:224] Handling call
0709 12:14:33.103835 (+ 22322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.180444 19749 raft_consensus.cc:1240] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:33.181538 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 115461us
I20260709 12:14:33.182476 21797 consensus_queue.cc:1059] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:33.184337 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.184520 21797 consensus_queue.cc:1059] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:33.186594 21821 raft_consensus.cc:3055] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:14:33.176426 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.177899 19821 rpcz_store.cc:276] 0709 12:14:31.728535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.101647 (+1373112us) service_pool.cc:224] Handling call
0709 12:14:33.108131 (+  6484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.177320 19822 rpcz_store.cc:276] 0709 12:14:31.573162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.057101 (+1483939us) service_pool.cc:224] Handling call
0709 12:14:33.176834 (+119733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.188344 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.187507 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:33.215803 19815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1184) took 1370 ms. Trace:
I20260709 12:14:33.216254 19815 rpcz_store.cc:276] 0709 12:14:31.845530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.188005 (+1342475us) service_pool.cc:224] Handling call
0709 12:14:33.215743 (+ 27738us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.206387 21688 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.166254 21849 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:33.221529 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.223253 21688 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:33.226027 21688 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:33.226826 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.227710 19821 raft_consensus.cc:2393] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 5: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:33.227916 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.228132 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2012) took 1655 ms. Trace:
I20260709 12:14:33.228768 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1189) took 1135 ms. Trace:
I20260709 12:14:33.229250 19816 rpcz_store.cc:276] 0709 12:14:32.093315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.227618 (+1134303us) service_pool.cc:224] Handling call
0709 12:14:33.228713 (+  1095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.230297 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:33.231315 20431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60828 (request call id 451) took 1705 ms (client timeout 2127 ms). Trace:
W20260709 12:14:33.231712 20431 rpcz_store.cc:269] 0709 12:14:31.526403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.603051 (+1076648us) service_pool.cc:224] Handling call
0709 12:14:33.231117 (+628066us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b540041ad54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:33.231259 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43173760}
I20260709 12:14:33.234114 20424 raft_consensus.cc:1240] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:33.235105 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.235841 19822 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:33.236275 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1159) took 1758 ms. Trace:
I20260709 12:14:33.236574 19822 rpcz_store.cc:276] 0709 12:14:31.477787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.214097 (+1736310us) service_pool.cc:224] Handling call
0709 12:14:33.236221 (+ 22124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.237469 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.238026 19822 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:33.228641 19821 rpcz_store.cc:276] 0709 12:14:31.572734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.213989 (+1641255us) service_pool.cc:224] Handling call
0709 12:14:33.228075 (+ 14086us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.239018 20396 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:33.240264 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1165) took 1688 ms. Trace:
W20260709 12:14:33.240423 21834 log.cc:927] Time spent T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.413s	user 0.013s	sys 0.000s
I20260709 12:14:33.240882 21796 raft_consensus.cc:2804] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:33.241433 21796 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.241775 21796 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:33.241860 19818 raft_consensus.cc:2410] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:33.240775 19816 rpcz_store.cc:276] 0709 12:14:31.551791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.229958 (+1678167us) service_pool.cc:224] Handling call
0709 12:14:33.240207 (+ 10249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.218179 21850 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.244102 21850 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:33.244350 20429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 565) took 1249 ms. Trace:
I20260709 12:14:33.244964 20429 rpcz_store.cc:276] 0709 12:14:31.994730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.016920 (+ 22190us) service_pool.cc:224] Handling call
0709 12:14:32.021438 (+  4518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.668866 (+647428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.668904 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:32.668970 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:32.669120 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.243781 (+574661us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54006e0354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:33.243845 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:33.244090 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419514624}
I20260709 12:14:33.210911 21847 raft_consensus.cc:3055] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:33.208220 21821 raft_consensus.cc:740] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:33.248358 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.210099 21592 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:33.258173 19749 raft_consensus.cc:2393] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 6: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:33.255146 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.264220 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.265121 19820 raft_consensus.cc:2368] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4.
I20260709 12:14:33.265869 19820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1145) took 2264 ms. Trace:
I20260709 12:14:33.266242 19820 rpcz_store.cc:276] 0709 12:14:31.179171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.213080 (+2033909us) service_pool.cc:224] Handling call
0709 12:14:33.265795 (+ 52715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.271176 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.275120 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:33.281698 19713 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:33.250100 21847 raft_consensus.cc:740] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:33.288921 19815 raft_consensus.cc:2410] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:14:33.290063 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 66437.6us
I20260709 12:14:33.290304 21592 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:33.293872 21592 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:33.295173 19745 raft_consensus.cc:1240] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:33.296521 21366 raft_consensus.cc:2804] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:33.297173 21366 raft_consensus.cc:697] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:33.294174 19790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.002s	sys 0.016s
W20260709 12:14:33.299736 19790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.005s	sys 0.017s
W20260709 12:14:33.299221 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 87440.5us
I20260709 12:14:33.287464 19822 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:33.301344 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.303259 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.305208 19815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1162) took 1826 ms. Trace:
I20260709 12:14:33.305794 19815 rpcz_store.cc:276] 0709 12:14:31.478752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.216892 (+1738140us) service_pool.cc:224] Handling call
0709 12:14:33.305128 (+ 88236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299328}
I20260709 12:14:33.309576 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.308406 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.311317 19820 raft_consensus.cc:2368] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4.
I20260709 12:14:33.311403 19822 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:33.312067 19820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1174) took 1589 ms. Trace:
I20260709 12:14:33.315516 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.318048 19820 rpcz_store.cc:276] 0709 12:14:31.723129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.266989 (+1543860us) service_pool.cc:224] Handling call
0709 12:14:33.311917 (+ 44928us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.313900 19747 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:33.321062 19713 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:33.322695 19746 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:33.324676 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.331511 19745 raft_consensus.cc:1240] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:33.332763 19713 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:33.334312 21789 raft_consensus.cc:2804] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:33.339254 19815 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:33.339630 19818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1187) took 1293 ms (client timeout 1681 ms). Trace:
W20260709 12:14:33.340046 19818 rpcz_store.cc:269] 0709 12:14:32.046267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.043128 (+996861us) service_pool.cc:224] Handling call
0709 12:14:33.339411 (+296283us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54001f0754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:33.339569 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413093760}
I20260709 12:14:33.346863 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:33.347107 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:33.348448 19819 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2015) took 1775 ms (client timeout 2073 ms). Trace:
W20260709 12:14:33.348918 19819 rpcz_store.cc:269] 0709 12:14:31.573316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.342701 (+1769385us) service_pool.cc:224] Handling call
0709 12:14:33.348353 (+  5652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.350116 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.350829 19749 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:33.351711 19745 raft_consensus.cc:1240] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:33.351908 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.352799 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.353226 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:33.358757 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:33.355111 21592 consensus_queue.cc:1059] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:14:33.360510 21842 raft_consensus.cc:3055] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:33.360929 21842 raft_consensus.cc:740] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:33.353405 19640 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:33.361943 21842 consensus_queue.cc:260] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:33.298363 21366 consensus_queue.cc:237] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:33.338014 19713 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:33.353143 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:33.484318 19742 consensus_meta.cc:287] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.004s
I20260709 12:14:33.536121 19742 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:33.378654 19748 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
W20260709 12:14:33.391781 20398 leader_election.cc:336] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.887s (SENT)
W20260709 12:14:33.415095 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.410917 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.353709 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.539367 19820 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:33.516474 19750 raft_consensus.cc:2468] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:33.456234 19746 raft_consensus.cc:1275] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:33.353390 19745 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
W20260709 12:14:33.455425 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 44159us
W20260709 12:14:33.517755 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 215569us
I20260709 12:14:33.505308 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.543432 19817 raft_consensus.cc:2410] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:33.363749 19819 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:33.388669 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:33.547856 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:33.548182 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 194899us
I20260709 12:14:33.553781 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.555120 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.555799 20398 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:33.557281 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.335515 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:33.562498 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.563604 19821 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:33.564308 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1185) took 1555 ms. Trace:
I20260709 12:14:33.564729 19821 rpcz_store.cc:276] 0709 12:14:32.017331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.239434 (+1222103us) service_pool.cc:224] Handling call
0709 12:14:33.562247 (+322813us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b5800013898. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:14:33.564223 (+  1976us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20144384}
I20260709 12:14:33.570395 19744 raft_consensus.cc:1240] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:33.573828 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.574855 19816 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
W20260709 12:14:33.577674 19817 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1170) took 1873 ms (client timeout 1909 ms). Trace:
W20260709 12:14:33.580767 19817 rpcz_store.cc:269] 0709 12:14:31.704546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.504942 (+1800396us) service_pool.cc:224] Handling call
0709 12:14:33.577577 (+ 72635us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.343161 21685 raft_consensus.cc:2804] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:33.583313 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.583949 19823 raft_consensus.cc:3060] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:33.385365 21504 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.353662 21573 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.585373 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.425912 21850 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:33.590839 19640 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:33.589942 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.590197 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.362413 21581 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:33.594515 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:33.410477 21688 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:33.594704 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:33.595614 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.596254 19750 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:33.596535 19748 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:33.592322 19824 raft_consensus.cc:2468] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:33.592680 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.598206 19821 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:33.597988 19824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56898 (request call id 1171) took 1892 ms (client timeout 1900 ms). Trace:
W20260709 12:14:33.608639 19824 rpcz_store.cc:269] 0709 12:14:31.705209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.341666 (+1636457us) service_pool.cc:224] Handling call
0709 12:14:33.597902 (+256236us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:33.615666 19638 leader_election.cc:336] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 2.171s (SENT)
I20260709 12:14:33.617219 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.618592 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.619227 19816 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:33.617997 19746 raft_consensus.cc:2468] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:33.584944 21685 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:33.621593 19638 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:33.620920 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.595503 21592 raft_consensus.cc:2804] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:33.625411 19820 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:33.625689 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.631187 19818 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:33.332774 21821 consensus_queue.cc:260] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:33.631778 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.627197 19744 raft_consensus.cc:1240] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:33.628118 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 80963.9us
W20260709 12:14:33.615358 21781 consensus_meta.cc:287] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.876s	user 0.016s	sys 0.000s
I20260709 12:14:33.638931 21781 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:33.624707 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:33.644235 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 306453us
I20260709 12:14:33.625921 19741 raft_consensus.cc:2393] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:33.508126 21847 consensus_queue.cc:260] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:33.648811 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.652802 19816 raft_consensus.cc:2468] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:33.650000 19742 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:33.593866 21504 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:33.655755 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:33.621376 21685 raft_consensus.cc:3060] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:33.657492 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.660467 19820 raft_consensus.cc:2410] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:33.660697 19821 raft_consensus.cc:2468] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:33.660956 19818 raft_consensus.cc:2468] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:33.669731 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.670684 19821 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:33.664665 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:33.627213 21789 raft_consensus.cc:697] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:33.614471 21688 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:33.642298 21494 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.681473 19713 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:33.681797 20429 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 5: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:33.641875 21840 raft_consensus.cc:2749] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:33.683372 19824 raft_consensus.cc:2410] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:33.683347 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:33.684405 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.684616 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.646313 21846 raft_consensus.cc:2804] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:33.687269 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 45737.9us
I20260709 12:14:33.617069 21573 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:33.689705 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.697404 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:33.725131 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.690267 19817 raft_consensus.cc:2410] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:33.689657 19819 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:33.656914 21842 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:33.725633 19820 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:33.667900 21858 raft_consensus.cc:2749] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:33.736505 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.686317 21850 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:33.737691 21850 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:33.738137 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.699802 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.739488 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:33.685981 21821 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:33.732336 20424 consensus_queue.cc:237] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:33.697603 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 305915us
I20260709 12:14:33.722371 21871 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.735309 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:33.680107 21789 consensus_queue.cc:237] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:33.763943 21871 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:33.740608 21847 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:33.777845 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 108945us
I20260709 12:14:33.779695 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.782743 19748 raft_consensus.cc:2468] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:33.725485 21846 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:33.764349 21592 raft_consensus.cc:697] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
W20260709 12:14:33.791765 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 70812.7us
W20260709 12:14:33.792882 20398 leader_election.cc:336] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.904s (SENT)
I20260709 12:14:33.793445 20398 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:33.713534 19750 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
I20260709 12:14:33.740085 19818 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:33.754112 19816 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
W20260709 12:14:33.746414 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.779862 19640 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:33.746336 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 135056us
I20260709 12:14:33.756680 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:33.801378 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:33.762885 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 102605us
W20260709 12:14:33.755885 19668 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.004s	sys 0.006s
I20260709 12:14:33.764794 19747 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
W20260709 12:14:33.802292 19668 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.004s	sys 0.007s
W20260709 12:14:33.763832 21861 log.cc:927] Time spent T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.358s	user 0.000s	sys 0.002s
I20260709 12:14:33.804425 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:33.769214 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.770150 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:33.805922 20397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.806200 19821 raft_consensus.cc:2410] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:33.806722 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2009) took 2234 ms. Trace:
I20260709 12:14:33.802443 19713 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:33.802902 19746 raft_consensus.cc:1240] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:33.807057 19821 rpcz_store.cc:276] 0709 12:14:31.572146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.696212 (+2124066us) service_pool.cc:224] Handling call
0709 12:14:33.806653 (+110441us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.700328 21612 consensus_queue.cc:1059] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
W20260709 12:14:33.790625 21857 log.cc:927] Time spent T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.321s	user 0.002s	sys 0.000s
I20260709 12:14:33.808943 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.809002 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:33.814828 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 60871.3us
I20260709 12:14:33.778596 21865 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.746315 21494 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:33.828815 19742 raft_consensus.cc:2410] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:33.837828 19821 raft_consensus.cc:1240] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:33.838518 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1150) took 2523 ms. Trace:
I20260709 12:14:33.838855 19821 rpcz_store.cc:276] 0709 12:14:31.316025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.810313 (+2494288us) service_pool.cc:224] Handling call
0709 12:14:33.837648 (+ 27335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.838277 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.838461 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.791982 21846 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:33.765864 21840 consensus_queue.cc:1059] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:14:33.809327 19741 raft_consensus.cc:2393] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:33.841774 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:33.843309 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.843817 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:33.850519 19824 raft_consensus.cc:1240] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:33.855811 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.858168 19824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1151) took 2505 ms. Trace:
I20260709 12:14:33.858698 19824 rpcz_store.cc:276] 0709 12:14:31.353222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.830073 (+2476851us) service_pool.cc:224] Handling call
0709 12:14:33.850308 (+ 20235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.857849 (+  7541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.858102 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.861737 19749 raft_consensus.cc:1240] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:33.819514 21631 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:33.873729 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:33.937863 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 135483us
W20260709 12:14:34.199530 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:33.903030 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 70118.9us
I20260709 12:14:33.986076 19823 raft_consensus.cc:2468] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:34.057803 19748 raft_consensus.cc:2468] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
W20260709 12:14:34.324193 19823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2016) took 2750 ms (client timeout 2024 ms). Trace:
I20260709 12:14:34.324308 19818 raft_consensus.cc:1240] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:34.324846 19823 rpcz_store.cc:269] 0709 12:14:31.573463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.352804 (+1779341us) service_pool.cc:224] Handling call
0709 12:14:34.324099 (+971295us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.319669 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.114655 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:34.003086 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.116453 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.917714 19821 raft_consensus.cc:1240] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:34.330137 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.330333 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1153) took 2976 ms. Trace:
W20260709 12:14:33.910399 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.877733 19815 raft_consensus.cc:2468] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:34.334843 19815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2024) took 1517 ms. Trace:
W20260709 12:14:34.158888 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 360847us
I20260709 12:14:34.335353 19815 rpcz_store.cc:276] 0709 12:14:32.817629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.314211 (+496582us) service_pool.cc:224] Handling call
0709 12:14:34.334736 (+1020525us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.339771 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.329355 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.342051 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.327698 19747 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:34.330739 19821 rpcz_store.cc:276] 0709 12:14:31.354113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.839557 (+2485444us) service_pool.cc:224] Handling call
0709 12:14:33.917402 (+ 77845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.330018 (+412616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.330265 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.330742 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.352242 19820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 256) took 3366 ms. Trace:
I20260709 12:14:34.352989 19820 rpcz_store.cc:276] 0709 12:14:30.985712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.734325 (+2748613us) service_pool.cc:224] Handling call
0709 12:14:33.734768 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.735163 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:33.803141 (+ 67978us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.323781 (+520640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.323865 (+    84us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:34.351910 (+ 28045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.352008 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.352179 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":273046,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"thread_start_us":494044,"threads_started":3}
W20260709 12:14:34.048524 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 254393us
I20260709 12:14:34.369062 19715 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:34.111747 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:34.004069 21861 log.cc:927] Time spent T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:14:33.984722 21866 log.cc:927] Time spent T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
W20260709 12:14:34.390152 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 53898.5us
I20260709 12:14:34.003782 21871 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:34.353681 21620 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.319829 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:33.876521 21869 log.cc:927] Time spent T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 12:14:34.396968 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 45174.8us
I20260709 12:14:34.113397 21568 raft_consensus.cc:3055] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:34.398427 19817 raft_consensus.cc:1240] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:34.320080 21573 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:34.399923 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:34.320837 21688 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:33.874429 21864 raft_consensus.cc:2749] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:34.190131 21878 consensus_queue.cc:1059] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.355s
I20260709 12:14:34.376739 21631 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:33.840225 21865 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:33.876889 21874 raft_consensus.cc:2804] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:33.875022 21872 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.659s
I20260709 12:14:34.399755 19820 raft_consensus.cc:1240] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:34.109134 21879 raft_consensus.cc:2749] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:34.397686 19824 raft_consensus.cc:1240] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:34.403322 19713 connection.cc:256] RPC call timeout handler was delayed by -1.0735607080000591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
I20260709 12:14:34.412357 21568 raft_consensus.cc:740] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:34.551386 19816 raft_consensus.cc:1240] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:34.552124 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1149) took 3270 ms. Trace:
I20260709 12:14:34.551837 21568 consensus_queue.cc:260] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:34.552579 19743 consensus_meta.cc:287] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 1.571s	user 0.030s	sys 0.006s
W20260709 12:14:34.419313 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 631899us
I20260709 12:14:34.555015 19750 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:34.414407 19817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1157) took 2937 ms. Trace:
W20260709 12:14:34.460136 19822 consensus_meta.cc:287] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 1.115s	user 0.013s	sys 0.025s
I20260709 12:14:34.585603 19822 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:34.585522 19817 rpcz_store.cc:276] 0709 12:14:31.477181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.060068 (+2582887us) service_pool.cc:224] Handling call
0709 12:14:34.375255 (+315187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.413446 (+ 38191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.414302 (+   856us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.586154 19822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56904 (request call id 2030) took 1693 ms (client timeout 2011 ms). Trace:
W20260709 12:14:34.586512 19822 rpcz_store.cc:269] 0709 12:14:32.892397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.300929 (+408532us) service_pool.cc:224] Handling call
0709 12:14:34.586099 (+1285170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.376997 21592 consensus_queue.cc:237] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:34.583515 19668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 260) took 1504 ms. Trace:
I20260709 12:14:34.552488 19816 rpcz_store.cc:276] 0709 12:14:31.282342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.810188 (+2527846us) service_pool.cc:224] Handling call
0709 12:14:34.550995 (+740807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.551853 (+   858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.552072 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.591495 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.591854 19820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1163) took 3052 ms. Trace:
I20260709 12:14:34.584496 19824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1154) took 3230 ms. Trace:
I20260709 12:14:34.606448 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:34.606984 20398 leader_election.cc:336] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.980s (SENT)
I20260709 12:14:34.608412 19747 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:34.597311 19820 rpcz_store.cc:276] 0709 12:14:31.539791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.399052 (+2859261us) service_pool.cc:224] Handling call
0709 12:14:34.399502 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.555570 (+156068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.591785 (+ 36215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.598203 19824 rpcz_store.cc:276] 0709 12:14:31.354511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.859663 (+2505152us) service_pool.cc:224] Handling call
0709 12:14:34.367564 (+507901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.557212 (+189648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.584404 (+ 27192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.417497 21867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.032s
I20260709 12:14:34.411386 21871 raft_consensus.cc:2804] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:34.405920 21620 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:34.592973 19668 rpcz_store.cc:276] 0709 12:14:33.078756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.078899 (+   143us) service_pool.cc:224] Handling call
0709 12:14:33.097892 (+ 18993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.184314 (+ 86422us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:33.806747 (+622433us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.572249 (+765502us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.583204 (+ 10955us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:34.583257 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.583326 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.583454 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66488,"prepare.queue_time_us":94927,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":12577,"thread_start_us":1022407,"threads_started":3,"wal-append.queue_time_us":653366}
I20260709 12:14:34.678153 19747 raft_consensus.cc:1240] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:34.700623 19819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1147) took 3498 ms. Trace:
W20260709 12:14:34.697894 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 90934.6us
W20260709 12:14:34.709910 20398 leader_election.cc:336] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.949s (SENT)
W20260709 12:14:34.689459 19744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.005s	sys 0.011s
W20260709 12:14:34.713420 19744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.007s	sys 0.013s
I20260709 12:14:34.607652 19672 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:34.617187 19742 raft_consensus.cc:2393] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:34.582540 19743 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:34.720212 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 261) took 3175 ms. Trace:
I20260709 12:14:34.720880 19822 rpcz_store.cc:276] 0709 12:14:31.544490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.608905 (+3064415us) service_pool.cc:224] Handling call
0709 12:14:34.677952 (+ 69047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.678266 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.678298 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.689271 (+ 10973us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:34.719115 (+ 29844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.719665 (+   550us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.720141 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.418270 21881 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:34.725731 19816 raft_consensus.cc:1240] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:34.730022 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:34.658748 21796 consensus_meta.cc:287] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 1.384s	user 0.008s	sys 0.024s
W20260709 12:14:34.726013 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.625898 21366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.011s	sys 0.011s
W20260709 12:14:34.736817 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.746541 19666 raft_consensus.cc:2468] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:34.735786 21881 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:34.606444 21573 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:34.739182 19817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 260) took 3195 ms. Trace:
I20260709 12:14:34.743067 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2013) took 3170 ms. Trace:
W20260709 12:14:34.696755 21840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.025s	sys 0.008s
I20260709 12:14:34.759056 19817 rpcz_store.cc:276] 0709 12:14:31.544132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.586576 (+3042444us) service_pool.cc:224] Handling call
0709 12:14:34.689009 (+102433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.738802 (+ 49793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.738839 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.738889 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:34.738924 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.738990 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.739120 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.737852 21581 raft_consensus.cc:2804] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:34.714111 21871 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.713806 19819 rpcz_store.cc:276] 0709 12:14:31.202419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.752498 (+2550079us) service_pool.cc:224] Handling call
0709 12:14:33.774067 (+ 21569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.774329 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:33.940825 (+166496us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.697932 (+757107us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.698009 (+    77us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:34.698085 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.698183 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.700540 (+  2357us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43427,"prepare.queue_time_us":498996,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":25610,"thread_start_us":709437,"threads_started":3}
I20260709 12:14:34.758157 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 263) took 3176 ms. Trace:
I20260709 12:14:34.615391 21568 raft_consensus.cc:3060] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:34.759507 19816 rpcz_store.cc:276] 0709 12:14:31.572966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.609484 (+3036518us) service_pool.cc:224] Handling call
0709 12:14:34.725477 (+115993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.742537 (+ 17060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.742957 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.723572 21867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.003s	sys 0.052s
I20260709 12:14:34.729475 21688 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.746768 21366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.020s	sys 0.029s
W20260709 12:14:34.768714 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.614979 21874 raft_consensus.cc:697] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:34.770725 19822 rpcz_store.cc:276] 0709 12:14:31.581642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.735372 (+3153730us) service_pool.cc:224] Handling call
0709 12:14:34.747642 (+ 12270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.756707 (+  9065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.756854 (+   147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.757055 (+   201us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:34.757157 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.757493 (+   336us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.757933 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.771822 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.776393 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:34.760821 21840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.025s	sys 0.011s
W20260709 12:14:34.782299 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.785147 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.785051 19666 raft_consensus.cc:2410] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:34.778955 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:34.792495 19822 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:34.735170 21878 consensus_queue.cc:1059] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 12:14:34.750217 19743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36936 (request call id 1722) took 1824 ms (client timeout 1599 ms). Trace:
I20260709 12:14:34.761262 21881 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:34.806404 19817 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:34.811410 19817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 265) took 1944 ms. Trace:
I20260709 12:14:34.811765 19817 rpcz_store.cc:276] 0709 12:14:32.867623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.768597 (+1900974us) service_pool.cc:224] Handling call
0709 12:14:34.801033 (+ 32436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.811113 (+ 10080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.811348 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.768625 21871 raft_consensus.cc:3060] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:34.814360 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 436243us
I20260709 12:14:34.775660 21879 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.818171 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.808120 19714 connection.cc:256] RPC call timeout handler was delayed by -1.0048447659999056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 12:14:34.749969 21796 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:34.817881 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:34.776618 21885 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:34.819624 19640 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:34.824466 19666 raft_consensus.cc:2393] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:34.768347 21573 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:34.832291 21850 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:34.833931 21849 consensus_meta.cc:287] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.575s	user 0.009s	sys 0.002s
I20260709 12:14:34.834388 21849 raft_consensus.cc:2749] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:34.834954 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 189) took 1149 ms. Trace:
I20260709 12:14:34.835414 19746 rpcz_store.cc:276] 0709 12:14:33.685655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.692374 (+  6719us) service_pool.cc:224] Handling call
0709 12:14:33.802469 (+110095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:33.807601 (+  5132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.834694 (+1027093us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540017f550. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:34.834892 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252080384}
I20260709 12:14:34.836126 21895 raft_consensus.cc:3055] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:34.836547 21895 raft_consensus.cc:740] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:34.837379 21895 consensus_queue.cc:260] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:34.838299 21874 consensus_queue.cc:237] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:34.840713 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.838375 19818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1148) took 3622 ms. Trace:
W20260709 12:14:34.847404 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.853282 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.869246 19640 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:34.870958 19816 raft_consensus.cc:1275] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:34.878367 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2026) took 1998 ms. Trace:
I20260709 12:14:34.878813 19816 rpcz_store.cc:276] 0709 12:14:32.883830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.798693 (+1914863us) service_pool.cc:224] Handling call
0709 12:14:34.817827 (+ 19134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.878061 (+ 60234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.878296 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.856281 19818 rpcz_store.cc:276] 0709 12:14:31.216510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.809161 (+2592651us) service_pool.cc:224] Handling call
0709 12:14:34.324089 (+514928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.328239 (+  4150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.838114 (+509875us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b540036b5d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:34.838297 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031716608}
I20260709 12:14:34.806625 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:34.805130 19743 rpcz_store.cc:269] 0709 12:14:32.913397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.913574 (+   177us) service_pool.cc:224] Handling call
0709 12:14:34.732436 (+1818862us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.842661 21685 consensus_meta.cc:287] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 1.161s	user 0.015s	sys 0.015s
I20260709 12:14:34.857005 21895 raft_consensus.cc:3060] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:34.843065 21840 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:34.885701 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:34.889684 19819 raft_consensus.cc:2468] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
W20260709 12:14:34.889899 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.887305 20398 leader_election.cc:336] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.778s (SENT)
I20260709 12:14:34.896463 20398 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:34.890856 19714 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:34.825295 21688 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:34.895576 19666 raft_consensus.cc:2376] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2. Re-sending same reply.
I20260709 12:14:34.898672 19817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2027) took 2007 ms. Trace:
I20260709 12:14:34.899151 19817 rpcz_store.cc:276] 0709 12:14:32.891318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.812532 (+1921214us) service_pool.cc:224] Handling call
0709 12:14:34.872329 (+ 59797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.887196 (+ 14867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.887226 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.890889 (+  3663us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:34.898394 (+  7505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.898477 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.898606 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.899739 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 204) took 1125 ms. Trace:
I20260709 12:14:34.843614 19572 catalog_manager.cc:5697] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:34.900378 19747 rpcz_store.cc:276] 0709 12:14:33.774519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.708297 (+933778us) service_pool.cc:224] Handling call
0709 12:14:34.708691 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.708986 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:34.743346 (+ 34360us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.899389 (+156043us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.899445 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:34.899492 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.899559 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.899675 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":116017,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":184110,"threads_started":2}
I20260709 12:14:34.895664 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:34.903234 19670 raft_consensus.cc:2468] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 1.
W20260709 12:14:34.893950 21842 consensus_meta.cc:287] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.129s	user 0.012s	sys 0.016s
I20260709 12:14:34.909404 19640 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:34.895220 21840 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.911803 19816 raft_consensus.cc:1240] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:34.914621 19817 pending_rounds.cc:85] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting all ops after (but not including) 5
I20260709 12:14:34.915942 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2032) took 1961 ms. Trace:
I20260709 12:14:34.914151 19569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53406 (request call id 125) took 10817 ms. Trace:
I20260709 12:14:34.916168 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:34.916417 19816 rpcz_store.cc:276] 0709 12:14:32.955052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.879742 (+1924690us) service_pool.cc:224] Handling call
0709 12:14:34.898676 (+ 18934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.914537 (+ 15861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.915878 (+  1341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.917479 19666 raft_consensus.cc:2468] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:34.922330 21573 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:34.923040 21903 raft_consensus.cc:2749] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:34.923905 21889 log.cc:927] Time spent T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 12:14:34.925591 21898 log.cc:927] Time spent T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:34.905157 21894 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.887989 21685 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:34.824018 21879 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:34.875511 21885 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:34.915110 19817 pending_rounds.cc:107] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:14:34.943482 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:34.941219 19745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36936 (request call id 1737) took 1607 ms. Trace:
I20260709 12:14:34.966997 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 188) took 1317 ms. Trace:
W20260709 12:14:35.060555 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 153543us
I20260709 12:14:35.182418 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1216) took 1846 ms. Trace:
I20260709 12:14:35.504004 19817 raft_consensus.cc:2889] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:34.945852 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:34.957331 19572 catalog_manager.cc:5697] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 2 to 3, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 3 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:35.426550 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.183019 19820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2017) took 3609 ms. Trace:
W20260709 12:14:35.510134 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 638491us
W20260709 12:14:35.069829 19638 leader_election.cc:336] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.784s (SENT)
I20260709 12:14:35.505271 19745 rpcz_store.cc:276] 0709 12:14:33.333813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.556788 (+222975us) service_pool.cc:224] Handling call
0709 12:14:34.940938 (+1384150us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003593d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:34.941132 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2655838464}
I20260709 12:14:34.950695 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40172 (request call id 203) took 1176 ms. Trace:
I20260709 12:14:35.415774 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2035) took 2137 ms. Trace:
I20260709 12:14:34.949872 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40172 (request call id 192) took 1217 ms. Trace:
I20260709 12:14:35.512459 19824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2018) took 3938 ms. Trace:
I20260709 12:14:35.076649 19819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 267) took 1891 ms. Trace:
I20260709 12:14:35.533815 19748 rpcz_store.cc:276] 0709 12:14:33.732235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.790013 (+ 57778us) service_pool.cc:224] Handling call
0709 12:14:34.949696 (+1159683us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b54001cedd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:34.949810 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146658560}
W20260709 12:14:34.909310 21821 consensus_meta.cc:287] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 1.156s	user 0.012s	sys 0.000s
I20260709 12:14:35.546372 19819 rpcz_store.cc:276] 0709 12:14:33.185275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.899159 (+1713884us) service_pool.cc:224] Handling call
0709 12:14:34.909761 (+ 10602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.061194 (+151433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.061233 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.076241 (+ 15008us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.076311 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.076400 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.076568 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.111642 19822 raft_consensus.cc:3055] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:35.548122 19822 raft_consensus.cc:740] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:454: Failure
Failed
Bad status: Timed out: LeaderStepDown RPC to 127.17.249.195:42991 timed out after 10.000s (SENT)
W20260709 12:14:35.335917 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.549085 21905 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:35.549850 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.966620 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.964228 20433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 571) took 1319 ms. Trace:
W20260709 12:14:35.534714 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.519167 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:35.540164 20397 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.513226 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.519088 19667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
W20260709 12:14:35.261418 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.910597 21849 raft_consensus.cc:2804] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:35.298120 21891 log.cc:927] Time spent T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.688s	user 0.004s	sys 0.000s
I20260709 12:14:35.539902 19744 rpcz_store.cc:276] 0709 12:14:33.649650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.649806 (+   156us) service_pool.cc:224] Handling call
0709 12:14:33.672807 (+ 23001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:33.689637 (+ 16830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:33.689683 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:33.780754 (+ 91071us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.715657 (+934903us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:34.715713 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.716436 (+   723us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:34.966771 (+250335us) raft_consensus.cc:1685] finished
0709 12:14:34.966809 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.966941 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":900454,"threads_started":1,"wal-append.queue_time_us":1117816}
I20260709 12:14:35.539083 19749 rpcz_store.cc:276] 0709 12:14:33.336377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.588675 (+252298us) service_pool.cc:224] Handling call
0709 12:14:33.841395 (+252720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.869842 (+ 28447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.182148 (+1312306us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54003520d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:35.182350 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513940736}
W20260709 12:14:35.502314 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.553929 19572 catalog_manager.cc:5697] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 2 to 3, leader changed from b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:35.545856 19672 raft_consensus.cc:2410] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:34.945540 21688 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:35.533661 19816 rpcz_store.cc:276] 0709 12:14:33.278293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.917781 (+1639488us) service_pool.cc:224] Handling call
0709 12:14:35.213891 (+296110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.401464 (+187573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.401529 (+    65us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.415013 (+ 13484us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:35.415418 (+   405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.415513 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.415691 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.949702 21886 log.cc:927] Time spent T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.269s	user 0.001s	sys 0.001s
W20260709 12:14:35.247651 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.572451 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.552227 19640 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:35.553472 21853 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.549928 21905 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:35.576308 19818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.005s	sys 0.014s
W20260709 12:14:35.576756 19818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.006s	sys 0.015s
W20260709 12:14:35.577164 19788 connection.cc:256] RPC call timeout handler was delayed by -1.2063540580002154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 12:14:35.553854 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.551039 20433 rpcz_store.cc:276] 0709 12:14:33.644837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.645044 (+   207us) service_pool.cc:224] Handling call
0709 12:14:33.660582 (+ 15538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.626244 (+965662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.626274 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.626328 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:34.626354 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.963912 (+337558us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54007936d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:34.963956 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.964139 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199694208}
I20260709 12:14:35.554888 19670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:35.552188 19667 raft_consensus.cc:3060] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:35.555853 19815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.005s	sys 0.014s
I20260709 12:14:34.913965 21858 raft_consensus.cc:2749] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:34.916617 21840 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:34.949494 21846 consensus_meta.cc:287] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 1.010s	user 0.007s	sys 0.002s
W20260709 12:14:35.285938 21847 consensus_meta.cc:287] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 1.498s	user 0.017s	sys 0.014s
I20260709 12:14:35.535213 19820 rpcz_store.cc:276] 0709 12:14:31.573627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.613127 (+3039500us) service_pool.cc:224] Handling call
0709 12:14:34.750815 (+137688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.751057 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.751085 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.762997 (+ 11912us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.879369 (+116372us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:34.879416 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.879567 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.182721 (+303154us) raft_consensus.cc:1685] finished
0709 12:14:35.182749 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.182948 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":74139,"threads_started":1,"wal-append.queue_time_us":404732}
I20260709 12:14:35.559095 19674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:35.559891 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:35.566229 21849 raft_consensus.cc:697] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:34.960328 21581 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.933262 21612 raft_consensus.cc:3055] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:35.561506 19666 raft_consensus.cc:2368] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4.
I20260709 12:14:34.948446 21494 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:35.546161 19824 rpcz_store.cc:276] 0709 12:14:31.573859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.725023 (+3151164us) service_pool.cc:224] Handling call
0709 12:14:34.744034 (+ 19011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.760172 (+ 16138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.760200 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.795139 (+ 34939us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.879075 (+ 83936us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:34.879123 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.879194 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.512144 (+632950us) raft_consensus.cc:1685] finished
0709 12:14:35.512170 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.512371 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":46730,"threads_started":1,"wal-append.queue_time_us":93745}
W20260709 12:14:35.563210 19713 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.003s	sys 0.018s
W20260709 12:14:35.608523 19713 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.003s	sys 0.018s
W20260709 12:14:35.608840 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 838909us
I20260709 12:14:35.070809 21842 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:35.611734 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 67843.4us
I20260709 12:14:34.954348 19741 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:35.532835 19742 rpcz_store.cc:276] 0709 12:14:33.774229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.841541 (+ 67312us) service_pool.cc:224] Handling call
0709 12:14:34.110719 (+269178us) spinlock_profiling.cc:243] Waited 904 us on lock 0x7b54001ce228. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa55c5f4 00007fadf9745227 00007fadf9744ab8 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:34.950439 (+839720us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54001ce3d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:34.950613 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1165406464}
I20260709 12:14:35.614867 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:35.194692 21620 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:35.181735 21820 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:35.620779 21885 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:35.601035 21688 raft_consensus.cc:2804] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:34.927682 21631 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:35.536036 21504 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:35.544425 21894 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:35.606927 21581 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.571146 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:35.549371 18407 tablet_server.cc:179] TabletServer@127.17.249.193:0 shutting down...
I20260709 12:14:34.927445 21865 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:35.572999 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.553153 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.573321 19715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.004s	sys 0.017s
I20260709 12:14:35.573508 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
W20260709 12:14:35.559173 21874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.010s	sys 0.008s
I20260709 12:14:35.582521 19670 raft_consensus.cc:2393] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 5: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
W20260709 12:14:35.582872 19815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.006s	sys 0.014s
I20260709 12:14:35.633261 19815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 258) took 4145 ms. Trace:
I20260709 12:14:35.606950 21612 raft_consensus.cc:740] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:35.598413 19640 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:35.560269 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 491453us
I20260709 12:14:35.560389 21821 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:34.951460 21897 raft_consensus.cc:3055] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:35.612341 19673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8"
I20260709 12:14:35.612829 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:35.610666 19572 catalog_manager.cc:5697] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.639394 19673 raft_consensus.cc:2410] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:35.614027 19713 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:35.618189 19671 raft_consensus.cc:2468] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:35.621959 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 259) took 4133 ms. Trace:
I20260709 12:14:35.633785 19815 rpcz_store.cc:276] 0709 12:14:31.488319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.376764 (+2888445us) service_pool.cc:224] Handling call
0709 12:14:34.392466 (+ 15702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.409747 (+ 17281us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:34.468817 (+ 59070us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.632780 (+1163963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.632874 (+    94us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.632939 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.633038 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.633188 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49868,"prepare.queue_time_us":87331,"prepare.run_cpu_time_us":6498,"prepare.run_wall_time_us":30053,"raft.queue_time_us":75776,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":21833,"thread_start_us":1009065,"threads_started":2,"wal-append.queue_time_us":273914}
W20260709 12:14:35.542451 21895 consensus_meta.cc:287] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.002s
I20260709 12:14:35.605165 21827 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.549145 19822 consensus_queue.cc:260] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:35.629654 19672 raft_consensus.cc:2468] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
W20260709 12:14:35.631695 19715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.005s	sys 0.017s
I20260709 12:14:35.599471 21853 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:35.645433 19572 catalog_manager.cc:5697] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 2 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:35.646514 19713 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:35.279567 21871 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:35.615468 21842 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:35.640641 19821 rpcz_store.cc:276] 0709 12:14:31.488666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.409647 (+2920981us) service_pool.cc:224] Handling call
0709 12:14:34.449117 (+ 39470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.732398 (+283281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.732446 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.749083 (+ 16637us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.094323 (+345240us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.094370 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.094460 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.621720 (+527260us) raft_consensus.cc:1685] finished
0709 12:14:35.621743 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.621892 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12680,"raft.queue_time_us":317004,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":38809,"thread_start_us":477961,"threads_started":2,"wal-append.queue_time_us":838552}
W20260709 12:14:35.645031 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 69466us
W20260709 12:14:35.636193 21874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.011s	sys 0.008s
I20260709 12:14:35.649884 20433 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:35.624540 21688 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:35.650054 19572 catalog_manager.cc:5697] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:35.655653 19638 leader_election.cc:336] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.802s (SENT)
I20260709 12:14:35.647972 19816 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.634413 19666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:35.653394 19673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48652 (request call id 2035) took 1328 ms. Trace:
I20260709 12:14:35.652802 19640 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:35.658540 19671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:35.659276 19671 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:35.659415 19668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:35.660709 19672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f662c4f7d6a74013a1e58a5330a049b8" is_pre_election: true
I20260709 12:14:35.656883 19673 rpcz_store.cc:276] 0709 12:14:34.320170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.353429 (+ 33259us) service_pool.cc:224] Handling call
0709 12:14:35.112256 (+758827us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5800003398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:14:35.612167 (+499911us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b5800003398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ae9c 00007fadf165aa5b 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:14:35.648295 (+ 36128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93555200}
I20260709 12:14:35.638402 21897 raft_consensus.cc:740] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:34.916563 19569 rpcz_store.cc:276] 0709 12:14:24.108041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.108447 (+   406us) service_pool.cc:224] Handling call
0709 12:14:34.842589 (+10734142us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:26.744816 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:26.838414 (+ 93598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:26.838482 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:14:26.838503 (+    21us) tablet.cc:662] Decoding operations
0709 12:14:26.839403 (+   900us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:26.839498 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:26.839538 (+    40us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:14:26.840138 (+   600us) tablet.cc:701] Row locks acquired
0709 12:14:26.840189 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:14:26.840408 (+   219us) write_op.cc:270] Start()
0709 12:14:26.840606 (+   198us) write_op.cc:276] Timestamp: P: 1783599266840328 usec, L: 0
0709 12:14:26.840626 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:14:26.841553 (+   927us) log.cc:844] Serialized 1762 byte log entry
0709 12:14:30.099294 (+3257741us) op_driver.cc:464] REPLICATION: finished
0709 12:14:30.929021 (+829727us) write_op.cc:301] APPLY: starting
0709 12:14:30.946358 (+ 17337us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:31.088172 (+141814us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:31.240885 (+152713us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:31.548720 (+307835us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:31.552613 (+  3893us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:14:31.552696 (+    83us) write_op.cc:312] APPLY: finished
0709 12:14:31.601974 (+ 49278us) log.cc:844] Serialized 41 byte log entry
0709 12:14:31.650442 (+ 48468us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:31.650580 (+   138us) write_op.cc:454] Released schema lock
0709 12:14:31.650659 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:31.779587 (+128928us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:31.779686 (+    99us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":757079,"apply.run_cpu_time_us":25805,"apply.run_wall_time_us":915019,"num_ops":4,"prepare.queue_time_us":275243,"prepare.run_cpu_time_us":44209,"prepare.run_wall_time_us":301600,"raft.queue_time_us":1462040,"raft.run_cpu_time_us":23947,"raft.run_wall_time_us":770637,"replication_time_us":3258354,"thread_start_us":1491773,"threads_started":5,"wal-append.queue_time_us":515292,"wal-append.run_cpu_time_us":29149,"wal-append.run_wall_time_us":3941611}]]}
I20260709 12:14:35.604543 21846 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:35.651400 21592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.034s	sys 0.035s
I20260709 12:14:35.657951 19666 raft_consensus.cc:2468] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:35.666011 19670 raft_consensus.cc:1275] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:35.666695 19670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 2039) took 1122 ms. Trace:
I20260709 12:14:35.639374 21781 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:35.649930 21878 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:35.667057 19670 rpcz_store.cc:276] 0709 12:14:34.544633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.652949 (+1108316us) service_pool.cc:224] Handling call
0709 12:14:35.665682 (+ 12733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.666463 (+   781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.666649 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.663085 19572 catalog_manager.cc:5697] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 2 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:35.672802 19713 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:35.654837 21842 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:35.675542 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 46729.5us
I20260709 12:14:35.677258 19821 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:35.655040 21885 raft_consensus.cc:2804] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:35.659806 21688 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.656275 21865 raft_consensus.cc:2804] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:35.685489 19675 raft_consensus.cc:1240] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:35.688162 21908 log.cc:927] Time spent T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:14:35.688660 21903 raft_consensus.cc:2804] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:35.689224 21568 consensus_queue.cc:1059] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:35.645031 21821 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:35.731302 21709 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:35.732326 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:35.779014 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 47639.6us
W20260709 12:14:35.669560 21592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.034s	sys 0.035s
I20260709 12:14:35.732100 19572 catalog_manager.cc:5697] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 2 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:35.759083 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 103470us
I20260709 12:14:35.644106 21620 consensus_queue.cc:1059] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:14:35.744714 19714 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
W20260709 12:14:35.863706 21918 log.cc:927] Time spent T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:14:35.841301 21879 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:35.724473 19788 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.554s (SENT)
I20260709 12:14:35.756654 20424 raft_consensus.cc:1240] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:35.737129 21685 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:35.823565 21847 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:14:35.693125 21849 consensus_queue.cc:237] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:35.825639 21853 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:35.826444 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:35.752848 21612 consensus_queue.cc:260] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:35.690685 19640 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:35.801540 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.826679 21846 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:35.780810 21781 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:14:35.679858 21895 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:35.694949 21865 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.724108 19822 raft_consensus.cc:3060] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.683213 21878 raft_consensus.cc:697] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:35.652031 21827 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:35.829716 21472 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:35.856588 21920 log.cc:927] Time spent T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260709 12:14:35.940884 21472 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:35.943516 21893 log.cc:927] Time spent T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.371s	user 0.006s	sys 0.000s
I20260709 12:14:35.943531 21472 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:35.865855 20429 raft_consensus.cc:1240] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:35.875631 21919 log.cc:927] Time spent T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:14:35.875834 19713 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:35.913226 21494 raft_consensus.cc:2804] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:35.877691 19638 leader_election.cc:336] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.900s (SENT)
I20260709 12:14:35.878228 19572 catalog_manager.cc:5697] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:35.834214 21885 raft_consensus.cc:697] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:35.822695 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 143331us
I20260709 12:14:35.855561 21905 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:35.895828 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 171510us
W20260709 12:14:35.963985 19788 leader_election.cc:336] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.578s (SENT)
W20260709 12:14:35.964587 19788 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.650s (SENT) [suppressed 31 similar messages]
W20260709 12:14:35.902731 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 212126us
I20260709 12:14:35.915957 19816 raft_consensus.cc:2468] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:35.879487 21903 raft_consensus.cc:697] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:35.884052 21871 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:35.903189 21881 consensus_meta.cc:287] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 1.075s	user 0.013s	sys 0.000s
I20260709 12:14:35.789772 21897 consensus_queue.cc:260] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:35.924254 20425 raft_consensus.cc:1240] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:35.922969 21865 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.936022 21895 raft_consensus.cc:697] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:35.911753 21820 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.961405 21685 raft_consensus.cc:2804] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:35.939492 21840 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:35.939368 21878 consensus_queue.cc:237] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:35.952111 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 76371.9us
I20260709 12:14:35.876543 19823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 257) took 4389 ms. Trace:
I20260709 12:14:35.955581 19822 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:36.011957 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:36.012444 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2039) took 1245 ms. Trace:
I20260709 12:14:36.012915 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:36.012843 19822 rpcz_store.cc:276] 0709 12:14:34.767130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.111048 (+343918us) service_pool.cc:224] Handling call
0709 12:14:35.111447 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.012191 (+900744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.012389 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:35.956360 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 224787us
W20260709 12:14:35.957434 20398 leader_election.cc:336] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 2.900s (SENT)
I20260709 12:14:36.014278 20398 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:35.973722 19638 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:35.976624 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:35.894333 21709 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:35.978703 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:35.924592 21846 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:35.957072 21612 raft_consensus.cc:3060] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:35.992254 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.026578 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 62012us
I20260709 12:14:35.975845 21494 raft_consensus.cc:697] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:36.023217 19572 catalog_manager.cc:5697] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 2, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:35.994370 19746 raft_consensus.cc:1240] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:36.032939 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:35.995045 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:35.998178 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:35.962440 21894 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:36.002830 19749 raft_consensus.cc:1240] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:35.977984 21879 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:14:36.003800 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:35.955911 20427 raft_consensus.cc:2468] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
W20260709 12:14:36.009425 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.010075 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.016830 19713 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:36.011204 19823 rpcz_store.cc:276] 0709 12:14:31.486874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.325896 (+2839022us) service_pool.cc:224] Handling call
0709 12:14:34.396791 (+ 70895us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.593287 (+196496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.593332 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.658548 (+ 65216us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.814046 (+155498us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:34.814107 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.814208 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.876296 (+1062088us) raft_consensus.cc:1685] finished
0709 12:14:35.876318 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.876476 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7268,"raft.queue_time_us":374839,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":17271,"thread_start_us":209558,"threads_started":2,"wal-append.queue_time_us":447033}
I20260709 12:14:36.030953 19744 raft_consensus.cc:1275] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:36.018129 21897 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:36.032187 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:36.028890 19818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 266) took 2843 ms. Trace:
I20260709 12:14:36.016325 19741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 200) took 2268 ms. Trace:
I20260709 12:14:36.003281 21685 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:36.045711 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.045300 19572 catalog_manager.cc:5697] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 2 to 3, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 3 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:36.022722 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 264) took 1943 ms. Trace:
I20260709 12:14:36.034024 19748 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:36.022078 21874 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:36.052470 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:36.050673 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:36.024961 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:36.052449 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 174814us
I20260709 12:14:36.050568 19669 rpcz_store.cc:276] 0709 12:14:34.079789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.081604 (+  1815us) service_pool.cc:224] Handling call
0709 12:14:35.108035 (+1026431us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5800003398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:14:35.556398 (+448363us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5800003398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ae9c 00007fadf165aa5b 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:14:35.568718 (+ 12320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.568943 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:35.851398 (+282455us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.978755 (+127357us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.978840 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:35.978887 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.978951 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.022531 (+ 43580us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5400391050. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:36.022655 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7127,"prepare.queue_time_us":282542,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":26660,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":4365,"spinlock_wait_cycles":105718016,"thread_start_us":377081,"threads_started":2}
W20260709 12:14:36.057763 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 100373us
I20260709 12:14:36.048103 19818 rpcz_store.cc:276] 0709 12:14:33.185008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.880888 (+1695880us) service_pool.cc:224] Handling call
0709 12:14:34.901181 (+ 20293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.906426 (+  5245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.906461 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:35.068882 (+162421us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.577170 (+508288us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:35.577239 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.577333 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.028632 (+451299us) raft_consensus.cc:1685] finished
0709 12:14:36.028670 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.028830 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":35529,"thread_start_us":506686,"threads_started":1,"wal-append.queue_time_us":585688}
I20260709 12:14:36.058193 21915 consensus_queue.cc:1059] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:14:36.073879 19669 raft_consensus.cc:1275] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:36.074131 21709 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:36.074571 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 2040) took 1480 ms. Trace:
I20260709 12:14:36.075081 19669 rpcz_store.cc:276] 0709 12:14:34.593859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.073127 (+1479268us) service_pool.cc:224] Handling call
0709 12:14:36.073535 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.074278 (+   743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.074506 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.076606 19669 raft_consensus.cc:1275] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:14:36.076913 19669 pending_rounds.cc:85] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8: Aborting all ops after (but not including) 3
I20260709 12:14:36.077149 19669 pending_rounds.cc:107] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:14:36.077389 19669 raft_consensus.cc:2889] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:36.078400 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48652 (request call id 2042) took 1467 ms. Trace:
I20260709 12:14:36.032965 21472 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:36.058004 19572 catalog_manager.cc:5697] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:36.059204 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.061539 19788 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.983s (SENT)
I20260709 12:14:36.067620 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:36.008445 21820 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:36.067816 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:36.083856 19742 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:36.078733 19669 rpcz_store.cc:276] 0709 12:14:34.610808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.075883 (+1465075us) service_pool.cc:224] Handling call
0709 12:14:36.076232 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.078113 (+  1881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.078328 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.088002 19669 raft_consensus.cc:1275] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:36.058372 19714 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:36.088745 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1856) took 1462 ms. Trace:
I20260709 12:14:36.089186 19669 rpcz_store.cc:276] 0709 12:14:34.626085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.087280 (+1461195us) service_pool.cc:224] Handling call
0709 12:14:36.087651 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.088411 (+   760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.088678 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.090773 19669 raft_consensus.cc:1240] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:36.058988 21884 raft_consensus.cc:2804] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:36.091452 21884 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.091547 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1859) took 1352 ms. Trace:
I20260709 12:14:36.091921 21884 raft_consensus.cc:3060] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.092067 19669 rpcz_store.cc:276] 0709 12:14:34.739324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.090116 (+1350792us) service_pool.cc:224] Handling call
0709 12:14:36.090499 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.091204 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.091489 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.001928 21905 consensus_queue.cc:1059] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:14:36.051970 21685 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:36.096001 21905 raft_consensus.cc:3055] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:36.049804 19741 rpcz_store.cc:276] 0709 12:14:33.755642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.549862 (+794220us) service_pool.cc:224] Handling call
0709 12:14:34.953945 (+404083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.615016 (+661071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.994349 (+379333us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54001ce3d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:36.011621 (+ 17272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928328960}
I20260709 12:14:36.096421 21905 raft_consensus.cc:740] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:36.099733 19669 raft_consensus.cc:1240] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:14:36.096691 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 68166.4us
W20260709 12:14:36.105870 19788 leader_election.cc:336] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 2.130s (SENT)
W20260709 12:14:36.106552 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.107270 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.108554 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:36.105952 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48662 (request call id 1860) took 1356 ms. Trace:
I20260709 12:14:36.021908 21871 consensus_queue.cc:1048] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:14:36.100247 19742 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:36.111384 21871 raft_consensus.cc:3055] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:36.110972 21885 consensus_queue.cc:237] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.111788 21871 raft_consensus.cc:740] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:36.083395 21494 consensus_queue.cc:237] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:35.989615 21881 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:36.114899 20397 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.17.249.254:37145, user_credentials={real_user=slave}} blocked reactor thread for 53859.7us
I20260709 12:14:36.112962 19669 rpcz_store.cc:276] 0709 12:14:34.750017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.099046 (+1349029us) service_pool.cc:224] Handling call
0709 12:14:36.099487 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.105582 (+  6095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.105866 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:36.117904 19638 connection.cc:256] RPC call timeout handler was delayed by -1.9513381039998876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
I20260709 12:14:36.131918 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:36.134624 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:36.141539 19667 consensus_meta.cc:287] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 12:14:36.142204 19667 raft_consensus.cc:2468] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:36.143137 19667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48652 (request call id 2038) took 1598 ms. Trace:
I20260709 12:14:36.144012 19667 rpcz_store.cc:276] 0709 12:14:34.544258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.544364 (+   106us) service_pool.cc:224] Handling call
0709 12:14:35.110032 (+565668us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b5800003398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:14:36.143024 (+1032992us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2463360}
I20260709 12:14:36.083493 21820 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:36.151753 19750 raft_consensus.cc:1240] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:36.154223 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 106832us
W20260709 12:14:36.163196 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.164110 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:36.168819 21581 consensus_meta.cc:287] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.527s	user 0.002s	sys 0.011s
I20260709 12:14:36.169443 21581 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.170398 21934 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.175901 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.176862 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.171125 21934 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.179296 21581 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:36.204156 20396 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:36.212280 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 45858.8us
I20260709 12:14:36.216840 19640 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:36.222544 20397 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:36.218400 19640 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:36.226640 19640 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:36.227840 19675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 267) took 2127 ms. Trace:
I20260709 12:14:36.162626 21936 raft_consensus.cc:2749] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:36.228227 19675 rpcz_store.cc:276] 0709 12:14:34.080738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.081785 (+  1047us) service_pool.cc:224] Handling call
0709 12:14:34.115349 (+ 33564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.849353 (+1734004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.207375 (+358022us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400287154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:36.207648 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3610165504}
I20260709 12:14:36.170720 21881 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:36.182341 21688 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:36.135090 21895 consensus_queue.cc:237] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:36.248047 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:36.071038 21903 consensus_queue.cc:237] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.241549 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
W20260709 12:14:36.249785 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 126289us
I20260709 12:14:36.250149 20429 raft_consensus.cc:3060] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.234344 21709 raft_consensus.cc:2804] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:36.269182 19674 raft_consensus.cc:2393] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:36.234942 21894 raft_consensus.cc:2804] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:36.154490 21871 consensus_queue.cc:260] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:36.235316 21849 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:36.242265 21847 raft_consensus.cc:2804] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:36.278285 19742 raft_consensus.cc:1240] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:36.281284 19638 leader_election.cc:336] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 2.782s (SENT)
I20260709 12:14:36.286072 19638 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
W20260709 12:14:36.287022 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.230410 21846 consensus_queue.cc:1048] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:14:36.226172 21874 consensus_queue.cc:1059] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:14:36.257867 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:36.298319 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 69370.6us
W20260709 12:14:36.283903 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 233730us
I20260709 12:14:36.269418 21709 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.306299 21916 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.307032 21916 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.310609 21916 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:36.311631 21871 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:36.314930 21926 log.cc:927] Time spent T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 12:14:36.315868 21927 log.cc:927] Time spent T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:14:36.285846 21847 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:36.324484 20429 raft_consensus.cc:2468] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
W20260709 12:14:36.319563 19789 connection.cc:256] RPC call timeout handler was delayed by -2.1123418909999145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 12:14:36.335307 19789 connection.cc:256] RPC call timeout handler was delayed by -2.1114418909999131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 12:14:36.335856 19789 connection.cc:256] RPC call timeout handler was delayed by -2.0898418909998782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 12:14:36.336309 19789 connection.cc:256] RPC call timeout handler was delayed by -2.0709418909998476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 12:14:36.336719 19789 connection.cc:256] RPC call timeout handler was delayed by -2.0682418909998432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 12:14:36.337162 19789 connection.cc:256] RPC call timeout handler was delayed by -2.0367418909997923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 12:14:36.337584 19789 connection.cc:256] RPC call timeout handler was delayed by -2.0367418909997923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 12:14:36.338007 19789 connection.cc:256] RPC call timeout handler was delayed by -2.0088418909999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 12:14:36.338445 19789 connection.cc:256] RPC call timeout handler was delayed by -1.9710418909999134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 12:14:36.343308 19789 connection.cc:256] RPC call timeout handler was delayed by -1.9152418909998232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:14:36.343775 19789 connection.cc:256] RPC call timeout handler was delayed by -1.9026418909998029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:14:36.344228 19789 connection.cc:256] RPC call timeout handler was delayed by -1.8684418909999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 12:14:36.344650 19789 connection.cc:256] RPC call timeout handler was delayed by -1.8621418909999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 12:14:36.345031 19789 connection.cc:256] RPC call timeout handler was delayed by -1.8621418909999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 12:14:36.345472 19789 connection.cc:256] RPC call timeout handler was delayed by -1.8297418909999124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 12:14:36.345903 19789 connection.cc:256] RPC call timeout handler was delayed by -1.8297418909999124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 12:14:36.346338 19789 connection.cc:256] RPC call timeout handler was delayed by -1.7820418909998352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
I20260709 12:14:36.288158 21894 raft_consensus.cc:697] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:36.278592 21879 consensus_queue.cc:1059] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:14:36.303218 21796 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:36.283226 21881 consensus_queue.cc:1059] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:14:36.351368 19714 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:36.356279 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.346753 19789 connection.cc:256] RPC call timeout handler was delayed by -1.7487418910000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260709 12:14:36.319392 21849 raft_consensus.cc:2749] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:36.319799 21709 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.314930 21621 raft_consensus.cc:2804] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:36.357380 19789 connection.cc:256] RPC call timeout handler was delayed by -1.7253418909999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 12:14:36.357179 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.334872 21842 consensus_meta.cc:287] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.005s
W20260709 12:14:36.348300 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 114714us
W20260709 12:14:36.367165 19789 connection.cc:256] RPC call timeout handler was delayed by -1.634441890999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 12:14:36.368043 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.368279 19789 connection.cc:256] RPC call timeout handler was delayed by -1.6254418909998094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 12:14:36.368729 19789 connection.cc:256] RPC call timeout handler was delayed by -1.6119418909997876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 12:14:36.368997 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.369026 19789 connection.cc:256] RPC call timeout handler was delayed by -1.5957418909999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260709 12:14:36.354254 19743 raft_consensus.cc:2393] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
W20260709 12:14:36.369611 19789 connection.cc:256] RPC call timeout handler was delayed by -1.5930418909999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260709 12:14:36.373237 21821 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:36.374919 21592 raft_consensus.cc:3055] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:36.377144 21934 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:36.347954 21840 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:36.383214 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 158016us
I20260709 12:14:36.348147 21847 raft_consensus.cc:3060] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:36.387116 19789 connection.cc:256] RPC call timeout handler was delayed by -1.5813418909999655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
W20260709 12:14:36.400360 19789 connection.cc:256] RPC call timeout handler was delayed by -1.5813418909999655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
W20260709 12:14:36.400861 19789 connection.cc:256] RPC call timeout handler was delayed by -1.5372418909998942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 12:14:36.401234 19789 connection.cc:256] RPC call timeout handler was delayed by -1.5336418909998883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
W20260709 12:14:36.401616 19789 connection.cc:256] RPC call timeout handler was delayed by -1.4949418909998258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260709 12:14:36.390838 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:36.402820 19818 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:36.388437 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 107196us
W20260709 12:14:36.404129 19789 connection.cc:256] RPC call timeout handler was delayed by -1.4949418909998258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
W20260709 12:14:36.403605 19638 connection.cc:256] RPC call timeout handler was delayed by -1.8622381039997435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 12:14:36.406558 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.407184 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.407526 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.407886 19638 connection.cc:256] RPC call timeout handler was delayed by -1.7623381039998094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 12:14:36.408402 19638 connection.cc:256] RPC call timeout handler was delayed by -1.749738103999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
W20260709 12:14:36.408710 19638 connection.cc:256] RPC call timeout handler was delayed by -1.4473381039997548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 12:14:36.408980 19638 connection.cc:256] RPC call timeout handler was delayed by -1.4068381039999167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
W20260709 12:14:36.409498 19789 connection.cc:256] RPC call timeout handler was delayed by -1.4445418909999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2295s for a response
W20260709 12:14:36.409897 19789 connection.cc:256] RPC call timeout handler was delayed by -1.0431418910000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2741s for a response
I20260709 12:14:36.386109 21621 raft_consensus.cc:697] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:36.393569 21592 raft_consensus.cc:740] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
W20260709 12:14:36.429824 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.429029 19789 leader_election.cc:304] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:36.386636 21842 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:36.423494 21849 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.445899 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 90330.1us
I20260709 12:14:36.460345 19824 raft_consensus.cc:1275] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:36.475533 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:36.475608 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:36.422585 21820 consensus_queue.cc:1059] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:14:36.478984 19669 raft_consensus.cc:1240] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:36.478931 19821 raft_consensus.cc:1275] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:36.474243 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 153516us
W20260709 12:14:36.480878 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 85799.6us
I20260709 12:14:36.434022 21827 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:36.484908 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 56067.3us
I20260709 12:14:36.481930 19715 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:36.445881 21939 raft_consensus.cc:2749] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.487593 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:36.502440 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:36.504016 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:36.504058 19821 raft_consensus.cc:2376] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3. Re-sending same reply.
I20260709 12:14:36.499208 19714 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:36.508096 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 77121us
W20260709 12:14:36.508924 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.513132 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:36.514106 19815 raft_consensus.cc:3060] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.514707 19789 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:36.488528 21688 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:36.522825 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.471372 21849 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.524858 19824 raft_consensus.cc:2468] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:36.527683 21930 raft_consensus.cc:2749] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.444643 21894 consensus_queue.cc:237] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:36.536700 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:36.520267 21621 consensus_queue.cc:237] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:36.549270 19824 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:36.448297 21592 consensus_queue.cc:260] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.542377 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:36.544708 21884 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:36.559499 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 66139.8us
I20260709 12:14:36.560655 19789 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:36.541183 21937 log.cc:927] Time spent T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:14:36.560715 21884 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:36.561513 19669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 271) took 1020 ms. Trace:
W20260709 12:14:36.562240 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.598505 19669 rpcz_store.cc:276] 0709 12:14:35.541512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.126755 (+585243us) service_pool.cc:224] Handling call
0709 12:14:36.149932 (+ 23177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.479860 (+329928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.561208 (+ 81348us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54002391d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:36.561423 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756306176}
W20260709 12:14:36.599294 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.600113 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.600487 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.557610 19821 raft_consensus.cc:3060] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:36.491124 21903 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 12:14:36.589571 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.541217 21879 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.532644 21951 raft_consensus.cc:2749] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:36.611307 21930 raft_consensus.cc:2749] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:36.640413 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 79921.7us
W20260709 12:14:36.647282 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 156958us
W20260709 12:14:36.648216 21942 log.cc:927] Time spent T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:14:36.650624 21943 log.cc:927] Time spent T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:14:36.652206 21842 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:36.652503 21948 log.cc:927] Time spent T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:14:36.649013 19714 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:36.653632 19638 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:36.654187 19714 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:36.655562 21842 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:36.663323 19821 raft_consensus.cc:2468] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:36.625119 21950 raft_consensus.cc:2804] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:36.666923 21950 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.667320 21950 raft_consensus.cc:3060] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.659247 19638 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:36.631544 21952 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:36.638437 21592 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:36.687557 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.691936 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.670883 21865 consensus_meta.cc:287] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.004s
I20260709 12:14:36.694263 21796 consensus_queue.cc:1059] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:36.701397 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 219514us
I20260709 12:14:36.702431 19715 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:36.694700 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:36.695683 21951 consensus_queue.cc:1048] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:36.697237 21944 consensus_queue.cc:1048] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:14:36.689924 20397 consensus_peers.cc:597] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:36.698382 19713 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:36.694322 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:36.700721 19638 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:36.711076 19821 raft_consensus.cc:3060] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:36.703011 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.711248 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 57120.3us
I20260709 12:14:36.678728 21581 raft_consensus.cc:2804] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:36.705468 19815 raft_consensus.cc:2468] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:36.709990 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:36.679553 21915 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:36.713492 20397 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.635015 21879 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.715060 19748 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:36.718053 19789 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:36.699563 21688 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:36.719935 19749 raft_consensus.cc:1240] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:36.704757 21865 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.724095 21952 raft_consensus.cc:2804] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:36.724115 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:36.725351 19745 raft_consensus.cc:1275] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:36.725875 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:36.726511 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:36.729470 21915 raft_consensus.cc:697] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:36.731367 21879 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:36.732712 19713 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:36.734349 19638 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
W20260709 12:14:36.743469 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.744935 20397 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.790432 19818 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 5.
I20260709 12:14:36.787281 19789 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:36.791965 19816 raft_consensus.cc:1240] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:36.792934 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 54215.6us
I20260709 12:14:36.793485 20396 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:36.769003 20431 raft_consensus.cc:1240] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:36.775985 19821 raft_consensus.cc:2468] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:36.700053 21709 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.716740 21842 raft_consensus.cc:2804] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:36.738715 21930 raft_consensus.cc:2749] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:36.779269 19747 raft_consensus.cc:2393] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:36.714267 21885 raft_consensus.cc:2804] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:36.780421 19748 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
W20260709 12:14:36.783084 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 66317.1us
I20260709 12:14:36.734068 21688 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:36.776319 21581 raft_consensus.cc:697] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:36.798735 19741 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:36.807021 21685 consensus_meta.cc:287] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.712s	user 0.013s	sys 0.000s
I20260709 12:14:36.800619 21874 raft_consensus.cc:2804] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:36.807061 21934 raft_consensus.cc:2764] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:36.801458 21842 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:36.821374 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 87108.3us
I20260709 12:14:36.808215 21688 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:36.808147 21952 raft_consensus.cc:697] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:36.836625 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 103989us
I20260709 12:14:36.837358 19713 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:36.830323 21842 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:36.844486 19713 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:36.844632 21581 consensus_queue.cc:237] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.845026 19714 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
I20260709 12:14:36.845391 21871 raft_consensus.cc:2804] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:36.846258 21871 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.846727 21871 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.823004 21874 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:36.855206 21946 log.cc:927] Time spent T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 12:14:36.835999 21945 log.cc:927] Time spent T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.351s	user 0.002s	sys 0.000s
W20260709 12:14:36.871737 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 47368.7us
I20260709 12:14:36.817584 21885 raft_consensus.cc:697] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:36.877877 21923 log.cc:927] Time spent T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.850s	user 0.003s	sys 0.009s
W20260709 12:14:36.920219 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.989542 21897 consensus_meta.cc:287] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.939s	user 0.014s	sys 0.007s
I20260709 12:14:36.821609 21685 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:36.975749 21957 raft_consensus.cc:2804] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:36.976927 21903 raft_consensus.cc:2804] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:36.875032 21884 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:36.851894 21915 consensus_queue.cc:237] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:36.983515 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 100140us
I20260709 12:14:36.977695 19713 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:36.984645 20398 leader_election.cc:336] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.984s (SENT)
W20260709 12:14:36.987035 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 140221us
I20260709 12:14:36.981527 19824 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:36.829826 21847 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:36.982352 21504 raft_consensus.cc:3055] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:36.883288 21568 raft_consensus.cc:3055] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:36.987854 21820 raft_consensus.cc:2804] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:36.995581 19638 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:36.995555 21874 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:36.996673 21885 consensus_queue.cc:237] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.003289 21849 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.001256 21952 consensus_queue.cc:237] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.011508 21685 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.025728 19823 raft_consensus.cc:1240] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:37.025897 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 142398us
W20260709 12:14:37.027050 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 175755us
I20260709 12:14:37.031270 19714 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.016076 21903 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.005059 19817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2033) took 3740 ms. Trace:
I20260709 12:14:37.016288 21957 raft_consensus.cc:697] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:37.028923 21568 raft_consensus.cc:740] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:37.035679 20429 raft_consensus.cc:1240] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:37.036948 21847 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:37.028729 21961 raft_consensus.cc:2804] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:37.047428 19817 rpcz_store.cc:276] 0709 12:14:33.264239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.900124 (+1635885us) service_pool.cc:224] Handling call
0709 12:14:34.909122 (+  8998us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:35.571111 (+661989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.571147 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:35.571595 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.868416 (+296821us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:35.998809 (+130393us) log.cc:844] Serialized 14 byte log entry
0709 12:14:36.116568 (+117759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.116647 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.877019 (+760372us) spinlock_profiling.cc:243] Waited 9.92 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:14:37.004658 (+127639us) raft_consensus.cc:1685] finished
0709 12:14:37.004773 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.004970 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":170850,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":15825,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":8154,"spinlock_wait_cycles":22814464,"thread_start_us":456946,"threads_started":3,"wal-append.queue_time_us":401717}
I20260709 12:14:37.038846 21709 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.028112 21504 raft_consensus.cc:740] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:37.045987 19713 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:37.055819 21504 consensus_queue.cc:260] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.022383 21842 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.055821 19714 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.030131 19741 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:37.054028 21685 raft_consensus.cc:2749] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:37.043251 21865 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.043737 21592 raft_consensus.cc:2804] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:37.040709 21820 raft_consensus.cc:697] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 5 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:37.008684 21950 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:37.059374 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 63873.9us
I20260709 12:14:37.057129 21933 raft_consensus.cc:2804] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:37.057540 21568 consensus_queue.cc:260] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.048396 21934 consensus_queue.cc:1059] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:14:37.063571 19789 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:37.051560 21903 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:37.062273 21871 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.061957 21592 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:37.075946 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.080729 19638 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:37.092700 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.071882 19789 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.068296 19713 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:37.079310 19714 leader_election.cc:400] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Vote denied by peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713) with higher term. Message: Invalid argument: T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for earlier term 5. Current term is 6.
I20260709 12:14:37.096444 19714 leader_election.cc:403] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:14:37.100675 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.110363 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.077379 21592 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.071099 21934 raft_consensus.cc:3055] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:37.083017 21947 raft_consensus.cc:2749] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:37.067800 21504 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:37.072150 21930 raft_consensus.cc:2764] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:37.068897 21568 raft_consensus.cc:3060] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.067683 21957 consensus_queue.cc:237] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.078269 21821 raft_consensus.cc:3055] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:37.070111 21842 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.078114 21871 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.065250 21961 raft_consensus.cc:697] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:37.124356 21934 raft_consensus.cc:740] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
W20260709 12:14:37.126694 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.106662 21939 raft_consensus.cc:2749] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:37.067965 21933 raft_consensus.cc:697] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:37.132515 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 60743.7us
I20260709 12:14:37.110388 21849 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:37.067119 21820 consensus_queue.cc:237] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.139175 19822 raft_consensus.cc:2955] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:37.153759 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.146932 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.167227 19748 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:37.147158 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:37.168104 19638 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:37.165495 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:37.079747 21688 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:37.173988 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 71077us
W20260709 12:14:37.182328 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.174309 19745 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:37.173429 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.186400 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.187060 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.147817 21881 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.014s	sys 0.034s
I20260709 12:14:37.135455 21581 raft_consensus.cc:2749] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713) with higher term. Message: Invalid argument: T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for earlier term 5. Current term is 6.
I20260709 12:14:37.134210 21897 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:37.193719 21881 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.015s	sys 0.034s
I20260709 12:14:37.143165 21821 raft_consensus.cc:740] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:37.144423 21950 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:37.146173 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:37.145615 21934 consensus_queue.cc:260] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.282929 19789 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.322137 21874 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.314095 21903 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:37.234180 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.323202 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 85747.3us
W20260709 12:14:37.291538 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 112846us
W20260709 12:14:37.338961 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.145012 21961 consensus_queue.cc:237] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.228566 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:37.235105 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.340605 19818 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:37.340761 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.194543 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:37.342466 19820 raft_consensus.cc:2410] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:37.343433 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:37.343997 19820 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:37.321609 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:37.347479 19817 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.349977 19818 raft_consensus.cc:2468] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:37.206578 19745 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:37.147686 21685 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:37.307674 21781 raft_consensus.cc:3055] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:37.371745 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:37.237730 21842 raft_consensus.cc:2804] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:37.175736 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.365104 19789 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.367367 19820 raft_consensus.cc:2468] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
W20260709 12:14:37.334245 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 200195us
I20260709 12:14:37.237512 21849 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.256242 21709 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.280483 21894 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:37.374509 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 295410us
I20260709 12:14:37.323789 20424 raft_consensus.cc:3060] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:37.383459 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.390388 19638 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:37.370836 21781 raft_consensus.cc:740] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:37.402904 21979 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:37.403566 21979 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.402419 21781 consensus_queue.cc:260] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.408859 21781 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:37.411464 21688 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:37.411480 21979 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.412247 21688 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.412938 21568 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:37.414239 21821 consensus_queue.cc:260] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.415738 21821 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:37.417944 21894 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.419157 21934 raft_consensus.cc:3060] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.420887 21894 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.424939 21903 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.375612 21842 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:37.426105 21842 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.396191 21874 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:37.431013 19741 raft_consensus.cc:2393] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:37.137117 21953 raft_consensus.cc:2955] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:37.391942 21685 raft_consensus.cc:697] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:37.352285 21958 consensus_queue.cc:1059] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:14:37.434468 21685 consensus_queue.cc:237] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.199626 21933 consensus_queue.cc:237] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.391996 21849 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.389006 21930 raft_consensus.cc:2764] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:14:37.393409 21709 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.412830 21688 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.465302 19817 raft_consensus.cc:2468] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:37.467599 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:37.468552 19817 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:37.453032 19714 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.337699 21897 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.447541 19713 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:37.503094 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:37.504407 19819 raft_consensus.cc:2393] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 4: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:37.506275 19819 raft_consensus.cc:1275] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:14:37.507328 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 44835.5us
W20260709 12:14:37.509989 19789 leader_election.cc:336] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.637s (SENT)
I20260709 12:14:37.445633 21709 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:37.516500 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 63593.7us
I20260709 12:14:37.516964 19640 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:37.463508 21494 raft_consensus.cc:3055] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:14:37.518967 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 71510.5us
I20260709 12:14:37.442729 21849 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.520849 19714 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.526479 19815 raft_consensus.cc:3055] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:37.521909 19713 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:37.528427 19815 raft_consensus.cc:740] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:37.531461 21897 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.534173 21978 consensus_queue.cc:1048] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:14:37.535521 19788 leader_election.cc:336] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.917s (SENT)
I20260709 12:14:37.536007 19788 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.519866 19789 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:37.537351 19713 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:37.509923 21874 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:14:37.544440 21592 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.560197 21592 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:37.557580 19817 raft_consensus.cc:2410] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:14:37.562381 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 184772us
W20260709 12:14:37.562382 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 45515.8us
I20260709 12:14:37.563490 19640 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:37.566103 19788 leader_election.cc:336] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 2.006s (SENT)
I20260709 12:14:37.566723 19788 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.521428 21494 raft_consensus.cc:740] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:37.540696 21976 raft_consensus.cc:2804] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:37.564132 19815 consensus_queue.cc:260] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.526997 21944 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:37.574986 19817 raft_consensus.cc:1275] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:37.553050 21957 raft_consensus.cc:2804] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:37.587428 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.579087 21930 raft_consensus.cc:2749] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:37.627281 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.573848 21504 raft_consensus.cc:2749] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:37.586011 21950 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.543951 21977 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.629005 19815 raft_consensus.cc:3060] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.541045 21939 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.568068 21865 raft_consensus.cc:2804] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:37.630542 19818 raft_consensus.cc:3060] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.574839 21980 consensus_queue.cc:1048] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:14:37.553023 21903 consensus_queue.cc:1048] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:14:37.637982 21781 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:37.640224 21988 raft_consensus.cc:2749] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:37.627027 21685 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.699406 21685 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.641260 21905 consensus_queue.cc:260] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.701279 21905 raft_consensus.cc:3060] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.646773 21950 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.703616 21950 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.647650 21976 raft_consensus.cc:697] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:37.642619 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 201) took 3869 ms. Trace:
I20260709 12:14:37.704879 21976 consensus_queue.cc:237] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.705155 19750 rpcz_store.cc:276] 0709 12:14:33.773573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.608323 (+834750us) service_pool.cc:224] Handling call
0709 12:14:34.679839 (+ 71516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.152490 (+1472651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.642315 (+1489825us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003502d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:37.642520 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3384392448}
I20260709 12:14:37.631915 21494 consensus_queue.cc:260] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.586282 21709 raft_consensus.cc:2804] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:37.707269 21709 raft_consensus.cc:697] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:37.586344 21581 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.643575 21688 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.577728 21897 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:37.586213 21592 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:14:37.647289 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 72973.4us
W20260709 12:14:37.647651 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 44907.3us
W20260709 12:14:37.648150 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.652469 21985 log.cc:927] Time spent T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:14:37.563555 21881 consensus_queue.cc:1048] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:14:37.654036 21989 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:37.661409 21984 log.cc:927] Time spent T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:14:37.661722 21972 log.cc:927] Time spent T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.463s	user 0.000s	sys 0.001s
I20260709 12:14:37.672847 20424 raft_consensus.cc:2468] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
W20260709 12:14:37.718379 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 208393us
I20260709 12:14:37.728940 21865 raft_consensus.cc:697] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:37.729732 21709 consensus_queue.cc:237] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.735069 21949 raft_consensus.cc:3055] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:37.735512 19821 raft_consensus.cc:1275] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:37.736073 21973 log.cc:927] Time spent T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.538s	user 0.000s	sys 0.002s
W20260709 12:14:37.736847 20397 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:37.737636 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:37.740844 19747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 1228) took 1753 ms (client timeout 2300 ms). Trace:
W20260709 12:14:37.741266 21960 log.cc:927] Time spent T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f: Append to log took a long time: real 0.963s	user 0.004s	sys 0.000s
I20260709 12:14:37.741672 19823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 283) took 1162 ms. Trace:
I20260709 12:14:37.737718 19818 raft_consensus.cc:2468] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:37.742216 21874 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.727679 21897 raft_consensus.cc:697] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:37.748106 19815 raft_consensus.cc:1275] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260709 12:14:37.762358 19747 rpcz_store.cc:269] 0709 12:14:35.987395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.993835 (+  6440us) service_pool.cc:224] Handling call
0709 12:14:37.740610 (+1746775us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54000ed3d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:37.740772 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762697600}
I20260709 12:14:37.788740 19815 pending_rounds.cc:85] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting all ops after (but not including) 2
I20260709 12:14:37.763510 19820 raft_consensus.cc:1275] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:14:37.783970 19823 rpcz_store.cc:276] 0709 12:14:36.579059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.655757 (+ 76698us) service_pool.cc:224] Handling call
0709 12:14:37.025534 (+369777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.045005 (+ 19471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.741470 (+696465us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54001ef850. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:37.741608 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849484544}
W20260709 12:14:37.789297 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.720393 21494 raft_consensus.cc:3060] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.789357 19815 pending_rounds.cc:107] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260709 12:14:37.762415 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 968545us
I20260709 12:14:37.790963 19815 raft_consensus.cc:2889] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:37.794003 21933 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:37.795758 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.797278 19714 connection.cc:256] RPC call timeout handler was delayed by -1.8497465100001591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 12:14:37.797613 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 45312.1us
I20260709 12:14:37.798434 19638 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:37.799938 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:37.800302 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:37.801014 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.802395 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.803217 19746 raft_consensus.cc:2393] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:37.796068 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:37.748883 21688 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:37.797927 20397 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:37.807948 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:37.808640 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:37.719985 21581 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.807313 20432 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:37.813577 20433 raft_consensus.cc:2410] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:14:37.811964 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.757481 21949 raft_consensus.cc:740] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:37.794539 21933 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.826690 19749 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:14:37.811409 20397 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:37.827962 20397 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:37.744580 21842 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.812165 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.790169 21849 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.750485 21957 raft_consensus.cc:697] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:37.816135 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.827129 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.832294 19747 raft_consensus.cc:1240] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:37.832240 19746 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 5.
I20260709 12:14:37.829475 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:37.829649 19674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48652 (request call id 2046) took 2977 ms (client timeout 2060 ms). Trace:
I20260709 12:14:37.815043 19815 raft_consensus.cc:1275] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:37.825865 21878 raft_consensus.cc:2749] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:37.833607 19674 rpcz_store.cc:269] 0709 12:14:34.848552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.538022 (+689470us) service_pool.cc:224] Handling call
0709 12:14:37.825506 (+2287484us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54002387d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:37.825677 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531960064}
I20260709 12:14:37.833607 19744 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:37.836611 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:37.837980 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:37.838069 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.840096 19745 raft_consensus.cc:2393] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 4: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:37.841004 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:37.841126 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.846956 21933 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.814566 21820 consensus_queue.cc:1059] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:14:37.847325 21865 consensus_queue.cc:237] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.848398 21820 raft_consensus.cc:3055] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:37.848834 21820 raft_consensus.cc:740] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:37.796367 21874 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.859057 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:37.880301 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.880615 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.859835 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.881553 19745 raft_consensus.cc:2468] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 2.
I20260709 12:14:37.879308 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.893090 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:37.840444 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.840289 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:37.899098 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.906560 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.900971 19640 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:37.838564 21685 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:37.904100 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:37.908066 19816 raft_consensus.cc:2410] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:37.749246 21989 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.897732 20398 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:37.828330 21688 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.911347 20398 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:37.913617 20398 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.911441 19715 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:37.917865 19747 raft_consensus.cc:1240] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:37.917300 19746 raft_consensus.cc:2393] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:37.927354 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.835894 21849 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.930666 19745 raft_consensus.cc:1275] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:37.943189 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.943761 20424 raft_consensus.cc:1240] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 5 LEADER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:37.908646 21821 consensus_queue.cc:1059] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:14:37.946382 21688 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:37.916882 21592 raft_consensus.cc:2804] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:37.948633 21849 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:37.948861 21592 raft_consensus.cc:697] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:37.929386 21999 raft_consensus.cc:2804] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:37.932407 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.959893 19747 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:37.960986 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.933130 21581 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:37.934243 19816 raft_consensus.cc:1275] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:37.935452 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.936012 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:37.936300 21975 log.cc:927] Time spent T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.821s	user 0.004s	sys 0.000s
I20260709 12:14:37.937031 20398 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.932410 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:37.941805 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:37.916147 21966 raft_consensus.cc:2749] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:37.932299 21956 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:37.915494 21631 raft_consensus.cc:2749] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:37.857829 21897 consensus_queue.cc:237] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:37.968946 19815 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:37.945686 19745 raft_consensus.cc:2393] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:37.969326 20398 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:37.970745 19750 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:37.971930 19640 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:37.979305 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:37.986037 19750 raft_consensus.cc:1240] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:37.979701 19747 raft_consensus.cc:1240] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:37.981017 19788 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.650s (SENT)
I20260709 12:14:37.987053 19746 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:37.958526 21878 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.991973 19747 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:14:37.989562 19638 connection.cc:256] RPC call timeout handler was delayed by -1.5911333230001219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 12:14:37.992883 19638 connection.cc:256] RPC call timeout handler was delayed by -1.5812333230001059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 12:14:37.986214 20398 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:37.994007 20425 raft_consensus.cc:2410] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:37.994040 21842 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:37.997658 19638 connection.cc:256] RPC call timeout handler was delayed by -1.5668333230000826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260709 12:14:37.996524 21994 consensus_queue.cc:1048] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:14:37.927716 21472 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:14:37.985522 21688 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:37.982507 21999 raft_consensus.cc:697] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:37.991895 21849 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:38.012710 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 120800us
W20260709 12:14:38.002938 19638 connection.cc:256] RPC call timeout handler was delayed by -1.456133323000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260709 12:14:37.992060 21821 raft_consensus.cc:2804] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:38.035643 19638 connection.cc:256] RPC call timeout handler was delayed by -1.416533323000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:14:38.040351 19638 connection.cc:256] RPC call timeout handler was delayed by -1.4039333230000466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260709 12:14:38.040922 19638 connection.cc:256] RPC call timeout handler was delayed by -1.3787333230000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260709 12:14:38.041333 19638 connection.cc:256] RPC call timeout handler was delayed by -1.3103333230001226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
W20260709 12:14:38.041719 19638 connection.cc:256] RPC call timeout handler was delayed by -1.3085333230001197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 12:14:38.042119 19638 connection.cc:256] RPC call timeout handler was delayed by -1.2626333230000455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260709 12:14:38.042505 19638 connection.cc:256] RPC call timeout handler was delayed by -1.2464333230000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 12:14:38.042923 19638 connection.cc:256] RPC call timeout handler was delayed by -1.2293333229999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
W20260709 12:14:38.043327 19638 connection.cc:256] RPC call timeout handler was delayed by -1.1267333230000531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
W20260709 12:14:38.043706 19638 connection.cc:256] RPC call timeout handler was delayed by -1.0853333229999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 12:14:37.967867 21957 consensus_queue.cc:237] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.998805 21966 raft_consensus.cc:2749] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:38.002319 21621 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:37.958089 21592 consensus_queue.cc:237] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:37.893385 21949 consensus_queue.cc:260] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:38.014520 19750 raft_consensus.cc:1240] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:38.004528 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:37.986737 21997 consensus_queue.cc:1059] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:14:38.049559 21821 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.065244 19670 raft_consensus.cc:1240] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:38.033268 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:38.079408 19788 leader_election.cc:336] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:38.000955 21953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:32898 (request call id 0) took 4316 ms. Trace:
I20260709 12:14:38.072861 20429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 584) took 1280 ms. Trace:
I20260709 12:14:38.079994 19788 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:38.039877 21905 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:38.087527 20429 rpcz_store.cc:276] 0709 12:14:36.792461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.792692 (+   231us) service_pool.cc:224] Handling call
0709 12:14:36.806822 (+ 14130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:37.050119 (+243297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.072487 (+1022368us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54007936d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:38.072776 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525702400}
I20260709 12:14:37.997278 21878 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:38.039183 21842 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 12:14:38.096256 19788 leader_election.cc:336] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:38.105479 19638 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.681s (SENT)
W20260709 12:14:38.106703 19788 leader_election.cc:336] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:38.114933 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1236) took 1396 ms. Trace:
I20260709 12:14:38.115737 19743 rpcz_store.cc:276] 0709 12:14:36.708494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.714488 (+  5994us) service_pool.cc:224] Handling call
0709 12:14:36.786163 (+ 71675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.834881 (+ 48718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:36.838447 (+  3566us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:37.030335 (+191888us) log.cc:844] Serialized 26 byte log entry
0709 12:14:37.184007 (+153672us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:37.193603 (+  9596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.193800 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:37.739208 (+545408us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b18003b6380. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db
0709 12:14:37.935537 (+196329us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:14:38.087436 (+151899us) raft_consensus.cc:1685] finished
0709 12:14:38.087471 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.104541 (+ 17070us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10174,"raft.queue_time_us":24374,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":36442,"spinlock_wait_cycles":50051840,"thread_start_us":55127,"threads_started":1,"wal-append.queue_time_us":67900}
I20260709 12:14:38.120060 19816 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:38.120348 21905 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:14:38.122040 19815 raft_consensus.cc:1275] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:38.079623 21821 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:38.124804 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.048050 21688 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:38.060811 21685 consensus_queue.cc:1059] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:14:38.130913 21987 raft_consensus.cc:2804] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:38.132066 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.137072 21990 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.143610 21905 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:38.145735 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 136769us
I20260709 12:14:38.149520 19815 raft_consensus.cc:1275] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:38.151255 19748 raft_consensus.cc:2468] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 2.
I20260709 12:14:38.123147 20424 raft_consensus.cc:2393] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:38.157922 21874 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:38.159092 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.048913 21849 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:38.106456 21997 raft_consensus.cc:2749] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:38.164604 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 152428us
I20260709 12:14:38.210224 19640 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:38.195267 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.153790 21999 consensus_queue.cc:237] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:38.197834 21987 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:38.201170 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 95741.1us
I20260709 12:14:38.092480 20427 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:38.206284 21685 consensus_queue.cc:1243] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Peer b12c250fb1a244ed9a49cf86950af1bf log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:38.235174 19749 raft_consensus.cc:1275] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:38.236534 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.206887 21989 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:38.220022 21987 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:38.224282 21895 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:38.251296 21895 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:38.251875 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:38.204200 21990 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:38.207962 21494 consensus_queue.cc:1059] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:14:38.255429 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:38.222745 21874 raft_consensus.cc:2804] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:38.271318 19715 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:38.293203 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:38.293023 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:38.295857 19750 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:38.295922 19818 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:14:38.301550 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.302241 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.254050 20425 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:38.253571 21895 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:38.254401 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:38.321761 21688 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:38.325093 21849 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:38.316018 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:38.293998 21874 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.087374 21953 rpcz_store.cc:276] 0709 12:14:33.666566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.673136 (+  6570us) service_pool.cc:224] Handling call
0709 12:14:33.880306 (+207170us) log.cc:844] Serialized 508 byte log entry
0709 12:14:35.109399 (+1229093us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5400820620. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46ffb26 00007fadf46f949a 00007fadf46f8714 00007fadf46d8eaa 00007fadf46dfd53 00007fadf46dfcd9 00007fadf46dfc69 00007fadf46dfc31 00007fadf46dedfd 0000000000388634
0709 12:14:35.298803 (+189404us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b5400820620. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46ffb26 00007fadf46f949a 00007fadf46f8714 00007fadf46d8eaa 00007fadf46dfd53 00007fadf46dfcd9 00007fadf46dfc69 00007fadf46dfc31 00007fadf46dedfd 0000000000388634
0709 12:14:37.982904 (+2684101us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69532,"raft.run_cpu_time_us":41039,"raft.run_wall_time_us":2295693,"spinlock_wait_cycles":135204992,"thread_start_us":281781,"threads_started":1,"wal-append.queue_time_us":627628,"wal-append.run_cpu_time_us":3608,"wal-append.run_wall_time_us":1430360}
I20260709 12:14:38.319003 21820 consensus_queue.cc:260] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:38.312955 21879 raft_consensus.cc:2804] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:38.337052 21990 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:38.340611 21987 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:38.318338 21971 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:14:38.299834 21989 consensus_queue.cc:1048] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 12:14:38.361698 19789 connection.cc:256] RPC call timeout handler was delayed by -2.2452852199999143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 12:14:38.364303 19789 connection.cc:256] RPC call timeout handler was delayed by -2.2236852200001067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 12:14:38.364718 19789 connection.cc:256] RPC call timeout handler was delayed by -1.7727852200000598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260709 12:14:38.364953 19789 connection.cc:256] RPC call timeout handler was delayed by -1.278685219999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27s for a response
I20260709 12:14:38.364950 20398 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:38.344758 21621 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.346340 19559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 62ed1b9937fd41ab83a0000603a38fc9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 12:14:38.363411 21994 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.346503 21879 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:38.448355 19559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 102220us
I20260709 12:14:38.374500 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:38.449402 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:38.449652 19818 raft_consensus.cc:2410] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:38.449978 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:38.438723 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.346307 21820 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:38.510738 19821 raft_consensus.cc:2468] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
W20260709 12:14:38.533346 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.534248 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.540483 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.342576 21874 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:38.451282 20424 raft_consensus.cc:2393] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 2: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:38.446015 21621 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:38.578419 19821 raft_consensus.cc:3055] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:14:38.589079 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.589417 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.450991 21876 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.590332 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.453771 21879 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:38.595060 19821 raft_consensus.cc:740] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
W20260709 12:14:38.621469 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 401525us
I20260709 12:14:38.622334 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.623375 19824 raft_consensus.cc:2376] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4. Re-sending same reply.
I20260709 12:14:38.350220 21821 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:38.637548 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.639528 19824 raft_consensus.cc:2368] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5.
I20260709 12:14:38.644527 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:38.645723 19638 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.831s (SENT)
I20260709 12:14:38.629626 19821 consensus_queue.cc:260] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:38.647820 19821 raft_consensus.cc:3060] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.454593 21994 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:38.658028 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.661661 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.663733 19823 raft_consensus.cc:2410] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:38.664809 19824 raft_consensus.cc:2410] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:38.667461 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.669039 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:38.669828 19816 raft_consensus.cc:2393] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:38.673640 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:38.677181 19638 leader_election.cc:336] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.875s (SENT)
I20260709 12:14:38.677870 19638 leader_election.cc:304] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:38.678125 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:38.679196 19638 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.889s (SENT)
I20260709 12:14:38.679620 19638 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:38.680635 19638 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.917s (SENT)
I20260709 12:14:38.685230 19818 raft_consensus.cc:2410] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:38.687831 19822 raft_consensus.cc:1275] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:38.700907 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.705168 19816 raft_consensus.cc:1275] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:38.706617 19822 raft_consensus.cc:2393] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
W20260709 12:14:38.711203 19638 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.993s (SENT)
I20260709 12:14:38.711651 19638 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:38.684438 21987 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:38.715834 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.716463 19822 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
I20260709 12:14:38.695641 21989 raft_consensus.cc:2749] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:38.695226 21897 raft_consensus.cc:2749] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:38.723443 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:38.724020 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.731652 19819 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:38.732419 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:38.733711 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.734436 19822 raft_consensus.cc:2410] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:38.725421 19821 raft_consensus.cc:1275] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:38.695878 21976 consensus_queue.cc:1048] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:14:38.739166 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:38.745370 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.746142 19821 raft_consensus.cc:2393] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
W20260709 12:14:38.739684 19638 leader_election.cc:336] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 2.083s (SENT)
I20260709 12:14:38.727314 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.747352 19820 raft_consensus.cc:2468] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:38.749027 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.739285 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.737478 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:38.713081 21952 consensus_queue.cc:1048] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:14:38.760071 21988 raft_consensus.cc:3055] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:38.760607 21988 raft_consensus.cc:740] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:38.761590 21988 consensus_queue.cc:260] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:38.741979 19816 raft_consensus.cc:1275] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:38.765787 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.774979 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:38.751067 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:38.745064 21939 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:38.707828 22000 consensus_queue.cc:1048] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:14:38.748131 21987 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.710731 21951 consensus_queue.cc:1048] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:14:38.729089 21990 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:38.747450 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.776346 19822 raft_consensus.cc:2393] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 6: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:38.706929 21494 consensus_queue.cc:1048] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:14:38.777096 19819 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
W20260709 12:14:38.778270 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 70482.9us
I20260709 12:14:38.779275 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:38.781016 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.784638 19820 raft_consensus.cc:2468] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:38.784852 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.785560 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:38.783900 19638 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 2.243s (SENT)
I20260709 12:14:38.785977 19819 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:38.785157 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.783053 19821 raft_consensus.cc:2468] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:38.787492 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.788661 19819 raft_consensus.cc:2393] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:38.788697 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.789740 19821 raft_consensus.cc:2410] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:38.790318 19819 raft_consensus.cc:1240] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:38.790570 21936 raft_consensus.cc:3055] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:38.791254 21936 raft_consensus.cc:740] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:38.792052 19819 raft_consensus.cc:1240] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:38.792781 21936 consensus_queue.cc:260] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:38.797147 19742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 1235) took 2089 ms (client timeout 2009 ms). Trace:
W20260709 12:14:38.797812 19742 rpcz_store.cc:269] 0709 12:14:36.708167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.708322 (+   155us) service_pool.cc:224] Handling call
0709 12:14:38.796840 (+2088518us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000960d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:38.797041 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2686963584}
I20260709 12:14:38.804119 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:38.805567 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:38.805805 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.794735 21936 raft_consensus.cc:3060] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:38.780423 21988 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.809304 21881 consensus_queue.cc:1048] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 12:14:38.829454 22028 log.cc:927] Time spent T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:14:38.807425 21847 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.806996 21897 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.780118 21939 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:38.839247 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.783371 21987 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:38.836366 22026 log.cc:927] Time spent T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:14:38.809194 21997 consensus_queue.cc:1059] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:14:38.836098 21847 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:38.859020 21847 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:38.860630 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 53264us
W20260709 12:14:38.848397 22021 log.cc:927] Time spent T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:14:38.847905 21821 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:38.834867 21685 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:14:38.867838 22000 consensus_queue.cc:1048] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:14:38.875211 19789 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:38.876740 22025 log.cc:927] Time spent T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 12:14:38.883744 22022 log.cc:927] Time spent T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:14:38.888391 21939 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:38.856146 21994 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:38.890291 21994 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:38.964282 19670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54544 (request call id 270) took 3423 ms. Trace:
I20260709 12:14:38.964941 19670 rpcz_store.cc:276] 0709 12:14:35.541207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.127229 (+586022us) service_pool.cc:224] Handling call
0709 12:14:37.825809 (+1698580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:38.071574 (+245765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.356785 (+285211us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54002387d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:38.963397 (+606612us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54002387d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:38.964199 (+   802us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4414308352}
I20260709 12:14:38.847612 22030 consensus_queue.cc:1048] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 12:14:38.970080 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 66155us
I20260709 12:14:38.973896 19817 raft_consensus.cc:1275] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:38.852312 21897 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:38.861615 21879 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:39.018675 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.031190 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.015868 21874 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:39.040670 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:39.041692 20430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60846 (request call id 304) took 1045 ms. Trace:
I20260709 12:14:39.042058 20430 rpcz_store.cc:276] 0709 12:14:37.996731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.001328 (+  4597us) service_pool.cc:224] Handling call
0709 12:14:39.040473 (+1039145us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b5800148b98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:14:39.041619 (+  1146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6771456}
I20260709 12:14:39.005431 21958 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:39.047632 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 172512us
I20260709 12:14:38.979923 21903 consensus_queue.cc:1048] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:14:39.049692 19789 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:38.984215 21494 consensus_queue.cc:1048] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:14:39.050762 21997 consensus_queue.cc:1243] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer ca42d3c27d2e46348120791d1282b193 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:39.057432 19741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1252) took 1105 ms. Trace:
I20260709 12:14:39.058235 19789 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:39.014298 21957 consensus_queue.cc:1048] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:14:39.064877 20429 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:39.048106 21987 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:39.052547 21958 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:39.092509 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.134385 22000 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:39.138945 22041 log.cc:927] Time spent T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:14:39.138688 22000 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:39.139735 21949 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:39.140026 22033 log.cc:927] Time spent T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:14:39.140677 21897 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:39.141723 21878 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:39.083647 21876 raft_consensus.cc:2749] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:39.143323 21879 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:39.145721 21621 consensus_meta.cc:287] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.006s
W20260709 12:14:39.146678 22031 log.cc:927] Time spent T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.306s	user 0.007s	sys 0.000s
I20260709 12:14:39.062270 19741 rpcz_store.cc:276] 0709 12:14:37.952557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.047203 (+ 94646us) service_pool.cc:224] Handling call
0709 12:14:38.065837 (+ 18634us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:38.108538 (+ 42701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:38.108589 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:38.109435 (+   846us) log.cc:844] Serialized 52 byte log entry
0709 12:14:38.309172 (+199737us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:38.315281 (+  6109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.042445 (+727164us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b54004a1b20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46fc41d 00007fadf4782a57 00007fadf477fdde 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:14:39.042558 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:39.044025 (+  1467us) raft_consensus.cc:1685] finished
0709 12:14:39.044046 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.057343 (+ 13297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":411,"raft.queue_time_us":9930,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"spinlock_wait_cycles":17089792,"thread_start_us":189143,"threads_started":1,"wal-append.queue_time_us":214867}
I20260709 12:14:39.146209 21621 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:39.140818 22000 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:39.150101 19816 raft_consensus.cc:2410] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:14:39.150261 19748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40172 (request call id 215) took 1350 ms (client timeout 1500 ms). Trace:
W20260709 12:14:39.150822 19748 rpcz_store.cc:269] 0709 12:14:37.799907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.800040 (+   133us) service_pool.cc:224] Handling call
0709 12:14:39.150053 (+1350013us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540012af54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:14:39.150195 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765769472}
I20260709 12:14:39.151120 21621 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:39.160033 21958 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:39.167474 20429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 591) took 1042 ms. Trace:
I20260709 12:14:39.167905 20429 rpcz_store.cc:276] 0709 12:14:38.125605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.125867 (+   262us) service_pool.cc:224] Handling call
0709 12:14:38.128035 (+  2168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.065412 (+937377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.167232 (+101820us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54002a03d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:39.167409 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2150559104}
I20260709 12:14:39.175307 19823 raft_consensus.cc:1275] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:14:39.175804 19823 pending_rounds.cc:85] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting all ops after (but not including) 2
I20260709 12:14:39.176038 19823 pending_rounds.cc:107] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:14:39.176268 19823 raft_consensus.cc:2889] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.181679 20430 raft_consensus.cc:1275] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:39.183128 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:39.183816 20424 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:39.217399 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.199039 21876 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.211773 21999 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.224785 20430 raft_consensus.cc:1275] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:39.230087 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:39.233896 19748 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:14:39.234370 19748 pending_rounds.cc:85] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193: Aborting all ops after (but not including) 5
I20260709 12:14:39.234593 19748 pending_rounds.cc:107] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:14:39.234835 19748 raft_consensus.cc:2889] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.235476 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:39.239239 20433 raft_consensus.cc:1240] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:39.241429 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 225) took 1429 ms. Trace:
I20260709 12:14:39.241863 19744 rpcz_store.cc:276] 0709 12:14:37.812439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.894571 (+ 82132us) service_pool.cc:224] Handling call
0709 12:14:37.910665 (+ 16094us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:37.921406 (+ 10741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.921444 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:38.961264 (+1039820us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b2c00000448. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:14:38.967043 (+  5779us) log.cc:844] Serialized 26 byte log entry
0709 12:14:39.116042 (+148999us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:39.240312 (+124270us) log.cc:844] Serialized 14 byte log entry
0709 12:14:39.241031 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.241111 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:39.241155 (+    44us) raft_consensus.cc:1685] finished
0709 12:14:39.241237 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.241365 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22761,"prepare.queue_time_us":46884,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":7548,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":9514,"spinlock_wait_cycles":13697280,"thread_start_us":167702,"threads_started":2,"wal-append.queue_time_us":177653}
I20260709 12:14:39.245743 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:39.248091 19741 raft_consensus.cc:1240] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:39.248180 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:39.250000 20431 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:39.255666 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:39.255748 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:39.258431 22037 log.cc:927] Time spent T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:14:39.218468 22030 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:14:39.216426 21977 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 12:14:39.276798 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.240614 21999 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:39.284260 21999 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:39.228533 21876 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:39.287456 21876 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:39.290370 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:39.300467 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.299803 19640 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:39.308272 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:39.298142 21842 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:39.320585 19748 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:39.321745 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:39.309290 19640 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:39.329450 19747 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:39.329216 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 98670.1us
I20260709 12:14:39.323550 19742 raft_consensus.cc:1275] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:39.321015 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:39.334576 19749 raft_consensus.cc:1275] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:39.342743 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:39.343598 19748 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 5.
I20260709 12:14:39.344712 19744 raft_consensus.cc:1275] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:39.310057 21897 raft_consensus.cc:3060] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:39.342159 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:39.369481 19745 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:39.311134 21987 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:14:39.307427 21878 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:14:39.328133 21978 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.374094 19750 raft_consensus.cc:2955] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:39.387012 19747 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:39.336325 21709 raft_consensus.cc:3060] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.363358 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:39.392709 19743 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:39.337358 21842 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:39.405074 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 67684.7us
I20260709 12:14:39.337913 21990 consensus_queue.cc:1059] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:14:39.336766 21952 consensus_queue.cc:1048] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:14:39.363022 21621 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:14:39.422633 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 84972.9us
I20260709 12:14:39.391088 21978 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:39.433707 19745 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:39.461174 21842 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:39.487846 21621 consensus_queue.cc:1059] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:39.489995 21853 raft_consensus.cc:3055] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:39.490419 21853 raft_consensus.cc:740] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
W20260709 12:14:39.497749 19714 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:39.498620 19714 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:39.503252 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 97272us
W20260709 12:14:39.579950 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 85333.4us
W20260709 12:14:39.581563 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 83877.6us
I20260709 12:14:39.491412 21853 consensus_queue.cc:260] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:39.583606 19714 consensus_peers.cc:597] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:39.587200 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 99886us
W20260709 12:14:39.584126 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 56941.5us
I20260709 12:14:39.584739 21999 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:39.588102 19714 consensus_peers.cc:597] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:39.591153 20397 consensus_peers.cc:597] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:39.593379 19714 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:39.602392 19714 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:39.579047 22056 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:39.604060 19714 consensus_peers.cc:597] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:39.607322 19714 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:39.607776 19714 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:39.605324 20397 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:39.497187 20424 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
W20260709 12:14:39.606467 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.610934 20397 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:39.644102 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 45120.5us
W20260709 12:14:39.645121 20397 consensus_peers.cc:597] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:39.644120 19714 leader_election.cc:336] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:39.648519 19714 leader_election.cc:336] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:39.649693 19714 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:39.651487 19714 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:39.590372 21951 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:39.591805 21990 consensus_queue.cc:1243] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer b12c250fb1a244ed9a49cf86950af1bf log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:39.592396 22048 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:39.658084 20397 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:39.657495 22035 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:39.610882 21853 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:39.652738 19714 consensus_peers.cc:597] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:39.610208 21999 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:39.671305 19714 consensus_peers.cc:597] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:39.667768 20397 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:39.657289 22054 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:14:39.674962 19714 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:39.674475 20397 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:39.675799 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 171677us
W20260709 12:14:39.669016 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 242221us
I20260709 12:14:39.679442 20398 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:39.681650 19714 leader_election.cc:336] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:39.682222 19714 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:39.679075 19640 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:39.716089 19714 consensus_peers.cc:597] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:39.717787 19714 leader_election.cc:336] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:39.719414 19714 leader_election.cc:336] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:39.721310 19714 leader_election.cc:336] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:39.723680 19714 consensus_peers.cc:597] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:39.725943 19714 leader_election.cc:336] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:39.727754 19714 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:39.737920 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 58960.4us
W20260709 12:14:39.738297 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 57040.5us
W20260709 12:14:39.737900 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 58522.4us
W20260709 12:14:39.747442 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.663148 21951 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:39.746359 22063 log.cc:927] Time spent T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:14:39.817269 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 759018us
I20260709 12:14:39.665323 22048 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:39.870720 19789 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:39.798153 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 58884.7us
I20260709 12:14:39.762209 22067 raft_consensus.cc:2749] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:39.741377 21958 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:39.658032 22056 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:39.740159 21957 raft_consensus.cc:2749] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:39.867153 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.747956 21953 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:39.890331 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 153995us
I20260709 12:14:39.876268 22039 raft_consensus.cc:2804] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:39.887390 21988 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:39.883520 21978 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:39.877940 21990 consensus_queue.cc:1048] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 12:14:39.898275 21709 consensus_meta.cc:287] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 12:14:39.884151 21953 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.907356 19640 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:39.933723 19789 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:39.903805 22039 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:39.943861 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 48304.3us
I20260709 12:14:39.911981 21957 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:39.954048 21709 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:39.897717 22067 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:14:39.954355 21953 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:39.989436 19824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2092) took 1007 ms. Trace:
I20260709 12:14:39.990044 19824 rpcz_store.cc:276] 0709 12:14:38.981913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.033418 (+ 51505us) service_pool.cc:224] Handling call
0709 12:14:39.046722 (+ 13304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.056450 (+  9728us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:39.065223 (+  8773us) log.cc:844] Serialized 14 byte log entry
0709 12:14:39.878485 (+813262us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.878975 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:14:39.879140 (+   165us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:39.879175 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.879243 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:39.989169 (+109926us) raft_consensus.cc:1685] finished
0709 12:14:39.989187 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.989353 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":789678,"prepare.queue_time_us":9146,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1582118,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5139,"spinlock_wait_cycles":16032384,"thread_start_us":69489,"threads_started":1,"wal-append.queue_time_us":163337}
I20260709 12:14:39.958811 22039 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:40.030879 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 55118.5us
I20260709 12:14:39.957629 22069 consensus_queue.cc:1048] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 12:14:40.046384 19788 leader_election.cc:336] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:40.050593 19788 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:40.054656 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 147377us
I20260709 12:14:40.055703 19640 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:39.972546 21957 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:40.075181 20397 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:40.023550 21709 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:14:40.055712 21939 raft_consensus.cc:3055] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:14:40.094714 19638 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 2.136s (SENT)
I20260709 12:14:40.112159 21951 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:40.133831 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 54400us
W20260709 12:14:40.095034 21897 consensus_meta.cc:287] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.001s
I20260709 12:14:40.129976 22066 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.152424 21897 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:40.152235 22066 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.153337 21897 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.153832 21897 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:40.154475 22068 log.cc:927] Time spent T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
I20260709 12:14:40.157023 22034 raft_consensus.cc:493] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:40.157682 22034 raft_consensus.cc:515] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:40.159369 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.159641 21990 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:40.160101 21990 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.160460 21990 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:40.162516 22073 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.094702 21939 raft_consensus.cc:740] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:40.129833 22089 raft_consensus.cc:2804] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:40.175103 22077 raft_consensus.cc:2749] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:40.183192 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 127476us
I20260709 12:14:40.163182 22038 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:40.187251 19640 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:40.191769 22043 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.193928 22083 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:40.187806 22089 raft_consensus.cc:697] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:40.205027 21988 raft_consensus.cc:2804] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:40.201176 22070 log.cc:927] Time spent T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:14:40.188541 22038 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.234930 19818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2094) took 1250 ms. Trace:
I20260709 12:14:40.235376 19818 rpcz_store.cc:276] 0709 12:14:38.984808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.171540 (+186732us) service_pool.cc:224] Handling call
0709 12:14:39.171935 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.993198 (+821263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.993257 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.021460 (+ 28203us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.183763 (+162303us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:40.183927 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.184190 (+   263us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.234691 (+ 50501us) raft_consensus.cc:1685] finished
0709 12:14:40.234712 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.234871 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":709807,"raft.queue_time_us":984354,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":210964,"threads_started":2,"wal-append.queue_time_us":176090}
I20260709 12:14:40.236375 22038 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.196501 22043 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.212098 22083 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:40.215651 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 169299us
I20260709 12:14:40.216343 22079 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:40.216915 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.217274 22081 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:40.239045 22083 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.219619 22048 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.220121 21897 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:40.222203 22034 leader_election.cc:290] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.239341 22081 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.242676 22081 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.242838 22089 consensus_queue.cc:237] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.182180 22085 consensus_queue.cc:1059] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:14:40.223773 21874 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:40.213025 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 279398us
I20260709 12:14:40.192354 22069 raft_consensus.cc:2804] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:40.228089 22066 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:40.229990 20429 raft_consensus.cc:1240] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:40.197214 21939 consensus_queue.cc:260] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.239202 22043 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.163183 22073 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.279462 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.284586 20429 raft_consensus.cc:1240] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:14:40.285957 21988 raft_consensus.cc:697] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:40.318296 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40172 (request call id 229) took 1088 ms. Trace:
I20260709 12:14:40.408226 19750 rpcz_store.cc:276] 0709 12:14:39.229413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.229539 (+   126us) service_pool.cc:224] Handling call
0709 12:14:39.255992 (+ 26453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.256447 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.256485 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.284387 (+ 27902us) log.cc:844] Serialized 508 byte log entry
0709 12:14:39.373890 (+ 89503us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:39.400115 (+ 26225us) log.cc:844] Serialized 14 byte log entry
0709 12:14:39.400422 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.400512 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.315238 (+914726us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b180040e940. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:14:40.317911 (+  2673us) raft_consensus.cc:1685] finished
0709 12:14:40.318040 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.318214 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2962,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":14690,"spinlock_wait_cycles":16932736,"thread_start_us":77574,"threads_started":1,"wal-append.queue_time_us":118874}
W20260709 12:14:40.390919 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.334542 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.286149 22081 raft_consensus.cc:3055] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:40.418862 20428 raft_consensus.cc:1275] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:40.294538 22073 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:40.280112 22069 raft_consensus.cc:697] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:40.386513 22034 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.447434 22034 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.450162 22034 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:40.291340 22056 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:40.380609 21958 raft_consensus.cc:2749] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:40.452858 22060 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.017s	sys 0.015s
W20260709 12:14:40.457418 22060 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.017s	sys 0.016s
I20260709 12:14:40.454507 22043 consensus_queue.cc:1059] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:14:40.459318 21990 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.418998 22081 raft_consensus.cc:740] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:40.461410 22081 consensus_queue.cc:260] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.452090 22090 raft_consensus.cc:493] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:40.463420 22090 raft_consensus.cc:515] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.292759 21953 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.467473 19817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2087) took 1491 ms. Trace:
I20260709 12:14:40.469625 19817 rpcz_store.cc:276] 0709 12:14:38.976278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.976433 (+   155us) service_pool.cc:224] Handling call
0709 12:14:38.976835 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:38.977119 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:38.983208 (+  6089us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.282456 (+1299248us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.466959 (+184503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:40.467047 (+    88us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:40.467125 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.467222 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.467389 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1028456,"prepare.queue_time_us":347796,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":125,"raft.queue_time_us":832532,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":21113,"thread_start_us":636284,"threads_started":4,"wal-append.queue_time_us":163764,"wal-append.run_cpu_time_us":1176,"wal-append.run_wall_time_us":1002323}
I20260709 12:14:40.310690 22039 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.287089 21988 consensus_queue.cc:237] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.483652 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:40.485044 20428 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:40.477615 22081 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:40.456224 22085 consensus_queue.cc:1059] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:14:40.486828 22090 leader_election.cc:290] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.477175 21990 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:40.492481 18407 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 19646)
I20260709 12:14:40.493369 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:40.502241 19638 leader_election.cc:336] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 2.567s (SENT)
I20260709 12:14:40.503738 19638 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:40.511211 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:40.512384 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.512537 19638 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:40.512879 22045 log.cc:927] Time spent T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 1.113s	user 0.004s	sys 0.008s
W20260709 12:14:40.513172 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.514442 22043 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:40.514581 19819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2090) took 1535 ms. Trace:
I20260709 12:14:40.515058 22043 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.516245 21592 raft_consensus.cc:3055] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:40.515468 19819 rpcz_store.cc:276] 0709 12:14:38.978895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.979016 (+   121us) service_pool.cc:224] Handling call
0709 12:14:38.979300 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.020469 (+ 41169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.020520 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.022021 (+  1501us) log.cc:844] Serialized 26 byte log entry
0709 12:14:39.196022 (+174001us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:39.196077 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.197618 (+  1541us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.512202 (+1314584us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:14:40.514255 (+  2053us) raft_consensus.cc:1685] finished
0709 12:14:40.514276 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.514514 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":754962,"raft.queue_time_us":66309,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":10167,"spinlock_wait_cycles":43131776,"thread_start_us":134429,"threads_started":1,"wal-append.queue_time_us":279177}
I20260709 12:14:40.517316 22043 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.517855 22043 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:40.518186 22043 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.516855 21592 raft_consensus.cc:740] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
W20260709 12:14:40.519944 22050 log.cc:927] Time spent T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 1.196s	user 0.002s	sys 0.007s
I20260709 12:14:40.524227 19638 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:40.526465 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.531332 19820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2089) took 1553 ms. Trace:
I20260709 12:14:40.531944 19820 rpcz_store.cc:276] 0709 12:14:38.977500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.977623 (+   123us) service_pool.cc:224] Handling call
0709 12:14:38.977945 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.019681 (+ 41736us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:39.136238 (+116557us) log.cc:844] Serialized 14 byte log entry
0709 12:14:39.286374 (+150136us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b1800384dc0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:14:39.977586 (+691212us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.989020 (+ 11434us) log.cc:844] Serialized 26 byte log entry
0709 12:14:39.989168 (+   148us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:39.989199 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.989267 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.519299 (+530032us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:14:40.530997 (+ 11698us) raft_consensus.cc:1685] finished
0709 12:14:40.531029 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.531235 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1283299,"prepare.queue_time_us":23789,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":978902,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":159,"spinlock_wait_cycles":237945472,"thread_start_us":257031,"threads_started":3,"wal-append.queue_time_us":166197}
I20260709 12:14:40.507650 22085 consensus_queue.cc:1243] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer ca42d3c27d2e46348120791d1282b193 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:40.508004 22090 raft_consensus.cc:2749] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:40.542981 21842 consensus_queue.cc:1059] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:40.533138 21990 consensus_queue.cc:1048] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:14:40.533187 22102 raft_consensus.cc:3060] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.519730 21592 consensus_queue.cc:260] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.536687 19638 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:40.548502 21592 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:40.551904 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1265) took 1242 ms. Trace:
W20260709 12:14:40.535149 19789 connection.cc:256] RPC call timeout handler was delayed by -1.1187267110001358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 12:14:40.536433 22083 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:40.535153 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.537835 21897 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:40.502102 22069 consensus_queue.cc:237] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.502600 22056 consensus_queue.cc:1048] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:14:40.538398 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.535367 21953 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:40.561825 19789 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:40.537453 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.552482 19746 rpcz_store.cc:276] 0709 12:14:39.309640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.322712 (+1013072us) service_pool.cc:224] Handling call
0709 12:14:40.323221 (+   509us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:40.323652 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.323680 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:40.363937 (+ 40257us) log.cc:844] Serialized 52 byte log entry
0709 12:14:40.477559 (+113622us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:40.477603 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.477672 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.551510 (+ 73838us) raft_consensus.cc:1685] finished
0709 12:14:40.551534 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.551724 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9910,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":2750,"thread_start_us":40513,"threads_started":1,"wal-append.queue_time_us":101163}
I20260709 12:14:40.579249 19638 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:40.581414 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.582085 19820 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:40.582562 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.582873 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.583892 19818 raft_consensus.cc:2468] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:40.584240 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.584146 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.581857 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.585217 19817 raft_consensus.cc:2410] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:40.586272 19824 raft_consensus.cc:2410] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:14:40.587549 19640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.587936 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.587736 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.589970 19818 raft_consensus.cc:2410] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:40.590629 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.590900 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:40.575256 20397 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:40.592447 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.593779 19822 raft_consensus.cc:2410] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:40.546609 22043 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.591274 19824 raft_consensus.cc:2468] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:40.535416 22034 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:40.603281 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.594274 20397 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:40.595026 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.604472 19821 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:40.605360 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.592118 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.573709 22085 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.606352 19819 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:40.616460 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.617416 19821 raft_consensus.cc:2410] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:40.608304 19824 raft_consensus.cc:2410] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:40.586445 22079 raft_consensus.cc:2749] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:40.609225 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.621449 19822 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:40.609879 22061 log.cc:927] Time spent T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.704s	user 0.002s	sys 0.000s
W20260709 12:14:40.612877 22106 log.cc:927] Time spent T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:14:40.603140 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.619503 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.624516 19820 raft_consensus.cc:2410] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:40.625833 19823 raft_consensus.cc:1275] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:40.578151 22083 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.628180 19818 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:40.594676 21990 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:40.624162 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 48940.4us
I20260709 12:14:40.630825 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.628963 19821 raft_consensus.cc:2468] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:40.631985 19820 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:40.631028 20397 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:40.633641 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.640391 20397 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:40.642568 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.631559 22089 raft_consensus.cc:2749] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:40.642900 19821 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:40.632438 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 52716.6us
I20260709 12:14:40.644598 19819 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:40.645560 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:40.647197 20397 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:40.627627 22062 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:40.646294 19638 leader_election.cc:336] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.692s (SENT)
I20260709 12:14:40.651325 19638 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:40.653756 19638 leader_election.cc:336] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.708s (SENT)
I20260709 12:14:40.654366 19638 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:40.647662 19819 raft_consensus.cc:2468] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
I20260709 12:14:40.647709 20397 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:40.648697 19823 raft_consensus.cc:2393] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:40.631852 22065 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:40.655941 19818 raft_consensus.cc:2410] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:14:40.658201 20397 leader_election.cc:336] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:40.621193 22060 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:14:40.667552 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.669886 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.670608 19823 raft_consensus.cc:2468] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 1.
I20260709 12:14:40.672137 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.623322 22034 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.677980 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.673085 19823 raft_consensus.cc:2376] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5. Re-sending same reply.
I20260709 12:14:40.676023 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.675729 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.683197 19818 raft_consensus.cc:2393] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 6: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:40.650177 22039 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:40.657311 21897 raft_consensus.cc:2749] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:40.657060 21820 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:40.685372 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.660897 21842 raft_consensus.cc:2749] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:40.663959 22054 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:40.687342 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.649780 22090 consensus_queue.cc:1048] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:14:40.692201 19818 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:40.688653 19822 raft_consensus.cc:2468] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:40.624511 22085 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.688547 19821 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:40.694072 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.696712 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:40.701782 19741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 1264) took 1396 ms (client timeout 1599 ms). Trace:
I20260709 12:14:40.700249 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:40.702523 19741 rpcz_store.cc:269] 0709 12:14:39.305296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.696306 (+1391010us) service_pool.cc:224] Handling call
0709 12:14:40.701711 (+  5405us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:40.703573 19821 raft_consensus.cc:2468] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
W20260709 12:14:40.697000 22111 log.cc:927] Time spent T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:14:40.689356 22089 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:40.704674 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.659543 22062 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.706882 19821 raft_consensus.cc:2376] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5. Re-sending same reply.
I20260709 12:14:40.700305 19822 raft_consensus.cc:2468] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 2.
I20260709 12:14:40.711941 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfc1fb42f6b4712acea35286ba371c3" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:40.710044 19788 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:40.712718 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 474990us
I20260709 12:14:40.712935 19821 raft_consensus.cc:2393] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:40.711987 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.708683 19820 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:40.714570 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:40.714577 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.715417 19820 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:40.715623 19822 raft_consensus.cc:2393] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
W20260709 12:14:40.727311 22113 log.cc:927] Time spent T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:14:40.728191 19788 leader_election.cc:336] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:40.728667 19788 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:40.729815 19788 consensus_peers.cc:597] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:40.731660 22034 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.732218 22089 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.742636 22083 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.753002 21994 raft_consensus.cc:3055] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:40.753703 21994 raft_consensus.cc:740] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:40.759122 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:40.762851 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:40.763684 19821 raft_consensus.cc:3055] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:40.764093 19821 raft_consensus.cc:740] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:40.765031 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:40.767357 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.772575 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:40.773695 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.777724 19820 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
I20260709 12:14:40.786615 20428 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
I20260709 12:14:40.793934 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:40.794803 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.795265 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.796066 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:40.796303 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.796367 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.796841 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:40.793594 19821 consensus_queue.cc:260] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.797482 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.798142 19748 raft_consensus.cc:2368] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
I20260709 12:14:40.802888 19818 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:40.808947 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.809314 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.810510 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:40.815191 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.815066 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.819360 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.822425 19715 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:40.812680 22079 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:40.825549 21881 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.825306 22079 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.826222 21881 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.827088 21939 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:40.827513 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.828316 20431 raft_consensus.cc:2393] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 4: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:40.828497 21881 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:40.829126 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.830268 22030 raft_consensus.cc:2804] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:40.830864 22030 raft_consensus.cc:697] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:40.831727 22030 consensus_queue.cc:237] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.780579 22039 raft_consensus.cc:2749] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:40.853012 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.777786 21685 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.855198 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:40.903851 19817 raft_consensus.cc:1275] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
W20260709 12:14:40.902456 19714 consensus_peers.cc:597] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:40.853940 21951 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:40.905413 19817 pending_rounds.cc:85] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting all ops after (but not including) 2
W20260709 12:14:40.906212 19714 consensus_peers.cc:597] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:40.906385 19817 pending_rounds.cc:107] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:40.906920 19817 raft_consensus.cc:2889] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:40.907087 19714 consensus_peers.cc:597] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:40.929332 19817 pending_rounds.cc:107] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:14:40.929826 19817 raft_consensus.cc:2889] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:40.780740 21994 consensus_queue.cc:260] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:40.954373 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.955302 20428 raft_consensus.cc:2468] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:40.937461 19743 raft_consensus.cc:2368] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 5. Current term is 6.
I20260709 12:14:40.960171 19715 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:40.904979 21685 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.968999 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.944670 21988 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.971478 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:40.971958 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:40.972021 19714 leader_election.cc:336] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:40.957525 22081 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.986672 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:40.987849 19746 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 6.
I20260709 12:14:40.978946 19714 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:40.972899 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.989147 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:40.989893 19746 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:40.927409 21951 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:40.998937 19742 raft_consensus.cc:2393] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 2: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:40.970535 21936 raft_consensus.cc:2804] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:40.974277 22034 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:40.997921 21994 raft_consensus.cc:3060] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.045285 19746 raft_consensus.cc:2468] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:41.048163 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:41.001052 22089 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:41.005515 21936 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.059146 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:41.065516 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:41.005782 22062 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:41.060878 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:41.066550 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:41.069738 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:40.987524 21988 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:41.078895 21990 raft_consensus.cc:2749] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:41.023290 21881 raft_consensus.cc:2749] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:41.073125 19746 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:41.073697 19820 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
W20260709 12:14:41.075904 22114 log.cc:927] Time spent T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:14:41.100471 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:41.101361 19820 raft_consensus.cc:2410] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:41.101665 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:41.102083 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:41.102650 19820 raft_consensus.cc:2468] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 1.
I20260709 12:14:41.102725 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:41.103768 19745 raft_consensus.cc:2393] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 5: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:41.104528 21951 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:41.105558 22085 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:41.106351 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:41.108341 19823 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:41.110152 20428 raft_consensus.cc:1240] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:41.111907 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:41.112524 20428 raft_consensus.cc:2468] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 2.
I20260709 12:14:40.997680 22081 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:41.046456 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:41.114377 19715 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:41.116855 19815 raft_consensus.cc:1240] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:41.103848 19820 raft_consensus.cc:1240] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:14:41.071529 21936 raft_consensus.cc:3060] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.106647 21685 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:41.053192 22034 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:41.152973 19815 raft_consensus.cc:1240] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:41.156147 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.137622 21494 raft_consensus.cc:2804] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:41.138294 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:41.072075 22102 consensus_meta.cc:287] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.009s
I20260709 12:14:41.136687 19746 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 6.
I20260709 12:14:41.161041 21494 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.166891 22102 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:41.187011 22085 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:41.208473 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:41.203163 19815 raft_consensus.cc:1240] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:41.200110 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 228026us
W20260709 12:14:41.293889 19714 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:41.294414 19714 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:41.296036 19714 consensus_peers.cc:597] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:41.296825 19714 consensus_peers.cc:597] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:41.297489 19714 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:41.298014 19714 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:41.266563 21685 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:41.268671 22121 log.cc:927] Time spent T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:14:41.207721 21494 raft_consensus.cc:3060] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.207983 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:41.290148 22118 log.cc:927] Time spent T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.099s	user 0.001s	sys 0.001s
W20260709 12:14:41.289791 22120 log.cc:927] Time spent T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:14:41.307061 22125 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:41.308018 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:41.290148 21988 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:41.314663 19714 consensus_peers.cc:597] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:41.315510 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.211318 22085 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:41.321542 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:41.291864 22054 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.314409 19822 raft_consensus.cc:1240] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:41.328186 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:41.329030 19822 raft_consensus.cc:2468] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 1.
I20260709 12:14:41.329674 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:41.330976 19746 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
W20260709 12:14:41.331928 19714 consensus_peers.cc:597] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:41.333564 19815 raft_consensus.cc:1275] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:41.335688 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:41.335760 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:41.337250 19713 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:41.340036 19741 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:41.340617 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:41.320217 22081 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:41.320542 21881 raft_consensus.cc:2749] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:41.337500 19815 raft_consensus.cc:1275] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:41.351241 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:41.333261 21957 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:41.306157 21685 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:41.358495 19817 raft_consensus.cc:1240] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:41.354653 19638 leader_election.cc:336] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Timed out: RequestConsensusVote RPC to 127.17.249.195:42991 timed out after 1.995s (SENT)
I20260709 12:14:41.373725 19638 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:41.363360 19745 raft_consensus.cc:1240] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 12:14:41.364393 19821 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.374214 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:41.375397 19817 raft_consensus.cc:2410] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:41.344638 19713 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:41.361766 19816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2093) took 2379 ms. Trace:
I20260709 12:14:41.377667 19816 rpcz_store.cc:276] 0709 12:14:38.982508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.152394 (+169886us) service_pool.cc:224] Handling call
0709 12:14:39.152892 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.724688 (+1571796us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b18000b9740. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf4777060 00007fadf4777bfb 00007fadf478264b
0709 12:14:40.725348 (+   660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.725651 (+   303us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.794512 (+ 68861us) log.cc:844] Serialized 26 byte log entry
0709 12:14:41.021312 (+226800us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:41.021354 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.021635 (+   281us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.344240 (+322605us) raft_consensus.cc:1685] finished
0709 12:14:41.344260 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.361682 (+ 17422us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":967022,"raft.queue_time_us":752840,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":17504,"spinlock_wait_cycles":51911552,"thread_start_us":237892,"threads_started":2,"wal-append.queue_time_us":360720}
I20260709 12:14:41.383066 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:41.343292 19743 raft_consensus.cc:2393] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 4: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:41.390951 21961 raft_consensus.cc:2749] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:41.391131 22102 raft_consensus.cc:2749] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:41.392853 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 48317.5us
I20260709 12:14:41.343942 22125 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:41.404107 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:41.339993 22030 consensus_queue.cc:1048] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:14:41.334061 22054 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:41.462987 19741 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
I20260709 12:14:41.463778 19821 raft_consensus.cc:1275] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:14:41.419235 22125 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:41.465317 19821 pending_rounds.cc:85] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting all ops after (but not including) 1
I20260709 12:14:41.472855 19821 pending_rounds.cc:107] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:14:41.473275 19821 raft_consensus.cc:2889] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:41.479321 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.486799 22073 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:14:41.501799 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:41.460001 21961 consensus_queue.cc:1059] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:14:41.477365 22125 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:41.507683 19744 raft_consensus.cc:2410] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:41.478767 21957 consensus_queue.cc:1059] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:14:41.486465 21958 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:14:41.505100 22096 raft_consensus.cc:3055] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:41.513144 21685 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:41.525671 20432 raft_consensus.cc:1240] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:14:41.538328 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.546908 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 65385.2us
I20260709 12:14:41.500427 22000 consensus_queue.cc:1048] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:14:41.508370 21936 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:41.521059 19743 raft_consensus.cc:1240] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:14:41.524103 22103 log.cc:927] Time spent T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 1.064s	user 0.020s	sys 0.005s
W20260709 12:14:41.606952 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.636016 20430 raft_consensus.cc:1240] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:41.724335 19743 raft_consensus.cc:1275] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:41.727746 21592 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.728381 21592 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:41.730501 21592 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:41.639247 22102 consensus_queue.cc:1059] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:14:41.526000 22096 raft_consensus.cc:740] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
W20260709 12:14:41.641543 21994 consensus_meta.cc:287] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.003s
W20260709 12:14:41.793793 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 297821us
I20260709 12:14:41.839601 19745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1281) took 1003 ms. Trace:
I20260709 12:14:41.846246 19745 rpcz_store.cc:276] 0709 12:14:40.835863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.375103 (+539240us) service_pool.cc:224] Handling call
0709 12:14:41.375463 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.375706 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:41.427419 (+ 51713us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.839108 (+411689us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:41.839185 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:41.839257 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.839363 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.839520 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125492,"prepare.queue_time_us":88282,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":23151,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":5197,"thread_start_us":402642,"threads_started":2,"wal-append.queue_time_us":140542}
I20260709 12:14:41.819216 22085 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:41.871798 19714 consensus_peers.cc:597] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:41.872574 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 539905us
W20260709 12:14:41.873582 19714 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 143 similar messages]
I20260709 12:14:41.881286 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:41.882285 20430 raft_consensus.cc:3060] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.932190 19818 raft_consensus.cc:1275] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:41.817864 21936 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:41.962774 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.981016 22138 log.cc:927] Time spent T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:14:41.996927 22054 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:41.868474 21957 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:41.959520 22081 consensus_queue.cc:1059] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:14:41.931075 22148 raft_consensus.cc:3055] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:41.995046 22096 consensus_queue.cc:260] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:42.039345 19789 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.553s (SENT)
I20260709 12:14:41.906265 21592 raft_consensus.cc:3055] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:42.051991 20430 raft_consensus.cc:2468] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:42.052047 19789 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:42.067958 19819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2118) took 1105 ms. Trace:
W20260709 12:14:42.068208 19789 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.554s (SENT)
I20260709 12:14:42.068843 19789 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:42.070730 19824 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.016s	sys 0.012s
W20260709 12:14:42.071321 19824 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.016s	sys 0.012s
I20260709 12:14:42.074224 19824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2115) took 1125 ms. Trace:
W20260709 12:14:42.074437 19789 leader_election.cc:336] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.578s (SENT)
I20260709 12:14:42.074924 19789 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:42.049851 22148 raft_consensus.cc:740] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:42.076776 19822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.029s
W20260709 12:14:42.077401 19822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.001s	sys 0.030s
I20260709 12:14:42.055250 21592 raft_consensus.cc:740] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:42.062223 22096 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:42.079581 19822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60644 (request call id 322) took 1150 ms. Trace:
I20260709 12:14:42.074605 19824 rpcz_store.cc:276] 0709 12:14:40.948581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.360297 (+411716us) service_pool.cc:224] Handling call
0709 12:14:41.360604 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.360812 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:41.502661 (+141849us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.073843 (+571182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.073904 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:42.073954 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.074022 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.074153 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18638,"prepare.queue_time_us":159320,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":29,"thread_start_us":691376,"threads_started":2}
I20260709 12:14:42.071848 19819 rpcz_store.cc:276] 0709 12:14:40.962196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.362138 (+399942us) service_pool.cc:224] Handling call
0709 12:14:41.362702 (+   564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.363140 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:41.593189 (+230049us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.067548 (+474359us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.067617 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:42.067667 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.067739 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.067885 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":218402,"prepare.queue_time_us":277222,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":6870,"thread_start_us":679654,"threads_started":2}
I20260709 12:14:42.091605 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:42.089613 19822 rpcz_store.cc:276] 0709 12:14:40.928432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.330188 (+401756us) service_pool.cc:224] Handling call
0709 12:14:41.330449 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.330641 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:41.503216 (+172575us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.077894 (+574678us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.077967 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:42.078032 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.078118 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.078298 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":708,"prepare.queue_time_us":189192,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"thread_start_us":697833,"threads_started":2,"wal-append.queue_time_us":577505}
I20260709 12:14:42.094089 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:42.095829 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:42.096652 19822 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:42.104468 22079 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:42.106389 22148 consensus_queue.cc:260] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:42.107558 22148 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:42.099035 21961 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.017s	sys 0.015s
W20260709 12:14:42.110016 21961 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.017s	sys 0.016s
I20260709 12:14:42.072587 21988 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:42.070645 22085 raft_consensus.cc:2749] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:42.049962 21957 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.119783 22034 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:42.125114 21494 consensus_meta.cc:287] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.802s	user 0.014s	sys 0.000s
I20260709 12:14:42.129752 21494 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.122696 21994 raft_consensus.cc:3055] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:14:42.180086 18407 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 19700)
W20260709 12:14:42.193787 19640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.015s	sys 0.010s
W20260709 12:14:42.194324 19746 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.091s	sys 0.108s
W20260709 12:14:42.194468 19640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.016s	sys 0.010s
W20260709 12:14:42.194898 19746 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.092s	sys 0.108s
I20260709 12:14:42.196003 19741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1282) took 1339 ms. Trace:
W20260709 12:14:42.200528 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.203217 19742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.016s	sys 0.014s
W20260709 12:14:42.203958 19742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.016s	sys 0.014s
W20260709 12:14:42.205572 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 130913us
I20260709 12:14:42.207614 19821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2121) took 1227 ms. Trace:
W20260709 12:14:42.207917 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.212262 19789 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.599s (SENT)
I20260709 12:14:42.219218 22085 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:42.216094 20396 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:42.225159 21957 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:42.139385 21994 raft_consensus.cc:740] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:42.219812 22054 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:42.123534 21685 raft_consensus.cc:3055] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:42.228755 19640 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:42.219764 21592 consensus_queue.cc:260] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.206317 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1278) took 1371 ms. Trace:
W20260709 12:14:42.234803 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.272176 21685 raft_consensus.cc:740] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:42.272506 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 57126.9us
W20260709 12:14:42.275202 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 46846.3us
W20260709 12:14:42.277331 22125 consensus_meta.cc:287] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.005s
I20260709 12:14:42.267858 19789 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:42.267874 19742 rpcz_store.cc:276] 0709 12:14:40.834948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.349954 (+515006us) service_pool.cc:224] Handling call
0709 12:14:41.350276 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:41.380861 (+ 30585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.380891 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:41.381473 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 12:14:42.205227 (+823754us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:42.205419 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.205610 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.205752 (+   142us) raft_consensus.cc:1685] finished
0709 12:14:42.205771 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.206217 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30179,"raft.queue_time_us":30897,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":131,"thread_start_us":822571,"threads_started":1,"wal-append.queue_time_us":767150}
I20260709 12:14:42.284356 21874 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:42.196966 19741 rpcz_store.cc:276] 0709 12:14:40.856184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.464953 (+608769us) service_pool.cc:224] Handling call
0709 12:14:41.465354 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.494601 (+ 29247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.494637 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.495213 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:14:41.552508 (+ 57295us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:41.552574 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.552719 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.194465 (+641746us) raft_consensus.cc:1685] finished
0709 12:14:42.194543 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.195476 (+   933us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29385,"raft.queue_time_us":28949,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":7661,"thread_start_us":56918,"threads_started":1,"wal-append.queue_time_us":554086}
I20260709 12:14:42.288658 22076 consensus_queue.cc:1059] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:42.293807 22153 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.277980 22125 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.274521 21685 consensus_queue.cc:260] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:42.347097 22054 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.348955 21685 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.350399 22054 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:42.355070 22085 raft_consensus.cc:2749] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:42.357120 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:42.359782 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:42.370153 19818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2108) took 1462 ms. Trace:
W20260709 12:14:42.375779 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 79480.4us
I20260709 12:14:42.377686 21994 consensus_queue.cc:260] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.237792 19821 rpcz_store.cc:276] 0709 12:14:40.980162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.474261 (+494099us) service_pool.cc:224] Handling call
0709 12:14:41.474640 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.474902 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:41.561975 (+ 87073us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.206388 (+644413us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.206604 (+   216us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:42.206802 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.207087 (+   285us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.207339 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76368,"prepare.queue_time_us":348640,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":83,"raft.queue_time_us":53205,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":137,"thread_start_us":644621,"threads_started":3,"wal-append.queue_time_us":520563}
I20260709 12:14:42.405690 19818 rpcz_store.cc:276] 0709 12:14:40.907454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.311261 (+403807us) service_pool.cc:224] Handling call
0709 12:14:41.311507 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.932742 (+621235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.369562 (+436820us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54001f1654. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:14:42.369946 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302461696}
W20260709 12:14:42.480181 19714 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.001s	sys 0.030s
W20260709 12:14:42.480803 19714 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.001s	sys 0.030s
W20260709 12:14:42.481254 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 607677us
W20260709 12:14:42.482718 19714 consensus_peers.cc:597] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.483723 19714 consensus_peers.cc:597] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.484589 19714 consensus_peers.cc:597] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.473657 21994 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.431315 22153 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.495271 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36936 (request call id 1777) took 1650 ms. Trace:
I20260709 12:14:42.503485 19748 rpcz_store.cc:276] 0709 12:14:40.822005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.822202 (+   197us) service_pool.cc:224] Handling call
0709 12:14:42.356534 (+1534332us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b5800135698. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:14:42.471239 (+114705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68247296}
I20260709 12:14:42.507937 19638 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:42.518467 19714 consensus_peers.cc:597] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.508054 22054 raft_consensus.cc:2804] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:42.533126 19714 consensus_peers.cc:597] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.533686 20424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60840 (request call id 607) took 1581 ms. Trace:
W20260709 12:14:42.534183 19714 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:42.535094 19820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.007s	sys 0.018s
W20260709 12:14:42.535566 19820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.018s
W20260709 12:14:42.539604 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 265913us
I20260709 12:14:42.541674 19750 raft_consensus.cc:2368] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5.
I20260709 12:14:42.506363 21874 raft_consensus.cc:697] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 6 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
W20260709 12:14:42.541388 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 263151us
I20260709 12:14:42.546482 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36936 (request call id 1778) took 1723 ms. Trace:
I20260709 12:14:42.546849 19714 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:42.552795 22175 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.553895 22153 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:42.555022 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:42.556324 19749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36936 (request call id 1768) took 1761 ms (client timeout 1920 ms). Trace:
I20260709 12:14:42.557025 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1289) took 1606 ms. Trace:
I20260709 12:14:42.550045 19750 rpcz_store.cc:276] 0709 12:14:40.822921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.823630 (+   709us) service_pool.cc:224] Handling call
0709 12:14:42.359182 (+1535552us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b5800135698. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:14:42.546403 (+187221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49833216}
I20260709 12:14:42.558853 22081 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.559151 22125 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:42.559520 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 347417us
I20260709 12:14:42.560065 22081 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:42.564371 22081 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:42.567514 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.569197 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:42.571550 21592 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:42.573722 20397 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.016s
W20260709 12:14:42.574193 20397 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.011s	sys 0.016s
I20260709 12:14:42.534308 20424 rpcz_store.cc:276] 0709 12:14:40.952336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.957710 (+  5374us) service_pool.cc:224] Handling call
0709 12:14:41.003211 (+ 45501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.024376 (+ 21165us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:42.102862 (+1078486us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b18002df100. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf81773c7 00007fadf47899a7 00007fadf47990bf
0709 12:14:42.103056 (+   194us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.532776 (+429720us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.532910 (+   134us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:42.533014 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.533172 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.533384 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25019,"prepare.queue_time_us":241296,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":48520,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":312,"spinlock_wait_cycles":14417792,"thread_start_us":626263,"threads_started":2}
I20260709 12:14:42.579908 22096 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:42.580830 22076 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:42.582798 22176 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.584033 22176 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.583351 22076 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.580997 22096 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.586642 22081 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.587453 22177 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:42.587551 22081 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:42.588918 22096 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:42.589165 22177 consensus_queue.cc:1048] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:42.591295 22081 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:42.595817 22076 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:42.538115 22054 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.606938 22054 raft_consensus.cc:3060] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:42.597625 19573 catalog_manager.cc:5697] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.598989 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:42.602497 19820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56904 (request call id 2105) took 1750 ms. Trace:
W20260709 12:14:42.560573 19789 leader_election.cc:336] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.602s (SENT)
I20260709 12:14:42.618718 19789 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:42.556842 19749 rpcz_store.cc:269] 0709 12:14:40.794453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.796061 (+  1608us) service_pool.cc:224] Handling call
0709 12:14:42.358768 (+1562707us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5800135698. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:14:42.556220 (+197452us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59416320}
W20260709 12:14:42.557096 19823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.025s	sys 0.034s
W20260709 12:14:42.621253 19823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.025s	sys 0.034s
I20260709 12:14:42.554469 21494 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:42.554080 22175 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.611853 19820 rpcz_store.cc:276] 0709 12:14:40.851709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.131805 (+280096us) service_pool.cc:224] Handling call
0709 12:14:41.132213 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:41.185393 (+ 53180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.185427 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:41.186147 (+   720us) log.cc:844] Serialized 52 byte log entry
0709 12:14:41.913953 (+727806us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b1800384280. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:14:42.538384 (+624431us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:42.549821 (+ 11437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.562814 (+ 12993us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.602041 (+ 39227us) raft_consensus.cc:1685] finished
0709 12:14:42.602061 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.602394 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35174,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":5567,"spinlock_wait_cycles":12172032,"thread_start_us":621828,"threads_started":1,"wal-append.queue_time_us":1413175}
W20260709 12:14:42.641623 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.642354 19849 heartbeater.cc:646] Failed to heartbeat to 127.17.249.254:37145 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.249.254:37145 timed out after 15.000s (SENT)
I20260709 12:14:42.644774 19715 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:42.646900 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.648595 19749 raft_consensus.cc:1275] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:42.649900 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1283) took 1719 ms. Trace:
I20260709 12:14:42.650336 19744 rpcz_store.cc:276] 0709 12:14:40.907161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.525134 (+617973us) service_pool.cc:224] Handling call
0709 12:14:41.575128 (+ 49994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.816927 (+241799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.816978 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.971122 (+154144us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.576324 (+605202us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:42.576426 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.576567 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.611408 (+ 34841us) raft_consensus.cc:1685] finished
0709 12:14:42.611429 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.626662 (+ 15233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":256884,"raft.queue_time_us":301613,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":52216,"thread_start_us":485563,"threads_started":1,"wal-append.queue_time_us":530409}
I20260709 12:14:42.631094 22081 raft_consensus.cc:2749] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:42.657269 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.658167 22030 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.664088 22146 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:42.664274 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 130248us
W20260709 12:14:42.666451 19714 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:42.667254 19714 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:42.667721 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.668536 19817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1294) took 1253 ms. Trace:
W20260709 12:14:42.669536 19714 consensus_peers.cc:597] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.669852 22125 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:42.557703 19743 rpcz_store.cc:276] 0709 12:14:40.950651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.725357 (+774706us) service_pool.cc:224] Handling call
0709 12:14:41.725682 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.725950 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:41.933541 (+207591us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.555696 (+622155us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.556083 (+   387us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.556175 (+    92us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:42.556354 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.556509 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.556779 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16052,"prepare.queue_time_us":138002,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":4114,"thread_start_us":489695,"threads_started":1}
I20260709 12:14:42.669070 19817 rpcz_store.cc:276] 0709 12:14:41.365834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.824617 (+458783us) service_pool.cc:224] Handling call
0709 12:14:41.825080 (+   463us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:41.825633 (+   553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.825673 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:41.915704 (+ 90031us) log.cc:844] Serialized 52 byte log entry
0709 12:14:42.591127 (+675423us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:42.591243 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.591368 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.611528 (+ 20160us) raft_consensus.cc:1685] finished
0709 12:14:42.611546 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.618912 (+  7366us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24162,"raft.queue_time_us":117,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":31344,"thread_start_us":445345,"threads_started":1,"wal-append.queue_time_us":600333}
I20260709 12:14:42.644891 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:42.672825 21874 consensus_queue.cc:237] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:42.673636 19714 leader_election.cc:336] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:42.674278 19714 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:42.675284 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36924 (request call id 1276) took 1841 ms. Trace:
I20260709 12:14:42.677358 22146 raft_consensus.cc:2749] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:42.675880 19746 rpcz_store.cc:276] 0709 12:14:40.834256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.382029 (+547773us) service_pool.cc:224] Handling call
0709 12:14:41.382426 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.382698 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:42.195930 (+813232us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.551267 (+355337us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.629181 (+ 77914us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.632029 (+  2848us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:42.674897 (+ 42868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.675040 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.675196 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131624,"prepare.queue_time_us":136165,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":112,"raft.queue_time_us":90900,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":28119,"thread_start_us":1007199,"threads_started":2,"wal-append.queue_time_us":400229}
W20260709 12:14:42.695266 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 134749us
I20260709 12:14:42.700803 22176 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:42.703135 19572 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47152 (request call id 258) took 15720 ms (client timeout 15000 ms). Trace:
W20260709 12:14:42.709600 20397 leader_election.cc:336] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:42.709936 20433 raft_consensus.cc:1240] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:14:42.713089 22169 log.cc:927] Time spent T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.065s	user 0.000s	sys 0.003s
I20260709 12:14:42.715534 22175 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:42.683465 22030 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:42.725749 22030 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:42.726529 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 82056.2us
I20260709 12:14:42.727420 21994 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.727835 21957 raft_consensus.cc:2804] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:42.728546 21957 raft_consensus.cc:697] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:42.728292 21994 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:42.742733 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:42.730033 21957 consensus_queue.cc:237] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:42.757704 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.762568 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.766721 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 225738us
W20260709 12:14:42.703670 19572 rpcz_store.cc:269] 0709 12:14:26.982838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.999296 (+ 16458us) service_pool.cc:224] Handling call
0709 12:14:42.693492 (+15694196us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:36.220560 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:36.315044 (+ 94484us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:36.315109 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:14:36.315134 (+    25us) tablet.cc:662] Decoding operations
0709 12:14:36.316530 (+  1396us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:36.316638 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:36.316677 (+    39us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:14:36.318106 (+  1429us) tablet.cc:701] Row locks acquired
0709 12:14:36.318144 (+    38us) write_op.cc:260] PREPARE: finished
0709 12:14:36.318383 (+   239us) write_op.cc:270] Start()
0709 12:14:36.318541 (+   158us) write_op.cc:276] Timestamp: P: 1783599276318281 usec, L: 0
0709 12:14:36.318569 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:14:36.436405 (+117836us) log.cc:844] Serialized 4827 byte log entry
0709 12:14:37.739975 (+1303570us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:14:38.336289 (+596314us) op_driver.cc:464] REPLICATION: finished
0709 12:14:38.677592 (+341303us) write_op.cc:301] APPLY: starting
0709 12:14:38.677715 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:38.678003 (+   288us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:38.678063 (+    60us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:38.867045 (+188982us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:39.035556 (+168511us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:14:39.043826 (+  8270us) write_op.cc:312] APPLY: finished
0709 12:14:39.057031 (+ 13205us) log.cc:844] Serialized 89 byte log entry
0709 12:14:39.057232 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:39.057386 (+   154us) write_op.cc:454] Released schema lock
0709 12:14:39.057435 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:39.057796 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:39.057822 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1620293,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":341000,"apply.run_cpu_time_us":6289,"apply.run_wall_time_us":380189,"num_ops":12,"prepare.queue_time_us":70557,"prepare.run_cpu_time_us":18895,"prepare.run_wall_time_us":512384,"raft.queue_time_us":350697,"raft.run_cpu_time_us":28186,"raft.run_wall_time_us":281906,"replication_time_us":2017540,"spinlock_wait_cycles":7935232,"thread_start_us":716735,"threads_started":4,"wal-append.queue_time_us":257066,"wal-append.run_cpu_time_us":68610,"wal-append.run_wall_time_us":3339252}]]}
W20260709 12:14:42.782630 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 216926us
I20260709 12:14:42.771200 22030 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.802363 19573 catalog_manager.cc:5697] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:42.835618 19788 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.648s (SENT)
I20260709 12:14:42.856066 20432 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:42.858884 22181 consensus_queue.cc:1059] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:42.861603 22161 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:42.863013 22161 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:42.869076 22167 raft_consensus.cc:3055] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:42.869855 22167 raft_consensus.cc:740] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:42.871470 22167 consensus_queue.cc:260] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.872249 19573 catalog_manager.cc:5697] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.874172 22167 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:42.827656 22030 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:42.826431 22175 consensus_queue.cc:1059] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 12:14:42.882455 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 154915us
I20260709 12:14:42.844357 22081 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.881143 21936 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:14:42.839442 22076 consensus_queue.cc:1048] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:14:42.895574 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:42.900066 22081 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:42.908999 19789 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.668s (SENT)
I20260709 12:14:42.874562 19573 catalog_manager.cc:5697] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 3 to 4, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 4 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.906605 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:42.932083 20432 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 4.
I20260709 12:14:42.932793 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:42.934602 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:42.938375 19789 leader_election.cc:336] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.772s (SENT)
I20260709 12:14:42.939109 19789 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:42.940644 19789 leader_election.cc:336] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Timed out: RequestConsensusVote RPC to 127.17.249.194:46489 timed out after 1.786s (SENT)
I20260709 12:14:42.940842 22176 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.941183 19789 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:42.941884 19823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56898 (request call id 1292) took 1576 ms. Trace:
W20260709 12:14:42.942337 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.943090 22085 raft_consensus.cc:2749] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:42.937631 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:42.943928 21874 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:42.944741 21874 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } attrs { replace: true } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:42.945505 19713 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:42.947407 21494 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:42.947873 21494 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:42.948251 21494 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:42.949640 22125 consensus_queue.cc:1048] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:42.903548 21994 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:42.941612 22176 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:42.955000 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 478164us
I20260709 12:14:42.940668 19640 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:42.904525 22161 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:42.959378 19638 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:42.974277 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 117353us
W20260709 12:14:42.978983 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.963647 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:42.942385 19823 rpcz_store.cc:276] 0709 12:14:41.365111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.819890 (+454779us) service_pool.cc:224] Handling call
0709 12:14:41.820296 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:42.621834 (+801538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.621902 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:42.622672 (+   770us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.829916 (+207244us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:42.855593 (+ 25677us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.884331 (+ 28738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.891502 (+  7171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.941617 (+ 50115us) raft_consensus.cc:1685] finished
0709 12:14:42.941637 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.941817 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43727,"prepare.queue_time_us":20209,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":119178,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":16235,"thread_start_us":934417,"threads_started":2,"wal-append.queue_time_us":271026}
I20260709 12:14:42.991955 19573 catalog_manager.cc:5697] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 1 to 2, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:42.994659 19573 catalog_manager.cc:5697] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.980290 21592 raft_consensus.cc:2804] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:43.002599 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.007325 21994 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:43.008006 21994 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:43.010711 21994 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:43.004076 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 140068us
I20260709 12:14:42.987062 22161 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:43.004645 19750 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 3.
I20260709 12:14:43.005604 21592 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.014945 21994 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.024065 20431 raft_consensus.cc:2393] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:43.024704 19573 catalog_manager.cc:5697] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 2 to 4, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 4 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:43.020011 22081 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:42.937577 22179 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.942802 22158 raft_consensus.cc:2749] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:43.039531 22102 raft_consensus.cc:2749] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:43.040762 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 81545.2us
I20260709 12:14:43.041697 19638 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:43.042330 22176 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:43.043111 22176 raft_consensus.cc:2804] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:43.043510 22176 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.043879 22176 raft_consensus.cc:3060] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:43.045513 21874 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:43.036495 22161 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.040166 19573 catalog_manager.cc:5697] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:43.050479 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:43.029016 21592 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:43.058144 19789 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:43.063841 19640 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:43.082419 19640 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:43.089775 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.128083 19573 catalog_manager.cc:5697] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:43.090914 20397 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:43.079377 22158 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:43.088647 21874 raft_consensus.cc:3060] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:43.141176 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.143461 19746 raft_consensus.cc:1813] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Handling vote request from an unknown peer f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:43.144449 19746 raft_consensus.cc:2410] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:14:43.149883 22054 consensus_meta.cc:287] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.001s
W20260709 12:14:43.151125 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 119277us
I20260709 12:14:43.151901 21494 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:43.153240 19749 raft_consensus.cc:1240] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:43.152325 19789 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:43.150359 22054 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.155174 19789 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:43.155540 20429 raft_consensus.cc:2393] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 3: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:43.155369 19638 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:43.133564 22153 raft_consensus.cc:2749] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:43.083731 21994 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:43.145954 21685 raft_consensus.cc:493] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:43.181419 18407 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 19700)
I20260709 12:14:43.145711 22030 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:43.192061 19820 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:14:43.192517 19820 pending_rounds.cc:85] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting all ops after (but not including) 5
I20260709 12:14:43.192790 19820 pending_rounds.cc:107] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:14:43.193074 19820 raft_consensus.cc:2889] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:43.199226 19819 raft_consensus.cc:1240] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Rejecting Update request from peer ca42d3c27d2e46348120791d1282b193 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:43.201973 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:43.202737 19818 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
W20260709 12:14:43.204453 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.162479 22085 raft_consensus.cc:2749] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:43.202280 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:43.181378 22158 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.243830 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:43.244801 19820 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:43.131640 22179 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:43.232102 19573 catalog_manager.cc:5697] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 3 to 4, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 4 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:43.260033 19815 raft_consensus.cc:3060] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:14:43.267369 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 271210us
I20260709 12:14:43.284981 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:43.286305 19819 raft_consensus.cc:2410] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:43.289456 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:43.290235 19822 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:43.296530 22178 raft_consensus.cc:3055] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:43.297349 22178 raft_consensus.cc:740] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:43.301783 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.260591 22085 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:43.304414 20432 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:43.308220 21494 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:43.309244 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 154009us
I20260709 12:14:43.310957 19638 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:43.311789 22076 raft_consensus.cc:2749] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:43.312422 19638 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:43.313345 22076 raft_consensus.cc:2749] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:43.313541 22175 consensus_queue.cc:1059] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:14:43.317778 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.314059 19638 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:43.235520 21685 raft_consensus.cc:515] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:43.376319 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.261018 22153 raft_consensus.cc:2749] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:43.413002 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 51154us
W20260709 12:14:43.412019 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 83798.8us
I20260709 12:14:43.332480 19573 catalog_manager.cc:5697] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:43.351213 21978 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
W20260709 12:14:43.443280 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 158734us
I20260709 12:14:43.416785 22161 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:43.430851 22096 raft_consensus.cc:2804] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:43.335431 21592 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.350366 22076 consensus_queue.cc:1059] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.101s
W20260709 12:14:43.483559 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.478912 22096 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:43.498440 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 343399us
W20260709 12:14:43.501937 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 188016us
I20260709 12:14:43.489795 22158 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:43.511699 22199 log.cc:927] Time spent T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:14:43.491873 22102 raft_consensus.cc:3055] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:43.507110 19815 raft_consensus.cc:2468] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
I20260709 12:14:43.499799 22096 raft_consensus.cc:3060] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:43.518694 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.512957 22180 raft_consensus.cc:493] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:43.533630 19749 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:43.504331 22054 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:43.546103 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 108911us
I20260709 12:14:43.516549 22153 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.550135 22148 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:43.493903 22178 consensus_queue.cc:260] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.543716 22180 raft_consensus.cc:515] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.551622 22184 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:43.551870 22207 log.cc:927] Time spent T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:14:43.550349 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.517409 22102 raft_consensus.cc:740] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:43.519104 21994 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:43.555405 19789 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:43.499133 21978 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:43.558542 22153 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:43.571319 22203 log.cc:927] Time spent T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:14:43.573243 21978 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:43.574075 22178 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:43.574666 21874 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:43.575558 22102 consensus_queue.cc:260] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:43.578981 22054 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.579411 19638 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:43.580180 22148 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.565693 22182 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:14:43.552145 22205 consensus_queue.cc:1059] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:14:43.600049 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:43.600715 19749 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:43.589547 22158 raft_consensus.cc:2749] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:43.595013 21685 leader_election.cc:290] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:43.611732 22078 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:14:43.612344 19638 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:43.612375 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 79182us
W20260709 12:14:43.616389 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:43.616389 22176 consensus_meta.cc:287] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.010s
I20260709 12:14:43.620689 22180 leader_election.cc:290] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:43.603150 22179 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:43.622434 22204 raft_consensus.cc:3055] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:43.622493 22096 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:43.628814 22167 consensus_meta.cc:287] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.734s	user 0.013s	sys 0.001s
W20260709 12:14:43.624737 22206 log.cc:927] Time spent T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.098s	user 0.002s	sys 0.000s
I20260709 12:14:43.564121 22184 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.640494 19713 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:43.648649 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:43.624331 21592 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:43.660247 22225 raft_consensus.cc:2804] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:43.660813 22225 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:43.661881 22225 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:43.635632 22204 raft_consensus.cc:740] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:43.660567 19713 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:43.663755 22204 consensus_queue.cc:260] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.665299 22204 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:43.666056 22150 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:43.666760 22150 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:43.667285 22150 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:43.667811 19789 leader_election.cc:400] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 election: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 2. Current term is 3.
I20260709 12:14:43.669237 19789 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:43.641130 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:43.650002 22218 raft_consensus.cc:3060] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:43.654978 22214 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:43.681339 20432 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:43.623751 22148 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:43.670742 19789 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:43.694361 19713 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:43.637374 22102 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:43.671525 22220 log.cc:927] Time spent T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:14:43.698452 19749 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:43.755007 21994 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:43.721444 21977 raft_consensus.cc:2804] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:43.625012 22054 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.671151 22223 raft_consensus.cc:2749] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:43.796558 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 193198us
I20260709 12:14:43.671622 21685 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.809643 21685 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:43.810272 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:43.811961 21685 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:43.775310 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:43.715111 22214 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.753512 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.745112 19640 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:43.751606 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 139430us
I20260709 12:14:43.812829 19817 raft_consensus.cc:2393] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 3: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:43.671378 22179 raft_consensus.cc:2749] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:43.814342 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 69340us
I20260709 12:14:43.671151 22225 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:43.778577 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.747171 21978 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.818836 21978 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:43.820048 22225 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:43.820771 22096 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:43.821699 21978 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:43.714524 21592 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.743709 22218 raft_consensus.cc:2749] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:43.779484 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.714769 22181 raft_consensus.cc:3055] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:43.743515 22184 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:43.748962 22212 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:43.781287 19820 consensus_meta.cc:287] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
W20260709 12:14:43.784088 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.831812 19820 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:43.783448 22150 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.777529 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:43.763342 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.754062 19743 raft_consensus.cc:1240] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:43.735839 22081 raft_consensus.cc:2749] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:43.754954 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.726291 22078 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.701715 22158 raft_consensus.cc:2749] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:43.791186 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.837612 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.793246 19789 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:43.765326 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.797708 20432 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:43.798099 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:43.799535 21977 raft_consensus.cc:697] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:43.635605 22176 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:43.817709 19640 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:43.826879 20428 raft_consensus.cc:2393] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 6: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
I20260709 12:14:43.838155 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:43.838143 19748 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
I20260709 12:14:43.864054 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:43.868628 22205 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:43.869445 22205 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:43.830873 22180 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:43.873304 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 153934us
I20260709 12:14:43.874207 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:43.876086 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 142342us
I20260709 12:14:44.079638 19638 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.082559 19789 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:44.084235 19789 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.085021 22221 raft_consensus.cc:2749] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:44.085570 19749 raft_consensus.cc:1240] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:44.085668 22221 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:44.087314 19789 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:43.876935 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.088212 22216 raft_consensus.cc:2749] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:43.826246 22181 raft_consensus.cc:740] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:44.089458 22181 consensus_queue.cc:260] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.090535 22181 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:43.878357 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.095239 19742 raft_consensus.cc:2393] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 5: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
I20260709 12:14:43.918081 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.924482 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.096724 19746 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
I20260709 12:14:43.822875 21592 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.099027 21592 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:43.925943 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:43.815562 21994 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.102008 21994 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:43.826761 22182 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:14:44.102202 22223 raft_consensus.cc:2804] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:43.940677 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:44.104185 22226 log.cc:927] Time spent T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
I20260709 12:14:44.109107 22081 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:44.109839 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:44.110126 22081 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.110529 22153 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:43.889737 22078 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.116582 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.117264 19745 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:44.123598 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:44.124219 19815 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.126223 22153 raft_consensus.cc:2804] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:44.074249 20399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.130517 19745 raft_consensus.cc:1240] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:44.129062 22153 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:44.132083 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 44870.6us
I20260709 12:14:44.132192 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:44.133846 22078 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:44.133929 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:44.135070 19822 raft_consensus.cc:2410] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:43.947551 21977 consensus_queue.cc:237] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:44.074999 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 200644us
I20260709 12:14:44.141783 19640 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:43.865460 19741 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
I20260709 12:14:43.865038 20431 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
I20260709 12:14:44.111184 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739682f97cd84854a1b009c4b2271c7b" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:44.108352 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:44.143767 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.856976 22212 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.110687 19818 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
W20260709 12:14:44.061972 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 255972us
W20260709 12:14:44.138881 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 273773us
I20260709 12:14:44.151604 19640 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:43.874747 22179 raft_consensus.cc:2804] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:44.155242 22218 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:44.081458 22085 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.132280 22153 raft_consensus.cc:3060] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.077579 22158 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.106012 22223 raft_consensus.cc:697] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
W20260709 12:14:44.165053 19788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.172313 19821 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.172878 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:44.181433 20432 raft_consensus.cc:2410] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:14:44.182982 18407 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 19700)
W20260709 12:14:44.185223 20397 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.185461 19815 raft_consensus.cc:2468] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:44.156487 19743 raft_consensus.cc:1240] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:44.142985 22054 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:44.184075 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:44.159533 22182 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:44.199576 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:44.163710 22218 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.204433 20430 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
I20260709 12:14:44.205978 22158 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.206924 22205 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:44.184403 22176 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:44.209276 22212 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:44.249688 19817 raft_consensus.cc:1240] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:44.209792 19638 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.210065 22223 consensus_queue.cc:237] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.211732 19789 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.168782 22179 raft_consensus.cc:697] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:44.214679 22081 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:44.243311 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 87538.1us
W20260709 12:14:44.243885 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:44.251564 20396 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.203998 22182 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.257699 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.227264 22218 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.268108 19820 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:44.272167 20430 raft_consensus.cc:1275] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:44.271957 22179 consensus_queue.cc:237] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.273810 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:44.276110 22158 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:44.265281 22182 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:44.278831 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.279456 22081 raft_consensus.cc:2749] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:44.280267 21592 raft_consensus.cc:2749] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:44.289800 19821 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 7.
I20260709 12:14:44.289827 22182 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.301450 22153 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:14:44.302886 22150 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:44.307514 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 123046us
W20260709 12:14:44.259428 22204 consensus_meta.cc:287] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.594s	user 0.016s	sys 0.001s
I20260709 12:14:44.178488 22085 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.310889 21874 consensus_queue.cc:1059] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:44.311533 22214 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:44.329816 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 160474us
I20260709 12:14:44.326956 19713 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:44.340338 19640 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:44.350003 20397 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:44.351159 20397 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:44.355050 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 176968us
I20260709 12:14:44.357932 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:44.365188 19816 raft_consensus.cc:1240] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:44.366381 22153 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:44.368490 22178 consensus_meta.cc:287] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: Time spent flushing consensus metadata: real 0.773s	user 0.014s	sys 0.002s
W20260709 12:14:44.371892 20397 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:44.379223 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 52358us
I20260709 12:14:44.341818 21592 raft_consensus.cc:3055] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:44.380368 21592 raft_consensus.cc:740] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:44.380039 22030 consensus_queue.cc:1048] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:44.381446 21592 consensus_queue.cc:260] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.381937 19713 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:44.383162 21957 raft_consensus.cc:2804] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:44.383601 21957 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:44.384004 21957 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.384210 22214 consensus_queue.cc:1059] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:44.385804 22204 raft_consensus.cc:3055] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:44.386297 22204 raft_consensus.cc:740] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:44.386580 22182 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:44.387427 22204 consensus_queue.cc:260] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.389137 22204 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.389771 22085 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:44.368567 19789 leader_election.cc:400] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5.
I20260709 12:14:44.396068 19789 leader_election.cc:403] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:14:44.399509 19638 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.400305 22085 raft_consensus.cc:2749] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489) with higher term. Message: Invalid argument: T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5.
I20260709 12:14:44.401170 19638 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.401769 19789 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:44.363772 21874 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:44.403977 21874 raft_consensus.cc:2804] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:44.404356 22182 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:44.405052 22182 raft_consensus.cc:697] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:44.405319 22085 raft_consensus.cc:2749] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:44.379931 22146 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:44.406262 19713 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:44.397377 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:44.396215 20397 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:44.404448 21874 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.416908 19713 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:44.382767 21592 raft_consensus.cc:3060] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:44.419345 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 55540.8us
I20260709 12:14:44.419620 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:44.421403 19713 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:44.421967 20428 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.415416 21874 raft_consensus.cc:3060] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.415270 21978 raft_consensus.cc:2804] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:44.414436 22146 raft_consensus.cc:697] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:44.434185 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:44.435495 19750 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.435748 19638 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.438118 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:44.425208 22125 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:44.468111 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:44.479290 19821 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
W20260709 12:14:44.490422 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 68763.7us
I20260709 12:14:44.491387 19638 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:44.492758 19638 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:44.506489 19750 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 7.
W20260709 12:14:44.511040 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 65255.4us
I20260709 12:14:44.511956 19640 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
W20260709 12:14:44.513010 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:44.512274 19714 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.517537 19714 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:44.470762 22125 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.483568 22241 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:44.494618 22179 raft_consensus.cc:3060] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.536618 20428 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 7.
I20260709 12:14:44.536630 19713 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:44.537817 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:44.540611 20431 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
I20260709 12:14:44.509333 21978 raft_consensus.cc:697] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:44.537447 22176 raft_consensus.cc:2804] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:44.559671 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:44.560557 20431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:44.560743 20428 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 6.
W20260709 12:14:44.553297 19714 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.561879 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:44.561923 19714 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:44.554975 22153 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:44.519704 21977 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:44.563514 21977 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.565014 21957 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.565932 21977 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:44.553093 19713 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:44.567344 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:44.568674 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:44.571007 22153 raft_consensus.cc:697] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:44.529649 22180 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:44.581913 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.533576 22125 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:44.544642 19789 connection.cc:256] RPC call timeout handler was delayed by -1.5999634740001056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 12:14:44.584055 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 91406us
I20260709 12:14:44.537963 22239 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:44.547847 22184 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:44.580014 22030 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:44.582191 22176 raft_consensus.cc:697] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:44.591096 22160 raft_consensus.cc:2804] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:44.612936 19789 connection.cc:256] RPC call timeout handler was delayed by -1.4756306169999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
W20260709 12:14:44.626016 19789 connection.cc:256] RPC call timeout handler was delayed by -1.2740146090000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260709 12:14:44.627643 19789 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:44.629001 19789 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:44.607980 20398 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:44.502926 22182 consensus_queue.cc:237] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.589866 22180 raft_consensus.cc:697] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:44.616835 19638 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.588796 21977 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:44.634697 22081 raft_consensus.cc:2764] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:44.588943 22241 raft_consensus.cc:697] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 7 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:44.627251 21957 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:44.621693 22160 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.611232 22184 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.595431 22146 consensus_queue.cc:237] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.648170 20398 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.632792 22158 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:44.635430 22030 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:44.659282 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.636963 22176 consensus_queue.cc:237] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.660225 19741 raft_consensus.cc:2393] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 6: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:44.649536 22160 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.660045 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.662475 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.662742 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.663161 19745 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 6.
I20260709 12:14:44.663501 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.657420 22191 raft_consensus.cc:2749] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:44.664179 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.664781 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.654407 22158 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.667001 22191 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.667021 22158 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.667732 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.669384 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.671005 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.667584 22191 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.674330 22191 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:44.674470 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.675676 19744 raft_consensus.cc:2410] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:44.677385 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.657435 22222 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.678716 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.679052 22222 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.680765 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:44.686748 22242 log.cc:927] Time spent T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:14:44.687875 22030 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.669315 22177 raft_consensus.cc:2804] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:44.645587 22204 raft_consensus.cc:2749] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:44.630900 22153 consensus_queue.cc:237] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:44.698567 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 92993.1us
I20260709 12:14:44.698570 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:44.644547 21978 consensus_queue.cc:237] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.700338 22214 consensus_queue.cc:1059] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:44.701189 20398 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:44.702860 19789 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:44.681399 22222 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:44.705994 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:44.707964 19816 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:44.717440 19820 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.716990 19789 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:44.718258 22085 raft_consensus.cc:2804] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:44.720175 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.725484 19750 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
I20260709 12:14:44.703848 22177 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.728893 19638 leader_election.cc:304] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:44.726478 19789 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:44.734175 19788 leader_election.cc:336] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.572s (SENT)
I20260709 12:14:44.734740 19788 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:44.736518 22177 raft_consensus.cc:3060] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:44.738022 19820 raft_consensus.cc:2468] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:44.738962 22223 raft_consensus.cc:2749] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:44.739740 19789 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.728083 20398 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.744539 20396 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:44.718748 22085 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.749540 19789 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.750764 22081 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:44.724717 22230 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:44.705964 22160 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.727587 22180 consensus_queue.cc:237] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.791909 22125 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.793476 19746 raft_consensus.cc:2393] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 6: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:44.797744 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a16e4dda0004683a44ee0708e576b6a" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:44.798834 19822 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.803944 22160 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:44.784614 22191 raft_consensus.cc:2804] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:44.805105 22191 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.805492 22191 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:44.805601 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:44.806315 19823 raft_consensus.cc:3060] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:44.811570 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 83569.5us
W20260709 12:14:44.811921 19713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:44.819490 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.819859 22184 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:44.787066 22204 raft_consensus.cc:2749] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:44.753543 22216 raft_consensus.cc:2749] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:44.757027 22212 raft_consensus.cc:2749] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:44.753418 21994 raft_consensus.cc:2749] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:44.823014 21592 raft_consensus.cc:2804] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:44.823282 22248 log.cc:927] Time spent T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:14:44.823602 21592 raft_consensus.cc:493] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:44.824110 21592 raft_consensus.cc:3060] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:44.794442 22125 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:44.828720 19823 raft_consensus.cc:2468] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 7.
I20260709 12:14:44.754211 22085 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.753340 22081 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:44.860186 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 130000us
W20260709 12:14:44.834229 22218 consensus_meta.cc:287] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.006s
W20260709 12:14:44.869124 19788 leader_election.cc:336] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.587s (SENT)
I20260709 12:14:44.894371 19788 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:44.884621 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 71712.5us
I20260709 12:14:44.872661 22230 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.893594 19822 raft_consensus.cc:2468] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:44.874547 22176 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.897248 19822 raft_consensus.cc:1275] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:44.753551 22241 consensus_queue.cc:237] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.899706 20398 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:44.893187 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:44.893945 22081 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.902621 19824 raft_consensus.cc:2468] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:44.911007 20433 raft_consensus.cc:1275] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:44.911778 20398 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:44.907195 22212 raft_consensus.cc:2749] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:44.901306 22230 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.920883 22230 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:44.898030 22218 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:44.931155 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 72447.8us
I20260709 12:14:44.932052 19713 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:44.950717 19713 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:44.951892 22125 raft_consensus.cc:2804] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:44.952534 22125 raft_consensus.cc:697] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 7 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:44.953533 22125 consensus_queue.cc:237] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.954213 20424 raft_consensus.cc:1275] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:44.955291 19638 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:44.900943 22176 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.922261 22191 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.957252 19713 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:44.910458 22158 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:44.975634 19713 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:44.976877 21494 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:44.978698 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.979636 19744 raft_consensus.cc:1275] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:44.983179 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:44.959102 22214 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:44.981199 22153 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:44.980011 21685 raft_consensus.cc:2804] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:44.962291 21957 raft_consensus.cc:2804] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:44.984104 19820 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 5.
I20260709 12:14:44.983233 19750 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 6.
I20260709 12:14:44.980317 19638 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:44.935853 22259 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:44.996121 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:44.986856 22229 raft_consensus.cc:3055] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:44.957000 22085 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.004009 21685 raft_consensus.cc:697] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:45.005120 21685 consensus_queue.cc:237] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:44.990470 22239 raft_consensus.cc:2804] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:45.011022 22239 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:45.011693 22239 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.012974 22191 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:44.998232 22229 raft_consensus.cc:740] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:45.005309 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:45.016350 19750 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:45.017416 22229 consensus_queue.cc:260] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.019317 22229 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:45.007951 20396 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
W20260709 12:14:45.021106 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.995697 21957 raft_consensus.cc:697] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:45.028801 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:45.029047 20397 leader_election.cc:336] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.030026 19824 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.027208 19638 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:45.035105 22254 raft_consensus.cc:2804] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:45.035816 21874 consensus_meta.cc:287] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.002s
I20260709 12:14:45.033852 22230 raft_consensus.cc:2804] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:45.024541 22177 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:45.113977 19788 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.697s (SENT)
I20260709 12:14:45.028710 22102 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
W20260709 12:14:45.118685 20397 leader_election.cc:336] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.120379 22254 raft_consensus.cc:697] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:45.120558 22177 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.121428 22254 consensus_queue.cc:237] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.124809 22085 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:45.129745 22081 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.032361 22160 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
W20260709 12:14:45.104856 22179 consensus_meta.cc:287] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.000s
I20260709 12:14:45.141470 22179 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:45.105372 22230 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.112090 22153 raft_consensus.cc:3060] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.140838 22081 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:45.144927 19788 leader_election.cc:336] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.703s (SENT)
I20260709 12:14:45.151293 19788 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:45.149506 19824 raft_consensus.cc:2468] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 5.
I20260709 12:14:45.135766 22102 consensus_queue.cc:1243] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer b12c250fb1a244ed9a49cf86950af1bf log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:45.114192 21874 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.158311 19750 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 7.
I20260709 12:14:45.147104 22230 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:45.171875 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 144747us
W20260709 12:14:45.183346 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 45552.2us
I20260709 12:14:45.187271 20396 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:45.188463 22167 raft_consensus.cc:2804] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:45.189003 22167 raft_consensus.cc:697] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 5 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
W20260709 12:14:45.183765 18407 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 19700)
I20260709 12:14:45.162957 22081 raft_consensus.cc:2749] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:45.197258 19788 leader_election.cc:336] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.770s (SENT)
I20260709 12:14:45.148469 21957 consensus_queue.cc:237] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.179744 22158 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:45.204555 20397 leader_election.cc:336] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:45.207149 19788 leader_election.cc:336] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.770s (SENT)
I20260709 12:14:45.207607 19788 leader_election.cc:304] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:45.211464 19714 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:45.211716 22261 log.cc:927] Time spent T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:14:45.217823 22081 raft_consensus.cc:2749] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:45.234227 22030 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:45.237254 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 325549us
I20260709 12:14:45.238639 20398 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:45.241851 19638 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:45.242643 20398 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:45.206274 22167 consensus_queue.cc:237] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.225665 21592 raft_consensus.cc:515] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.254825 21592 leader_election.cc:290] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:45.255260 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.257331 22218 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:45.243364 22204 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:45.267550 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:45.311573 20429 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:45.258985 22181 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:45.270191 22250 log.cc:927] Time spent T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.617s	user 0.018s	sys 0.043s
I20260709 12:14:45.270540 22222 raft_consensus.cc:3060] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:45.270200 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 44281.7us
I20260709 12:14:45.319365 19638 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf
W20260709 12:14:45.274154 22251 log.cc:927] Time spent T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.642s	user 0.000s	sys 0.014s
I20260709 12:14:45.276822 22176 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.279183 21874 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:45.280550 22267 log.cc:927] Time spent T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:45.320724 22176 raft_consensus.cc:2804] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:45.321501 22176 raft_consensus.cc:697] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:45.287529 19640 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:45.301170 19816 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:45.300659 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.290285 22102 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:14:45.323938 19817 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:45.308950 22180 raft_consensus.cc:493] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.258641 19789 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:45.324815 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 79192.8us
I20260709 12:14:45.321776 19638 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:45.325666 22180 raft_consensus.cc:515] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.334877 19638 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:45.336078 22102 raft_consensus.cc:2804] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:45.336161 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 48715.6us
I20260709 12:14:45.336694 22102 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:14:45.325824 22176 consensus_queue.cc:237] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.337819 19640 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:45.337487 22102 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.338876 22254 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:45.339488 22254 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.339949 22254 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:45.340377 22268 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:45.326614 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 68103.1us
I20260709 12:14:45.341883 22268 raft_consensus.cc:697] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 7 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:45.343077 22268 consensus_queue.cc:237] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:45.332325 19714 leader_election.cc:336] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.335222 22180 leader_election.cc:290] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:45.345708 19714 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:45.348461 20429 raft_consensus.cc:2468] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 6.
I20260709 12:14:45.348750 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:45.327215 22081 raft_consensus.cc:2804] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:45.359167 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:45.360033 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:45.361904 19744 raft_consensus.cc:1240] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:45.369028 19789 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:45.323182 22239 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:45.366453 22182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.014s	sys 0.003s
I20260709 12:14:45.377629 20433 pending_rounds.cc:85] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: Aborting all ops after (but not including) 4
I20260709 12:14:45.385784 20433 pending_rounds.cc:107] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:14:45.386096 20433 raft_consensus.cc:2889] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:45.377668 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:45.394307 19573 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47138 (request call id 242) took 13698 ms (client timeout 15000 ms). Trace:
I20260709 12:14:45.383077 22158 raft_consensus.cc:2804] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:45.403784 22158 raft_consensus.cc:697] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:45.403234 19570 catalog_manager.cc:5697] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 5 to 6, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 6 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.405076 22158 consensus_queue.cc:237] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.406019 22230 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:45.387105 22182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.014s	sys 0.003s
I20260709 12:14:45.405704 19570 catalog_manager.cc:5697] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 3, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 3 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.407200 20428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:45.408136 20428 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:45.361093 22081 raft_consensus.cc:493] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:45.417331 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.426240 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:45.437598 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.426393 19570 catalog_manager.cc:5697] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: config changed from index 4 to 6, VOTER f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) evicted. New cstate: current_term: 3 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.387418 21978 raft_consensus.cc:2749] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:45.447180 19788 leader_election.cc:336] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 2.030s (SENT)
I20260709 12:14:45.447731 19788 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:45.474094 22153 raft_consensus.cc:2749] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.476264 19570 catalog_manager.cc:5697] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.426602 22081 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:45.417811 22218 raft_consensus.cc:2749] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:45.482349 22204 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.494930 22232 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:45.399024 19573 rpcz_store.cc:269] 0709 12:14:31.696763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.699078 (+  2315us) service_pool.cc:224] Handling call
0709 12:14:45.394197 (+13695119us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:44.179547 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:44.212985 (+ 33438us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:44.213046 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:14:44.213067 (+    21us) tablet.cc:662] Decoding operations
0709 12:14:44.214329 (+  1262us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:44.214411 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:44.214447 (+    36us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:14:44.376805 (+162358us) tablet.cc:701] Row locks acquired
0709 12:14:44.376862 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:14:44.377036 (+   174us) write_op.cc:270] Start()
0709 12:14:44.377197 (+   161us) write_op.cc:276] Timestamp: P: 1783599284376962 usec, L: 0
0709 12:14:44.377220 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:14:44.378122 (+   902us) log.cc:844] Serialized 4445 byte log entry
0709 12:14:44.719950 (+341828us) op_driver.cc:464] REPLICATION: finished
0709 12:14:44.855189 (+135239us) write_op.cc:301] APPLY: starting
0709 12:14:44.863800 (+  8611us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:44.904218 (+ 40418us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:44.914253 (+ 10035us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:44.924576 (+ 10323us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:44.925093 (+   517us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:14:44.925164 (+    71us) write_op.cc:312] APPLY: finished
0709 12:14:44.925649 (+   485us) log.cc:844] Serialized 83 byte log entry
0709 12:14:44.925927 (+   278us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:44.926099 (+   172us) write_op.cc:454] Released schema lock
0709 12:14:44.926176 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:44.926754 (+   578us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:44.927489 (+   735us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":564563,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":127532,"apply.run_cpu_time_us":5035,"apply.run_wall_time_us":71560,"num_ops":11,"prepare.queue_time_us":395047,"prepare.run_cpu_time_us":51843,"prepare.run_wall_time_us":348523,"raft.queue_time_us":133283,"raft.run_cpu_time_us":8132,"raft.run_wall_time_us":212186,"replication_time_us":277344,"thread_start_us":467577,"threads_started":4,"wal-append.queue_time_us":127295}]]}
W20260709 12:14:45.500818 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 166064us
W20260709 12:14:45.500013 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 167700us
I20260709 12:14:45.478396 19570 catalog_manager.cc:5697] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 2 to 5, leader changed from b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:45.504067 19713 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
W20260709 12:14:45.506942 19714 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.504317 19570 catalog_manager.cc:5697] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 2 to 5, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 5 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.451581 22239 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.511344 19570 catalog_manager.cc:5697] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 3 to 4, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 4 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.521646 19570 catalog_manager.cc:5697] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:45.485965 22182 consensus_queue.cc:1059] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:14:45.526942 19570 catalog_manager.cc:5697] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 4 to 5, leader changed from b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 5 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:45.534539 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 87390.3us
I20260709 12:14:45.509950 22223 raft_consensus.cc:2749] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.547852 19570 catalog_manager.cc:5697] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:45.548935 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 45335.1us
W20260709 12:14:45.549728 19714 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.551755 20428 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 7.
I20260709 12:14:45.526448 22253 raft_consensus.cc:2804] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:45.553850 19570 catalog_manager.cc:5697] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 2 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:45.503726 22204 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.564656 19570 catalog_manager.cc:5697] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 2 to 5, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:45.580032 22180 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:45.583705 22180 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.583272 19570 catalog_manager.cc:5697] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:45.585300 19570 catalog_manager.cc:5697] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.586182 22180 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:45.598464 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:45.599445 22180 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.600039 22180 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.602309 22180 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.608572 19823 raft_consensus.cc:1275] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:45.609905 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:45.610555 19822 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.612848 22102 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:45.609956 22273 log.cc:927] Time spent T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:14:45.572207 19638 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:45.555091 19788 leader_election.cc:336] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 2.138s (SENT)
I20260709 12:14:45.623380 19788 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:45.628803 20430 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:14:45.633853 19714 leader_election.cc:336] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:45.634990 19714 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.631624 19822 raft_consensus.cc:2468] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:45.635489 19714 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:45.552948 22182 consensus_queue.cc:1243] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer ca42d3c27d2e46348120791d1282b193 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:45.641469 20432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:45.655910 19815 raft_consensus.cc:1275] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:14:45.660650 19714 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:45.662022 19714 leader_election.cc:336] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.662562 19714 leader_election.cc:304] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:45.556670 22253 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:45.564831 22222 raft_consensus.cc:2749] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:45.671185 19640 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:45.675834 20428 raft_consensus.cc:1240] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:45.677680 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:45.684753 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 156937us
W20260709 12:14:45.694077 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 139031us
W20260709 12:14:45.695257 19714 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:45.711305 19714 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.711899 19714 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:45.721621 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 50535us
I20260709 12:14:45.668514 22223 raft_consensus.cc:2749] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.678732 22253 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.706635 22254 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.738538 22254 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 8 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.685528 22150 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:45.685019 22030 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:14:45.739238 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:45.740064 19741 raft_consensus.cc:2393] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:45.742035 22222 consensus_queue.cc:1059] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:45.738672 22268 consensus_queue.cc:1048] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:45.743042 22222 raft_consensus.cc:3055] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:45.743480 22222 raft_consensus.cc:740] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:45.744464 22222 consensus_queue.cc:260] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.746100 22222 raft_consensus.cc:3060] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:45.749198 22150 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.750583 22142 consensus_queue.cc:1048] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:14:45.754150 19821 raft_consensus.cc:1240] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:45.755513 19713 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:45.756763 22150 raft_consensus.cc:2804] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:45.758848 19789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:45.765991 20397 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:45.685195 22182 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:45.767246 20397 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.768435 20397 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.769083 20397 leader_election.cc:336] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.757747 22150 raft_consensus.cc:697] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:45.713960 22225 raft_consensus.cc:2749] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.773120 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:45.777357 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e10328bf7c47c599ca08bbced8fe7e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.780120 20432 raft_consensus.cc:1240] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:45.726300 21592 raft_consensus.cc:2749] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:45.781127 22204 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.781848 22160 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:45.782013 22102 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.782629 18407 tablet_replica.cc:333] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
W20260709 12:14:45.783155 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 71903.4us
I20260709 12:14:45.784264 18407 raft_consensus.cc:2243] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:45.783619 22150 consensus_queue.cc:237] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.784914 18407 raft_consensus.cc:2272] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:45.758455 22142 consensus_queue.cc:1048] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
W20260709 12:14:45.788571 19714 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:45.789654 19714 leader_election.cc:336] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.791644 18407 tablet_replica.cc:333] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
W20260709 12:14:45.778541 20397 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.793737 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.794062 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.794759 22218 consensus_queue.cc:1059] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:45.795892 22102 raft_consensus.cc:3055] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:45.796322 22102 raft_consensus.cc:740] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:45.796525 22266 raft_consensus.cc:3055] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:45.760830 22230 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.797953 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.802073 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f15effca34f488df4f83da15c1167" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.797070 22266 raft_consensus.cc:740] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:45.798115 19822 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:45.803006 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:45.797282 22102 consensus_queue.cc:260] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.803601 22266 consensus_queue.cc:260] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.804852 22266 raft_consensus.cc:3060] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:45.804916 22102 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:45.806176 19818 raft_consensus.cc:1275] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:14:45.806579 19818 pending_rounds.cc:85] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting all ops after (but not including) 2
I20260709 12:14:45.806842 19818 pending_rounds.cc:107] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:45.797128 22225 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:45.807063 19818 raft_consensus.cc:2889] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:45.799533 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ca66c6318754a02b1dc2218db00b004" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.808532 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:45.809119 19638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:45.812160 19714 leader_election.cc:336] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.808851 19745 raft_consensus.cc:1217] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 3.2->[5.3-5.3]
I20260709 12:14:45.818813 19745 raft_consensus.cc:1240] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:14:45.819329 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:45.819695 19816 raft_consensus.cc:2393] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 8: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:45.814733 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "364cf3a27fd34a1a913602f0fdb49018" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.815896 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0057355e85a74bfa9919f82a00f3fecc" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:45.820079 19741 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:45.825515 19714 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:45.830106 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.831033 19824 raft_consensus.cc:2468] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 7.
I20260709 12:14:45.832050 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20afb18f0c024945ab458d1b8f6c62aa" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.833341 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798fecda3ed247f4941d585924251970" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:45.835141 19817 raft_consensus.cc:1240] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:45.830217 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:45.837504 19821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729536e45a0e41f181949f78e28166c2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:45.838831 19787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.840468 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3393082b24fed88cd1cc954e4e568" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.785909 22081 raft_consensus.cc:515] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:45.841931 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.849385 19817 raft_consensus.cc:1240] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:45.871645 19817 raft_consensus.cc:1275] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:45.876973 21957 consensus_queue.cc:1048] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:45.878918 22180 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.880124 19741 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 8.
I20260709 12:14:45.882936 19640 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:45.883791 19821 raft_consensus.cc:1275] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:45.884574 22268 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:45.885159 22268 raft_consensus.cc:697] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 8 LEADER]: Becoming Leader. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:45.886127 22268 consensus_queue.cc:237] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.887200 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:45.888548 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 95988.3us
W20260709 12:14:45.889286 19714 leader_election.cc:336] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:45.891121 22078 raft_consensus.cc:2749] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:45.894704 19741 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:45.900058 22254 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.900919 22254 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.903825 22176 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:45.904332 22254 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.910185 21874 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.910836 21874 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.879765 22180 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.912493 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:45.913005 21874 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.913215 22176 raft_consensus.cc:493] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.915153 22176 raft_consensus.cc:515] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:45.917276 22176 leader_election.cc:290] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.913045 22180 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:45.918713 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:45.919026 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:45.919834 22081 leader_election.cc:290] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:45.920202 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:45.920864 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:45.920248 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:45.923811 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:45.924484 19744 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:45.819700 22225 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:45.925365 19741 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
I20260709 12:14:45.927724 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:45.931627 19824 raft_consensus.cc:1275] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:45.937170 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:45.942744 20432 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:45.944295 19741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:46.005865 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:46.125864 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.949194 19713 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:46.002333 19742 raft_consensus.cc:1275] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:45.960901 19744 raft_consensus.cc:2468] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 6.
I20260709 12:14:45.978044 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:46.135618 19749 raft_consensus.cc:2393] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 6: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
I20260709 12:14:46.131917 19820 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:14:45.944114 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 247531us
I20260709 12:14:46.132323 19747 raft_consensus.cc:1240] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:45.926641 22225 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:45.987903 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:45.944149 20397 leader_election.cc:336] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:46.143517 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 201364us
I20260709 12:14:46.148277 19748 raft_consensus.cc:2393] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 8: Already voted for candidate f662c4f7d6a74013a1e58a5330a049b8 in this term.
W20260709 12:14:46.144472 20397 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:46.023465 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:46.027326 19824 raft_consensus.cc:1240] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:46.150640 19817 raft_consensus.cc:2393] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 in current term 8: Already voted for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in this term.
W20260709 12:14:46.092640 22278 log.cc:927] Time spent T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:14:46.154016 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:46.154711 19823 raft_consensus.cc:3060] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.147044 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:46.158223 20432 raft_consensus.cc:1240] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 5 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:46.163595 19820 raft_consensus.cc:2468] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
W20260709 12:14:46.165339 19788 leader_election.cc:336] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.547s (SENT)
I20260709 12:14:46.173965 19818 raft_consensus.cc:1275] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:14:46.177961 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.178859 19789 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:46.179824 22081 raft_consensus.cc:2749] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:46.181350 19789 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.182173 22081 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:46.183514 19789 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:46.183983 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:46.184840 19742 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.185264 18407 raft_consensus.cc:2243] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:46.194520 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 245431us
I20260709 12:14:45.958688 21494 consensus_queue.cc:1048] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.201s
I20260709 12:14:46.211053 19823 raft_consensus.cc:2468] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 6.
W20260709 12:14:46.187454 20397 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:46.212888 19714 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:46.221062 19714 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:46.240394 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 56924.6us
I20260709 12:14:46.212112 22142 raft_consensus.cc:2749] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:46.241189 19789 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:46.172981 22180 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:14:46.219561 22081 raft_consensus.cc:2804] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:46.217931 22222 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.259045 20432 raft_consensus.cc:1275] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:46.223737 21994 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
W20260709 12:14:46.268728 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 46334.5us
I20260709 12:14:46.257566 22158 raft_consensus.cc:2804] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:46.280184 19823 raft_consensus.cc:1275] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:46.227422 22254 consensus_queue.cc:1059] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:14:46.260769 22081 raft_consensus.cc:493] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:46.295840 20396 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.273576 21994 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:46.298811 19714 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:46.251886 22179 consensus_queue.cc:1059] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 12:14:46.307879 19714 consensus_peers.cc:597] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:46.310243 19788 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.576s (SENT)
W20260709 12:14:46.317772 19714 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:46.313030 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:46.321171 20433 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
W20260709 12:14:46.322330 19714 leader_election.cc:336] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:46.323088 19789 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:46.269587 22223 consensus_queue.cc:1048] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:14:46.337886 22158 raft_consensus.cc:697] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:46.307730 22081 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.273396 22222 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:46.311091 22254 consensus_queue.cc:1243] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer ca42d3c27d2e46348120791d1282b193 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:46.304325 21994 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:46.328245 22178 raft_consensus.cc:2804] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:46.326277 22179 consensus_queue.cc:1243] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer b12c250fb1a244ed9a49cf86950af1bf log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:46.328564 21874 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:46.379106 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 70003.1us
I20260709 12:14:46.383303 22304 consensus_queue.cc:1048] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:46.386070 22294 log.cc:927] Time spent T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.085s	user 0.001s	sys 0.002s
I20260709 12:14:46.343395 22303 consensus_queue.cc:1048] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:14:46.376513 21994 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:46.394059 22298 log.cc:927] Time spent T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:14:46.399353 22287 log.cc:927] Time spent T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:14:46.369593 22178 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.387952 21874 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:46.400326 22158 consensus_queue.cc:237] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:46.372956 22259 consensus_queue.cc:1048] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:14:46.400106 22178 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:46.381306 20396 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.393726 21994 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:46.402577 21874 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:46.431504 22259 raft_consensus.cc:2804] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:46.432232 22259 raft_consensus.cc:697] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 6 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:46.433736 18407 pending_rounds.cc:70] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8: Trying to abort 1 pending ops.
I20260709 12:14:46.434203 18407 pending_rounds.cc:77] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8: Aborting op as it isn't in flight: id { term: 5 index: 3 } timestamp: 7305622669887520768 op_type: NO_OP noop_request { }
I20260709 12:14:46.435664 22259 consensus_queue.cc:237] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:46.434715 18407 raft_consensus.cc:2889] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:46.442569 18407 raft_consensus.cc:2272] T 1a16e4dda0004683a44ee0708e576b6a P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:46.444661 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e1443af427414db7bbd4a4be3fa074" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:46.445638 19819 raft_consensus.cc:2368] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6.
I20260709 12:14:46.400348 22222 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:46.457232 22301 log.cc:927] Time spent T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:14:46.457401 19819 raft_consensus.cc:1240] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:46.416419 21994 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:46.459805 22268 raft_consensus.cc:3055] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:46.460299 22268 raft_consensus.cc:740] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:46.461139 22268 consensus_queue.cc:260] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:46.461849 22299 log.cc:927] Time spent T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:14:46.462417 22268 raft_consensus.cc:3060] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:46.477330 19822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185cd8f7a6e242a7993588e5c71850fd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:46.480489 19788 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.698s (SENT)
I20260709 12:14:46.481098 19788 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.481266 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:46.473973 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ba1229768c4d258720bb3492dde33d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:46.486076 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65b6b06871344a9bd4bbd3e34b99502" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:46.441545 22253 consensus_meta.cc:287] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193: Time spent flushing consensus metadata: real 0.671s	user 0.005s	sys 0.007s
I20260709 12:14:46.507701 19742 raft_consensus.cc:2468] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 6.
I20260709 12:14:46.499578 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:46.509819 19788 leader_election.cc:336] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 2.237s (SENT)
I20260709 12:14:46.510231 19788 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.511656 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5281957321c64f93988644f4841fbe35" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:46.459782 18407 tablet_replica.cc:333] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
W20260709 12:14:46.524410 19788 leader_election.cc:336] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:46.525168 19788 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.508663 22308 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:46.572788 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.576284 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 51931.7us
W20260709 12:14:46.580443 20398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 249787us
I20260709 12:14:46.530049 22309 raft_consensus.cc:2749] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:46.521589 22253 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:46.587822 19788 leader_election.cc:336] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 2.011s (SENT)
I20260709 12:14:46.588570 19788 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.578289 22303 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:46.596216 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 209794us
I20260709 12:14:46.605383 19745 raft_consensus.cc:2393] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 5: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:46.611599 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:46.617411 19749 raft_consensus.cc:2393] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:46.619451 22307 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.620353 22307 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:46.621343 18407 raft_consensus.cc:2243] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 7 LEADER]: Raft consensus shutting down.
W20260709 12:14:46.622502 22295 log.cc:927] Time spent T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.226s	user 0.001s	sys 0.002s
I20260709 12:14:46.609699 22158 raft_consensus.cc:2749] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:46.646308 19788 leader_election.cc:336] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Timed out: RequestConsensusVote RPC to 127.17.249.193:36713 timed out after 1.657s (SENT)
I20260709 12:14:46.704516 22178 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:46.704516 21994 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:46.714057 19788 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:46.714771 19788 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.721022 21994 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:46.724757 22081 raft_consensus.cc:515] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:46.726084 22308 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:46.727276 19817 raft_consensus.cc:1240] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Rejecting Update request from peer b12c250fb1a244ed9a49cf86950af1bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:46.729142 22307 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:46.730015 22102 raft_consensus.cc:3055] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:46.730460 22102 raft_consensus.cc:740] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:46.731503 22102 consensus_queue.cc:260] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:46.732628 22102 raft_consensus.cc:3060] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:46.734325 19788 leader_election.cc:336] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:46.737442 19788 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.743785 22253 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:46.737443 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.738986 22176 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.748540 19638 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:46.751168 20397 leader_election.cc:336] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:46.765632 19788 leader_election.cc:336] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:46.766549 19788 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:46.771981 19788 leader_election.cc:336] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:46.771878 19638 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:46.773017 19788 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.774551 19638 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:46.781087 19638 leader_election.cc:304] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:46.783111 22309 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:46.782724 19638 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
W20260709 12:14:46.784516 19788 leader_election.cc:336] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:46.785581 19788 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.786556 19638 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:46.787654 19788 leader_election.cc:336] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:46.789577 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.753662 22308 raft_consensus.cc:2749] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:46.793917 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 126110us
I20260709 12:14:46.761437 22178 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:46.830941 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 44761.7us
I20260709 12:14:46.772269 22223 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:46.832866 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.840149 22309 raft_consensus.cc:2749] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:46.831552 22182 raft_consensus.cc:2749] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:46.785291 22222 raft_consensus.cc:2749] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:46.839704 19714 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:46.845155 19638 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:46.799515 21592 raft_consensus.cc:2749] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:46.799899 22268 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 12:14:46.847097 19714 consensus_peers.cc:597] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.833515 21874 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:46.848726 19714 consensus_peers.cc:597] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:46.849560 20397 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 53708.7us
I20260709 12:14:46.844321 22223 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:46.777431 22312 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:46.779683 22316 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:46.763417 22176 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:46.860848 19638 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:46.864941 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:46.878976 19638 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:46.879971 22222 raft_consensus.cc:2804] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:46.880399 22222 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.880753 22222 raft_consensus.cc:3060] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:46.882709 22176 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:46.886119 19823 raft_consensus.cc:1275] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:46.886556 22292 log.cc:927] Time spent T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:14:46.876251 22325 log.cc:927] Time spent T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:14:46.889245 18407 raft_consensus.cc:2272] T cf852411f79143c4b7d9d087e57902ee P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:46.859817 22180 raft_consensus.cc:2749] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:46.901808 19714 consensus_peers.cc:597] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.834367 22254 consensus_queue.cc:1048] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:14:46.863270 21592 raft_consensus.cc:2749] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:46.866679 22229 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:46.877595 22081 leader_election.cc:290] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:46.910193 19638 raft_consensus.cc:2686] T 20afb18f0c024945ab458d1b8f6c62aa P f662c4f7d6a74013a1e58a5330a049b8: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:46.917135 19638 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:46.919618 22253 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.920253 22253 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:46.920985 19638 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:46.919534 22254 raft_consensus.cc:2749] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:46.922103 19638 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:46.922602 19641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.927628 22253 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:46.923842 21592 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:46.928275 22316 raft_consensus.cc:2749] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:46.929191 22332 log.cc:927] Time spent T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.169s	user 0.003s	sys 0.000s
I20260709 12:14:46.929886 19638 leader_election.cc:304] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:46.931124 19638 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:46.931833 22316 raft_consensus.cc:2749] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:46.932479 22316 raft_consensus.cc:2749] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:46.933652 19638 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:46.934331 22316 raft_consensus.cc:2749] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:46.935714 22316 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:46.936604 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f69387176614121ab470bb58987f450" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:46.938910 19638 leader_election.cc:400] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Vote denied by peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) with higher term. Message: Invalid argument: T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6.
I20260709 12:14:46.939306 19638 leader_election.cc:403] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:14:46.939896 22316 consensus_queue.cc:1059] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:46.940703 22316 raft_consensus.cc:3060] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.941012 22102 raft_consensus.cc:3055] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:46.941551 22102 raft_consensus.cc:740] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:46.946157 19743 raft_consensus.cc:1240] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:46.947827 19747 raft_consensus.cc:1240] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:46.948186 19744 raft_consensus.cc:1275] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:46.949486 19748 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:46.956846 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:46.957623 19744 raft_consensus.cc:2393] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in current term 4: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
W20260709 12:14:46.957022 19714 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 162 similar messages]
W20260709 12:14:46.959290 19714 consensus_peers.cc:597] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.954164 19638 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:46.960551 19789 leader_election.cc:304] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:46.963548 22030 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:46.918689 22229 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:46.942634 22102 consensus_queue.cc:260] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:46.965652 19789 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:46.972697 22223 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:46.966590 22030 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:46.973346 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:46.973774 22339 log.cc:927] Time spent T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:14:46.976559 21592 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.995590 22030 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:46.995410 21592 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:46.966882 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f571c10f46804596bd8b664f6181c2c8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:46.967123 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:46.997128 19748 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 7.
I20260709 12:14:46.967443 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:46.997648 21592 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:46.976720 22218 raft_consensus.cc:2749] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:46.977175 18407 tablet_replica.cc:333] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:46.986770 22254 consensus_queue.cc:1059] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:14:47.001097 22254 raft_consensus.cc:3055] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:47.001264 18407 raft_consensus.cc:2243] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.001461 22254 raft_consensus.cc:740] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:47.001919 18407 raft_consensus.cc:2272] T 5ca66c6318754a02b1dc2218db00b004 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:46.976572 22229 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:46.987311 22180 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:14:47.002411 22254 consensus_queue.cc:260] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:46.999711 22223 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.008411 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:47.009181 19816 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.004204 22254 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.014374 22310 consensus_queue.cc:1059] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:47.016213 22310 raft_consensus.cc:3055] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:47.016629 22310 raft_consensus.cc:740] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:47.017854 22310 consensus_queue.cc:260] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:47.063697 22310 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.979938 22102 raft_consensus.cc:3060] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.987739 22176 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:14:47.071498 19818 raft_consensus.cc:1275] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:46.982468 20429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:47.072827 20429 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:47.025758 18407 tablet_replica.cc:333] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:46.987423 22316 raft_consensus.cc:2749] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991) with higher term. Message: Invalid argument: T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f662c4f7d6a74013a1e58a5330a049b8 for earlier term 5. Current term is 6.
I20260709 12:14:46.992369 22222 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:47.074613 18407 raft_consensus.cc:2243] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.075671 18407 raft_consensus.cc:2272] T 62ed1b9937fd41ab83a0000603a38fc9 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.075851 22222 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 8 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:47.027079 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 56108.1us
I20260709 12:14:47.029079 20428 raft_consensus.cc:1240] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 5 LEADER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:47.030336 20424 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:47.039675 22223 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.078708 22030 consensus_queue.cc:1048] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:47.040138 20430 raft_consensus.cc:1240] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:47.041656 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:47.042105 20427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:47.043407 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062f541ef1eb40229095ed423b256495" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
W20260709 12:14:47.057512 20397 leader_election.cc:336] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.080807 18407 tablet_replica.cc:333] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:47.086331 18407 raft_consensus.cc:2243] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:47.088222 20397 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:46.965718 19714 consensus_peers.cc:597] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.089010 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 123311us
I20260709 12:14:46.970938 21994 raft_consensus.cc:2804] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:47.090487 21994 raft_consensus.cc:697] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:47.091442 21994 consensus_queue.cc:237] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:47.095372 18407 pending_rounds.cc:70] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Trying to abort 1 pending ops.
I20260709 12:14:47.095748 18407 pending_rounds.cc:77] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: Aborting op as it isn't in flight: id { term: 5 index: 7 } timestamp: 7305622670501023744 op_type: NO_OP noop_request { }
I20260709 12:14:47.096109 18407 raft_consensus.cc:2889] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:47.096436 18407 raft_consensus.cc:2272] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.097548 22218 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:47.104696 19569 catalog_manager.cc:5697] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.062085 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:47.086773 22222 consensus_queue.cc:1059] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:47.109773 22222 raft_consensus.cc:3055] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:47.110176 22222 raft_consensus.cc:740] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:47.106364 19569 catalog_manager.cc:5697] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 1 to 4, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 4 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.110949 22222 consensus_queue.cc:260] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:47.112011 22222 raft_consensus.cc:3060] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.112211 19569 catalog_manager.cc:5697] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.114197 19569 catalog_manager.cc:5697] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.116815 19569 catalog_manager.cc:5697] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 1 to 4, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 4 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:47.121838 20397 consensus_peers.cc:597] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.119297 19569 catalog_manager.cc:5697] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 2 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:47.124302 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:47.129128 19820 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:47.131158 20398 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:47.102414 20427 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:47.137162 19789 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:47.138592 22223 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:47.139207 22223 raft_consensus.cc:697] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:47.139562 19820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:47.140336 19820 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:47.140446 22223 consensus_queue.cc:237] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:47.148799 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
W20260709 12:14:47.165573 19639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.171082 19569 catalog_manager.cc:5697] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 2 to 3, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.174736 19713 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:47.177225 19569 catalog_manager.cc:5697] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 4 to 5, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.183589 22253 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:47.185233 22253 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.185660 22253 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.185335 19569 catalog_manager.cc:5697] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.187577 19569 catalog_manager.cc:5697] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 3 to 5, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.965605 19638 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:47.189538 19569 catalog_manager.cc:5697] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 4 to 5, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.190609 22102 raft_consensus.cc:2749] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:47.191476 19638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 225995us
I20260709 12:14:47.192389 19638 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:47.177549 22259 consensus_queue.cc:1048] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:14:47.199781 19569 catalog_manager.cc:5697] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 2 to 3, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.200881 19638 leader_election.cc:304] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:47.203604 19638 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:47.198729 22218 raft_consensus.cc:2749] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:47.209973 19816 raft_consensus.cc:2468] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:47.211956 20396 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:47.214529 19638 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:47.222309 19816 raft_consensus.cc:1275] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 8 FOLLOWER]: Refusing update from remote peer f662c4f7d6a74013a1e58a5330a049b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:14:47.219231 19569 catalog_manager.cc:5697] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.230535 19823 raft_consensus.cc:1240] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:14:47.226071 19816 pending_rounds.cc:85] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting all ops after (but not including) 4
I20260709 12:14:47.214206 22176 raft_consensus.cc:3060] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.248600 19816 pending_rounds.cc:107] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:14:47.214859 22316 raft_consensus.cc:2749] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:47.255952 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fed9282bd954e378bf04bb924e3e716" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:47.217689 22259 raft_consensus.cc:2804] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:47.252031 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705ac6c3557f4f89b2fe88524f96bafb" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:47.252270 19816 raft_consensus.cc:2889] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:47.220307 22254 raft_consensus.cc:2749] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.256659 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56f5017d25a447ab75b3f0cb650c9e6" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:47.275475 22253 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:47.251549 22153 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.279031 22253 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:47.279196 22153 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:47.251626 22179 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.280654 22179 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:47.281685 22153 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:47.272451 19570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53406 (request call id 126) took 5276 ms. Trace:
I20260709 12:14:47.287091 22259 raft_consensus.cc:697] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:47.288060 22259 consensus_queue.cc:237] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:47.282578 22179 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:47.282320 19570 rpcz_store.cc:276] 0709 12:14:42.045296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.191337 (+146041us) service_pool.cc:224] Handling call
0709 12:14:47.255931 (+5064594us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:46.179065 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:46.179607 (+   542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:46.179652 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:14:46.179675 (+    23us) tablet.cc:662] Decoding operations
0709 12:14:46.180956 (+  1281us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:46.181034 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:46.181060 (+    26us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:14:46.182262 (+  1202us) tablet.cc:701] Row locks acquired
0709 12:14:46.182282 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:14:46.182429 (+   147us) write_op.cc:270] Start()
0709 12:14:46.182535 (+   106us) write_op.cc:276] Timestamp: P: 1783599286182380 usec, L: 0
0709 12:14:46.182549 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:14:46.266922 (+ 84373us) log.cc:844] Serialized 5554 byte log entry
0709 12:14:46.628349 (+361427us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b540010ead4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477ae28 00007fadf81b5581 00007fadf81b4d58 00007fadf81b99f1 00007fadf81b99a9 00007fadf81b9939 00007fadf81b9901 00007fadf81b8b2d 0000000000388634 0000000000388479
0709 12:14:46.693631 (+ 65282us) op_driver.cc:464] REPLICATION: finished
0709 12:14:46.877471 (+183840us) write_op.cc:301] APPLY: starting
0709 12:14:46.894578 (+ 17107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:46.915071 (+ 20493us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:46.916661 (+  1590us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:46.964606 (+ 47945us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:46.977472 (+ 12866us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:14:46.977518 (+    46us) write_op.cc:312] APPLY: finished
0709 12:14:46.977846 (+   328us) log.cc:844] Serialized 101 byte log entry
0709 12:14:46.978023 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:46.978190 (+   167us) write_op.cc:454] Released schema lock
0709 12:14:46.978265 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:46.978605 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:46.978631 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":147929,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":162662,"apply.run_cpu_time_us":4704,"apply.run_wall_time_us":115477,"num_ops":14,"prepare.queue_time_us":470927,"prepare.run_cpu_time_us":51276,"prepare.run_wall_time_us":449476,"raft.queue_time_us":218343,"raft.run_cpu_time_us":28982,"raft.run_wall_time_us":171302,"replication_time_us":504523,"spinlock_wait_cycles":46093312,"thread_start_us":611393,"threads_started":4,"wal-append.queue_time_us":184085}]]}
I20260709 12:14:47.297360 18407 tablet_replica.cc:333] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:47.299865 22229 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:47.300972 19569 catalog_manager.cc:5697] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 1 to 3, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.327872 19569 catalog_manager.cc:5697] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 4 to 5, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:47.335083 19788 leader_election.cc:336] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.335474 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:47.336211 19788 leader_election.cc:336] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.336650 19788 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:47.337805 19788 leader_election.cc:336] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.338222 19788 leader_election.cc:304] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:47.336674 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:47.345089 19569 catalog_manager.cc:5697] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 1 to 3, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 3 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:47.347373 19788 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.347590 19569 catalog_manager.cc:5697] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 5 to 6, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 6 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.349866 19638 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:47.347955 19788 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:47.320737 22222 raft_consensus.cc:493] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.348644 22336 raft_consensus.cc:2749] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:47.357649 19788 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.353232 19638 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:47.358189 19788 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:47.359762 19638 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
W20260709 12:14:47.370537 19788 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.377261 19638 raft_consensus.cc:2686] T 1fed9282bd954e378bf04bb924e3e716 P f662c4f7d6a74013a1e58a5330a049b8: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:47.356755 21994 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:47.349151 22223 raft_consensus.cc:2749] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:47.384492 19558 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 113457us
I20260709 12:14:47.369283 22254 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:47.371234 19788 leader_election.cc:336] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.354521 22180 raft_consensus.cc:2749] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.375470 22158 raft_consensus.cc:2749] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:47.361896 22222 raft_consensus.cc:515] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:47.381152 22218 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:14:47.398375 22229 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:47.398932 22229 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.399325 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:47.406483 22176 raft_consensus.cc:2749] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:47.427330 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:47.423931 19788 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.428773 19788 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:47.430578 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 180595us
W20260709 12:14:47.431285 19788 leader_election.cc:336] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:47.432734 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 182078us
W20260709 12:14:47.433342 19788 leader_election.cc:336] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.436229 20398 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:47.438350 19742 raft_consensus.cc:1275] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:47.440531 18407 raft_consensus.cc:2243] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.446314 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e480dc321ba24a11bdd32d2f0298f2e1" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:47.480773 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 49508.2us
I20260709 12:14:47.449285 22271 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:47.485937 19788 consensus_peers.cc:597] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.488899 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 53941.2us
I20260709 12:14:47.454608 22153 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:47.494029 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fc08630dd4a7494e6acb5b859150f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:47.496034 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46881c3a8b942fcb904f98b7ac1716f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:47.490389 22344 log.cc:927] Time spent T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 12:14:47.501557 19714 consensus_peers.cc:597] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.489116 21994 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:47.503214 19714 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.513393 19714 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:47.489918 22180 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.519189 18407 raft_consensus.cc:2272] T b65b6b06871344a9bd4bbd3e34b99502 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.499603 19640 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:47.520699 19640 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:47.491918 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:47.527108 19824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:47.535019 22102 raft_consensus.cc:2749] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:47.540211 20424 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.543021 22180 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:47.545562 19558 catalog_manager.cc:4755] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 62ed1b9937fd41ab83a0000603a38fc9: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:14:47.498976 22153 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:47.548800 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:47.550913 18407 tablet_replica.cc:333] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:47.551805 19819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:47.552356 18407 raft_consensus.cc:2243] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.552707 22222 leader_election.cc:290] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:47.553241 18407 raft_consensus.cc:2272] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.554627 20426 raft_consensus.cc:2468] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 6.
I20260709 12:14:47.560102 21936 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.545605 22180 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:47.566088 22229 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:47.599509 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 96330.6us
I20260709 12:14:47.609393 21994 consensus_queue.cc:1048] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:47.611871 19789 leader_election.cc:304] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
W20260709 12:14:47.618372 19640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 97740.1us
I20260709 12:14:47.621110 22218 raft_consensus.cc:2749] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.613083 22229 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 8 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:47.550961 22153 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:47.667445 19748 raft_consensus.cc:1275] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:14:47.661952 20397 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.671774 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 182131us
I20260709 12:14:47.653527 21994 raft_consensus.cc:2804] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:47.659473 20424 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:47.672806 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da80375ede34511af0e77afa09d8640" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:47.702143 18407 tablet_replica.cc:333] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:47.686457 21994 raft_consensus.cc:697] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
W20260709 12:14:47.735278 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 51703.5us
W20260709 12:14:47.738214 20397 leader_election.cc:336] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.738596 18407 raft_consensus.cc:2243] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.742918 18407 raft_consensus.cc:2272] T e480dc321ba24a11bdd32d2f0298f2e1 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:47.740859 19714 leader_election.cc:336] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.743675 19714 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:47.745968 21994 consensus_queue.cc:237] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:47.770819 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef4176fd716e466dae3f850b4d2c258f" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:47.771126 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c81f67e1574e8eb631a5176b7276f9" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:47.776105 20424 raft_consensus.cc:1240] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Rejecting Update request from peer f662c4f7d6a74013a1e58a5330a049b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:47.779601 20424 raft_consensus.cc:1240] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:47.782359 22303 consensus_queue.cc:1059] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:47.783366 22303 raft_consensus.cc:3055] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:47.783700 22303 raft_consensus.cc:740] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:47.784595 22303 consensus_queue.cc:260] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:47.785843 22303 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.788061 18407 tablet_replica.cc:333] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:47.789127 18407 raft_consensus.cc:2243] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.789709 18407 raft_consensus.cc:2272] T c56f5017d25a447ab75b3f0cb650c9e6 P f662c4f7d6a74013a1e58a5330a049b8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.793205 19640 leader_election.cc:304] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:47.794067 22218 raft_consensus.cc:2749] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:47.796753 22102 consensus_queue.cc:1059] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:47.797860 22102 raft_consensus.cc:3055] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:47.798300 22102 raft_consensus.cc:740] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f662c4f7d6a74013a1e58a5330a049b8, State: Running, Role: LEADER
I20260709 12:14:47.799240 22102 consensus_queue.cc:260] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:47.800707 22102 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.802665 22150 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:47.804349 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 63515us
I20260709 12:14:47.816112 19640 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:47.816926 19640 raft_consensus.cc:2686] T ef4176fd716e466dae3f850b4d2c258f P f662c4f7d6a74013a1e58a5330a049b8: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:47.823171 19640 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:47.824100 22218 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.825634 18407 tablet_replica.cc:333] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
W20260709 12:14:47.830011 20397 consensus_peers.cc:597] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.833887 22158 consensus_queue.cc:1048] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:47.830852 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:47.834739 22158 consensus_queue.cc:1243] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Peer ca42d3c27d2e46348120791d1282b193 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:47.851513 18407 raft_consensus.cc:2243] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.852218 18407 raft_consensus.cc:2272] T a2ba1229768c4d258720bb3492dde33d P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.855749 19715 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324
W20260709 12:14:47.868584 19788 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.869539 19788 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:47.870076 19788 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:47.871484 18407 tablet_replica.cc:333] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:47.874416 18407 raft_consensus.cc:2243] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.875664 22150 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:47.879617 22150 raft_consensus.cc:697] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:47.880215 18407 raft_consensus.cc:2272] T 9f633905374c40ef9d178aa3de255d6f P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.880983 22150 consensus_queue.cc:237] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:47.877997 22303 raft_consensus.cc:2749] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:47.891388 19823 raft_consensus.cc:1275] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:47.895187 18407 tablet_replica.cc:333] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:47.897679 18407 raft_consensus.cc:2243] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:47.901158 18407 raft_consensus.cc:2272] T 798fecda3ed247f4941d585924251970 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.905077 22310 consensus_queue.cc:1048] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 12:14:47.920313 19788 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.926633 20398 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:47.927194 19750 raft_consensus.cc:1240] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Rejecting Update request from peer 1f9fb1b1a86c4eb99abdbaf9d239e324 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:47.925256 19742 pending_rounds.cc:85] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193: Aborting all ops after (but not including) 2
I20260709 12:14:47.930949 19742 pending_rounds.cc:107] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:47.931221 19742 raft_consensus.cc:2889] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:47.919762 22102 raft_consensus.cc:493] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:47.933485 22229 raft_consensus.cc:2749] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.942251 22102 raft_consensus.cc:515] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:47.952179 18407 tablet_replica.cc:333] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:47.953356 18407 raft_consensus.cc:2243] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:47.954509 18407 raft_consensus.cc:2272] T 2ccab10bc1b5444482abde3bf4bced52 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:47.991138 22102 leader_election.cc:290] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:47.994020 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:47.996923 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b26df664874fc9abfb63a819ba56f7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:48.007054 19640 leader_election.cc:304] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:48.010768 22102 raft_consensus.cc:2749] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:48.012667 22271 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:48.016113 22271 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:48.018491 22271 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:48.019780 18407 tablet_replica.cc:333] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.027730 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:48.055138 22102 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.055823 22102 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:48.058137 22102 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:48.060001 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:48.060400 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26992be39c764bb3bc020dd42bc74a55" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:48.066056 22102 raft_consensus.cc:493] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.071097 19640 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:48.075362 18407 raft_consensus.cc:2243] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.076692 18407 raft_consensus.cc:2272] T a78fc08630dd4a7494e6acb5b859150f P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.072710 22218 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:48.073982 22102 raft_consensus.cc:515] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:48.108177 20397 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:48.111460 20397 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:48.113982 22178 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:48.133680 22102 leader_election.cc:290] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:48.137786 19570 catalog_manager.cc:5697] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.140846 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:48.146311 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86cf843c11e474cb87f4e55acb4505d" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:48.148043 19638 leader_election.cc:304] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:48.149323 22102 raft_consensus.cc:2749] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:48.152923 20397 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:48.174180 22218 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.140384 19570 catalog_manager.cc:5697] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 4 to 6, leader changed from b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 6 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:48.200693 18407 tablet_replica.cc:333] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.204118 19570 catalog_manager.cc:5697] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.206315 19570 catalog_manager.cc:5697] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 5 to 6, leader changed from b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 6 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:48.207810 19570 catalog_manager.cc:5697] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 2 to 7, leader changed from b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 7 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:48.209394 19570 catalog_manager.cc:5697] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.211439 19570 catalog_manager.cc:5697] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:48.237819 19714 consensus_peers.cc:597] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.239593 19569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47140 (request call id 232) took 8366 ms. Trace:
I20260709 12:14:48.202040 22218 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:48.243445 18407 raft_consensus.cc:2243] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.245123 22218 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:48.246404 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:48.247201 19816 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:48.242383 19570 catalog_manager.cc:5697] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:48.257901 19638 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8; no voters: 
I20260709 12:14:48.259197 19570 catalog_manager.cc:5697] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:48.260766 19570 catalog_manager.cc:5697] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 5, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 5 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:48.262272 19570 catalog_manager.cc:5697] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 3 to 4, leader changed from b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 4 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:48.263918 19570 catalog_manager.cc:5697] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:48.242141 19569 rpcz_store.cc:276] 0709 12:14:39.873593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.873740 (+   147us) service_pool.cc:224] Handling call
0709 12:14:48.239524 (+8365784us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:47.663101 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:47.663770 (+   669us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:47.663814 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:14:47.663836 (+    22us) tablet.cc:662] Decoding operations
0709 12:14:47.665520 (+  1684us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:47.665592 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:47.665627 (+    35us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:14:47.690433 (+ 24806us) tablet.cc:701] Row locks acquired
0709 12:14:47.693310 (+  2877us) write_op.cc:260] PREPARE: finished
0709 12:14:47.736570 (+ 43260us) write_op.cc:270] Start()
0709 12:14:47.742735 (+  6165us) write_op.cc:276] Timestamp: P: 1783599287736488 usec, L: 0
0709 12:14:47.754519 (+ 11784us) op_driver.cc:348] REPLICATION: starting
0709 12:14:47.756528 (+  2009us) log.cc:844] Serialized 6796 byte log entry
0709 12:14:47.864626 (+108098us) op_driver.cc:464] REPLICATION: finished
0709 12:14:47.882562 (+ 17936us) write_op.cc:301] APPLY: starting
0709 12:14:47.882673 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:47.883193 (+   520us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:47.883377 (+   184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:48.010469 (+127092us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:48.010768 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:14:48.010849 (+    81us) write_op.cc:312] APPLY: finished
0709 12:14:48.011225 (+   376us) log.cc:844] Serialized 119 byte log entry
0709 12:14:48.011421 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:48.011613 (+   192us) write_op.cc:454] Released schema lock
0709 12:14:48.011675 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:48.066055 (+ 54380us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:48.066545 (+   490us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":809548,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":17560,"apply.run_cpu_time_us":5948,"apply.run_wall_time_us":165285,"num_ops":17,"prepare.queue_time_us":209162,"prepare.run_cpu_time_us":6116,"prepare.run_wall_time_us":102527,"replication_time_us":109874,"thread_start_us":73596,"threads_started":2}]]}
I20260709 12:14:48.265653 22180 raft_consensus.cc:2706] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Received pre-election callback for term 6 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:14:48.266497 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:48.267198 19742 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f662c4f7d6a74013a1e58a5330a049b8 in term 5.
I20260709 12:14:48.266721 18407 raft_consensus.cc:2272] T 298cdd8cc5a94e2d9165affadf233104 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.276044 20426 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:48.277952 22158 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:48.280550 20426 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:48.282253 22225 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:48.284334 18407 tablet_replica.cc:333] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.286038 18407 raft_consensus.cc:2243] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.286695 18407 raft_consensus.cc:2272] T 4dfc1fb42f6b4712acea35286ba371c3 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.305526 18407 tablet_replica.cc:333] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.307739 18407 raft_consensus.cc:2243] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.308297 18407 pending_rounds.cc:70] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8: Trying to abort 1 pending ops.
I20260709 12:14:48.308524 18407 pending_rounds.cc:77] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7305622583492722688 op_type: NO_OP noop_request { }
I20260709 12:14:48.308885 18407 raft_consensus.cc:2889] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:48.309228 18407 raft_consensus.cc:2272] T 185cd8f7a6e242a7993588e5c71850fd P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.320663 18407 tablet_replica.cc:333] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.321641 18407 raft_consensus.cc:2243] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.326977 19742 raft_consensus.cc:3060] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:48.335510 19742 raft_consensus.cc:1275] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:48.339259 18407 raft_consensus.cc:2272] T 5281957321c64f93988644f4841fbe35 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.339958 21994 consensus_queue.cc:1048] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:48.344342 21874 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.345023 21874 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:48.351055 21874 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:48.352878 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:48.356387 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd361cc5d6794bb1a8c5e6cf32a7a8fe" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:48.357982 19640 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:48.359282 22180 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:48.367962 20397 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:48.359372 18407 tablet_replica.cc:333] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.387953 18407 raft_consensus.cc:2243] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.388842 18407 raft_consensus.cc:2272] T 31e10328bf7c47c599ca08bbced8fe7e P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.406970 19818 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:14:48.407361 19818 pending_rounds.cc:85] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting all ops after (but not including) 6
I20260709 12:14:48.407591 19818 pending_rounds.cc:107] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:14:48.407856 19818 raft_consensus.cc:2889] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:48.412243 22225 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:14:48.414716 20397 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.425581 20397 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:48.443418 18407 tablet_replica.cc:333] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.452867 18407 raft_consensus.cc:2243] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.453569 18407 pending_rounds.cc:70] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8: Trying to abort 1 pending ops.
I20260709 12:14:48.453887 18407 pending_rounds.cc:77] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7305622593792045056 op_type: NO_OP noop_request { }
I20260709 12:14:48.454349 18407 raft_consensus.cc:2889] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:48.454721 18407 raft_consensus.cc:2272] T 65e1443af427414db7bbd4a4be3fa074 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:48.469627 19714 consensus_peers.cc:597] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.478081 18407 tablet_replica.cc:333] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.484018 18407 raft_consensus.cc:2243] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:48.482225 19714 consensus_peers.cc:597] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.472988 22180 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.491051 22180 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:48.493407 22180 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:48.496198 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:48.482540 22327 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:48.500567 22327 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:48.503109 22327 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:48.504609 20426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:48.505327 20426 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 7.
I20260709 12:14:48.506003 18407 raft_consensus.cc:2272] T 0057355e85a74bfa9919f82a00f3fecc P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.507705 19715 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:48.509857 18407 tablet_replica.cc:333] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.514955 22142 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:48.515460 22142 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:48.515825 22142 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.518177 21874 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.522360 22180 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.518761 21874 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:48.526103 22180 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:48.530187 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:48.531107 19816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478219fa5bde484ea1c2b7351aa260c7" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:48.533133 19638 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:48.523049 19714 consensus_peers.cc:597] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:48.535760 20397 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:48.537966 18407 raft_consensus.cc:2243] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.544842 19572 catalog_manager.cc:5697] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 2 to 4, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 4 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:48.537323 22218 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:48.546617 19572 catalog_manager.cc:5697] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 4 to 6, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 6 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:48.548692 19572 catalog_manager.cc:5697] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 2 to 4, leader changed from 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 4 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:48.537185 21874 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:48.561568 19572 catalog_manager.cc:5697] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 2 to 3, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:48.564216 21874 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.564529 19572 catalog_manager.cc:5697] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:48.564847 21874 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:48.566746 19714 consensus_peers.cc:597] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.566385 19572 catalog_manager.cc:5697] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 1 to 4, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 4 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:48.567595 19714 consensus_peers.cc:597] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.568387 19572 catalog_manager.cc:5697] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 2 to 5, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 5 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:48.569296 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ad2622957437eae185bfda331f538" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:48.569932 19714 consensus_peers.cc:597] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.579341 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:48.581144 22180 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:48.585920 19714 consensus_peers.cc:597] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:48.591168 19714 consensus_peers.cc:597] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:48.591905 19714 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:48.592890 19714 consensus_peers.cc:597] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.597743 21874 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:48.601133 22142 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:48.606635 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf852411f79143c4b7d9d087e57902ee" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:48.607435 20424 raft_consensus.cc:3060] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.571940 19572 catalog_manager.cc:5697] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 5 to 6, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 6 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:48.574926 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:48.575968 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32227fe2da84ebdaa3ba00cfe55031e" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:48.578127 22218 raft_consensus.cc:493] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b12c250fb1a244ed9a49cf86950af1bf)
I20260709 12:14:48.578876 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20aaa30e54fa432caa5875892f7b4398" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:48.612237 19640 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:48.616086 19640 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:48.621448 22218 raft_consensus.cc:515] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:48.623746 22218 leader_election.cc:290] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:48.623984 20424 raft_consensus.cc:2468] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 8.
I20260709 12:14:48.624830 22254 raft_consensus.cc:2749] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:48.625967 19715 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:48.626260 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:48.626895 19640 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:48.627005 22150 raft_consensus.cc:2804] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:48.627322 22176 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:48.627628 22150 raft_consensus.cc:697] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 8 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
W20260709 12:14:48.635725 20397 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.636466 18407 raft_consensus.cc:2272] T 729536e45a0e41f181949f78e28166c2 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.638649 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a61494383461482b9ddf0e4f6ceb4323" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:48.641193 19640 leader_election.cc:304] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
W20260709 12:14:48.643222 19714 consensus_peers.cc:597] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.628646 22150 consensus_queue.cc:237] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:48.628989 22176 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:48.644207 21874 raft_consensus.cc:2749] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:48.618757 22142 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 8 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:48.687999 19714 consensus_peers.cc:597] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:48.689270 19714 consensus_peers.cc:597] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:48.691354 19714 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:48.719020 19714 consensus_peers.cc:597] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:48.720183 19714 consensus_peers.cc:597] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:48.721298 19714 consensus_peers.cc:597] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.741952 19570 catalog_manager.cc:5697] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 3 to 5, leader changed from b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
W20260709 12:14:48.737704 19714 consensus_peers.cc:597] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.751430 19570 catalog_manager.cc:5697] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 5 to 6, leader changed from b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 6 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:48.752612 22218 raft_consensus.cc:493] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.755126 22218 raft_consensus.cc:515] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:48.757913 22218 leader_election.cc:290] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:48.759027 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:48.759895 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5895f7d8826c4e48a39f2ead181ee1bd" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:48.768998 19640 leader_election.cc:304] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:48.770619 22218 raft_consensus.cc:2749] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:48.787024 18407 tablet_replica.cc:333] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.788635 18407 raft_consensus.cc:2243] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.783205 22218 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.789449 22218 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:14:48.791685 22218 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:48.793226 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:48.794713 18407 raft_consensus.cc:2272] T 739682f97cd84854a1b009c4b2271c7b P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.793370 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bffa2c492142dcb1c6ffe4ce59bde8" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:48.797806 19638 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:48.799180 22218 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:48.801347 18407 tablet_replica.cc:333] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.801219 19572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47152 (request call id 259) took 3857 ms. Trace:
I20260709 12:14:48.802614 18407 raft_consensus.cc:2243] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.811785 18407 pending_rounds.cc:70] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: Trying to abort 1 pending ops.
I20260709 12:14:48.812067 18407 pending_rounds.cc:77] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8: Aborting op as it isn't in flight: id { term: 5 index: 4 } timestamp: 7305622584507183104 op_type: NO_OP noop_request { }
I20260709 12:14:48.812391 18407 raft_consensus.cc:2889] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:48.811324 19569 catalog_manager.cc:5697] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 3 to 6, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 6 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.812774 18407 raft_consensus.cc:2272] T e32227fe2da84ebdaa3ba00cfe55031e P f662c4f7d6a74013a1e58a5330a049b8 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.813575 19569 catalog_manager.cc:5697] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.815125 19569 catalog_manager.cc:5697] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 4 to 8, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 8 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:48.816756 19569 catalog_manager.cc:5697] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 3 to 7, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193). New cstate: current_term: 7 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } } }
I20260709 12:14:48.818604 19569 catalog_manager.cc:5697] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 2 to 6, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 6 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:48.822858 19569 catalog_manager.cc:5697] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:48.823346 18407 tablet_replica.cc:333] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.824453 18407 raft_consensus.cc:2243] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.826028 18407 raft_consensus.cc:2272] T b9b26df664874fc9abfb63a819ba56f7 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.826508 19569 catalog_manager.cc:5697] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 2 to 7, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 7 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.805217 19572 rpcz_store.cc:276] 0709 12:14:44.943192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.943463 (+   271us) service_pool.cc:224] Handling call
0709 12:14:48.800665 (+3857202us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:48.639325 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:48.642360 (+  3035us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:48.642406 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:14:48.642437 (+    31us) tablet.cc:662] Decoding operations
0709 12:14:48.649007 (+  6570us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:48.649346 (+   339us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:48.649384 (+    38us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:14:48.650064 (+   680us) tablet.cc:701] Row locks acquired
0709 12:14:48.650088 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:14:48.650262 (+   174us) write_op.cc:270] Start()
0709 12:14:48.651192 (+   930us) write_op.cc:276] Timestamp: P: 1783599288650208 usec, L: 0
0709 12:14:48.651224 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:14:48.654358 (+  3134us) log.cc:844] Serialized 3282 byte log entry
0709 12:14:48.670559 (+ 16201us) op_driver.cc:464] REPLICATION: finished
0709 12:14:48.671342 (+   783us) write_op.cc:301] APPLY: starting
0709 12:14:48.671460 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:48.671755 (+   295us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:48.671897 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:48.681995 (+ 10098us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:48.682347 (+   352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:14:48.682418 (+    71us) write_op.cc:312] APPLY: finished
0709 12:14:48.705077 (+ 22659us) log.cc:844] Serialized 65 byte log entry
0709 12:14:48.713655 (+  8578us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b540010ead4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477ae28 00007fadf81b5581 00007fadf81b4d58 00007fadf81b99f1 00007fadf81b99a9 00007fadf81b9939 00007fadf81b9901 00007fadf81b8b2d 0000000000388634 0000000000388479
0709 12:14:48.717235 (+  3580us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:48.727533 (+ 10298us) write_op.cc:454] Released schema lock
0709 12:14:48.727603 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:48.727958 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:48.727989 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":168417,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":491,"apply.run_cpu_time_us":8155,"apply.run_wall_time_us":56594,"num_ops":8,"prepare.queue_time_us":302,"prepare.run_cpu_time_us":7913,"prepare.run_wall_time_us":74525,"replication_time_us":15043,"spinlock_wait_cycles":5397888}]]}
I20260709 12:14:48.828372 19569 catalog_manager.cc:5697] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 5 to 6, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 6 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.830066 19569 catalog_manager.cc:5697] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "f662c4f7d6a74013a1e58a5330a049b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } }
I20260709 12:14:48.831300 19569 catalog_manager.cc:5697] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 4 to 5, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.832752 19569 catalog_manager.cc:5697] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.835471 18407 tablet_replica.cc:333] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
W20260709 12:14:48.836812 19714 consensus_peers.cc:597] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.840436 18407 raft_consensus.cc:2243] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.841027 18407 raft_consensus.cc:2272] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.844520 18407 tablet_replica.cc:333] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.845347 18407 raft_consensus.cc:2243] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.846167 18407 pending_rounds.cc:70] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8: Trying to abort 1 pending ops.
I20260709 12:14:48.846405 18407 pending_rounds.cc:77] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8: Aborting op as it isn't in flight: id { term: 4 index: 6 } timestamp: 7305622672881680384 op_type: NO_OP noop_request { }
I20260709 12:14:48.846766 18407 raft_consensus.cc:2889] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:48.847116 18407 raft_consensus.cc:2272] T d86cf843c11e474cb87f4e55acb4505d P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.849582 18407 tablet_replica.cc:333] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.850337 18407 raft_consensus.cc:2243] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.850946 18407 raft_consensus.cc:2272] T 478219fa5bde484ea1c2b7351aa260c7 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.854382 18407 tablet_replica.cc:333] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.855146 18407 raft_consensus.cc:2243] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:48.856164 18407 raft_consensus.cc:2272] T f055e0ff3254433f83caca3e0e190a4c P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.858978 22218 raft_consensus.cc:493] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.859468 22218 raft_consensus.cc:515] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:48.862561 18407 tablet_replica.cc:333] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.863382 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:48.863960 22218 leader_election.cc:290] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:48.864773 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f602836b3181405ca03967cbb5c11bc2" candidate_uuid: "f662c4f7d6a74013a1e58a5330a049b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:48.863432 18407 raft_consensus.cc:2243] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.868956 18407 pending_rounds.cc:70] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8: Trying to abort 1 pending ops.
I20260709 12:14:48.869216 18407 pending_rounds.cc:77] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7305622599105679360 op_type: NO_OP noop_request { }
I20260709 12:14:48.869566 18407 raft_consensus.cc:2889] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:48.869917 18407 raft_consensus.cc:2272] T e46881c3a8b942fcb904f98b7ac1716f P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.872545 18407 tablet_replica.cc:333] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.873368 18407 raft_consensus.cc:2243] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.873230 19638 leader_election.cc:304] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f662c4f7d6a74013a1e58a5330a049b8; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf
I20260709 12:14:48.877928 22218 raft_consensus.cc:2749] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:48.878983 18407 raft_consensus.cc:2272] T 364cf3a27fd34a1a913602f0fdb49018 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.900774 18407 tablet_replica.cc:333] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.901607 18407 raft_consensus.cc:2243] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.902156 18407 pending_rounds.cc:70] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8: Trying to abort 1 pending ops.
I20260709 12:14:48.902390 18407 pending_rounds.cc:77] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305622582334623744 op_type: NO_OP noop_request { }
W20260709 12:14:48.902693 19714 consensus_peers.cc:597] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:48.902746 18407 raft_consensus.cc:2889] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:48.903738 18407 raft_consensus.cc:2272] T 8f69387176614121ab470bb58987f450 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.906358 18407 tablet_replica.cc:333] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.907179 18407 raft_consensus.cc:2243] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:14:48.908116 18407 raft_consensus.cc:2272] T dc5e311340504d31a6b1704b5459afa8 P f662c4f7d6a74013a1e58a5330a049b8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.913550 18407 tablet_replica.cc:333] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.914932 18407 raft_consensus.cc:2243] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:48.916006 18407 raft_consensus.cc:2272] T 3efb146893bc46c5b42e3fc209a2135d P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.918802 18407 tablet_replica.cc:333] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.919658 18407 raft_consensus.cc:2243] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.920648 18407 raft_consensus.cc:2272] T 9a2ad2622957437eae185bfda331f538 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:48.930936 19558 catalog_manager.cc:4755] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 62ed1b9937fd41ab83a0000603a38fc9: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:14:48.938885 18407 tablet_replica.cc:333] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.939842 18407 raft_consensus.cc:2243] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:48.940873 18407 raft_consensus.cc:2272] T 1c3fa3feedde422fbce04c9f6ab16f44 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.940506 19569 catalog_manager.cc:5697] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 7 to 8, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 8 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.943993 18407 tablet_replica.cc:333] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.944819 18407 raft_consensus.cc:2243] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.945703 18407 raft_consensus.cc:2272] T a61494383461482b9ddf0e4f6ceb4323 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.950011 18407 tablet_replica.cc:333] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.950865 18407 raft_consensus.cc:2243] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.951464 18407 raft_consensus.cc:2272] T f602836b3181405ca03967cbb5c11bc2 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.954361 18407 tablet_replica.cc:333] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.955204 18407 raft_consensus.cc:2243] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.955701 18407 raft_consensus.cc:2272] T 20aaa30e54fa432caa5875892f7b4398 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.959030 18407 tablet_replica.cc:333] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.960397 18407 raft_consensus.cc:2243] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.960950 18407 pending_rounds.cc:70] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8: Trying to abort 1 pending ops.
I20260709 12:14:48.961202 18407 pending_rounds.cc:77] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8: Aborting op as it isn't in flight: id { term: 5 index: 7 } timestamp: 7305622671932432384 op_type: NO_OP noop_request { }
I20260709 12:14:48.961563 18407 raft_consensus.cc:2889] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:48.961872 18407 raft_consensus.cc:2272] T 8da80375ede34511af0e77afa09d8640 P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.964674 18407 tablet_replica.cc:333] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.965446 18407 raft_consensus.cc:2243] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.965994 18407 raft_consensus.cc:2272] T 705ac6c3557f4f89b2fe88524f96bafb P f662c4f7d6a74013a1e58a5330a049b8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.968811 18407 tablet_replica.cc:333] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.969889 18407 raft_consensus.cc:2243] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.970513 18407 raft_consensus.cc:2272] T def3393082b24fed88cd1cc954e4e568 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.974356 18407 tablet_replica.cc:333] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.975121 18407 raft_consensus.cc:2243] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.975880 18407 raft_consensus.cc:2272] T 26992be39c764bb3bc020dd42bc74a55 P f662c4f7d6a74013a1e58a5330a049b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.978446 18407 tablet_replica.cc:333] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.979158 18407 raft_consensus.cc:2243] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.979964 18407 raft_consensus.cc:2272] T 871f15effca34f488df4f83da15c1167 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.982456 18407 tablet_replica.cc:333] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.983230 18407 raft_consensus.cc:2243] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.983851 18407 raft_consensus.cc:2272] T f571c10f46804596bd8b664f6181c2c8 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:48.986626 18407 tablet_replica.cc:333] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:48.989233 18407 raft_consensus.cc:2243] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:48.995020 18407 raft_consensus.cc:2272] T bc8e96dba8054da2a8d0b930ae6a53a0 P f662c4f7d6a74013a1e58a5330a049b8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.021080 18407 tablet_replica.cc:333] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:49.022014 18407 raft_consensus.cc:2243] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.022922 18407 pending_rounds.cc:70] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8: Trying to abort 1 pending ops.
I20260709 12:14:49.023212 18407 pending_rounds.cc:77] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8: Aborting op as it isn't in flight: id { term: 3 index: 6 } timestamp: 7305622669974925312 op_type: NO_OP noop_request { }
I20260709 12:14:49.023600 18407 raft_consensus.cc:2889] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:49.023967 18407 raft_consensus.cc:2272] T 5895f7d8826c4e48a39f2ead181ee1bd P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.027097 18407 tablet_replica.cc:333] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:49.027879 18407 raft_consensus.cc:2243] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:49.029085 18407 raft_consensus.cc:2272] T 186a44ea95974c119996690984996f55 P f662c4f7d6a74013a1e58a5330a049b8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.055477 18407 tablet_replica.cc:333] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:49.056367 18407 raft_consensus.cc:2243] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.058537 18407 raft_consensus.cc:2272] T d7c81f67e1574e8eb631a5176b7276f9 P f662c4f7d6a74013a1e58a5330a049b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:49.062019 18407 tablet_replica.cc:333] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8: stopping tablet replica
I20260709 12:14:49.069707 18407 raft_consensus.cc:2243] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:49.070318 18407 raft_consensus.cc:2272] T 70bffa2c492142dcb1c6ffe4ce59bde8 P f662c4f7d6a74013a1e58a5330a049b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:49.094434 19714 consensus_peers.cc:597] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:49.164420 22229 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:49.165225 22229 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:49.170387 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:49.175868 20397 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:49.176383 20397 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:49.177318 22271 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:49.178366 22229 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:49.242357 21994 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:49.243158 21994 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:49.250124 19788 leader_election.cc:336] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:49.252737 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:49.253872 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:49.255864 19789 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:49.257189 22378 raft_consensus.cc:2749] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:49.261883 20425 raft_consensus.cc:1275] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:49.264042 22225 consensus_queue.cc:1048] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:49.257236 21994 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:49.272787 21977 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:49.273414 21977 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:49.275717 21977 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:49.277505 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:49.278441 20424 raft_consensus.cc:2393] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca42d3c27d2e46348120791d1282b193 in current term 8: Already voted for candidate b12c250fb1a244ed9a49cf86950af1bf in this term.
W20260709 12:14:49.280133 19714 leader_election.cc:336] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:49.280754 19715 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: b12c250fb1a244ed9a49cf86950af1bf, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:49.281626 21977 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:49.308439 21977 raft_consensus.cc:2749] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:49.350327 22229 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:49.351276 22229 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:49.357342 22229 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:49.383235 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:49.384269 19823 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 6.
I20260709 12:14:49.419386 22150 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
W20260709 12:14:49.422005 20397 leader_election.cc:336] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:49.437012 19714 consensus_peers.cc:597] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:49.438472 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:49.439239 19748 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 6.
I20260709 12:14:49.420284 22150 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:49.446198 22150 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:49.448549 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:49.449448 20425 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:49.452809 19715 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:49.470659 20398 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:49.472534 22229 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:49.473032 22229 raft_consensus.cc:493] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:49.473435 22229 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:49.473706 19714 consensus_peers.cc:597] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:49.460800 22150 raft_consensus.cc:2804] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:49.479173 22150 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:49.479677 22150 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:49.483584 22229 raft_consensus.cc:515] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:49.490193 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:49.490970 19823 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:49.500912 22229 leader_election.cc:290] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:49.506714 20397 leader_election.cc:336] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:49.507359 19823 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 7.
I20260709 12:14:49.511687 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f633905374c40ef9d178aa3de255d6f" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:49.512425 19748 raft_consensus.cc:3060] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:49.511749 19714 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:49.511770 22150 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:49.518482 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccab10bc1b5444482abde3bf4bced52" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:49.519124 20425 raft_consensus.cc:3060] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:49.525031 19748 raft_consensus.cc:2468] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 7.
I20260709 12:14:49.527868 20425 raft_consensus.cc:2468] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:49.529464 19715 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:49.530380 22387 raft_consensus.cc:2804] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:49.530942 22387 raft_consensus.cc:697] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:49.531893 22387 consensus_queue.cc:237] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:49.537765 22150 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:49.546834 20398 leader_election.cc:304] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:49.555279 22229 raft_consensus.cc:2804] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:49.556937 22229 raft_consensus.cc:697] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 7 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:49.558048 22229 consensus_queue.cc:237] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:49.562062 19714 consensus_peers.cc:597] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.592433 19714 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:49.628619 19569 catalog_manager.cc:5697] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 5 to 6, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 6 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:49.650909 22388 log.cc:927] Time spent T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:14:49.697870 19572 catalog_manager.cc:5697] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 6 to 7, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 7 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:49.719198 19714 consensus_peers.cc:597] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.723104 19714 consensus_peers.cc:597] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.846016 19714 consensus_peers.cc:597] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.855494 20397 consensus_peers.cc:597] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:49.863471 22378 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:49.864204 22378 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:49.868279 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
W20260709 12:14:49.874359 19788 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:49.874862 19788 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:49.875578 22378 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:49.876190 21994 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:49.898300 19788 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.903164 19714 consensus_peers.cc:597] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.954838 19714 consensus_peers.cc:597] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:50.002955 22378 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.003614 22378 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:50.012638 19788 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.013420 22378 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:50.015722 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:50.023413 19789 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:50.024645 22378 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:50.022603 19558 catalog_manager.cc:4755] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 62ed1b9937fd41ab83a0000603a38fc9: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.056478 19818 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:50.057729 22150 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.058311 22150 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:50.060446 22150 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:50.062599 22271 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:50.067108 19788 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:50.074046 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:50.074755 19818 raft_consensus.cc:2468] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 3.
W20260709 12:14:50.076256 20397 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:50.077033 19713 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:50.078137 22387 raft_consensus.cc:2804] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:50.078612 22387 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.079061 22387 raft_consensus.cc:3060] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:50.080374 20397 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:50.089324 22229 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:50.084137 19714 consensus_peers.cc:597] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:50.092707 19714 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.090113 22229 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:50.098249 22229 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:50.109341 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:50.110123 19748 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 8.
I20260709 12:14:50.121387 22387 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:50.125221 20397 leader_election.cc:336] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:50.126834 19788 consensus_peers.cc:597] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:50.127311 20398 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:50.128687 22271 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:50.129180 22271 raft_consensus.cc:493] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.129628 22271 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:50.130213 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efb146893bc46c5b42e3fc209a2135d" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:50.130920 19823 raft_consensus.cc:3060] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:50.131590 21977 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.132251 21977 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:50.134683 21977 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:50.135996 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:50.136807 19818 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 8.
I20260709 12:14:50.137821 22271 raft_consensus.cc:515] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:50.138149 19713 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:50.139292 21977 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:50.139963 21977 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.140564 21977 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:50.142726 22387 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:50.144512 22229 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.145381 22229 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:50.158887 22150 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.159525 22150 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:50.161595 22150 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:50.165810 20397 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.166448 22271 leader_election.cc:290] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:50.167092 22271 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.167578 22271 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:50.169169 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:50.170017 20424 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:50.170920 22390 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.171571 22390 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:50.173331 19714 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:50.173918 19714 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.175101 19715 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:50.176268 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:50.176479 22225 raft_consensus.cc:2804] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:50.176956 22225 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.176985 19818 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:50.177507 22225 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:50.178694 19713 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:50.174008 22390 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:50.180778 22150 raft_consensus.cc:2804] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:50.181226 22150 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.181561 22150 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:50.183344 22229 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:50.187458 20397 leader_election.cc:336] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.192296 22271 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:50.169129 21977 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:50.199307 20397 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.204258 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e96dba8054da2a8d0b930ae6a53a0" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:50.205441 19748 raft_consensus.cc:3060] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:50.200532 19823 raft_consensus.cc:2468] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:50.213156 19748 raft_consensus.cc:2468] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 9.
I20260709 12:14:50.214548 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:50.215324 19750 raft_consensus.cc:1275] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:50.214216 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:50.203348 22390 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.219954 22390 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:50.218537 22225 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:50.221201 20425 raft_consensus.cc:1275] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:50.221771 19742 raft_consensus.cc:2393] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b12c250fb1a244ed9a49cf86950af1bf in current term 6: Already voted for candidate ca42d3c27d2e46348120791d1282b193 in this term.
I20260709 12:14:50.218112 19713 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:50.222575 22390 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:50.223320 22390 raft_consensus.cc:2804] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:50.223824 22390 raft_consensus.cc:697] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:50.227063 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:50.227880 22225 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:50.217913 21977 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 9 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:50.230609 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5e311340504d31a6b1704b5459afa8" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:50.231998 19823 raft_consensus.cc:3060] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:50.231356 19714 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.236236 20398 leader_election.cc:304] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:50.237703 20398 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:50.238405 22229 raft_consensus.cc:2804] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:50.238775 22399 consensus_queue.cc:1048] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:50.240545 22399 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:50.244772 20398 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:50.244928 19823 raft_consensus.cc:2468] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 9.
I20260709 12:14:50.246347 19713 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:50.241519 22229 raft_consensus.cc:697] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 9 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:50.249122 22271 raft_consensus.cc:3060] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:50.250418 19714 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.250223 22229 consensus_queue.cc:237] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:50.251929 19714 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.224774 22390 consensus_queue.cc:237] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:50.272732 19714 leader_election.cc:336] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.273789 19714 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca42d3c27d2e46348120791d1282b193; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:50.280026 19714 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:50.272641 19715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 46345.8us
I20260709 12:14:50.280838 22387 raft_consensus.cc:2749] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:50.272830 22402 raft_consensus.cc:2804] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:50.304399 22402 raft_consensus.cc:697] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 9 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:50.305441 22402 consensus_queue.cc:237] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:50.297292 22400 consensus_queue.cc:1048] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:14:50.309055 19572 catalog_manager.cc:5697] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 3 to 4, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 4 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:50.318460 18407 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19696)
I20260709 12:14:50.294723 22150 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:50.317389 22271 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:50.342044 22150 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:50.333745 20425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f055e0ff3254433f83caca3e0e190a4c" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
W20260709 12:14:50.350997 20397 consensus_peers.cc:597] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:50.356383 22387 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.357095 22387 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:50.364024 22387 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:50.365470 20424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:50.375550 20424 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 4.
I20260709 12:14:50.394637 20425 raft_consensus.cc:2468] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:50.424701 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298cdd8cc5a94e2d9165affadf233104" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:50.425585 19818 raft_consensus.cc:3060] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:50.464285 19715 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:50.466813 19818 raft_consensus.cc:2468] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 6.
I20260709 12:14:50.480089 19715 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:50.491871 19569 catalog_manager.cc:5697] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 7 to 9, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 9 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:50.496476 22405 raft_consensus.cc:2804] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:50.497265 22405 raft_consensus.cc:697] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:50.498252 22405 consensus_queue.cc:237] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:50.507718 22415 raft_consensus.cc:2804] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:50.508460 22415 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.508884 22415 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:50.515137 22378 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.515995 22378 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:50.518947 22378 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:50.532879 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 50761.3us
I20260709 12:14:50.565683 19713 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:50.577279 22415 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:50.583923 20397 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.587833 19788 leader_election.cc:336] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.593981 22405 raft_consensus.cc:2804] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:50.594630 22405 raft_consensus.cc:697] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:50.595631 22405 consensus_queue.cc:237] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:50.603065 19788 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:50.609130 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3fa3feedde422fbce04c9f6ab16f44" candidate_uuid: "ca42d3c27d2e46348120791d1282b193" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
W20260709 12:14:50.609498 19714 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.609956 20430 raft_consensus.cc:3060] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:50.610726 19714 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.613051 22415 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:50.626905 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193" is_pre_election: true
I20260709 12:14:50.627555 19750 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
W20260709 12:14:50.644764 20397 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:50.652364 20430 raft_consensus.cc:2468] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca42d3c27d2e46348120791d1282b193 in term 5.
I20260709 12:14:50.653751 19715 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193; no voters: 
I20260709 12:14:50.654881 22405 raft_consensus.cc:2804] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:50.655706 22405 raft_consensus.cc:697] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Becoming Leader. State: Replica: ca42d3c27d2e46348120791d1282b193, State: Running, Role: LEADER
I20260709 12:14:50.657024 22405 consensus_queue.cc:237] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:50.661512 19789 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:50.662983 22424 raft_consensus.cc:2804] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:50.663430 22424 raft_consensus.cc:493] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f662c4f7d6a74013a1e58a5330a049b8)
I20260709 12:14:50.663810 22424 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:50.672224 22424 raft_consensus.cc:515] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:50.689759 19788 leader_election.cc:336] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.696511 22424 leader_election.cc:290] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Requested vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:50.703328 19714 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:50.711310 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186a44ea95974c119996690984996f55" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca42d3c27d2e46348120791d1282b193"
I20260709 12:14:50.711910 19750 raft_consensus.cc:3060] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:50.719609 19750 raft_consensus.cc:2468] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 6.
I20260709 12:14:50.726274 19789 leader_election.cc:304] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193; no voters: f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:50.727650 22424 raft_consensus.cc:2804] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:50.728163 22424 raft_consensus.cc:697] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:50.729013 22424 consensus_queue.cc:237] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:50.747285 19714 consensus_peers.cc:597] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:50.747978 19714 consensus_peers.cc:597] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:50.784176 19815 raft_consensus.cc:1275] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:50.796931 19569 catalog_manager.cc:5697] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 8 to 9, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 9 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.799561 19569 catalog_manager.cc:5697] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 5 to 6, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 6 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.801749 19569 catalog_manager.cc:5697] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.803987 19569 catalog_manager.cc:5697] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 reported cstate change: term changed from 4 to 5, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to ca42d3c27d2e46348120791d1282b193 (127.17.249.194). New cstate: current_term: 5 leader_uuid: "ca42d3c27d2e46348120791d1282b193" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.820366 19572 catalog_manager.cc:5697] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 5 to 6, leader changed from f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 6 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:50.824959 19714 consensus_peers.cc:597] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:50.835973 19748 raft_consensus.cc:1275] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 9 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:50.837829 22399 consensus_queue.cc:1048] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:14:50.842303 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 48232.7us
I20260709 12:14:50.852360 22415 consensus_queue.cc:1048] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:14:50.871758 20397 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.932837 19714 consensus_peers.cc:597] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:50.987051 19714 consensus_peers.cc:597] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:51.003554 19815 raft_consensus.cc:1275] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:51.013168 22410 consensus_queue.cc:1048] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:14:51.028565 19714 consensus_peers.cc:597] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:51.036533 19823 raft_consensus.cc:1275] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:14:51.039529 19714 consensus_peers.cc:597] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.070511 22150 consensus_queue.cc:1048] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:14:51.080394 20430 raft_consensus.cc:1275] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:51.082799 22423 consensus_queue.cc:1048] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:14:51.088104 20397 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:51.126441 20397 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.136999 20397 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:51.199287 19714 consensus_peers.cc:597] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.199914 19714 consensus_peers.cc:597] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.200886 19714 consensus_peers.cc:597] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.201313 19714 consensus_peers.cc:597] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.201671 19714 consensus_peers.cc:597] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.202028 19714 consensus_peers.cc:597] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.230175 19714 consensus_peers.cc:597] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.251123 19714 consensus_peers.cc:597] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.255865 19714 consensus_peers.cc:597] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.256371 19714 consensus_peers.cc:597] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:51.258914 20426 raft_consensus.cc:1275] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Refusing update from remote peer ca42d3c27d2e46348120791d1282b193: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:51.261786 22414 consensus_queue.cc:1048] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:14:51.264515 19714 consensus_peers.cc:597] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.265053 19714 consensus_peers.cc:597] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.290977 19714 consensus_peers.cc:597] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.306921 20397 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:51.319003 18407 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 19696)
I20260709 12:14:51.329867 19750 raft_consensus.cc:1275] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:14:51.331223 19788 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.332844 22424 consensus_queue.cc:1048] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:14:51.387996 19714 consensus_peers.cc:597] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.485183 19714 consensus_peers.cc:597] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.488700 19714 consensus_peers.cc:597] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.654309 19714 consensus_peers.cc:597] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:51.666188 19714 consensus_peers.cc:597] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.957218 19714 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111) [suppressed 437 similar messages]
W20260709 12:14:52.028577 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 51609.8us
W20260709 12:14:52.144667 19714 consensus_peers.cc:597] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.145254 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 45139.5us
W20260709 12:14:52.163440 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 50039.5us
W20260709 12:14:52.164214 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:46489, user_credentials={real_user=slave}} blocked reactor thread for 104714us
W20260709 12:14:52.177260 19714 consensus_peers.cc:597] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.213617 20396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 46745us
W20260709 12:14:52.204186 19558 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 89856.1us
W20260709 12:14:52.238071 19558 catalog_manager.cc:4755] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 62ed1b9937fd41ab83a0000603a38fc9: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:52.259745 19714 consensus_peers.cc:597] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.260845 19714 consensus_peers.cc:597] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:52.296442 19713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:42991, user_credentials={real_user=slave}} blocked reactor thread for 75674.2us
W20260709 12:14:52.319586 18407 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 19696)
W20260709 12:14:52.334767 19714 consensus_peers.cc:597] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.342409 20397 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:52.365428 19714 consensus_peers.cc:597] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.389405 20397 consensus_peers.cc:597] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.510509 20397 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.588867 19788 consensus_peers.cc:597] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.618064 19788 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.695629 19714 consensus_peers.cc:597] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.746893 19788 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.825713 19714 consensus_peers.cc:597] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.884298 19714 consensus_peers.cc:597] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.964373 20397 consensus_peers.cc:597] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:53.050714 20397 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:53.199807 19788 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:53.234956 20397 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:53.602284 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 189207us
W20260709 12:14:53.816196 19714 consensus_peers.cc:597] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.820412 19714 consensus_peers.cc:597] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.820842 19714 consensus_peers.cc:597] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:53.821183 19714 consensus_peers.cc:597] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.879599 19714 consensus_peers.cc:597] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.882673 19714 consensus_peers.cc:597] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:53.884125 19714 consensus_peers.cc:597] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:53.886986 19714 consensus_peers.cc:597] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:53.887511 19714 consensus_peers.cc:597] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.887962 19714 consensus_peers.cc:597] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.888427 19714 consensus_peers.cc:597] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.888859 19714 consensus_peers.cc:597] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.899112 19714 consensus_peers.cc:597] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.901180 20397 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:53.904559 20397 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:53.905524 20397 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.905995 20397 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:53.911458 19714 consensus_peers.cc:597] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.918074 19714 consensus_peers.cc:597] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.918916 19714 consensus_peers.cc:597] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.919546 19714 consensus_peers.cc:597] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.026737 19714 consensus_peers.cc:597] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:54.139799 18407 tablet_server.cc:196] TabletServer@127.17.249.193:0 shutdown complete.
W20260709 12:14:54.175129 19845 debug-util.cc:398] Leaking SignalData structure 0x7b08001915c0 after lost signal to thread 18410
W20260709 12:14:54.176499 19845 debug-util.cc:398] Leaking SignalData structure 0x7b0800191560 after lost signal to thread 19607
W20260709 12:14:54.177932 19845 debug-util.cc:398] Leaking SignalData structure 0x7b08001a8740 after lost signal to thread 19774
W20260709 12:14:54.188014 19845 debug-util.cc:398] Leaking SignalData structure 0x7b080016e040 after lost signal to thread 19848
W20260709 12:14:54.190274 19845 debug-util.cc:398] Leaking SignalData structure 0x7b080032e5c0 after lost signal to thread 20457
W20260709 12:14:54.237012 19714 consensus_peers.cc:597] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.263595 20397 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:54.271768 19714 consensus_peers.cc:597] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:54.302850 19788 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:54.348225 18407 tablet_server.cc:179] TabletServer@127.17.249.194:0 shutting down...
W20260709 12:14:54.358985 19714 consensus_peers.cc:597] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.377475 19714 consensus_peers.cc:597] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.378041 19714 consensus_peers.cc:597] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.474313 19714 consensus_peers.cc:597] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.495601 19714 consensus_peers.cc:597] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:54.495627 19789 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.548986 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:54.550324 18407 tablet_replica.cc:333] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.551468 18407 raft_consensus.cc:2243] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.552641 18407 raft_consensus.cc:2272] T b65b6b06871344a9bd4bbd3e34b99502 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.557684 18407 tablet_replica.cc:333] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.558988 18407 raft_consensus.cc:2243] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.560372 18407 raft_consensus.cc:2272] T cf852411f79143c4b7d9d087e57902ee P ca42d3c27d2e46348120791d1282b193 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.564042 18407 tablet_replica.cc:333] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.565065 18407 raft_consensus.cc:2243] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.566243 18407 raft_consensus.cc:2272] T 5ca66c6318754a02b1dc2218db00b004 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.569608 18407 tablet_replica.cc:333] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.570649 18407 raft_consensus.cc:2243] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.571952 18407 raft_consensus.cc:2272] T 62ed1b9937fd41ab83a0000603a38fc9 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.575105 18407 tablet_replica.cc:333] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.576161 18407 raft_consensus.cc:2243] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.579737 18407 raft_consensus.cc:2272] T 1a16e4dda0004683a44ee0708e576b6a P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.585083 18407 tablet_replica.cc:333] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.586144 18407 raft_consensus.cc:2243] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.587550 18407 raft_consensus.cc:2272] T a2ba1229768c4d258720bb3492dde33d P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.590588 18407 tablet_replica.cc:333] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.591578 18407 raft_consensus.cc:2243] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.593158 18407 raft_consensus.cc:2272] T ef4176fd716e466dae3f850b4d2c258f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:54.608425 19789 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.609133 18407 tablet_replica.cc:333] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.610195 18407 raft_consensus.cc:2243] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.611883 18407 raft_consensus.cc:2272] T e480dc321ba24a11bdd32d2f0298f2e1 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.614701 18407 tablet_replica.cc:333] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.615623 18407 raft_consensus.cc:2243] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.616904 18407 raft_consensus.cc:2272] T c56f5017d25a447ab75b3f0cb650c9e6 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.620105 18407 tablet_replica.cc:333] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.621243 18407 raft_consensus.cc:2243] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.622565 18407 raft_consensus.cc:2272] T 4dfc1fb42f6b4712acea35286ba371c3 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.625710 18407 tablet_replica.cc:333] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.626694 18407 raft_consensus.cc:2243] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.628032 18407 raft_consensus.cc:2272] T 185cd8f7a6e242a7993588e5c71850fd P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.631470 18407 tablet_replica.cc:333] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.632385 18407 raft_consensus.cc:2243] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.633929 18407 raft_consensus.cc:2272] T a78fc08630dd4a7494e6acb5b859150f P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.637137 18407 tablet_replica.cc:333] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.638317 18407 raft_consensus.cc:2243] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.640023 18407 raft_consensus.cc:2272] T 298cdd8cc5a94e2d9165affadf233104 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.648161 18407 tablet_replica.cc:333] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.650049 18407 raft_consensus.cc:2243] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.651374 18407 raft_consensus.cc:2272] T 5281957321c64f93988644f4841fbe35 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.654428 18407 tablet_replica.cc:333] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.655277 18407 raft_consensus.cc:2243] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.656497 18407 raft_consensus.cc:2272] T 2ccab10bc1b5444482abde3bf4bced52 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.659562 18407 tablet_replica.cc:333] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.660476 18407 raft_consensus.cc:2243] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.663769 18407 raft_consensus.cc:2272] T c9123f5829474284995dd8a5c8139d82 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.667500 18407 tablet_replica.cc:333] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.668411 18407 raft_consensus.cc:2243] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.669587 18407 raft_consensus.cc:2272] T 9f633905374c40ef9d178aa3de255d6f P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:54.669682 20398 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:54.680464 19789 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.681074 18407 tablet_replica.cc:333] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.683204 18407 raft_consensus.cc:2243] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.684484 18407 raft_consensus.cc:2272] T 0057355e85a74bfa9919f82a00f3fecc P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.688014 18407 tablet_replica.cc:333] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.688964 18407 raft_consensus.cc:2243] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.690199 18407 raft_consensus.cc:2272] T 729536e45a0e41f181949f78e28166c2 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.693286 18407 tablet_replica.cc:333] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
W20260709 12:14:54.693431 20398 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.694253 18407 raft_consensus.cc:2243] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.695639 18407 raft_consensus.cc:2272] T 31e10328bf7c47c599ca08bbced8fe7e P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.700553 18407 tablet_replica.cc:333] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.701452 18407 raft_consensus.cc:2243] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.702294 18407 raft_consensus.cc:2272] T 65e1443af427414db7bbd4a4be3fa074 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.705165 18407 tablet_replica.cc:333] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.706143 18407 raft_consensus.cc:2243] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.707244 18407 raft_consensus.cc:2272] T 3a1b950de64348a69098644dcf9be21d P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.710026 18407 tablet_replica.cc:333] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.710853 18407 raft_consensus.cc:2243] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.711520 18407 raft_consensus.cc:2272] T 739682f97cd84854a1b009c4b2271c7b P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.715900 18407 tablet_replica.cc:333] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.716892 18407 raft_consensus.cc:2243] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.718233 18407 raft_consensus.cc:2272] T 199b867263264f1c8e61b1e410b2a082 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:54.719588 20397 consensus_peers.cc:597] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:54.721585 18407 tablet_replica.cc:333] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.722625 18407 raft_consensus.cc:2243] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.724117 18407 raft_consensus.cc:2272] T bc8e96dba8054da2a8d0b930ae6a53a0 P ca42d3c27d2e46348120791d1282b193 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.731833 18407 tablet_replica.cc:333] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.732867 18407 raft_consensus.cc:2243] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.734225 18407 raft_consensus.cc:2272] T e32227fe2da84ebdaa3ba00cfe55031e P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.737519 18407 tablet_replica.cc:333] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.738363 18407 raft_consensus.cc:2243] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.739478 18407 raft_consensus.cc:2272] T b9b26df664874fc9abfb63a819ba56f7 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.742748 18407 tablet_replica.cc:333] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.743578 18407 raft_consensus.cc:2243] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:54.744169 19714 consensus_peers.cc:597] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:54.744190 18407 raft_consensus.cc:2272] T 062f541ef1eb40229095ed423b256495 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.748695 18407 tablet_replica.cc:333] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.749786 18407 raft_consensus.cc:2243] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.751013 18407 raft_consensus.cc:2272] T 38079882b39945f6b049a6e7401f7280 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.754336 18407 tablet_replica.cc:333] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.755300 18407 raft_consensus.cc:2243] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.756577 18407 raft_consensus.cc:2272] T def3393082b24fed88cd1cc954e4e568 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.759656 18407 tablet_replica.cc:333] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.760571 18407 raft_consensus.cc:2243] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.761806 18407 raft_consensus.cc:2272] T 705ac6c3557f4f89b2fe88524f96bafb P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.765173 18407 tablet_replica.cc:333] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.766180 18407 raft_consensus.cc:2243] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.767640 18407 raft_consensus.cc:2272] T 3efb146893bc46c5b42e3fc209a2135d P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.770639 18407 tablet_replica.cc:333] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.771544 18407 raft_consensus.cc:2243] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.772835 18407 raft_consensus.cc:2272] T dc5e311340504d31a6b1704b5459afa8 P ca42d3c27d2e46348120791d1282b193 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.775576 18407 tablet_replica.cc:333] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.776365 18407 raft_consensus.cc:2243] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:14:54.777208 19714 consensus_peers.cc:597] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:54.777608 18407 raft_consensus.cc:2272] T 26992be39c764bb3bc020dd42bc74a55 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:54.788162 19789 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.793726 18407 tablet_replica.cc:333] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.794706 18407 raft_consensus.cc:2243] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.796792 18407 raft_consensus.cc:2272] T 20aaa30e54fa432caa5875892f7b4398 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.799973 18407 tablet_replica.cc:333] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.800873 18407 raft_consensus.cc:2243] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.802193 18407 raft_consensus.cc:2272] T 613b9bd906514e3684eb97813eda93a5 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:54.819959 19789 consensus_peers.cc:597] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:54.831012 20398 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.831753 18407 tablet_replica.cc:333] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.832937 18407 raft_consensus.cc:2243] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.834228 18407 raft_consensus.cc:2272] T e46881c3a8b942fcb904f98b7ac1716f P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.838847 18407 tablet_replica.cc:333] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.839663 18407 raft_consensus.cc:2243] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.841025 18407 raft_consensus.cc:2272] T 364cf3a27fd34a1a913602f0fdb49018 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.844043 18407 tablet_replica.cc:333] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.844872 18407 raft_consensus.cc:2243] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.846097 18407 raft_consensus.cc:2272] T 8f69387176614121ab470bb58987f450 P ca42d3c27d2e46348120791d1282b193 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.849129 18407 tablet_replica.cc:333] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.850001 18407 raft_consensus.cc:2243] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.851452 18407 raft_consensus.cc:2272] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.864956 18407 tablet_replica.cc:333] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.865790 18407 raft_consensus.cc:2243] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.867069 18407 raft_consensus.cc:2272] T 09360ce480dc4631988b668a1a16fd23 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.870213 18407 tablet_replica.cc:333] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.871019 18407 raft_consensus.cc:2243] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.877630 18407 raft_consensus.cc:2272] T 478219fa5bde484ea1c2b7351aa260c7 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.880592 18407 tablet_replica.cc:333] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.882180 18407 raft_consensus.cc:2243] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.883612 18407 raft_consensus.cc:2272] T 9a2ad2622957437eae185bfda331f538 P ca42d3c27d2e46348120791d1282b193 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:54.885229 20454 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3de0 after lost signal to thread 18410
W20260709 12:14:54.886354 20454 debug-util.cc:398] Leaking SignalData structure 0x7b08002a8d80 after lost signal to thread 19607
I20260709 12:14:54.886574 18407 tablet_replica.cc:333] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.887360 18407 raft_consensus.cc:2243] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:14:54.887743 20454 debug-util.cc:398] Leaking SignalData structure 0x7b08002a63c0 after lost signal to thread 19774
I20260709 12:14:54.889060 18407 raft_consensus.cc:2272] T 1c3fa3feedde422fbce04c9f6ab16f44 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:54.889415 20454 debug-util.cc:398] Leaking SignalData structure 0x7b0800233fa0 after lost signal to thread 19848
W20260709 12:14:54.890964 20454 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9820 after lost signal to thread 20457
I20260709 12:14:54.892601 18407 tablet_replica.cc:333] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.893647 18407 raft_consensus.cc:2243] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.895138 18407 raft_consensus.cc:2272] T f055e0ff3254433f83caca3e0e190a4c P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.900194 18407 tablet_replica.cc:333] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.901212 18407 raft_consensus.cc:2243] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.909111 18407 raft_consensus.cc:2272] T f034c09c286a4ac3a1f560c84eb05120 P ca42d3c27d2e46348120791d1282b193 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.913817 18407 tablet_replica.cc:333] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.918154 18407 raft_consensus.cc:2243] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.920819 18407 raft_consensus.cc:2272] T d7c81f67e1574e8eb631a5176b7276f9 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.926062 18407 tablet_replica.cc:333] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.930584 18407 raft_consensus.cc:2243] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.933274 18407 raft_consensus.cc:2272] T 70bffa2c492142dcb1c6ffe4ce59bde8 P ca42d3c27d2e46348120791d1282b193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.940438 18407 tablet_replica.cc:333] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.942901 18407 raft_consensus.cc:2243] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.944697 18407 raft_consensus.cc:2272] T 186a44ea95974c119996690984996f55 P ca42d3c27d2e46348120791d1282b193 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.966338 18407 tablet_replica.cc:333] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193: stopping tablet replica
I20260709 12:14:54.967826 18407 raft_consensus.cc:2243] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.970184 18407 raft_consensus.cc:2272] T f571c10f46804596bd8b664f6181c2c8 P ca42d3c27d2e46348120791d1282b193 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:55.070762 19788 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:55.311475 20397 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:55.361742 19788 consensus_peers.cc:597] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:55.434216 19788 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:55.509552 20397 consensus_peers.cc:597] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:55.516817 20397 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:55.664813 22472 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.665614 22472 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.675645 22472 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:55.688911 19788 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:55.692335 20397 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:55.695326 19789 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.702315 19789 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:55.711982 22472 raft_consensus.cc:2749] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:55.718123 19788 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:55.719626 22472 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.720455 22472 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.723757 22472 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:55.744597 19788 leader_election.cc:336] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:55.753283 22472 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:55.753733 19789 leader_election.cc:336] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.754457 19789 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:55.754316 22472 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:55.756210 22471 raft_consensus.cc:2749] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:55.758044 22472 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:55.764084 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:55.767905 22472 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.768630 22472 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.771167 22472 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:55.772881 20397 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:55.775663 22472 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.777033 22472 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.778406 22463 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.779199 22463 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:55.779554 22472 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:55.774669 19789 leader_election.cc:336] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:55.776347 19788 leader_election.cc:336] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:55.783314 19789 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:55.784247 22471 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.784837 22471 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.787204 22471 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:55.787890 22471 raft_consensus.cc:2749] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:55.788199 19789 leader_election.cc:336] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:55.787231 20398 leader_election.cc:336] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.788930 19789 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:55.790226 19788 leader_election.cc:336] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:55.792650 22463 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:55.793799 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:55.797106 20396 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:55.797678 22471 raft_consensus.cc:2749] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:55.797729 22472 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.798700 22463 raft_consensus.cc:2749] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:55.799185 19789 leader_election.cc:336] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.798722 22472 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:55.799820 19789 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:55.802062 22472 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:55.802836 22463 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.803507 22463 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:55.807673 22463 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:55.808537 19788 leader_election.cc:336] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:55.811901 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:55.812657 19823 raft_consensus.cc:2468] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
W20260709 12:14:55.813822 20398 leader_election.cc:336] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.814555 20396 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:55.815052 22471 raft_consensus.cc:2749] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:55.815497 22463 raft_consensus.cc:2804] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:55.815975 22463 raft_consensus.cc:493] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.816336 22463 raft_consensus.cc:3060] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:55.820282 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:55.820773 19789 leader_election.cc:336] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.820299 22471 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.821424 19789 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:55.822360 22471 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.822825 22472 raft_consensus.cc:2749] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:55.825021 22471 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:55.826952 19789 leader_election.cc:336] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.827607 19789 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:55.831228 22472 raft_consensus.cc:2749] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:55.831404 19789 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.832312 22472 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.833014 22472 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:55.834235 19788 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:55.834766 19788 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:55.836339 22472 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:55.844100 22472 raft_consensus.cc:2749] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:55.843107 19789 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.849862 22463 raft_consensus.cc:515] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:55.868033 22472 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.868963 22472 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.870064 22463 leader_election.cc:290] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:55.871719 22463 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.872296 22463 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:55.879388 19789 leader_election.cc:336] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:55.880172 19788 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:55.881034 19788 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:55.881984 22471 raft_consensus.cc:2749] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:55.876456 22472 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:55.882097 22477 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.883071 22477 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:55.884667 20398 leader_election.cc:336] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:55.885285 20398 leader_election.cc:336] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.885807 22471 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.886062 22477 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:55.886415 22471 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.874691 22463 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:55.891108 22444 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.889484 22471 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:55.891599 20397 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:55.894694 22444 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:55.896426 19789 leader_election.cc:336] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.897362 22444 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:55.898018 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38079882b39945f6b049a6e7401f7280" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:55.898701 19823 raft_consensus.cc:3060] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:55.899073 22444 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.899678 22444 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:55.901026 20398 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.901638 20398 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:55.901983 22444 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:55.903144 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:55.906466 22444 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.907163 22444 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:55.909005 22471 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.909723 22471 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.911631 22463 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:55.911692 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:55.912331 22471 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:55.914808 20396 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:55.916280 22463 raft_consensus.cc:2749] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:55.920047 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
W20260709 12:14:55.924150 19789 leader_election.cc:336] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.910079 22444 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:55.925838 19788 leader_election.cc:336] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:55.916036 19823 raft_consensus.cc:2468] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:55.926362 19788 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:55.927647 22444 raft_consensus.cc:2749] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:55.929167 22463 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.929782 22463 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:55.930658 19789 leader_election.cc:336] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.931160 19789 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:55.932548 22463 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:55.934623 19818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:55.934938 22471 raft_consensus.cc:2749] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:55.935388 19818 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 5.
I20260709 12:14:55.935608 22471 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.936072 22471 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:55.938124 22471 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:55.942039 20398 leader_election.cc:336] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.942397 22471 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.943171 22471 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.944651 22444 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.945281 22444 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.947546 22444 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:55.950917 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:55.951247 20396 leader_election.cc:304] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:55.951540 20430 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
I20260709 12:14:55.952368 22463 raft_consensus.cc:2804] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:55.953191 22463 raft_consensus.cc:697] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:55.953483 20396 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:55.954344 22475 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:55.954702 22475 raft_consensus.cc:493] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.955067 22475 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:55.955886 19789 leader_election.cc:336] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.956338 19789 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
W20260709 12:14:55.957177 19789 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.958350 22444 raft_consensus.cc:2749] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:55.948959 22471 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:55.959928 19788 leader_election.cc:336] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:55.960371 19788 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:55.961236 19788 leader_election.cc:336] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:55.961624 19788 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:55.961791 22463 consensus_queue.cc:237] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:55.962474 19788 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:55.962920 22444 raft_consensus.cc:2749] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:55.971123 19788 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:55.972231 22444 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:55.963342 22471 raft_consensus.cc:2749] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:55.974548 22471 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.975193 22471 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:55.965404 22472 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.978488 22472 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:14:55.980674 22472 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:55.966120 22475 raft_consensus.cc:515] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:55.984547 22476 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:55.985164 22476 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:55.985927 22475 leader_election.cc:290] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:55.991384 20398 leader_election.cc:336] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:55.994339 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62ed1b9937fd41ab83a0000603a38fc9" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:55.995100 19823 raft_consensus.cc:3060] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:55.996135 22476 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:55.977734 22471 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:55.997488 19788 leader_election.cc:336] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:55.998041 19788 leader_election.cc:336] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.003975 19823 raft_consensus.cc:2468] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 6.
W20260709 12:14:56.005523 20398 leader_election.cc:336] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.004938 19569 catalog_manager.cc:5697] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 3 to 4, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 4 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:56.007025 20396 leader_election.cc:304] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.009361 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:56.010198 19823 raft_consensus.cc:2468] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 3.
I20260709 12:14:56.011979 22476 raft_consensus.cc:2804] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:56.012377 22471 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.012799 22476 raft_consensus.cc:697] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 6 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:56.013024 22471 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:56.013937 22476 consensus_queue.cc:237] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.015635 22471 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.015930 20396 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.012075 22444 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.017683 19789 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:56.028225 22463 raft_consensus.cc:2804] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:56.028831 22463 raft_consensus.cc:493] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.029368 22463 raft_consensus.cc:3060] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:56.028542 22444 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:56.032507 22444 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.017046 22472 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.028796 22471 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.035225 22472 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:56.035629 22471 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:56.038146 22471 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.038220 22472 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.034472 22444 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.041910 22475 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.042582 22475 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.049852 22480 raft_consensus.cc:2804] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:56.050984 22480 raft_consensus.cc:493] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.051528 22480 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:56.042491 22463 raft_consensus.cc:515] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.063223 22471 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.064066 22471 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:56.066607 22477 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.067452 22477 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.065933 22472 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.073299 22472 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:56.039666 22444 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:56.077210 19789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:38821, user_credentials={real_user=slave}} blocked reactor thread for 59754.4us
W20260709 12:14:56.081667 19789 leader_election.cc:336] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.088320 22477 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:56.089058 22477 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.089628 22477 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.090590 22463 leader_election.cc:290] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:56.092535 22472 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.094974 22477 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:56.096908 20398 leader_election.cc:336] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.097535 20398 leader_election.cc:336] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.097811 20397 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:56.098315 19788 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:56.099167 19788 leader_election.cc:336] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.105823 19815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:56.111088 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b950de64348a69098644dcf9be21d" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:56.111841 19823 raft_consensus.cc:3060] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:56.112291 20397 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.115962 22475 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.119305 22444 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:56.120683 20398 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.121299 20398 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.122330 19823 raft_consensus.cc:2468] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 4.
I20260709 12:14:56.123502 22475 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:56.129070 22483 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.129825 22483 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:56.130357 22471 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.132925 22483 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:56.133481 19789 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.134056 19789 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.134727 22472 raft_consensus.cc:2749] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:56.134966 19789 leader_election.cc:336] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.135380 19789 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:56.135914 20397 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.127043 22444 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.136309 22472 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:56.136971 19789 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.140889 19789 leader_election.cc:336] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.140452 22444 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:56.141498 19789 leader_election.cc:336] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.142002 19789 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.142488 19789 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.143035 19789 leader_election.cc:336] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.143136 22444 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.142606 22480 raft_consensus.cc:515] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.143589 19789 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:56.144798 19789 leader_election.cc:336] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.145543 22480 leader_election.cc:290] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:56.145319 22444 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:56.148291 19789 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.149096 22484 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:56.149613 20398 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.149865 22444 raft_consensus.cc:2749] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:56.149744 22484 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.151417 20396 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.152222 22484 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:56.153038 22476 raft_consensus.cc:2749] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:56.150125 20398 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.155570 22475 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:56.158027 20396 leader_election.cc:304] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.158905 22477 raft_consensus.cc:2804] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:56.159406 22477 raft_consensus.cc:697] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:56.160327 22477 consensus_queue.cc:237] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:56.162393 19789 leader_election.cc:336] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.163936 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b867263264f1c8e61b1e410b2a082" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:56.164584 20430 raft_consensus.cc:3060] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:56.171001 22444 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.171833 22444 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:56.172988 20398 leader_election.cc:336] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.174741 22444 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:56.173051 19788 leader_election.cc:336] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.178930 20430 raft_consensus.cc:2468] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 6.
W20260709 12:14:56.185277 19789 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.186470 20397 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:56.187626 18407 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19771)
I20260709 12:14:56.182478 19788 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.191061 22480 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:56.191458 19788 leader_election.cc:336] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.192013 19788 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.192950 22444 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:56.193136 19788 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.192119 19789 leader_election.cc:304] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: 
I20260709 12:14:56.193766 19788 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.194475 22444 raft_consensus.cc:2804] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:56.194633 22480 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.196213 22444 raft_consensus.cc:697] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:56.197332 22444 consensus_queue.cc:237] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:56.199112 19789 leader_election.cc:336] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.202374 19789 leader_election.cc:336] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.203017 19789 leader_election.cc:336] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.208391 19788 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.209115 19788 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:56.209862 19789 leader_election.cc:336] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.219420 22480 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:56.235356 19788 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.236091 19788 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.237031 22477 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.237253 22483 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:56.237774 22477 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.240522 19823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
I20260709 12:14:56.241446 19823 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 5.
I20260709 12:14:56.245863 22483 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.246469 22483 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:56.248318 20397 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.249043 22483 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.249665 22477 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.254972 22483 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.255631 22483 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.259778 22483 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:56.260504 19572 catalog_manager.cc:5697] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 5 to 6, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 6 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:56.257688 20398 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.262037 20398 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.262414 19572 catalog_manager.cc:5697] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 3 to 4, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 4 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:56.263504 22476 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:56.257448 19789 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.261240 22483 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.267997 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:56.268723 22483 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.272192 22483 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:56.276510 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:56.277307 22476 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:56.277550 19789 leader_election.cc:336] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.278321 19788 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.287166 20430 raft_consensus.cc:2468] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 3.
I20260709 12:14:56.287369 19789 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: b12c250fb1a244ed9a49cf86950af1bf, ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.278304 20396 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.290132 22477 raft_consensus.cc:2804] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:56.290617 22477 raft_consensus.cc:493] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.290740 22483 raft_consensus.cc:2749] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:56.291608 22483 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.292093 22483 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:56.291095 22477 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:56.288965 19788 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.304562 22480 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:56.305881 19788 leader_election.cc:336] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.306430 19788 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.307272 22480 raft_consensus.cc:2749] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:56.288059 22476 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:56.308465 19788 leader_election.cc:336] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.308981 19788 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:56.311643 19789 leader_election.cc:336] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.312247 22480 raft_consensus.cc:2749] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:56.294863 22483 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:56.316859 19789 leader_election.cc:336] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.317193 20398 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.318223 19789 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.324754 22477 raft_consensus.cc:515] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.325680 19572 catalog_manager.cc:5697] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 5 to 6, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 6 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:56.327829 19788 leader_election.cc:336] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.333698 22475 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.333997 19788 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.328202 22476 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.328460 22483 raft_consensus.cc:2804] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:56.334362 22475 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.334939 22483 raft_consensus.cc:493] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.335389 22483 raft_consensus.cc:3060] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:56.336988 22475 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:56.339160 20398 leader_election.cc:336] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.328712 20397 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.340607 20397 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.329427 22484 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.344288 22484 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.328964 22444 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.347172 22444 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:56.348464 19788 leader_election.cc:336] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.349074 19788 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.350210 22472 raft_consensus.cc:2749] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:56.350569 22444 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:56.347162 22480 raft_consensus.cc:2749] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:56.346508 22484 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:56.343350 20398 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:56.357532 19789 leader_election.cc:336] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.360823 22484 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:56.368984 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" is_pre_election: true
W20260709 12:14:56.369611 19788 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.370193 19788 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.369680 19817 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 6.
I20260709 12:14:56.370942 22483 raft_consensus.cc:515] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:56.373013 20397 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:56.373610 20398 leader_election.cc:336] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.377912 22483 leader_election.cc:290] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:56.380903 19789 leader_election.cc:336] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.381507 22480 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:56.381697 22444 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.383857 22477 leader_election.cc:290] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
I20260709 12:14:56.384320 22444 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.387123 22444 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
W20260709 12:14:56.387835 20397 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:56.382416 19788 leader_election.cc:336] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.391346 19788 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.396450 22444 raft_consensus.cc:2749] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:56.390422 20397 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.399099 22477 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:56.405372 19789 leader_election.cc:336] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.407459 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b9bd906514e3684eb97813eda93a5" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:56.412215 20430 raft_consensus.cc:3060] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:56.414851 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9123f5829474284995dd8a5c8139d82" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
W20260709 12:14:56.414870 19788 leader_election.cc:336] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.415596 19817 raft_consensus.cc:3060] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:56.408421 20433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf" is_pre_election: true
I20260709 12:14:56.415925 19788 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:56.416586 20433 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 5.
I20260709 12:14:56.417718 20396 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.420694 22484 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:56.421164 22484 raft_consensus.cc:493] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.421525 22484 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:56.427145 22444 raft_consensus.cc:2749] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:56.430985 19817 raft_consensus.cc:2468] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 6.
I20260709 12:14:56.432264 19789 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.445179 22444 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:56.445612 22444 raft_consensus.cc:493] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:56.446130 22444 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:56.446098 20396 leader_election.cc:304] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.447407 22477 raft_consensus.cc:2804] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:56.448021 22477 raft_consensus.cc:697] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 6 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:56.449038 22477 consensus_queue.cc:237] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.450112 19823 raft_consensus.cc:1275] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:56.452453 22476 consensus_queue.cc:1048] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:56.434810 22484 raft_consensus.cc:515] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.432941 20430 raft_consensus.cc:2468] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 4.
I20260709 12:14:56.455541 19789 leader_election.cc:304] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.458884 22483 raft_consensus.cc:2804] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:56.459553 22483 raft_consensus.cc:697] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:56.461529 19817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09360ce480dc4631988b668a1a16fd23" candidate_uuid: "b12c250fb1a244ed9a49cf86950af1bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324"
I20260709 12:14:56.462183 19817 raft_consensus.cc:3060] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:56.463344 22483 consensus_queue.cc:237] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.468636 22444 raft_consensus.cc:515] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:56.471818 20398 consensus_peers.cc:597] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.472455 20398 leader_election.cc:336] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.477506 19817 raft_consensus.cc:2468] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b12c250fb1a244ed9a49cf86950af1bf in term 7.
I20260709 12:14:56.461390 22484 leader_election.cc:290] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:14:56.478205 19558 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 45983.8us
I20260709 12:14:56.480406 20396 leader_election.cc:304] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
W20260709 12:14:56.485049 19789 leader_election.cc:336] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:56.489356 20430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f034c09c286a4ac3a1f560c84eb05120" candidate_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b12c250fb1a244ed9a49cf86950af1bf"
I20260709 12:14:56.490176 20430 raft_consensus.cc:3060] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:56.487121 22484 raft_consensus.cc:2804] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:56.487840 22444 leader_election.cc:290] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Requested vote from peers ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489), b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196:38821)
I20260709 12:14:56.512245 19569 catalog_manager.cc:5697] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 5 to 6, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 6 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:56.498195 19558 catalog_manager.cc:4755] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 62ed1b9937fd41ab83a0000603a38fc9: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:56.515856 20430 raft_consensus.cc:2468] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f9fb1b1a86c4eb99abdbaf9d239e324 in term 6.
I20260709 12:14:56.517781 19789 leader_election.cc:304] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193
I20260709 12:14:56.519264 22484 raft_consensus.cc:697] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 7 LEADER]: Becoming Leader. State: Replica: b12c250fb1a244ed9a49cf86950af1bf, State: Running, Role: LEADER
I20260709 12:14:56.519577 22480 raft_consensus.cc:2804] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:56.525686 22480 raft_consensus.cc:697] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Becoming Leader. State: Replica: 1f9fb1b1a86c4eb99abdbaf9d239e324, State: Running, Role: LEADER
I20260709 12:14:56.525303 22484 consensus_queue.cc:237] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:56.526605 22480 consensus_queue.cc:237] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:56.565496 20398 consensus_peers.cc:597] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.574155 19823 raft_consensus.cc:1275] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:56.577131 22463 consensus_queue.cc:1048] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:56.577384 19572 catalog_manager.cc:5697] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf reported cstate change: term changed from 6 to 7, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to b12c250fb1a244ed9a49cf86950af1bf (127.17.249.196). New cstate: current_term: 7 leader_uuid: "b12c250fb1a244ed9a49cf86950af1bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:56.581282 20397 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:56.585029 19569 catalog_manager.cc:5697] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 3 to 4, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 4 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:56.599539 19788 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:56.637316 19569 catalog_manager.cc:5697] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 reported cstate change: term changed from 5 to 6, leader changed from ca42d3c27d2e46348120791d1282b193 (127.17.249.194) to 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195). New cstate: current_term: 6 leader_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:56.675872 19817 raft_consensus.cc:1275] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:56.677527 22484 consensus_queue.cc:1048] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:56.708690 20398 consensus_peers.cc:597] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.766292 20430 raft_consensus.cc:1275] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:56.772616 22480 consensus_queue.cc:1048] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:56.803582 19789 consensus_peers.cc:597] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.842157 20398 consensus_peers.cc:597] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.908654 19789 consensus_peers.cc:597] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.909305 19817 raft_consensus.cc:1275] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:56.911280 22475 consensus_queue.cc:1048] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:56.951213 20398 consensus_peers.cc:597] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.959978 20397 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111) [suppressed 460 similar messages]
W20260709 12:14:56.963296 20397 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:56.969195 20433 raft_consensus.cc:1275] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:56.972548 22472 consensus_queue.cc:1048] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:56.995749 19817 raft_consensus.cc:1275] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Refusing update from remote peer b12c250fb1a244ed9a49cf86950af1bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:56.998344 22475 consensus_queue.cc:1048] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:57.031828 19789 consensus_peers.cc:597] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.033838 20430 raft_consensus.cc:1275] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Refusing update from remote peer 1f9fb1b1a86c4eb99abdbaf9d239e324: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:57.038569 22471 consensus_queue.cc:1048] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:57.049347 19789 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:57.122184 19789 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:57.130116 20398 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:57.188113 18407 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 19771)
W20260709 12:14:57.190349 19789 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:57.238224 20398 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:57.251683 19789 consensus_peers.cc:597] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:57.315493 19789 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:57.337371 20398 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:57.363585 22480 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.364297 22480 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.369544 22480 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.376695 19789 leader_election.cc:336] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:57.378746 19788 leader_election.cc:336] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:57.381224 19788 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.383490 22480 raft_consensus.cc:2749] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:57.440634 22471 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.441246 22471 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.443610 22471 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.450098 19789 leader_election.cc:336] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:57.464354 19788 leader_election.cc:336] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:57.465027 19788 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.465920 22471 raft_consensus.cc:2749] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:57.470024 20397 consensus_peers.cc:597] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:57.492234 22471 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.492858 22471 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.495999 22471 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.506266 19789 leader_election.cc:336] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:57.507308 19788 leader_election.cc:336] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:57.507763 19788 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.509703 22480 raft_consensus.cc:2749] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:57.527071 22475 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.527735 22475 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:57.530604 22475 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.535835 20398 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:57.548621 20397 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:57.549322 20397 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.550383 22484 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:57.683188 22471 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.683830 22471 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.690826 22471 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.696576 19788 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:57.702324 19789 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:57.702893 19789 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.703673 22471 raft_consensus.cc:2749] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:57.753403 19788 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:57.756565 22480 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.757238 22480 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.767661 22480 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.768550 19788 leader_election.cc:336] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:57.772933 19789 leader_election.cc:336] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:57.774062 19789 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.775094 22480 raft_consensus.cc:2749] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:57.800467 19788 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:57.819135 22480 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.819830 22480 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.824484 22480 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.829821 19789 leader_election.cc:336] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:57.831522 22480 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.832118 22480 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:57.834054 19788 leader_election.cc:336] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:57.834266 22480 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:57.834681 19788 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.836962 22471 raft_consensus.cc:2749] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:57.850842 19788 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:57.850402 22484 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.854086 22484 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:57.855065 19789 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:57.855625 19789 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.856772 22484 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.860037 19788 consensus_peers.cc:597] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:57.866860 20397 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:57.867470 22471 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:57.868196 22444 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.870198 22444 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.872978 22444 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:57.874289 22444 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.875010 22444 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.877367 22444 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.877499 20398 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:57.878801 20398 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:57.879339 19788 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:57.882853 19789 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:57.883320 19789 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.883592 22444 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.884286 22471 raft_consensus.cc:2749] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:57.884274 22444 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.885401 22484 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:57.886761 19788 leader_election.cc:336] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:57.887125 22444 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:57.890321 22444 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.890913 22484 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.891702 22484 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:57.892325 22471 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.891120 22444 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.892974 22471 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.894753 22444 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:57.895630 22471 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.896646 19788 leader_election.cc:336] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:57.898396 22484 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.899410 19789 leader_election.cc:336] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:57.909998 19789 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:57.911513 19788 leader_election.cc:336] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:57.913329 22471 raft_consensus.cc:2749] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:57.912173 19788 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:57.913496 19789 leader_election.cc:336] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:57.914631 19789 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:57.915721 19789 leader_election.cc:336] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:57.916954 19789 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.918620 22444 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:57.918835 19789 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:57.919441 19789 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.920254 22444 raft_consensus.cc:2749] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:57.909004 20398 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:57.921664 20397 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:57.916258 22471 raft_consensus.cc:2749] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:57.923240 20397 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.925320 22475 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:57.945258 20397 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:57.957458 20397 consensus_peers.cc:597] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:57.982481 22471 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:57.983022 22471 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:57.985186 22471 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:57.991029 19788 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:57.993009 19789 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:57.993428 19789 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:57.994113 22471 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:58.011082 22471 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.011814 22471 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:58.014497 22471 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.021160 19788 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:58.025404 19789 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:58.025869 19789 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.027523 22471 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:58.039203 22471 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.039757 22471 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:58.041965 22471 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.049088 20397 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:58.050817 19789 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:58.051532 19788 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.051975 19788 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.053237 22471 raft_consensus.cc:2749] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:58.085196 22444 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.085871 22444 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:58.088505 22444 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.097306 19789 leader_election.cc:336] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:58.100816 22471 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.101552 22471 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:58.102653 19788 leader_election.cc:336] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.103178 19788 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.103888 22444 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:58.104858 22471 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.111774 19789 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:58.116091 19788 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.116564 19788 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.117413 22471 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:58.139083 22471 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.139812 22471 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:58.156421 22444 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.157160 22444 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:58.159686 22444 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.162456 19789 leader_election.cc:336] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:58.178203 22471 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.182638 19788 leader_election.cc:336] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:58.180004 19789 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:58.184296 19788 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.185868 22471 raft_consensus.cc:2749] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:58.188616 18407 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 19771)
I20260709 12:14:58.195427 22471 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.196291 22471 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:14:58.205492 22444 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.206092 22444 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:58.209357 22444 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:58.203084 22471 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.221911 19789 leader_election.cc:336] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:58.231637 22475 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.232326 22475 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:58.246978 20397 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:58.249246 20398 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:58.249818 20398 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.252270 22484 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:58.250402 22475 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.261051 19789 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:58.231127 19788 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.262888 22444 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.275103 19788 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.275148 22444 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:58.276330 22471 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:58.277755 22444 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.284315 20397 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:14:58.293483 22444 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.294097 22444 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:58.296658 22444 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.301770 19789 leader_election.cc:336] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:58.303416 19788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:36713, user_credentials={real_user=slave}} blocked reactor thread for 72327.5us
W20260709 12:14:58.306643 19789 leader_election.cc:336] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:58.319561 22444 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.320168 22444 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:58.320642 19788 leader_election.cc:336] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.321384 19788 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.322299 22471 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:58.322468 22444 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.326412 19788 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.328747 19788 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.331372 22444 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.331880 22471 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:58.332031 22444 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:58.331401 19789 leader_election.cc:336] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:58.334847 22444 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.347225 19789 leader_election.cc:336] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:58.348215 22444 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.350313 22444 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:58.351665 22475 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.352617 22444 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.349341 19788 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:58.352325 22475 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:58.355355 22475 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.366566 20397 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:58.367686 20398 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:58.368251 20398 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.369999 22475 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:58.373160 19788 leader_election.cc:336] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.376492 19788 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.377455 22444 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:58.377733 19788 leader_election.cc:336] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.380347 19788 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.383755 22444 raft_consensus.cc:2749] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:58.382753 19789 leader_election.cc:336] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:58.396193 19788 leader_election.cc:336] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.400228 19788 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.408165 22444 raft_consensus.cc:2749] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:58.409643 19788 leader_election.cc:336] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.412081 19788 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.413031 22444 raft_consensus.cc:2749] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:58.419726 19788 leader_election.cc:336] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.420480 19788 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.421430 22444 raft_consensus.cc:2749] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:58.469581 20397 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:58.476815 22444 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.477447 22444 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:58.479933 22444 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.496083 19789 leader_election.cc:336] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:58.497438 19788 leader_election.cc:336] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.498171 19788 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.499186 22444 raft_consensus.cc:2749] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:58.537936 20397 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:14:58.587312 22471 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.588001 22471 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:58.590324 22471 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.620215 19788 leader_election.cc:336] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.624394 22509 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:58.625185 22509 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:58.623728 19789 leader_election.cc:336] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:58.631211 19789 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.637810 22471 raft_consensus.cc:2749] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:58.652245 22509 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:58.644176 20398 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:58.682435 20397 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:58.682981 20397 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:58.684034 22484 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:58.801937 20397 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:58.819311 20398 consensus_peers.cc:597] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:58.968223 20397 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:58.990207 20398 consensus_peers.cc:597] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:59.088001 19788 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:59.141222 20398 consensus_peers.cc:597] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:59.177073 20397 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:59.190531 18407 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 19771)
I20260709 12:14:59.301209 22484 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:59.301920 22484 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:14:59.304499 22484 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:59.348788 20397 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:59.354017 20398 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:59.356194 20398 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:14:59.369573 19789 consensus_peers.cc:597] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:59.374469 22509 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:59.382236 22511 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:59.388187 22511 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:14:59.396059 19788 leader_election.cc:336] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:59.405870 19789 leader_election.cc:336] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:59.406495 19789 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:59.407356 22471 raft_consensus.cc:2749] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:59.412590 22511 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:59.480710 19789 consensus_peers.cc:597] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:59.528290 19789 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:59.541878 20397 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:59.557507 19789 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:59.562968 20398 consensus_peers.cc:597] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:59.581262 20398 consensus_peers.cc:597] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:59.665766 19789 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:59.688766 22511 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:59.689469 22511 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:59.692265 22511 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:59.707214 19789 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:59.725255 19788 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:59.734505 19788 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:59.744345 22511 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:59.766875 20398 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:59.767628 20398 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:59.770207 22511 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:59.772972 22511 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:59.775503 22511 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:59.793588 22509 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:14:59.769747 19789 consensus_peers.cc:597] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:59.796610 22509 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:14:59.820921 19788 leader_election.cc:336] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:59.831257 22511 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:59.832017 22511 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:59.835103 22511 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:59.821686 22509 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:14:59.832911 19789 leader_election.cc:336] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:59.827328 20398 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:14:59.850466 20397 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:14:59.851617 20397 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:59.846823 19789 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:59.856607 22471 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:14:59.863672 22471 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:14:59.866117 22471 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:14:59.867115 22471 raft_consensus.cc:2749] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:59.869119 22484 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:59.883589 19788 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:59.889739 20398 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:59.908687 19788 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:14:59.910940 19789 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:59.915028 19789 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:59.915978 22511 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:59.917030 19789 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:14:59.918673 19789 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:14:59.921077 22511 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:59.945772 19789 consensus_peers.cc:597] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:59.949018 19789 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:00.005280 22511 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.005887 22511 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.008492 22511 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:00.020126 22471 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.020753 22471 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.028054 22471 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:00.037282 19788 leader_election.cc:336] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:00.040319 19788 leader_election.cc:336] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:00.085342 19789 leader_election.cc:336] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:00.101751 19789 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:15:00.087412 20397 consensus_peers.cc:597] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:00.107975 22471 raft_consensus.cc:2749] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:00.109196 19789 leader_election.cc:336] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:00.112735 19789 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:15:00.112212 19788 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:00.116926 22471 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:00.134606 22471 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.135609 22471 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:15:00.151554 22471 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:00.173446 19788 leader_election.cc:336] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:00.192425 18407 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 19771)
W20260709 12:15:00.250058 19789 leader_election.cc:336] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:00.252027 19789 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:00.255952 22471 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:00.278630 19788 consensus_peers.cc:597] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:00.342634 22511 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.343243 22511 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.345592 22511 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:00.351110 20397 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:00.356253 19789 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:00.364220 19788 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:00.364703 19788 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:00.365454 22511 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:00.397128 22509 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.397814 22509 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:15:00.419310 22509 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:00.420331 20398 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:00.422286 20397 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:00.424366 20397 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:00.425612 22484 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:00.439568 22511 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.440238 22511 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.443173 22511 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:00.446663 22471 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.449446 22471 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.451848 22471 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:00.452688 19789 leader_election.cc:336] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:00.459359 20397 consensus_peers.cc:597] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:00.461606 19789 leader_election.cc:336] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:00.470124 22511 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.470882 22511 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.473510 22511 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:00.477239 22511 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.477833 22511 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.479991 22511 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:00.492343 19789 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:00.494546 19788 leader_election.cc:336] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:00.502885 19788 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:15:00.503943 19788 leader_election.cc:336] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:00.506646 19788 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:15:00.502323 19789 leader_election.cc:336] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:00.504462 22511 raft_consensus.cc:2749] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:00.508558 22471 raft_consensus.cc:2749] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:00.511758 19788 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:00.520944 19788 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:00.521538 19788 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:00.524058 22511 raft_consensus.cc:2749] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:00.525147 19788 leader_election.cc:336] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:00.525606 19788 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:00.526332 22511 raft_consensus.cc:2749] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:00.527793 20397 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:00.596987 20397 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:00.653344 22511 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.653985 22511 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.656328 22511 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:00.664134 19789 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:00.670598 19788 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:00.671228 19788 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:00.672070 22511 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:00.677788 22511 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.678371 22511 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.684590 22511 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:00.687180 19789 leader_election.cc:336] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:00.695182 19788 leader_election.cc:336] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:00.695775 19788 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:00.696609 22511 raft_consensus.cc:2749] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:00.743181 19788 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:00.761278 22511 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.761925 22511 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.779402 22471 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.780097 22471 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.796387 22471 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:00.809252 22471 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.809962 22471 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.778699 22511 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:00.821880 22471 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:00.841842 19789 leader_election.cc:336] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:00.877767 19789 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:00.878334 22516 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.892110 22516 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.903656 22516 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:00.882038 19788 leader_election.cc:336] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:00.904537 22514 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.905946 22514 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.908579 22514 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:00.909271 19788 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:15:00.913486 19788 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:00.917073 19788 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:00.914132 22516 raft_consensus.cc:2749] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:00.910722 22514 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.919962 22514 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.924234 22514 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:00.924968 22471 raft_consensus.cc:2749] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:00.918627 19789 leader_election.cc:336] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:00.942725 19788 leader_election.cc:336] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:00.952842 19788 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:00.954423 22514 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:00.963219 19789 leader_election.cc:336] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:00.967175 19789 leader_election.cc:336] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:00.988860 22514 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:00.990078 22514 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:00.997408 22514 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:00.999588 19789 leader_election.cc:336] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:01.002405 19788 leader_election.cc:336] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.016345 19788 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.018880 22514 raft_consensus.cc:2749] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:01.019889 19788 leader_election.cc:336] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.022408 19788 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.023247 22514 raft_consensus.cc:2749] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:01.024209 19788 leader_election.cc:336] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.029431 19788 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.032037 22514 raft_consensus.cc:2749] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:01.028837 19789 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:01.034574 22514 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:01.035203 22514 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:01.058135 22514 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:01.072777 19789 leader_election.cc:336] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:01.078341 19788 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.078889 19788 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.079689 22514 raft_consensus.cc:2749] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:01.083217 19788 leader_election.cc:336] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.083705 19788 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.084482 22514 raft_consensus.cc:2749] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:01.101394 20397 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:01.142448 22509 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:01.143074 22509 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:15:01.172021 20398 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:01.172643 22509 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:01.182932 20397 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.183569 20397 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.187726 22509 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:01.188444 22513 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:01.189105 22513 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:15:01.191922 22513 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:01.193037 18407 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 19771)
W20260709 12:15:01.201366 20398 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:01.248775 20397 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.253654 20397 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.254524 22509 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:01.295468 20397 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:01.296854 22514 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:01.297499 22514 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:01.300144 22514 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:01.310601 22516 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:01.318130 22516 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:15:01.415089 19789 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:01.428783 22516 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:01.435359 19789 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:01.451112 22471 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:01.451700 22471 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:01.453732 22471 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:01.465715 19788 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.466248 19788 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.466998 22514 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:01.467252 19788 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.467698 19788 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.468415 22518 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:01.468667 19788 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.474762 22518 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:01.476298 22518 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:01.478927 22518 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:01.475445 19789 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:01.483050 19789 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.484129 22518 raft_consensus.cc:2749] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:01.497992 20398 consensus_peers.cc:597] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:01.505692 20397 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:01.507740 19788 leader_election.cc:336] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:01.517882 20397 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:01.535971 22518 raft_consensus.cc:493] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:01.536644 22518 raft_consensus.cc:515] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:01.539971 22518 leader_election.cc:290] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:01.547386 19789 leader_election.cc:336] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:01.547947 19789 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.548991 22518 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:01.552338 19788 leader_election.cc:336] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:01.555157 19789 leader_election.cc:336] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:01.555673 19789 leader_election.cc:304] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.556535 22518 raft_consensus.cc:2749] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:01.569257 20398 consensus_peers.cc:597] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:01.573218 22509 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:01.573868 22509 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:15:01.576303 22509 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:01.581652 20398 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:01.583055 20397 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.589221 20397 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.590193 22513 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:01.668819 20397 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:01.687680 20398 consensus_peers.cc:597] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:01.774493 19788 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:01.780961 22518 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:01.781697 22518 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:01.784386 22518 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:01.797293 19788 leader_election.cc:336] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:01.800069 19789 leader_election.cc:336] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:01.804489 19789 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.805495 22518 raft_consensus.cc:2749] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:01.843828 19789 consensus_peers.cc:597] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:01.868893 22509 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:01.869499 22509 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:15:01.872648 22509 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:01.878944 20398 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:01.889142 19789 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:01.893471 20397 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:01.894001 20397 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:01.894704 22509 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:01.941603 19789 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:01.956552 20397 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:01.988423 20397 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111) [suppressed 456 similar messages]
W20260709 12:15:01.995101 20398 consensus_peers.cc:597] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:02.000504 20398 consensus_peers.cc:597] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:02.013587 19789 consensus_peers.cc:597] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:02.061096 20398 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:02.128433 22518 raft_consensus.cc:493] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:02.129050 22518 raft_consensus.cc:515] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:15:02.138844 19789 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:02.143837 22518 leader_election.cc:290] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:02.152698 19788 leader_election.cc:336] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:02.153179 19788 leader_election.cc:304] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:02.154958 22518 raft_consensus.cc:2749] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:02.185837 19789 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:02.193835 18407 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 19771)
I20260709 12:15:02.285720 22518 raft_consensus.cc:493] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:02.286495 22518 raft_consensus.cc:515] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:15:02.299770 20398 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:02.309463 22518 leader_election.cc:290] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:02.317132 22524 raft_consensus.cc:493] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:15:02.320469 19604 debug-util.cc:398] Leaking SignalData structure 0x7b08000387e0 after lost signal to thread 18410
W20260709 12:15:02.321250 19789 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:02.321610 19604 debug-util.cc:398] Leaking SignalData structure 0x7b0800038620 after lost signal to thread 19607
W20260709 12:15:02.322970 19604 debug-util.cc:398] Leaking SignalData structure 0x7b0800389f60 after lost signal to thread 19848
W20260709 12:15:02.324142 19604 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7700 after lost signal to thread 20457
W20260709 12:15:02.329871 19788 leader_election.cc:336] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:02.330526 19788 leader_election.cc:304] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:02.332159 22518 raft_consensus.cc:2749] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:02.319049 22524 raft_consensus.cc:515] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } }
I20260709 12:15:02.346894 22524 leader_election.cc:290] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:02.349536 19788 leader_election.cc:336] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:02.350207 19789 leader_election.cc:336] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:02.350660 19789 leader_election.cc:304] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:02.352140 22524 raft_consensus.cc:2749] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:02.365118 19789 consensus_peers.cc:597] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:02.383859 19789 consensus_peers.cc:597] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:02.447903 20398 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:02.480588 20397 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:02.705865 19788 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:02.881816 19788 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:02.882676 19788 consensus_peers.cc:597] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:02.889190 20397 consensus_peers.cc:597] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:02.890717 19789 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:02.896708 22529 raft_consensus.cc:493] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:02.897835 22529 raft_consensus.cc:515] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:02.900897 22529 leader_election.cc:290] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:02.918056 20397 consensus_peers.cc:597] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:02.921674 19788 leader_election.cc:336] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:02.946978 19789 leader_election.cc:336] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:02.947535 19789 leader_election.cc:304] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:02.948488 22531 raft_consensus.cc:2749] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:02.961846 20397 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:02.969811 20397 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:03.083318 22531 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:03.084379 22531 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:15:03.098095 19789 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:03.099197 19788 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:03.099664 19788 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:03.100670 22529 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:03.101787 22531 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:03.106454 22529 raft_consensus.cc:493] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:03.108985 22529 raft_consensus.cc:515] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:03.111935 22529 leader_election.cc:290] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:03.121146 19789 leader_election.cc:336] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:03.125252 19788 leader_election.cc:336] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:03.125866 19788 leader_election.cc:304] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:03.126799 22529 raft_consensus.cc:2749] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:03.194527 18407 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 19771)
I20260709 12:15:03.206151 22529 raft_consensus.cc:493] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:03.207469 22529 raft_consensus.cc:515] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:03.210116 22529 leader_election.cc:290] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:03.224188 19789 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:03.264053 19788 leader_election.cc:336] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:03.271121 19788 leader_election.cc:304] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:03.274999 22529 raft_consensus.cc:2749] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:03.329363 22513 raft_consensus.cc:493] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:03.330209 22513 raft_consensus.cc:515] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:15:03.343961 20398 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:03.355526 22513 leader_election.cc:290] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:03.357733 22531 raft_consensus.cc:493] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:03.358830 22531 raft_consensus.cc:515] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:03.361591 22531 leader_election.cc:290] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:03.364001 20397 leader_election.cc:336] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:03.369549 20397 leader_election.cc:304] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:03.371268 22533 raft_consensus.cc:2749] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:03.422470 19788 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:03.432813 19789 leader_election.cc:336] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:03.444576 19789 leader_election.cc:304] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:03.451061 22529 raft_consensus.cc:2749] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:03.515522 19845 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbfe0 after lost signal to thread 18410
W20260709 12:15:03.517293 19845 debug-util.cc:398] Leaking SignalData structure 0x7b0800299620 after lost signal to thread 19607
W20260709 12:15:03.519320 19845 debug-util.cc:398] Leaking SignalData structure 0x7b08001f4e80 after lost signal to thread 19848
W20260709 12:15:03.520744 19845 debug-util.cc:398] Leaking SignalData structure 0x7b0800315580 after lost signal to thread 20457
I20260709 12:15:03.561517 22529 raft_consensus.cc:493] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:03.562408 22529 raft_consensus.cc:515] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:15:03.577322 19788 leader_election.cc:336] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:03.578729 19789 leader_election.cc:336] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:03.580117 22529 leader_election.cc:290] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:03.579324 19789 leader_election.cc:304] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:03.582890 22529 raft_consensus.cc:2749] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:03.630167 20397 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:03.836673 20397 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:03.877139 19788 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:03.878350 22529 raft_consensus.cc:493] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:03.879185 22529 raft_consensus.cc:515] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:15:03.903465 19788 leader_election.cc:336] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:03.886582 22529 leader_election.cc:290] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:03.909721 19789 leader_election.cc:336] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:03.910297 19789 leader_election.cc:304] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:03.912247 22529 raft_consensus.cc:2749] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:03.926345 20398 consensus_peers.cc:597] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:03.935827 20397 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:15:03.968969 22531 raft_consensus.cc:493] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:03.969894 22531 raft_consensus.cc:515] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:03.972731 22531 leader_election.cc:290] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:03.979287 19788 leader_election.cc:336] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:03.981439 19789 leader_election.cc:336] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:03.981972 19789 leader_election.cc:304] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:03.983711 22531 raft_consensus.cc:2749] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:04.015374 22529 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.016224 22529 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:04.021373 22529 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:04.022094 22529 raft_consensus.cc:493] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.022924 22529 raft_consensus.cc:515] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:04.029686 22529 leader_election.cc:290] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:04.026584 19788 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:04.036074 19789 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:04.041272 19789 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:15:04.038856 19788 leader_election.cc:336] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:04.056952 22529 raft_consensus.cc:2749] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:04.060685 19789 leader_election.cc:336] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:04.061249 19789 leader_election.cc:304] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.062701 22529 raft_consensus.cc:2749] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:04.111078 22529 raft_consensus.cc:493] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.111968 22529 raft_consensus.cc:515] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:04.116935 22513 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.117751 22513 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:15:04.119227 22529 leader_election.cc:290] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:04.123782 19789 leader_election.cc:336] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:04.130184 19788 leader_election.cc:336] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:04.130738 19788 leader_election.cc:304] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.131711 22529 raft_consensus.cc:2749] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:04.132283 20397 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:04.138141 22513 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:04.140287 20398 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:04.140839 20398 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.142323 22513 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:04.168241 20398 consensus_peers.cc:597] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:04.195133 18407 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 19771)
I20260709 12:15:04.242533 22529 raft_consensus.cc:493] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.243399 22529 raft_consensus.cc:515] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:04.249159 22529 leader_election.cc:290] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:04.251530 19788 leader_election.cc:336] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:04.283619 19788 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:04.284686 19789 leader_election.cc:336] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:04.285243 19789 leader_election.cc:304] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.287463 22529 raft_consensus.cc:2749] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:04.289996 20397 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:04.309487 19789 consensus_peers.cc:597] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:04.321194 20398 consensus_peers.cc:597] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:04.342193 20397 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:04.392517 20397 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:15:04.407297 22529 raft_consensus.cc:493] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.408221 22529 raft_consensus.cc:515] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:15:04.419070 19789 leader_election.cc:336] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:04.420076 19788 leader_election.cc:336] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:04.420588 19788 leader_election.cc:304] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.421519 22531 raft_consensus.cc:2749] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:04.423460 22529 leader_election.cc:290] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:04.449090 20398 consensus_peers.cc:597] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:04.456636 20398 consensus_peers.cc:597] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:04.464150 22513 raft_consensus.cc:493] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.465152 22513 raft_consensus.cc:515] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:15:04.467511 22513 leader_election.cc:290] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:04.470400 22513 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.471993 22513 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:15:04.475343 20398 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:04.479537 22513 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:04.480646 20397 leader_election.cc:336] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:04.482100 20397 leader_election.cc:304] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.483218 22533 raft_consensus.cc:2749] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:04.489293 20398 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:04.492722 20397 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:04.496953 20397 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.498287 22536 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:04.536717 19789 consensus_peers.cc:597] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:04.589130 22529 raft_consensus.cc:493] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.589761 22529 raft_consensus.cc:515] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:04.592001 22529 leader_election.cc:290] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:04.598747 19788 leader_election.cc:336] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:04.603690 19789 leader_election.cc:336] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:04.604118 19789 leader_election.cc:304] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.605286 22529 raft_consensus.cc:2749] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:04.629034 19789 consensus_peers.cc:597] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:04.665685 20398 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:04.681535 19789 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:04.685200 22529 raft_consensus.cc:493] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.685950 22529 raft_consensus.cc:515] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:15:04.695951 19788 leader_election.cc:336] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:04.698040 19789 leader_election.cc:336] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:04.698459 19789 leader_election.cc:304] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.699220 22531 raft_consensus.cc:2749] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:04.700425 22529 leader_election.cc:290] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:04.711886 19789 consensus_peers.cc:597] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:04.731455 22529 raft_consensus.cc:493] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.732052 22529 raft_consensus.cc:515] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:04.734202 22529 leader_election.cc:290] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:04.741792 19789 leader_election.cc:336] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:04.742955 19788 leader_election.cc:336] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:04.743355 19788 leader_election.cc:304] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.744686 22529 raft_consensus.cc:2749] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:04.751991 22537 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.753202 22537 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:15:04.756157 22537 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:04.761332 22529 raft_consensus.cc:493] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.762086 22529 raft_consensus.cc:515] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:04.764727 22529 leader_election.cc:290] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:04.765758 20398 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:04.767696 19789 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:04.769022 20397 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:04.769577 20397 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.771190 22537 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:04.772174 19788 leader_election.cc:336] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:04.779688 19789 leader_election.cc:336] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:04.782532 19789 leader_election.cc:304] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:04.784150 22529 raft_consensus.cc:2749] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:04.821130 19558 catalog_manager.cc:4755] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 62ed1b9937fd41ab83a0000603a38fc9: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:04.833930 20398 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:04.983834 22529 raft_consensus.cc:493] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:04.984647 22529 raft_consensus.cc:515] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:04.989771 22529 leader_election.cc:290] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:04.993487 19789 leader_election.cc:336] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
W20260709 12:15:05.002100 20398 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:05.002921 19788 leader_election.cc:336] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:05.003407 19788 leader_election.cc:304] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:05.004201 22529 raft_consensus.cc:2749] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:05.082324 22529 raft_consensus.cc:493] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:05.083197 22529 raft_consensus.cc:515] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:15:05.091197 19788 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:05.092409 22529 leader_election.cc:290] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:05.107436 20397 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:05.108314 19789 leader_election.cc:336] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:05.110136 19789 leader_election.cc:304] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:05.111728 22529 raft_consensus.cc:2749] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:05.119673 22529 raft_consensus.cc:493] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:05.120517 22529 raft_consensus.cc:515] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:05.141366 22529 leader_election.cc:290] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:05.149600 19788 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:05.159351 20397 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:05.161638 19789 consensus_peers.cc:597] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:05.164847 19789 leader_election.cc:336] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:05.165428 19789 leader_election.cc:304] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:05.166316 22529 raft_consensus.cc:2749] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:05.170766 19789 consensus_peers.cc:597] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:05.195153 19788 consensus_peers.cc:597] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:05.195824 18407 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 19771)
I20260709 12:15:05.239490 22531 raft_consensus.cc:493] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:05.240290 22531 raft_consensus.cc:515] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:05.250187 22529 raft_consensus.cc:493] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:15:05.254006 19788 consensus_peers.cc:597] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:05.255618 22529 raft_consensus.cc:515] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:05.261387 22529 leader_election.cc:290] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:05.242731 22531 leader_election.cc:290] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:05.279814 19788 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:05.293876 19788 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:05.314374 20397 consensus_peers.cc:597] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:05.339167 19789 leader_election.cc:336] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:05.346004 19789 leader_election.cc:304] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:05.346917 22529 raft_consensus.cc:2749] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:05.347056 19789 leader_election.cc:336] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:05.348282 19789 leader_election.cc:304] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:05.349239 22529 raft_consensus.cc:2749] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:05.365813 20397 consensus_peers.cc:597] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:05.372185 19788 consensus_peers.cc:597] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:05.408092 22529 raft_consensus.cc:493] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:05.408972 22529 raft_consensus.cc:515] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
W20260709 12:15:05.421244 19788 leader_election.cc:336] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:05.431506 19789 leader_election.cc:336] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:05.432565 19789 leader_election.cc:304] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:05.430029 22529 leader_election.cc:290] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:05.433671 22540 raft_consensus.cc:2749] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:05.452363 18407 tablet_server.cc:196] TabletServer@127.17.249.194:0 shutdown complete.
W20260709 12:15:05.561378 20397 consensus_peers.cc:597] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:05.698498 18407 tablet_server.cc:179] TabletServer@127.17.249.195:0 shutting down...
I20260709 12:15:05.702090 22540 raft_consensus.cc:493] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:05.702881 22540 raft_consensus.cc:515] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:05.707831 22540 leader_election.cc:290] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:05.712713 19789 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:05.722400 22533 raft_consensus.cc:493] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
W20260709 12:15:05.740111 19788 leader_election.cc:336] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:05.740756 19788 leader_election.cc:304] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:05.742579 22541 raft_consensus.cc:2749] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:05.723670 22533 raft_consensus.cc:515] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
W20260709 12:15:05.782547 20396 consensus_peers.cc:597] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:05.783576 20396 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:05.793553 22533 leader_election.cc:290] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:05.800953 20397 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:05.809160 20398 leader_election.cc:336] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:05.809823 20398 leader_election.cc:304] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:15:05.813763 20396 consensus_peers.cc:597] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:05.816825 22543 raft_consensus.cc:2749] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:05.842401 20396 consensus_peers.cc:597] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:05.852615 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:05.853940 18407 tablet_replica.cc:333] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.854858 22529 raft_consensus.cc:493] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:05.855522 22529 raft_consensus.cc:515] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:05.857916 22529 leader_election.cc:290] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:05.863459 19789 leader_election.cc:336] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:05.864642 22529 raft_consensus.cc:493] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:05.865249 22529 raft_consensus.cc:515] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } }
I20260709 12:15:05.867486 22529 leader_election.cc:290] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:05.869412 19788 leader_election.cc:336] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:05.871358 19788 leader_election.cc:304] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
W20260709 12:15:05.872886 19789 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:05.877306 22529 raft_consensus.cc:2749] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:05.873703 18407 raft_consensus.cc:2243] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:05.880641 18407 raft_consensus.cc:2272] T 1fed9282bd954e378bf04bb924e3e716 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:05.883057 19788 leader_election.cc:336] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:05.883718 19788 leader_election.cc:304] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f9fb1b1a86c4eb99abdbaf9d239e324; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:05.884418 18407 tablet_replica.cc:333] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.884562 22529 raft_consensus.cc:2749] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:05.885977 18407 raft_consensus.cc:2243] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.886930 18407 raft_consensus.cc:2272] T 5ca66c6318754a02b1dc2218db00b004 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.890910 18407 tablet_replica.cc:333] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.892268 18407 raft_consensus.cc:2243] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:05.894145 18407 raft_consensus.cc:2272] T b65b6b06871344a9bd4bbd3e34b99502 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.897745 18407 tablet_replica.cc:333] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.898924 18407 raft_consensus.cc:2243] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.899793 18407 raft_consensus.cc:2272] T 20afb18f0c024945ab458d1b8f6c62aa P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.904435 18407 tablet_replica.cc:333] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.905473 18407 raft_consensus.cc:2243] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.906211 18407 raft_consensus.cc:2272] T 31e10328bf7c47c599ca08bbced8fe7e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.909237 18407 tablet_replica.cc:333] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.910219 18407 raft_consensus.cc:2243] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:05.911736 18407 raft_consensus.cc:2272] T 65e1443af427414db7bbd4a4be3fa074 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.914834 18407 tablet_replica.cc:333] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.915768 18407 raft_consensus.cc:2243] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.916555 18407 raft_consensus.cc:2272] T 1a16e4dda0004683a44ee0708e576b6a P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.919852 18407 tablet_replica.cc:333] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
W20260709 12:15:05.919878 20396 consensus_peers.cc:597] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:05.920993 18407 raft_consensus.cc:2243] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.922288 18407 raft_consensus.cc:2272] T 62ed1b9937fd41ab83a0000603a38fc9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.925347 18407 tablet_replica.cc:333] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.926405 18407 raft_consensus.cc:2243] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.927182 18407 raft_consensus.cc:2272] T ef4176fd716e466dae3f850b4d2c258f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.930171 18407 tablet_replica.cc:333] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.931053 18407 raft_consensus.cc:2243] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.932014 18407 raft_consensus.cc:2272] T e480dc321ba24a11bdd32d2f0298f2e1 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.934902 18407 tablet_replica.cc:333] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
W20260709 12:15:05.935144 20396 consensus_peers.cc:597] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:05.935911 18407 raft_consensus.cc:2243] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.936970 18407 raft_consensus.cc:2272] T c56f5017d25a447ab75b3f0cb650c9e6 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.940395 18407 tablet_replica.cc:333] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
W20260709 12:15:05.940960 20396 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:05.941429 18407 raft_consensus.cc:2243] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.942466 18407 raft_consensus.cc:2272] T a2ba1229768c4d258720bb3492dde33d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.945626 18407 tablet_replica.cc:333] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.946623 18407 raft_consensus.cc:2243] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.949095 18407 raft_consensus.cc:2272] T 5281957321c64f93988644f4841fbe35 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.952138 18407 tablet_replica.cc:333] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.953119 18407 raft_consensus.cc:2243] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.953768 18407 raft_consensus.cc:2272] T 798fecda3ed247f4941d585924251970 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.958236 18407 tablet_replica.cc:333] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.959192 18407 raft_consensus.cc:2243] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.960052 18407 raft_consensus.cc:2272] T 4dfc1fb42f6b4712acea35286ba371c3 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.964608 18407 tablet_replica.cc:333] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.965548 18407 raft_consensus.cc:2243] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.966367 18407 raft_consensus.cc:2272] T 185cd8f7a6e242a7993588e5c71850fd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.969908 18407 tablet_replica.cc:333] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.970845 18407 raft_consensus.cc:2243] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.971541 18407 raft_consensus.cc:2272] T a78fc08630dd4a7494e6acb5b859150f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.974570 18407 tablet_replica.cc:333] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.975484 18407 raft_consensus.cc:2243] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.976351 18407 raft_consensus.cc:2272] T 298cdd8cc5a94e2d9165affadf233104 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.979375 18407 tablet_replica.cc:333] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.980413 18407 raft_consensus.cc:2243] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.981040 18407 raft_consensus.cc:2272] T 0057355e85a74bfa9919f82a00f3fecc P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.985138 18407 tablet_replica.cc:333] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.985996 18407 raft_consensus.cc:2243] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.986696 18407 raft_consensus.cc:2272] T 729536e45a0e41f181949f78e28166c2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.989497 18407 tablet_replica.cc:333] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.991326 18407 raft_consensus.cc:2243] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.992735 18407 raft_consensus.cc:2272] T 9f633905374c40ef9d178aa3de255d6f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:05.995697 18407 tablet_replica.cc:333] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:05.996645 18407 raft_consensus.cc:2243] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:05.998376 18407 raft_consensus.cc:2272] T c9123f5829474284995dd8a5c8139d82 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.001201 18407 tablet_replica.cc:333] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
W20260709 12:15:06.001734 20396 consensus_peers.cc:597] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:06.002065 18407 raft_consensus.cc:2243] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.003325 18407 raft_consensus.cc:2272] T 3a1b950de64348a69098644dcf9be21d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.006395 18407 tablet_replica.cc:333] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
W20260709 12:15:06.006466 20396 consensus_peers.cc:597] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:06.007377 18407 raft_consensus.cc:2243] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:06.008891 18407 raft_consensus.cc:2272] T 739682f97cd84854a1b009c4b2271c7b P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.013358 18407 tablet_replica.cc:333] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.014288 18407 raft_consensus.cc:2243] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:06.015605 18407 raft_consensus.cc:2272] T 199b867263264f1c8e61b1e410b2a082 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.019232 18407 tablet_replica.cc:333] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.020177 18407 raft_consensus.cc:2243] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:15:06.021189 20396 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:06.021634 18407 raft_consensus.cc:2272] T 613b9bd906514e3684eb97813eda93a5 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:06.025525 20396 consensus_peers.cc:597] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:06.026073 18407 tablet_replica.cc:333] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.027068 18407 raft_consensus.cc:2243] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:06.028455 18407 raft_consensus.cc:2272] T 062f541ef1eb40229095ed423b256495 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.032397 18407 tablet_replica.cc:333] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.033396 18407 raft_consensus.cc:2243] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.034165 18407 raft_consensus.cc:2272] T 38079882b39945f6b049a6e7401f7280 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.037308 18407 tablet_replica.cc:333] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.038128 18407 raft_consensus.cc:2243] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.038905 18407 raft_consensus.cc:2272] T fd361cc5d6794bb1a8c5e6cf32a7a8fe P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.042177 18407 tablet_replica.cc:333] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.043046 18407 raft_consensus.cc:2243] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.043725 18407 raft_consensus.cc:2272] T d86cf843c11e474cb87f4e55acb4505d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.046713 18407 tablet_replica.cc:333] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.047551 18407 raft_consensus.cc:2243] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.048239 18407 raft_consensus.cc:2272] T 478219fa5bde484ea1c2b7351aa260c7 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.051290 18407 tablet_replica.cc:333] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.052147 18407 raft_consensus.cc:2243] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.053088 18407 raft_consensus.cc:2272] T 09360ce480dc4631988b668a1a16fd23 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.057544 18407 tablet_replica.cc:333] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.058549 18407 raft_consensus.cc:2243] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:06.060204 18407 raft_consensus.cc:2272] T f034c09c286a4ac3a1f560c84eb05120 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.063409 18407 tablet_replica.cc:333] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.064313 18407 raft_consensus.cc:2243] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.064944 18407 raft_consensus.cc:2272] T e46881c3a8b942fcb904f98b7ac1716f P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.068322 18407 tablet_replica.cc:333] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.069217 18407 raft_consensus.cc:2243] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.069226 22543 raft_consensus.cc:493] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:06.070091 18407 raft_consensus.cc:2272] T 364cf3a27fd34a1a913602f0fdb49018 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.070230 22543 raft_consensus.cc:515] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:15:06.074375 18407 tablet_replica.cc:333] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.075609 18407 raft_consensus.cc:2243] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.076720 18407 raft_consensus.cc:2272] T 8f69387176614121ab470bb58987f450 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:06.079536 20397 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:06.080543 18407 tablet_replica.cc:333] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.081600 18407 raft_consensus.cc:2243] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.082466 18407 raft_consensus.cc:2272] T 3efb146893bc46c5b42e3fc209a2135d P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.085930 18407 tablet_replica.cc:333] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
W20260709 12:15:06.086300 20398 leader_election.cc:336] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:06.086922 18407 raft_consensus.cc:2243] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.086936 20398 leader_election.cc:304] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:06.087812 18407 raft_consensus.cc:2272] T dc5e311340504d31a6b1704b5459afa8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.088358 22533 raft_consensus.cc:2749] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:06.087073 22543 leader_election.cc:290] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:06.091504 18407 tablet_replica.cc:333] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.092465 18407 raft_consensus.cc:2243] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.093313 18407 raft_consensus.cc:2272] T 871f15effca34f488df4f83da15c1167 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.096891 18407 tablet_replica.cc:333] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.097842 18407 raft_consensus.cc:2243] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.098573 18407 raft_consensus.cc:2272] T def3393082b24fed88cd1cc954e4e568 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:06.098748 20396 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:06.101724 18407 tablet_replica.cc:333] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.102639 18407 raft_consensus.cc:2243] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.103461 18407 raft_consensus.cc:2272] T 705ac6c3557f4f89b2fe88524f96bafb P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.106520 18407 tablet_replica.cc:333] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.107388 18407 raft_consensus.cc:2243] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:06.107793 20396 consensus_peers.cc:597] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:06.108134 18407 raft_consensus.cc:2272] T 20aaa30e54fa432caa5875892f7b4398 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.111464 18407 tablet_replica.cc:333] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.112291 18407 raft_consensus.cc:2243] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.112957 18407 raft_consensus.cc:2272] T f602836b3181405ca03967cbb5c11bc2 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.116235 18407 tablet_replica.cc:333] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.117142 18407 raft_consensus.cc:2243] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.117887 18407 raft_consensus.cc:2272] T e32227fe2da84ebdaa3ba00cfe55031e P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.120954 18407 tablet_replica.cc:333] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.121737 18407 raft_consensus.cc:2243] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.122447 18407 raft_consensus.cc:2272] T 8da80375ede34511af0e77afa09d8640 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.125397 18407 tablet_replica.cc:333] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.126216 18407 raft_consensus.cc:2243] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.127476 18407 raft_consensus.cc:2272] T a61494383461482b9ddf0e4f6ceb4323 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:06.129510 20396 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf -> Peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Couldn't send request to peer 1f9fb1b1a86c4eb99abdbaf9d239e324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:06.130692 18407 tablet_replica.cc:333] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.131544 18407 raft_consensus.cc:2243] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:06.133111 18407 raft_consensus.cc:2272] T 186a44ea95974c119996690984996f55 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.137665 18407 tablet_replica.cc:333] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.138620 18407 raft_consensus.cc:2243] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.139287 18407 raft_consensus.cc:2272] T 5895f7d8826c4e48a39f2ead181ee1bd P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.142239 18407 tablet_replica.cc:333] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.143059 18407 raft_consensus.cc:2243] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.143810 18407 raft_consensus.cc:2272] T d7c81f67e1574e8eb631a5176b7276f9 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.146915 18407 tablet_replica.cc:333] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.147637 18407 raft_consensus.cc:2243] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.148461 18407 raft_consensus.cc:2272] T 70bffa2c492142dcb1c6ffe4ce59bde8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:06.151422 18407 tablet_replica.cc:333] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324: stopping tablet replica
I20260709 12:15:06.152298 18407 raft_consensus.cc:2243] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:06.153226 18407 raft_consensus.cc:2272] T f571c10f46804596bd8b664f6181c2c8 P 1f9fb1b1a86c4eb99abdbaf9d239e324 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:06.238988 20397 consensus_peers.cc:597] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:06.278851 20397 consensus_peers.cc:597] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:06.349756 20397 consensus_peers.cc:597] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:06.365696 20398 consensus_peers.cc:597] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:06.480582 22537 raft_consensus.cc:493] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:06.481202 22537 raft_consensus.cc:515] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:15:06.483605 22537 leader_election.cc:290] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
W20260709 12:15:06.488375 20397 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:06.499158 20398 leader_election.cc:336] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:06.499958 20398 leader_election.cc:304] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:06.501286 22537 raft_consensus.cc:2749] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:06.626061 20398 consensus_peers.cc:597] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:06.757263 20398 consensus_peers.cc:597] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:06.764238 20397 consensus_peers.cc:597] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:06.798425 20398 consensus_peers.cc:597] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:06.810539 20397 consensus_peers.cc:597] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:06.820788 18407 tablet_server.cc:196] TabletServer@127.17.249.195:0 shutdown complete.
W20260709 12:15:06.827572 20398 consensus_peers.cc:597] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf -> Peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Couldn't send request to peer ca42d3c27d2e46348120791d1282b193. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:06.839143 22537 raft_consensus.cc:493] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1f9fb1b1a86c4eb99abdbaf9d239e324)
I20260709 12:15:06.840016 22537 raft_consensus.cc:515] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "1f9fb1b1a86c4eb99abdbaf9d239e324" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42991 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:15:06.856473 22537 leader_election.cc:290] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991)
W20260709 12:15:06.862183 20396 leader_election.cc:336] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1f9fb1b1a86c4eb99abdbaf9d239e324 (127.17.249.195:42991): Network error: Client connection negotiation failed: client connection to 127.17.249.195:42991: connect: Connection refused (error 111)
W20260709 12:15:06.873106 20397 leader_election.cc:336] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:06.873832 20397 leader_election.cc:304] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: 1f9fb1b1a86c4eb99abdbaf9d239e324, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:06.874905 22537 raft_consensus.cc:2749] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:06.971032 22537 raft_consensus.cc:493] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca42d3c27d2e46348120791d1282b193)
I20260709 12:15:06.971726 22537 raft_consensus.cc:515] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f662c4f7d6a74013a1e58a5330a049b8" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 36713 } } peers { permanent_uuid: "ca42d3c27d2e46348120791d1282b193" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 46489 } } peers { permanent_uuid: "b12c250fb1a244ed9a49cf86950af1bf" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 38821 } attrs { promote: false } }
I20260709 12:15:06.981587 18407 tablet_server.cc:179] TabletServer@127.17.249.196:0 shutting down...
W20260709 12:15:06.988443 20398 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111) [suppressed 406 similar messages]
W20260709 12:15:06.991968 20397 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
W20260709 12:15:06.994258 20398 leader_election.cc:336] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489): Network error: Client connection negotiation failed: client connection to 127.17.249.194:46489: connect: Connection refused (error 111)
I20260709 12:15:06.994959 20398 leader_election.cc:304] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b12c250fb1a244ed9a49cf86950af1bf; no voters: ca42d3c27d2e46348120791d1282b193, f662c4f7d6a74013a1e58a5330a049b8
I20260709 12:15:06.994990 22537 leader_election.cc:290] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713), ca42d3c27d2e46348120791d1282b193 (127.17.249.194:46489)
I20260709 12:15:06.996137 22543 raft_consensus.cc:2749] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:07.067062 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:07.070274 18407 tablet_replica.cc:333] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.071430 18407 raft_consensus.cc:2243] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.073282 18407 raft_consensus.cc:2272] T 9f633905374c40ef9d178aa3de255d6f P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.076620 18407 tablet_replica.cc:333] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.077481 18407 raft_consensus.cc:2243] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.078703 18407 raft_consensus.cc:2272] T a61494383461482b9ddf0e4f6ceb4323 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.082212 18407 tablet_replica.cc:333] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.083279 18407 raft_consensus.cc:2243] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.084544 18407 raft_consensus.cc:2272] T 62ed1b9937fd41ab83a0000603a38fc9 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.088253 18407 tablet_replica.cc:333] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.089161 18407 raft_consensus.cc:2243] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.089861 18407 raft_consensus.cc:2272] T 613b9bd906514e3684eb97813eda93a5 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:07.090893 20397 consensus_peers.cc:597] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf -> Peer f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): Couldn't send request to peer f662c4f7d6a74013a1e58a5330a049b8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:07.093722 18407 tablet_replica.cc:333] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.094942 18407 raft_consensus.cc:2243] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.095837 18407 raft_consensus.cc:2272] T 26992be39c764bb3bc020dd42bc74a55 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.099255 18407 tablet_replica.cc:333] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.100257 18407 raft_consensus.cc:2243] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.101577 18407 raft_consensus.cc:2272] T c9123f5829474284995dd8a5c8139d82 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.104646 18407 tablet_replica.cc:333] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.105572 18407 raft_consensus.cc:2243] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.106675 18407 raft_consensus.cc:2272] T b9b26df664874fc9abfb63a819ba56f7 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.109714 18407 tablet_replica.cc:333] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.110613 18407 raft_consensus.cc:2243] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.112058 18407 raft_consensus.cc:2272] T 38079882b39945f6b049a6e7401f7280 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.115211 18407 tablet_replica.cc:333] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.116151 18407 raft_consensus.cc:2243] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.116863 18407 raft_consensus.cc:2272] T 062f541ef1eb40229095ed423b256495 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.120131 18407 tablet_replica.cc:333] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.121043 18407 raft_consensus.cc:2243] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.121781 18407 raft_consensus.cc:2272] T 1c3fa3feedde422fbce04c9f6ab16f44 P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.124832 18407 tablet_replica.cc:333] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.125702 18407 raft_consensus.cc:2243] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.126942 18407 raft_consensus.cc:2272] T 871f15effca34f488df4f83da15c1167 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.130108 18407 tablet_replica.cc:333] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.131084 18407 raft_consensus.cc:2243] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.132386 18407 raft_consensus.cc:2272] T f602836b3181405ca03967cbb5c11bc2 P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.135677 18407 tablet_replica.cc:333] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.136561 18407 raft_consensus.cc:2243] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.137910 18407 raft_consensus.cc:2272] T 2ccab10bc1b5444482abde3bf4bced52 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.141053 18407 tablet_replica.cc:333] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.141873 18407 raft_consensus.cc:2243] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.143167 18407 raft_consensus.cc:2272] T 8da80375ede34511af0e77afa09d8640 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.146539 18407 tablet_replica.cc:333] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.147456 18407 raft_consensus.cc:2243] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.148762 18407 raft_consensus.cc:2272] T 5895f7d8826c4e48a39f2ead181ee1bd P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.151639 18407 tablet_replica.cc:333] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.152554 18407 raft_consensus.cc:2243] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.154256 18407 raft_consensus.cc:2272] T bc8e96dba8054da2a8d0b930ae6a53a0 P b12c250fb1a244ed9a49cf86950af1bf [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.157575 18407 tablet_replica.cc:333] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.158452 18407 raft_consensus.cc:2243] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.159796 18407 raft_consensus.cc:2272] T 798fecda3ed247f4941d585924251970 P b12c250fb1a244ed9a49cf86950af1bf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.163149 18407 tablet_replica.cc:333] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.163980 18407 raft_consensus.cc:2243] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.164728 18407 raft_consensus.cc:2272] T cf852411f79143c4b7d9d087e57902ee P b12c250fb1a244ed9a49cf86950af1bf [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.167996 18407 tablet_replica.cc:333] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.168800 18407 raft_consensus.cc:2243] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.169940 18407 raft_consensus.cc:2272] T 20afb18f0c024945ab458d1b8f6c62aa P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.173326 18407 tablet_replica.cc:333] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.174149 18407 raft_consensus.cc:2243] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.175047 18407 raft_consensus.cc:2272] T f055e0ff3254433f83caca3e0e190a4c P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.179337 18407 tablet_replica.cc:333] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.180229 18407 raft_consensus.cc:2243] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.181007 18407 raft_consensus.cc:2272] T f034c09c286a4ac3a1f560c84eb05120 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.184487 18407 tablet_replica.cc:333] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.185336 18407 raft_consensus.cc:2243] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.186113 18407 raft_consensus.cc:2272] T 9a2ad2622957437eae185bfda331f538 P b12c250fb1a244ed9a49cf86950af1bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.189481 18407 tablet_replica.cc:333] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.190357 18407 raft_consensus.cc:2243] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.191836 18407 raft_consensus.cc:2272] T d86cf843c11e474cb87f4e55acb4505d P b12c250fb1a244ed9a49cf86950af1bf [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.195861 18407 tablet_replica.cc:333] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.196736 18407 raft_consensus.cc:2243] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.198256 18407 raft_consensus.cc:2272] T 09360ce480dc4631988b668a1a16fd23 P b12c250fb1a244ed9a49cf86950af1bf [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.202188 18407 tablet_replica.cc:333] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.203203 18407 raft_consensus.cc:2243] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.204308 18407 raft_consensus.cc:2272] T 199b867263264f1c8e61b1e410b2a082 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.208009 18407 tablet_replica.cc:333] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.208896 18407 raft_consensus.cc:2243] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.210302 18407 raft_consensus.cc:2272] T 3a1b950de64348a69098644dcf9be21d P b12c250fb1a244ed9a49cf86950af1bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.213500 18407 tablet_replica.cc:333] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf: stopping tablet replica
I20260709 12:15:07.214200 18407 raft_consensus.cc:2243] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.214845 18407 raft_consensus.cc:2272] T 1fed9282bd954e378bf04bb924e3e716 P b12c250fb1a244ed9a49cf86950af1bf [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.467677 18407 tablet_server.cc:196] TabletServer@127.17.249.196:0 shutdown complete.
I20260709 12:15:07.541045 18407 master.cc:562] Master@127.17.249.254:37145 shutting down...
W20260709 12:15:07.600181 19621 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:15:07.600639 19621 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:15:07.600896 19621 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:15:09.588960 19604 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2480 after lost signal to thread 18410
W20260709 12:15:09.589443 19604 debug-util.cc:398] Leaking SignalData structure 0x7b080031cb20 after lost signal to thread 19607
W20260709 12:15:21.230597 19558 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111) [suppressed 12 similar messages]
W20260709 12:15:21.234741 19558 catalog_manager.cc:4755] TS f662c4f7d6a74013a1e58a5330a049b8 (127.17.249.193:36713): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 62ed1b9937fd41ab83a0000603a38fc9: Network error: Client connection negotiation failed: client connection to 127.17.249.193:36713: connect: Connection refused (error 111)
I20260709 12:15:24.623605 18407 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:24.624996 18407 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.625454 18407 tablet_replica.cc:333] T 00000000000000000000000000000000 P ece09a42b2e24409af39499c01c3884f: stopping tablet replica
I20260709 12:15:24.795568 18407 master.cc:584] Master@127.17.249.254:37145 shutdown complete.
I20260709 12:15:24.853976 18407 test_util.cc:182] -----------------------------------------------
I20260709 12:15:24.854300 18407 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599138854584-18407-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (122134 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:15:24.858667 18407 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.249.254:41671
I20260709 12:15:24.860113 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:24.866869 22552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:24.867483 22554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:24.867803 22551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:24.868989 18407 server_base.cc:1061] running on GCE node
I20260709 12:15:24.871490 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:24.871726 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:24.871894 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599324871873 us; error 0 us; skew 500 ppm
I20260709 12:15:24.872489 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:24.875499 18407 webserver.cc:533] Webserver started at http://127.17.249.254:42511/ using document root <none> and password file <none>
I20260709 12:15:24.876116 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:24.876328 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:24.876631 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:24.878124 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/master-0-root/instance:
uuid: "cca02bb097e24340a2d738fc4f06877d"
format_stamp: "Formatted at 2026-07-09 12:15:24 on dist-test-slave-7mcn"
I20260709 12:15:24.884028 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:24.888284 22559 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:24.889214 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:15:24.889578 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/master-0-root
uuid: "cca02bb097e24340a2d738fc4f06877d"
format_stamp: "Formatted at 2026-07-09 12:15:24 on dist-test-slave-7mcn"
I20260709 12:15:24.889909 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:24.933913 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:24.935442 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:24.986577 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.254:41671
I20260709 12:15:24.986711 22610 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.254:41671 every 8 connection(s)
I20260709 12:15:24.991894 22611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:25.004243 22611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Bootstrap starting.
I20260709 12:15:25.008939 22611 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.013723 22611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: No bootstrap required, opened a new log
I20260709 12:15:25.016026 22611 raft_consensus.cc:359] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca02bb097e24340a2d738fc4f06877d" member_type: VOTER }
I20260709 12:15:25.016482 22611 raft_consensus.cc:385] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.016665 22611 raft_consensus.cc:740] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca02bb097e24340a2d738fc4f06877d, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.017285 22611 consensus_queue.cc:260] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca02bb097e24340a2d738fc4f06877d" member_type: VOTER }
I20260709 12:15:25.017720 22611 raft_consensus.cc:399] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:25.017925 22611 raft_consensus.cc:493] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:25.018150 22611 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.023276 22611 raft_consensus.cc:515] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca02bb097e24340a2d738fc4f06877d" member_type: VOTER }
I20260709 12:15:25.023772 22611 leader_election.cc:304] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cca02bb097e24340a2d738fc4f06877d; no voters: 
I20260709 12:15:25.025017 22611 leader_election.cc:290] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:25.025718 22614 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.027580 22614 raft_consensus.cc:697] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [term 1 LEADER]: Becoming Leader. State: Replica: cca02bb097e24340a2d738fc4f06877d, State: Running, Role: LEADER
I20260709 12:15:25.028522 22611 sys_catalog.cc:565] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:25.028450 22614 consensus_queue.cc:237] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca02bb097e24340a2d738fc4f06877d" member_type: VOTER }
I20260709 12:15:25.040512 22616 sys_catalog.cc:455] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [sys.catalog]: SysCatalogTable state changed. Reason: New leader cca02bb097e24340a2d738fc4f06877d. Latest consensus state: current_term: 1 leader_uuid: "cca02bb097e24340a2d738fc4f06877d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca02bb097e24340a2d738fc4f06877d" member_type: VOTER } }
I20260709 12:15:25.041760 22615 sys_catalog.cc:455] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cca02bb097e24340a2d738fc4f06877d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca02bb097e24340a2d738fc4f06877d" member_type: VOTER } }
I20260709 12:15:25.042605 22615 sys_catalog.cc:458] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:25.043808 22616 sys_catalog.cc:458] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:25.045680 22628 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:25.045943 18407 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:25.051491 22628 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:25.061305 22628 catalog_manager.cc:1383] Generated new cluster ID: 738cdcd8c2004f8b8b9316df9085266e
I20260709 12:15:25.061694 22628 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:25.094995 22628 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:25.096815 22628 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:25.111668 22628 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Generated new TSK 0
I20260709 12:15:25.112360 22628 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:25.177597 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:25.185333 22632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:25.186444 22633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:25.187623 22635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:25.188858 18407 server_base.cc:1061] running on GCE node
I20260709 12:15:25.191098 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:25.191318 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:25.191560 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599325191520 us; error 0 us; skew 500 ppm
I20260709 12:15:25.192256 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:25.195264 18407 webserver.cc:533] Webserver started at http://127.17.249.193:40455/ using document root <none> and password file <none>
I20260709 12:15:25.195874 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:25.196101 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:25.196450 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:25.197898 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/instance:
uuid: "a89a4b420ea9496aab55475fc38bb6f7"
format_stamp: "Formatted at 2026-07-09 12:15:25 on dist-test-slave-7mcn"
I20260709 12:15:25.203446 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:15:25.207680 22640 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.208714 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:15:25.209131 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-0-root
uuid: "a89a4b420ea9496aab55475fc38bb6f7"
format_stamp: "Formatted at 2026-07-09 12:15:25 on dist-test-slave-7mcn"
I20260709 12:15:25.209519 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:25.232658 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:25.234211 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:25.236081 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:25.239486 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:25.239805 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.240119 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:25.240327 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.291498 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.193:33285
I20260709 12:15:25.291666 22702 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.193:33285 every 8 connection(s)
I20260709 12:15:25.297780 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:25.307281 22707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:25.307928 22708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:25.311746 22710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:25.313436 18407 server_base.cc:1061] running on GCE node
I20260709 12:15:25.316295 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:25.316684 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:25.316975 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599325316950 us; error 0 us; skew 500 ppm
I20260709 12:15:25.317890 22703 heartbeater.cc:344] Connected to a master server at 127.17.249.254:41671
I20260709 12:15:25.317997 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:25.318452 22703 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:25.319465 22703 heartbeater.cc:507] Master 127.17.249.254:41671 requested a full tablet report, sending...
I20260709 12:15:25.321679 18407 webserver.cc:533] Webserver started at http://127.17.249.194:36017/ using document root <none> and password file <none>
I20260709 12:15:25.322227 22576 ts_manager.cc:194] Registered new tserver with Master: a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:25.322474 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:25.322904 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:25.323258 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:25.324389 22576 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43972
I20260709 12:15:25.325062 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/instance:
uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
format_stamp: "Formatted at 2026-07-09 12:15:25 on dist-test-slave-7mcn"
I20260709 12:15:25.331190 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:15:25.335382 22715 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.336318 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:15:25.336694 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-1-root
uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
format_stamp: "Formatted at 2026-07-09 12:15:25 on dist-test-slave-7mcn"
I20260709 12:15:25.337093 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:25.367255 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:25.368898 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:25.370683 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:25.373474 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:25.373726 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.374007 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:25.374197 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.431733 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.194:36669
I20260709 12:15:25.431833 22777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.194:36669 every 8 connection(s)
I20260709 12:15:25.438537 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:25.448575 22781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:25.449851 22782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:25.451251 22778 heartbeater.cc:344] Connected to a master server at 127.17.249.254:41671
I20260709 12:15:25.451996 22778 heartbeater.cc:461] Registering TS with master...
W20260709 12:15:25.452317 22784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:25.453327 22778 heartbeater.cc:507] Master 127.17.249.254:41671 requested a full tablet report, sending...
I20260709 12:15:25.453490 18407 server_base.cc:1061] running on GCE node
I20260709 12:15:25.454717 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:25.455056 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:25.455220 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599325455207 us; error 0 us; skew 500 ppm
I20260709 12:15:25.455747 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:25.456283 22576 ts_manager.cc:194] Registered new tserver with Master: e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:25.458320 22576 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43984
I20260709 12:15:25.458720 18407 webserver.cc:533] Webserver started at http://127.17.249.195:43521/ using document root <none> and password file <none>
I20260709 12:15:25.459378 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:25.459635 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:25.459968 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:25.461201 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/instance:
uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
format_stamp: "Formatted at 2026-07-09 12:15:25 on dist-test-slave-7mcn"
I20260709 12:15:25.466449 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:15:25.470568 22789 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.471616 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:25.472002 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-2-root
uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
format_stamp: "Formatted at 2026-07-09 12:15:25 on dist-test-slave-7mcn"
I20260709 12:15:25.472339 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:25.485737 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:25.487201 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:25.488821 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:25.492530 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:25.492779 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.493057 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:25.493242 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.541441 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.195:38963
I20260709 12:15:25.541637 22851 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.195:38963 every 8 connection(s)
I20260709 12:15:25.547761 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:25.557171 22855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:25.559628 22856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:25.562918 18407 server_base.cc:1061] running on GCE node
I20260709 12:15:25.564150 22852 heartbeater.cc:344] Connected to a master server at 127.17.249.254:41671
I20260709 12:15:25.564648 22852 heartbeater.cc:461] Registering TS with master...
W20260709 12:15:25.565070 22858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:25.565686 22852 heartbeater.cc:507] Master 127.17.249.254:41671 requested a full tablet report, sending...
I20260709 12:15:25.566195 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:25.566565 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:25.566860 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599325566838 us; error 0 us; skew 500 ppm
I20260709 12:15:25.567691 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:25.568358 22576 ts_manager.cc:194] Registered new tserver with Master: cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:25.570426 22576 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43994
I20260709 12:15:25.571002 18407 webserver.cc:533] Webserver started at http://127.17.249.196:41441/ using document root <none> and password file <none>
I20260709 12:15:25.571700 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:25.571943 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:25.572352 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:25.573601 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-3-root/instance:
uuid: "2c3a0d56045540b7802937559599f09c"
format_stamp: "Formatted at 2026-07-09 12:15:25 on dist-test-slave-7mcn"
I20260709 12:15:25.578888 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:15:25.582736 22863 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.583704 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:25.584090 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-3-root
uuid: "2c3a0d56045540b7802937559599f09c"
format_stamp: "Formatted at 2026-07-09 12:15:25 on dist-test-slave-7mcn"
I20260709 12:15:25.584417 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:25.602934 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:25.604278 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:25.605965 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:25.608700 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:25.608994 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.609275 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:25.609457 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:25.662657 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.196:37425
I20260709 12:15:25.662879 22925 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.196:37425 every 8 connection(s)
I20260709 12:15:25.681478 22926 heartbeater.cc:344] Connected to a master server at 127.17.249.254:41671
I20260709 12:15:25.681985 22926 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:25.682961 22926 heartbeater.cc:507] Master 127.17.249.254:41671 requested a full tablet report, sending...
I20260709 12:15:25.685304 22576 ts_manager.cc:194] Registered new tserver with Master: 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:25.686458 18407 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01987373s
I20260709 12:15:25.687160 22576 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43998
I20260709 12:15:25.723263 22576 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44004:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:15:26.003475 22743 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5e2a8f5b814b18a53ee5c8af767da0 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:26.004225 22741 tablet_service.cc:1511] Processing CreateTablet for tablet ab94770ad5c445e6bfb4a7fdd20ca0f2 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:26.005724 22743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5e2a8f5b814b18a53ee5c8af767da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.006558 22741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab94770ad5c445e6bfb4a7fdd20ca0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.008685 22742 tablet_service.cc:1511] Processing CreateTablet for tablet fb26ab285f3946aaa4009cfc56fb98fc (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:26.008862 22891 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5e2a8f5b814b18a53ee5c8af767da0 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:26.010653 22742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb26ab285f3946aaa4009cfc56fb98fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.010876 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5e2a8f5b814b18a53ee5c8af767da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.019294 22740 tablet_service.cc:1511] Processing CreateTablet for tablet d65fa6d7d4a74fa3bf4c3beda5687094 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:26.020089 22890 tablet_service.cc:1511] Processing CreateTablet for tablet ab94770ad5c445e6bfb4a7fdd20ca0f2 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:26.021441 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65fa6d7d4a74fa3bf4c3beda5687094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.022163 22890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab94770ad5c445e6bfb4a7fdd20ca0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.033933 22889 tablet_service.cc:1511] Processing CreateTablet for tablet a655a30b57d84c3da5e562990d01f8fe (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:26.035784 22889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a655a30b57d84c3da5e562990d01f8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.036073 22739 tablet_service.cc:1511] Processing CreateTablet for tablet c11f2301e6294b5ab1244e4784694274 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:15:26.037698 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11f2301e6294b5ab1244e4784694274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.040705 22738 tablet_service.cc:1511] Processing CreateTablet for tablet 76cb1231be0940089338c6aeb27ce69f (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:26.041201 22888 tablet_service.cc:1511] Processing CreateTablet for tablet c11f2301e6294b5ab1244e4784694274 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
W20260709 12:15:26.044478 22623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:26.044651 22887 tablet_service.cc:1511] Processing CreateTablet for tablet c887310d0efc43dbb01d55c7f99ff9a3 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:26.059937 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11f2301e6294b5ab1244e4784694274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.060678 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c887310d0efc43dbb01d55c7f99ff9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.068186 22668 tablet_service.cc:1511] Processing CreateTablet for tablet fb26ab285f3946aaa4009cfc56fb98fc (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:26.069722 22668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb26ab285f3946aaa4009cfc56fb98fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.072144 22667 tablet_service.cc:1511] Processing CreateTablet for tablet ab94770ad5c445e6bfb4a7fdd20ca0f2 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:26.073688 22667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab94770ad5c445e6bfb4a7fdd20ca0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.075994 22666 tablet_service.cc:1511] Processing CreateTablet for tablet a655a30b57d84c3da5e562990d01f8fe (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:26.078884 22665 tablet_service.cc:1511] Processing CreateTablet for tablet d65fa6d7d4a74fa3bf4c3beda5687094 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:26.081276 22664 tablet_service.cc:1511] Processing CreateTablet for tablet c11f2301e6294b5ab1244e4784694274 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:15:26.059937 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cb1231be0940089338c6aeb27ce69f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.084733 22663 tablet_service.cc:1511] Processing CreateTablet for tablet c887310d0efc43dbb01d55c7f99ff9a3 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:26.095449 22665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65fa6d7d4a74fa3bf4c3beda5687094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.097332 22663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c887310d0efc43dbb01d55c7f99ff9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.100435 22664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11f2301e6294b5ab1244e4784694274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.107224 22666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a655a30b57d84c3da5e562990d01f8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.136924 22817 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5e2a8f5b814b18a53ee5c8af767da0 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:26.137284 22815 tablet_service.cc:1511] Processing CreateTablet for tablet a655a30b57d84c3da5e562990d01f8fe (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:26.139729 22812 tablet_service.cc:1511] Processing CreateTablet for tablet 76cb1231be0940089338c6aeb27ce69f (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:26.140046 22813 tablet_service.cc:1511] Processing CreateTablet for tablet c887310d0efc43dbb01d55c7f99ff9a3 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:26.142880 22742 tablet_service.cc:1511] Processing CreateTablet for tablet 4cb67a71a0954b2bab724a9e4399cf13 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:26.143905 22814 tablet_service.cc:1511] Processing CreateTablet for tablet d65fa6d7d4a74fa3bf4c3beda5687094 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:26.144508 22742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cb67a71a0954b2bab724a9e4399cf13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.145174 22888 tablet_service.cc:1511] Processing CreateTablet for tablet 76cb1231be0940089338c6aeb27ce69f (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:26.146493 22886 tablet_service.cc:1511] Processing CreateTablet for tablet b5e170feadac4d27875b0a4c85b6d329 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:26.148738 22662 tablet_service.cc:1511] Processing CreateTablet for tablet 4cb67a71a0954b2bab724a9e4399cf13 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:26.149497 22811 tablet_service.cc:1511] Processing CreateTablet for tablet 4cb67a71a0954b2bab724a9e4399cf13 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:26.150317 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cb67a71a0954b2bab724a9e4399cf13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.146644 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cb1231be0940089338c6aeb27ce69f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.142656 22816 tablet_service.cc:1511] Processing CreateTablet for tablet fb26ab285f3946aaa4009cfc56fb98fc (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:26.156215 22812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76cb1231be0940089338c6aeb27ce69f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.159868 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65fa6d7d4a74fa3bf4c3beda5687094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.163749 22815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a655a30b57d84c3da5e562990d01f8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.168151 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e170feadac4d27875b0a4c85b6d329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.168380 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cb67a71a0954b2bab724a9e4399cf13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.172287 22813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c887310d0efc43dbb01d55c7f99ff9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.173163 22816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb26ab285f3946aaa4009cfc56fb98fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.175325 22817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5e2a8f5b814b18a53ee5c8af767da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.182248 22946 tablet_bootstrap.cc:492] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:26.189085 22661 tablet_service.cc:1511] Processing CreateTablet for tablet b5e170feadac4d27875b0a4c85b6d329 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:26.191110 22661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e170feadac4d27875b0a4c85b6d329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.240602 22740 tablet_service.cc:1511] Processing CreateTablet for tablet b5e170feadac4d27875b0a4c85b6d329 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:26.242282 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e170feadac4d27875b0a4c85b6d329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.279989 22946 tablet_bootstrap.cc:654] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.290915 22810 tablet_service.cc:1511] Processing CreateTablet for tablet 50b97aee66fb461a98eb4b2f92bb3c53 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:26.292500 22810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b97aee66fb461a98eb4b2f92bb3c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.309716 22891 tablet_service.cc:1511] Processing CreateTablet for tablet 50b97aee66fb461a98eb4b2f92bb3c53 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:26.311411 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b97aee66fb461a98eb4b2f92bb3c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.311931 22660 tablet_service.cc:1511] Processing CreateTablet for tablet 50b97aee66fb461a98eb4b2f92bb3c53 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:26.313577 22660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b97aee66fb461a98eb4b2f92bb3c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.317469 22947 tablet_bootstrap.cc:492] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:26.327557 22703 heartbeater.cc:499] Master 127.17.249.254:41671 was elected leader, sending a full tablet report...
I20260709 12:15:26.343647 22948 tablet_bootstrap.cc:492] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:26.348960 22947 tablet_bootstrap.cc:654] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.379993 22950 tablet_bootstrap.cc:492] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:26.382270 22739 tablet_service.cc:1511] Processing CreateTablet for tablet e2718d64abf84eb5b425ac4d5bd7217e (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:26.383682 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2718d64abf84eb5b425ac4d5bd7217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.385306 22947 tablet_bootstrap.cc:492] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:26.385933 22947 ts_tablet_manager.cc:1403] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.006s
I20260709 12:15:26.389173 22947 raft_consensus.cc:359] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:26.389830 22947 raft_consensus.cc:385] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.390110 22947 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.390954 22947 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:26.393147 22811 tablet_service.cc:1511] Processing CreateTablet for tablet e2718d64abf84eb5b425ac4d5bd7217e (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:26.394666 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2718d64abf84eb5b425ac4d5bd7217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.399806 22886 tablet_service.cc:1511] Processing CreateTablet for tablet e2718d64abf84eb5b425ac4d5bd7217e (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:26.401408 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2718d64abf84eb5b425ac4d5bd7217e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.401328 22738 tablet_service.cc:1511] Processing CreateTablet for tablet 87de87ebaff74d67abf876d88dc7a0e7 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:26.402670 22809 tablet_service.cc:1511] Processing CreateTablet for tablet 87de87ebaff74d67abf876d88dc7a0e7 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:26.403213 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87de87ebaff74d67abf876d88dc7a0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.404254 22809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87de87ebaff74d67abf876d88dc7a0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.406102 22948 tablet_bootstrap.cc:654] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.398698 22663 tablet_service.cc:1511] Processing CreateTablet for tablet 87de87ebaff74d67abf876d88dc7a0e7 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:26.408167 22663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87de87ebaff74d67abf876d88dc7a0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.443924 22888 tablet_service.cc:1511] Processing CreateTablet for tablet 44cb46cd92c346879a120a3d3b95561a (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:26.444720 22947 ts_tablet_manager.cc:1434] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.006s
I20260709 12:15:26.445627 22926 heartbeater.cc:499] Master 127.17.249.254:41671 was elected leader, sending a full tablet report...
I20260709 12:15:26.446128 22947 tablet_bootstrap.cc:492] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:26.450202 22946 tablet_bootstrap.cc:492] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:26.453472 22950 tablet_bootstrap.cc:654] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.458288 22946 ts_tablet_manager.cc:1403] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.277s	user 0.014s	sys 0.011s
I20260709 12:15:26.461675 22778 heartbeater.cc:499] Master 127.17.249.254:41671 was elected leader, sending a full tablet report...
I20260709 12:15:26.450681 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44cb46cd92c346879a120a3d3b95561a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.468310 22946 raft_consensus.cc:359] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:26.469288 22946 raft_consensus.cc:385] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.469640 22946 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.470832 22948 tablet_bootstrap.cc:492] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:26.470687 22946 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:26.471416 22948 ts_tablet_manager.cc:1403] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.128s	user 0.037s	sys 0.005s
I20260709 12:15:26.472352 22662 tablet_service.cc:1511] Processing CreateTablet for tablet 44cb46cd92c346879a120a3d3b95561a (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:26.474705 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44cb46cd92c346879a120a3d3b95561a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.478858 22948 raft_consensus.cc:359] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:26.479918 22948 raft_consensus.cc:385] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.480216 22948 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.481180 22948 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:26.513127 22946 ts_tablet_manager.cc:1434] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.054s	user 0.021s	sys 0.010s
I20260709 12:15:26.514611 22946 tablet_bootstrap.cc:492] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:26.514665 22887 tablet_service.cc:1511] Processing CreateTablet for tablet 5085cb71870c4e7782244635c250487e (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:26.516458 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5085cb71870c4e7782244635c250487e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.523403 22946 tablet_bootstrap.cc:654] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.525727 22660 tablet_service.cc:1511] Processing CreateTablet for tablet 5085cb71870c4e7782244635c250487e (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:26.527401 22660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5085cb71870c4e7782244635c250487e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.527999 22740 tablet_service.cc:1511] Processing CreateTablet for tablet 44cb46cd92c346879a120a3d3b95561a (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:26.529371 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44cb46cd92c346879a120a3d3b95561a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.529683 22950 tablet_bootstrap.cc:492] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:26.530494 22950 ts_tablet_manager.cc:1403] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.151s	user 0.014s	sys 0.019s
I20260709 12:15:26.534531 22814 tablet_service.cc:1511] Processing CreateTablet for tablet 5085cb71870c4e7782244635c250487e (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:26.536469 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5085cb71870c4e7782244635c250487e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.536024 22950 raft_consensus.cc:359] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:26.537302 22950 raft_consensus.cc:385] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.537755 22950 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.534449 22809 tablet_service.cc:1511] Processing CreateTablet for tablet a59fd6638f4a4b539acee7e61d0a1e9c (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:26.540134 22809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a59fd6638f4a4b539acee7e61d0a1e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.540524 22738 tablet_service.cc:1511] Processing CreateTablet for tablet a59fd6638f4a4b539acee7e61d0a1e9c (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:26.542101 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a59fd6638f4a4b539acee7e61d0a1e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.542917 22948 ts_tablet_manager.cc:1434] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.018s
I20260709 12:15:26.544436 22948 tablet_bootstrap.cc:492] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:26.548758 22704 tablet.cc:2406] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:26.550284 22950 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:26.557914 22891 tablet_service.cc:1511] Processing CreateTablet for tablet a59fd6638f4a4b539acee7e61d0a1e9c (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:26.559749 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a59fd6638f4a4b539acee7e61d0a1e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.568507 22950 ts_tablet_manager.cc:1434] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.038s	user 0.012s	sys 0.002s
I20260709 12:15:26.569922 22852 heartbeater.cc:499] Master 127.17.249.254:41671 was elected leader, sending a full tablet report...
I20260709 12:15:26.575533 22950 tablet_bootstrap.cc:492] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:26.579336 22948 tablet_bootstrap.cc:654] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.585443 22947 tablet_bootstrap.cc:654] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.599236 22663 tablet_service.cc:1511] Processing CreateTablet for tablet 036d0d4c85cb4c92bbe5eff5c95a2441 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:26.601099 22663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036d0d4c85cb4c92bbe5eff5c95a2441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.611476 22950 tablet_bootstrap.cc:654] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.612959 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 036d0d4c85cb4c92bbe5eff5c95a2441 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:26.621183 22946 tablet_bootstrap.cc:492] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:26.621830 22946 ts_tablet_manager.cc:1403] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.034s
I20260709 12:15:26.623009 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036d0d4c85cb4c92bbe5eff5c95a2441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.625231 22946 raft_consensus.cc:359] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:26.626190 22946 raft_consensus.cc:385] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.626578 22946 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.627642 22946 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:26.640913 22958 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.638942 22890 tablet_service.cc:1511] Processing CreateTablet for tablet c2f844c714924331b8be9b262fed0ddf (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:26.649281 22662 tablet_service.cc:1511] Processing CreateTablet for tablet c2f844c714924331b8be9b262fed0ddf (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:26.650931 22742 tablet_service.cc:1511] Processing CreateTablet for tablet c2f844c714924331b8be9b262fed0ddf (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:26.651886 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f844c714924331b8be9b262fed0ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.651942 22890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f844c714924331b8be9b262fed0ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.652817 22958 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:26.656100 22946 ts_tablet_manager.cc:1434] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 12:15:26.657271 22946 tablet_bootstrap.cc:492] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:26.652423 22742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f844c714924331b8be9b262fed0ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.659498 22948 tablet_bootstrap.cc:492] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:26.660080 22948 ts_tablet_manager.cc:1403] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.116s	user 0.016s	sys 0.004s
I20260709 12:15:26.669081 22811 tablet_service.cc:1511] Processing CreateTablet for tablet a35aee871f0b41e48335c0260a873076 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:26.671165 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35aee871f0b41e48335c0260a873076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.673131 22958 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:26.645031 22809 tablet_service.cc:1511] Processing CreateTablet for tablet 036d0d4c85cb4c92bbe5eff5c95a2441 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:26.687456 22809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036d0d4c85cb4c92bbe5eff5c95a2441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.692685 22948 raft_consensus.cc:359] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:26.693516 22948 raft_consensus.cc:385] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.693826 22948 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.701025 22891 tablet_service.cc:1511] Processing CreateTablet for tablet a35aee871f0b41e48335c0260a873076 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:26.701027 22660 tablet_service.cc:1511] Processing CreateTablet for tablet a35aee871f0b41e48335c0260a873076 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:26.702665 22660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35aee871f0b41e48335c0260a873076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.704910 22948 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:26.702665 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35aee871f0b41e48335c0260a873076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.711648 22946 tablet_bootstrap.cc:654] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.712056 22948 ts_tablet_manager.cc:1434] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.052s	user 0.003s	sys 0.006s
I20260709 12:15:26.746999 22814 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f073d198a4fd3a66aeb940d0b5ab1 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:26.747444 22947 tablet_bootstrap.cc:492] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:26.748293 22947 ts_tablet_manager.cc:1403] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.303s	user 0.023s	sys 0.003s
I20260709 12:15:26.748505 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f073d198a4fd3a66aeb940d0b5ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.754925 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:26.744762 22948 tablet_bootstrap.cc:492] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:26.753279 22888 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f073d198a4fd3a66aeb940d0b5ab1 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:26.755847 22947 raft_consensus.cc:359] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:26.756683 22790 leader_election.cc:343] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.757143 22947 raft_consensus.cc:385] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.757277 22742 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f073d198a4fd3a66aeb940d0b5ab1 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:26.758637 22742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f073d198a4fd3a66aeb940d0b5ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.757613 22947 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.759809 22947 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:26.765528 22663 tablet_service.cc:1511] Processing CreateTablet for tablet d360a1924d3c4721bf24cc5f0f17a90b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:26.756989 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f073d198a4fd3a66aeb940d0b5ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.770186 22950 tablet_bootstrap.cc:492] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:26.770686 22663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d360a1924d3c4721bf24cc5f0f17a90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.775020 22950 ts_tablet_manager.cc:1403] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.200s	user 0.023s	sys 0.014s
I20260709 12:15:26.776523 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:15:26.782905 22791 leader_election.cc:343] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.784461 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:26.804311 22958 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:26.804656 22890 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd506104b9c45169fdf473e38bd2352 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:26.787077 22948 tablet_bootstrap.cc:654] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.806233 22890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd506104b9c45169fdf473e38bd2352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.793260 22947 ts_tablet_manager.cc:1434] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.001s
I20260709 12:15:26.807621 22947 tablet_bootstrap.cc:492] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:26.807175 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd506104b9c45169fdf473e38bd2352 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:26.808800 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd506104b9c45169fdf473e38bd2352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.816767 22660 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd506104b9c45169fdf473e38bd2352 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:26.818233 22660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd506104b9c45169fdf473e38bd2352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.818066 22816 tablet_service.cc:1511] Processing CreateTablet for tablet 19a3e6a508714389b60c10fd4363972c (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:26.819380 22816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19a3e6a508714389b60c10fd4363972c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.827761 22887 tablet_service.cc:1511] Processing CreateTablet for tablet 19a3e6a508714389b60c10fd4363972c (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:26.827761 22662 tablet_service.cc:1511] Processing CreateTablet for tablet 19a3e6a508714389b60c10fd4363972c (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:26.828346 22950 raft_consensus.cc:359] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:26.829418 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19a3e6a508714389b60c10fd4363972c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.829646 22950 raft_consensus.cc:385] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.830377 22950 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.827831 22811 tablet_service.cc:1511] Processing CreateTablet for tablet d360a1924d3c4721bf24cc5f0f17a90b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:26.834127 22740 tablet_service.cc:1511] Processing CreateTablet for tablet af9dd2cd94724707b7aafa424c43031d (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:26.840689 22891 tablet_service.cc:1511] Processing CreateTablet for tablet af9dd2cd94724707b7aafa424c43031d (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:26.841495 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9dd2cd94724707b7aafa424c43031d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.842515 22950 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:26.841569 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d360a1924d3c4721bf24cc5f0f17a90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.803048 22742 tablet_service.cc:1511] Processing CreateTablet for tablet d360a1924d3c4721bf24cc5f0f17a90b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:26.829418 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19a3e6a508714389b60c10fd4363972c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.852635 22742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d360a1924d3c4721bf24cc5f0f17a90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.853911 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9dd2cd94724707b7aafa424c43031d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.854420 22947 tablet_bootstrap.cc:654] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.839407 22815 tablet_service.cc:1511] Processing CreateTablet for tablet af9dd2cd94724707b7aafa424c43031d (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:26.855629 22815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9dd2cd94724707b7aafa424c43031d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.856637 22956 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.857278 22956 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:26.862532 22956 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:26.864892 22738 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5c847d65ef47b0b14af4905d5a5fdb (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:15:26.865005 22953 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.866951 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5c847d65ef47b0b14af4905d5a5fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.866727 22953 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:26.869024 22946 tablet_bootstrap.cc:492] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:26.869699 22946 ts_tablet_manager.cc:1403] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.213s	user 0.016s	sys 0.011s
I20260709 12:15:26.846650 22950 ts_tablet_manager.cc:1434] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.071s	user 0.004s	sys 0.004s
I20260709 12:15:26.881539 22953 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:26.885108 22955 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.885753 22955 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:26.886466 22661 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5c847d65ef47b0b14af4905d5a5fdb (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:15:26.888098 22661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5c847d65ef47b0b14af4905d5a5fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.889995 22955 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:26.893174 22946 raft_consensus.cc:359] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:26.894170 22946 raft_consensus.cc:385] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.894557 22946 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.895535 22946 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:26.907192 22950 tablet_bootstrap.cc:492] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:26.906612 22665 tablet_service.cc:1511] Processing CreateTablet for tablet a2d5308b787c474aa407e2d08bb254b9 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:26.908444 22665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2d5308b787c474aa407e2d08bb254b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.912011 22739 tablet_service.cc:1511] Processing CreateTablet for tablet a2d5308b787c474aa407e2d08bb254b9 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:26.913519 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2d5308b787c474aa407e2d08bb254b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.898613 22946 ts_tablet_manager.cc:1434] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:15:26.914901 22946 tablet_bootstrap.cc:492] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:26.921463 22948 tablet_bootstrap.cc:492] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:26.922300 22948 ts_tablet_manager.cc:1403] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.185s	user 0.006s	sys 0.015s
I20260709 12:15:26.923275 22809 tablet_service.cc:1511] Processing CreateTablet for tablet 600c0eed9d234060b395482bb7c21cb8 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:26.924957 22809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600c0eed9d234060b395482bb7c21cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.926281 22946 tablet_bootstrap.cc:654] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.926409 22948 raft_consensus.cc:359] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:26.950163 22953 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.954062 22662 tablet_service.cc:1511] Processing CreateTablet for tablet 600c0eed9d234060b395482bb7c21cb8 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:26.957672 22814 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5c847d65ef47b0b14af4905d5a5fdb (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:15:26.964762 22948 raft_consensus.cc:385] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.980311 22948 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.967832 22953 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:26.990710 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5c847d65ef47b0b14af4905d5a5fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.996824 22740 tablet_service.cc:1511] Processing CreateTablet for tablet e8b793d48d6b4e5db13d9e6811d51310 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:26.997467 22953 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:26.998353 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b793d48d6b4e5db13d9e6811d51310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.999722 22958 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.000401 22958 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.000849 22810 tablet_service.cc:1511] Processing CreateTablet for tablet e8b793d48d6b4e5db13d9e6811d51310 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:27.002254 22810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b793d48d6b4e5db13d9e6811d51310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:26.993199 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600c0eed9d234060b395482bb7c21cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.008527 22948 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:27.020439 22664 tablet_service.cc:1511] Processing CreateTablet for tablet 17a6be884c6d4eeabbf042ccacf06ef6 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:27.021915 22664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a6be884c6d4eeabbf042ccacf06ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.040062 22955 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.040630 22955 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.040758 22742 tablet_service.cc:1511] Processing CreateTablet for tablet 17a6be884c6d4eeabbf042ccacf06ef6 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:27.043851 22742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a6be884c6d4eeabbf042ccacf06ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.043787 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:27.045357 22753 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:27.044385 22958 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:27.045607 22946 tablet_bootstrap.cc:492] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:27.046536 22946 ts_tablet_manager.cc:1403] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.132s	user 0.041s	sys 0.025s
I20260709 12:15:27.047205 22950 tablet_bootstrap.cc:654] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.047923 22641 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:27.049477 22956 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.050051 22956 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.049990 22946 raft_consensus.cc:359] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.050963 22956 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.051247 22946 raft_consensus.cc:385] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.051654 22946 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.053617 22946 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.043128 22955 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:27.034469 22948 ts_tablet_manager.cc:1434] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.109s	user 0.010s	sys 0.001s
I20260709 12:15:27.072934 22946 ts_tablet_manager.cc:1434] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.026s	user 0.013s	sys 0.006s
I20260709 12:15:27.074330 22946 tablet_bootstrap.cc:492] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:27.079311 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:27.096251 22623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:27.098870 22738 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4b3aaf1b5e494ca5ea0e6f05bdf52b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:27.100276 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4b3aaf1b5e494ca5ea0e6f05bdf52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.099941 22660 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4b3aaf1b5e494ca5ea0e6f05bdf52b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:27.101732 22660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4b3aaf1b5e494ca5ea0e6f05bdf52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.102254 22809 tablet_service.cc:1511] Processing CreateTablet for tablet 17a6be884c6d4eeabbf042ccacf06ef6 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:27.103803 22809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a6be884c6d4eeabbf042ccacf06ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.104665 22888 tablet_service.cc:1511] Processing CreateTablet for tablet a2d5308b787c474aa407e2d08bb254b9 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:27.105373 22891 tablet_service.cc:1511] Processing CreateTablet for tablet e8b793d48d6b4e5db13d9e6811d51310 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:27.106166 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2d5308b787c474aa407e2d08bb254b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.107450 22890 tablet_service.cc:1511] Processing CreateTablet for tablet 600c0eed9d234060b395482bb7c21cb8 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:27.110369 22886 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4b3aaf1b5e494ca5ea0e6f05bdf52b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:27.134161 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b793d48d6b4e5db13d9e6811d51310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.134887 22947 tablet_bootstrap.cc:492] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:27.135087 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4b3aaf1b5e494ca5ea0e6f05bdf52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.135776 22955 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.136297 22955 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.138199 22948 tablet_bootstrap.cc:492] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:27.138474 22890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600c0eed9d234060b395482bb7c21cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.138352 22955 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:27.139514 22947 ts_tablet_manager.cc:1403] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.332s	user 0.024s	sys 0.008s
I20260709 12:15:27.143113 22947 raft_consensus.cc:359] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:27.144085 22947 raft_consensus.cc:385] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:27.125979 22790 leader_election.cc:343] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.157853 22948 tablet_bootstrap.cc:654] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.146941 22947 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.167150 22956 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.169847 22956 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:27.170449 22956 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.170917 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:27.174016 22753 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.172708 22742 tablet_service.cc:1511] Processing CreateTablet for tablet 2961a92dd3ac479293a445dd4ee87d3b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:27.180030 22742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2961a92dd3ac479293a445dd4ee87d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.182490 22956 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:27.231585 22984 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.232591 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:27.212204 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:27.203243 22981 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.237111 22950 tablet_bootstrap.cc:492] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:27.207294 22947 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:27.237733 22950 ts_tablet_manager.cc:1403] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.331s	user 0.016s	sys 0.026s
I20260709 12:15:27.197245 22946 tablet_bootstrap.cc:654] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.207381 22811 tablet_service.cc:1511] Processing CreateTablet for tablet 2961a92dd3ac479293a445dd4ee87d3b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:27.207381 22887 tablet_service.cc:1511] Processing CreateTablet for tablet ba50a8d617df425cbc405952d1742265 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:27.240224 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2961a92dd3ac479293a445dd4ee87d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.203874 22810 tablet_service.cc:1511] Processing CreateTablet for tablet ba50a8d617df425cbc405952d1742265 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:27.244733 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba50a8d617df425cbc405952d1742265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.233414 22984 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:27.235702 22981 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:27.212301 22956 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:27.252399 22981 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:27.207090 22663 tablet_service.cc:1511] Processing CreateTablet for tablet ba50a8d617df425cbc405952d1742265 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:27.254050 22663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba50a8d617df425cbc405952d1742265. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:27.256494 22791 leader_election.cc:343] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.257241 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:27.258277 22958 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.259025 22752 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:27.264575 22947 ts_tablet_manager.cc:1434] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.003s
I20260709 12:15:27.265949 22947 tablet_bootstrap.cc:492] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:27.284461 22950 raft_consensus.cc:359] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:27.282284 22810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba50a8d617df425cbc405952d1742265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.298413 22641 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:27.299460 22956 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.299863 22956 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.300209 22956 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.311055 22753 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:27.285372 22947 tablet_bootstrap.cc:654] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.287086 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:27.288034 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:27.313514 22900 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:27.314079 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:27.314757 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:27.289386 22888 tablet_service.cc:1511] Processing CreateTablet for tablet 2961a92dd3ac479293a445dd4ee87d3b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:27.317144 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2961a92dd3ac479293a445dd4ee87d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.317238 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:27.290097 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:27.291067 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:27.318843 22751 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 0.
I20260709 12:15:27.314181 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:27.320825 22864 leader_election.cc:343] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.321581 22864 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:27.322451 22953 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.322981 22953 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.323323 22953 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.312741 22641 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:15:27.328538 22717 leader_election.cc:343] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.329437 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:27.334686 22738 tablet_service.cc:1511] Processing CreateTablet for tablet c98b51f118bc481dbf774ac4738c9617 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:27.337255 22981 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.337715 22981 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.338057 22981 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.338171 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b51f118bc481dbf774ac4738c9617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.340175 22984 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:27.340888 22984 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:27.341367 22984 raft_consensus.cc:697] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:27.343778 22948 tablet_bootstrap.cc:492] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:27.344414 22948 ts_tablet_manager.cc:1403] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.207s	user 0.013s	sys 0.025s
I20260709 12:15:27.344465 22946 tablet_bootstrap.cc:492] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:27.345183 22946 ts_tablet_manager.cc:1403] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.271s	user 0.023s	sys 0.014s
W20260709 12:15:27.347494 22642 leader_election.cc:343] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:27.348325 22642 leader_election.cc:343] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:27.348577 22865 leader_election.cc:343] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.349057 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:27.350580 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:27.293915 22950 raft_consensus.cc:385] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.356621 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:27.357452 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:27.358052 22946 raft_consensus.cc:359] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:27.367558 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:27.371834 22901 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:27.371953 22946 raft_consensus.cc:385] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.372516 22946 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.373344 22946 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:27.359113 22642 leader_election.cc:343] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.375452 22642 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:27.367992 22950 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.359393 22886 tablet_service.cc:1511] Processing CreateTablet for tablet 4af65e8169664ec2afee890830d185cf (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:27.380131 22950 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:27.381242 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af65e8169664ec2afee890830d185cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.342352 22984 consensus_queue.cc:237] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.389487 22946 ts_tablet_manager.cc:1434] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.005s
I20260709 12:15:27.364773 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:27.391808 22950 ts_tablet_manager.cc:1434] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.154s	user 0.010s	sys 0.002s
I20260709 12:15:27.366075 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:27.360139 22814 tablet_service.cc:1511] Processing CreateTablet for tablet c98b51f118bc481dbf774ac4738c9617 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:27.393282 22956 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:27.394846 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b51f118bc481dbf774ac4738c9617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.395109 22678 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:27.391048 22946 tablet_bootstrap.cc:492] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
W20260709 12:15:27.408576 22641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 95959.8us
I20260709 12:15:27.410847 22742 tablet_service.cc:1511] Processing CreateTablet for tablet 4af65e8169664ec2afee890830d185cf (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:27.412392 22742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af65e8169664ec2afee890830d185cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.412112 22663 tablet_service.cc:1511] Processing CreateTablet for tablet c98b51f118bc481dbf774ac4738c9617 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:27.413576 22663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b51f118bc481dbf774ac4738c9617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.413273 22953 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:27.414608 22900 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 1: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:27.415688 22953 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:27.416293 22953 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:27.416958 22717 leader_election.cc:343] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:27.410424 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 62036us
I20260709 12:15:27.420264 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:27.425824 22664 tablet_service.cc:1511] Processing CreateTablet for tablet 4af65e8169664ec2afee890830d185cf (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:27.427418 22664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af65e8169664ec2afee890830d185cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.429131 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:27.429975 22988 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.430393 22988 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.430814 22988 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.431468 22956 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:27.440511 22981 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:27.442272 22751 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 1: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:15:27.448907 22950 tablet_bootstrap.cc:492] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:27.445616 22981 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:15:27.422353 22717 leader_election.cc:343] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.457072 22815 tablet_service.cc:1511] Processing CreateTablet for tablet c25dfc24830b430e89a2abbfffe374ea (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:27.459024 22815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25dfc24830b430e89a2abbfffe374ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.467263 22891 tablet_service.cc:1511] Processing CreateTablet for tablet c25dfc24830b430e89a2abbfffe374ea (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:27.468781 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25dfc24830b430e89a2abbfffe374ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.380062 22948 raft_consensus.cc:359] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:27.471383 22948 raft_consensus.cc:385] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.471048 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 53fc67a4479240b383ece839d37b7b58 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:27.471768 22948 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.473076 22809 tablet_service.cc:1511] Processing CreateTablet for tablet 53fc67a4479240b383ece839d37b7b58 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:27.474671 22809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fc67a4479240b383ece839d37b7b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.468803 22662 tablet_service.cc:1511] Processing CreateTablet for tablet c25dfc24830b430e89a2abbfffe374ea (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:27.477047 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c25dfc24830b430e89a2abbfffe374ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.477429 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:27.478434 22955 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:27.478631 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 57409.3us
W20260709 12:15:27.479466 22717 leader_election.cc:343] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.481678 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:27.473018 22948 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:27.482574 22900 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 1: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:27.484202 22948 ts_tablet_manager.cc:1434] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.139s	user 0.009s	sys 0.001s
I20260709 12:15:27.488687 22948 tablet_bootstrap.cc:492] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:27.489173 22946 tablet_bootstrap.cc:654] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.502832 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fc67a4479240b383ece839d37b7b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.501487 22981 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.514276 22888 tablet_service.cc:1511] Processing CreateTablet for tablet 53fc67a4479240b383ece839d37b7b58 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:27.516664 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:27.517791 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fc67a4479240b383ece839d37b7b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.519280 22665 tablet_service.cc:1511] Processing CreateTablet for tablet 58484c2487d844518eb11323635fc3c0 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:27.521019 22665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58484c2487d844518eb11323635fc3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.521270 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:27.522187 22677 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:27.525032 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:27.528590 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:27.528712 22676 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:27.534231 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:27.513006 22981 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:27.535509 22576 catalog_manager.cc:5697] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:27.536717 22981 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:27.537420 22955 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:27.538371 22717 leader_election.cc:343] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.538833 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:27.539609 22955 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.540901 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:27.541910 22981 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.542744 22950 tablet_bootstrap.cc:654] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.544052 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:27.544821 22900 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:27.546202 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:27.547096 22981 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.547252 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:27.547528 22981 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.548121 22981 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.548192 22676 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:27.558454 22981 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:27.560178 22988 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:27.561661 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:27.562278 22988 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:27.562317 22900 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.568743 22947 tablet_bootstrap.cc:492] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:27.569415 22947 ts_tablet_manager.cc:1403] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.304s	user 0.022s	sys 0.053s
I20260709 12:15:27.572009 22900 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:27.577098 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:27.578223 22955 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:27.574931 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:27.582016 22676 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.575495 22981 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:27.592099 22811 tablet_service.cc:1511] Processing CreateTablet for tablet 58484c2487d844518eb11323635fc3c0 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:27.594242 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58484c2487d844518eb11323635fc3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.600943 22947 raft_consensus.cc:359] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.601845 22947 raft_consensus.cc:385] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.602144 22947 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.604249 22738 tablet_service.cc:1511] Processing CreateTablet for tablet 58484c2487d844518eb11323635fc3c0 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:27.616806 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58484c2487d844518eb11323635fc3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.586467 22948 tablet_bootstrap.cc:654] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.623373 22676 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:27.627416 22947 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.637353 22947 ts_tablet_manager.cc:1434] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.005s
I20260709 12:15:27.641774 22660 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0e2e48cbc740c0a7fad7f513017008 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:27.642551 22947 tablet_bootstrap.cc:492] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:27.644101 22891 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0e2e48cbc740c0a7fad7f513017008 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:27.648478 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0e2e48cbc740c0a7fad7f513017008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.655442 22660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0e2e48cbc740c0a7fad7f513017008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.661644 22989 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.662314 22989 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.665740 22947 tablet_bootstrap.cc:654] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.668987 22989 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:27.653677 22955 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:27.681946 22886 tablet_service.cc:1511] Processing CreateTablet for tablet aaa4164beb3941b2bc2f8a103ac0e7fb (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:27.683465 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa4164beb3941b2bc2f8a103ac0e7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.683184 22740 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0e2e48cbc740c0a7fad7f513017008 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:27.684556 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0e2e48cbc740c0a7fad7f513017008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.679222 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:27.689311 22751 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 0.
I20260709 12:15:27.696061 22814 tablet_service.cc:1511] Processing CreateTablet for tablet aaa4164beb3941b2bc2f8a103ac0e7fb (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:27.696902 22864 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:27.697710 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa4164beb3941b2bc2f8a103ac0e7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.697957 22989 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.698448 22989 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.700213 22989 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.703784 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 91b331b9ec19453b8cd59bd6d61760dd (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:15:27.705478 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b331b9ec19453b8cd59bd6d61760dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.698199 22662 tablet_service.cc:1511] Processing CreateTablet for tablet aaa4164beb3941b2bc2f8a103ac0e7fb (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:27.698622 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:27.699191 22955 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:27.677980 22642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 302611us
W20260709 12:15:27.721410 22865 leader_election.cc:343] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.721983 22946 tablet_bootstrap.cc:492] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:27.722704 22946 ts_tablet_manager.cc:1403] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.332s	user 0.019s	sys 0.011s
I20260709 12:15:27.728817 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:27.729187 22948 tablet_bootstrap.cc:492] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:27.730896 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:27.731812 22900 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 1: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:27.731065 22948 ts_tablet_manager.cc:1403] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.243s	user 0.011s	sys 0.007s
I20260709 12:15:27.732574 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:27.732992 22950 tablet_bootstrap.cc:492] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:27.733294 22901 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.733672 22950 ts_tablet_manager.cc:1403] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.309s	user 0.050s	sys 0.070s
I20260709 12:15:27.733382 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:27.739025 22676 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:27.740495 22809 tablet_service.cc:1511] Processing CreateTablet for tablet 91b331b9ec19453b8cd59bd6d61760dd (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:15:27.741917 22809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b331b9ec19453b8cd59bd6d61760dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.747184 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa4164beb3941b2bc2f8a103ac0e7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.752367 22901 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:27.741943 22642 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:27.754580 22988 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:15:27.756382 22642 leader_election.cc:343] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.756431 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:27.757988 22953 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.761327 22989 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.764204 22950 raft_consensus.cc:359] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.726421 22946 raft_consensus.cc:359] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:27.757225 22642 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:27.776160 22888 tablet_service.cc:1511] Processing CreateTablet for tablet 91b331b9ec19453b8cd59bd6d61760dd (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:15:27.777635 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b331b9ec19453b8cd59bd6d61760dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.779002 22988 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:27.779541 22946 raft_consensus.cc:385] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.779608 22988 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:27.780063 22946 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.780869 22988 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:27.781075 22946 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:27.770546 22950 raft_consensus.cc:385] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.783524 22950 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.789961 22664 tablet_service.cc:1511] Processing CreateTablet for tablet b6ff1852979a471a8510052b7ba98faa (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:27.792372 22664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ff1852979a471a8510052b7ba98faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.793606 22815 tablet_service.cc:1511] Processing CreateTablet for tablet b6ff1852979a471a8510052b7ba98faa (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:27.795166 22815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ff1852979a471a8510052b7ba98faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.795449 22950 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.798084 22950 ts_tablet_manager.cc:1434] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 12:15:27.799934 22738 tablet_service.cc:1511] Processing CreateTablet for tablet b6ff1852979a471a8510052b7ba98faa (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:27.800930 22887 tablet_service.cc:1511] Processing CreateTablet for tablet 790207f3e8474996938608fcdf438660 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:15:27.801589 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ff1852979a471a8510052b7ba98faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.802568 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 790207f3e8474996938608fcdf438660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.829952 22958 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.830761 22958 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:27.833388 22947 tablet_bootstrap.cc:492] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:27.834460 22947 ts_tablet_manager.cc:1403] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.192s	user 0.012s	sys 0.007s
I20260709 12:15:27.835315 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:27.836185 22958 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:27.837401 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:27.838038 22947 raft_consensus.cc:359] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:27.838934 22947 raft_consensus.cc:385] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:27.838968 22791 leader_election.cc:343] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.839395 22947 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.839794 22950 tablet_bootstrap.cc:492] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
W20260709 12:15:27.840780 22791 leader_election.cc:343] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.840441 22947 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:27.841269 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:27.842133 22958 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.843293 22946 ts_tablet_manager.cc:1434] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.002s
I20260709 12:15:27.844704 22946 tablet_bootstrap.cc:492] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:27.848778 22947 ts_tablet_manager.cc:1434] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:15:27.850662 22947 tablet_bootstrap.cc:492] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:27.867449 22948 raft_consensus.cc:359] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.868543 22948 raft_consensus.cc:385] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.868880 22948 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.869796 22948 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.872406 22947 tablet_bootstrap.cc:654] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.897576 22948 ts_tablet_manager.cc:1434] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.165s	user 0.003s	sys 0.005s
I20260709 12:15:27.916425 22948 tablet_bootstrap.cc:492] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:27.937158 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:27.937968 22751 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.941174 22660 tablet_service.cc:1511] Processing CreateTablet for tablet 790207f3e8474996938608fcdf438660 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:15:27.936095 22573 catalog_manager.cc:5697] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:27.931654 22955 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.954404 22955 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:27.952819 22950 tablet_bootstrap.cc:654] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.973898 22946 tablet_bootstrap.cc:654] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.975364 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:27.976203 22826 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.966193 22989 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:27.981150 22751 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:27.942988 22660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 790207f3e8474996938608fcdf438660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.982157 22947 tablet_bootstrap.cc:492] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:27.991503 22947 ts_tablet_manager.cc:1403] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.141s	user 0.034s	sys 0.012s
I20260709 12:15:27.944476 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 790207f3e8474996938608fcdf438660 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:15:27.991837 22864 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:28.000424 22989 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.000937 22989 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:28.001318 22948 tablet_bootstrap.cc:654] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.001852 22989 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:27.994549 22886 tablet_service.cc:1511] Processing CreateTablet for tablet a7ff31dcb5814f3c8cae392bb13ee152 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:28.003154 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 790207f3e8474996938608fcdf438660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.003630 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ff31dcb5814f3c8cae392bb13ee152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:27.995895 22988 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:27.997354 22809 tablet_service.cc:1511] Processing CreateTablet for tablet a7ff31dcb5814f3c8cae392bb13ee152 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:28.008775 22809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ff31dcb5814f3c8cae392bb13ee152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.022666 22662 tablet_service.cc:1511] Processing CreateTablet for tablet a7ff31dcb5814f3c8cae392bb13ee152 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:27.997366 22947 raft_consensus.cc:359] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:28.023840 22947 raft_consensus.cc:385] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.023691 22740 tablet_service.cc:1511] Processing CreateTablet for tablet a7fc8b6794ba455388f13d7c3c76e77b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:15:28.024257 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ff31dcb5814f3c8cae392bb13ee152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.025139 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fc8b6794ba455388f13d7c3c76e77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.024294 22947 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.030723 22947 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:28.033609 22947 ts_tablet_manager.cc:1434] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:15:28.034186 22946 tablet_bootstrap.cc:492] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:28.034929 22946 ts_tablet_manager.cc:1403] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.191s	user 0.010s	sys 0.006s
I20260709 12:15:28.034909 22947 tablet_bootstrap.cc:492] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:28.037197 22815 tablet_service.cc:1511] Processing CreateTablet for tablet a7fc8b6794ba455388f13d7c3c76e77b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:15:28.055141 22815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fc8b6794ba455388f13d7c3c76e77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.055387 22955 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:28.043823 22887 tablet_service.cc:1511] Processing CreateTablet for tablet a7fc8b6794ba455388f13d7c3c76e77b (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:15:28.057000 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fc8b6794ba455388f13d7c3c76e77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.044183 22946 raft_consensus.cc:359] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.045075 22826 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:28.049361 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:28.051719 22988 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.052116 22573 catalog_manager.cc:5697] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.053009 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:28.053951 22953 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.060516 22946 raft_consensus.cc:385] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.066318 22953 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.069455 22953 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:28.074453 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:28.079643 22717 leader_election.cc:343] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.066735 22827 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:28.064903 22988 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.086509 22738 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba57a7932934f629e6ed95148994535 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:28.087191 22664 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba57a7932934f629e6ed95148994535 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:28.087731 22988 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:28.087996 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba57a7932934f629e6ed95148994535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.088459 22664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba57a7932934f629e6ed95148994535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.067040 22946 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.091653 22809 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba57a7932934f629e6ed95148994535 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:28.092160 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:28.093868 22809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba57a7932934f629e6ed95148994535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.090556 22946 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.094133 22751 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:28.096136 22888 tablet_service.cc:1511] Processing CreateTablet for tablet 6d52bb84350d4c4ebd55acd59d333846 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:28.097595 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d52bb84350d4c4ebd55acd59d333846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.092098 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:15:28.099505 22641 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:28.100131 22995 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:28.100453 22865 leader_election.cc:343] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.100641 22995 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.100687 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:28.101346 22995 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.101673 22988 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:28.102674 22865 leader_election.cc:343] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.102129 22988 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.111377 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:28.111840 22988 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.114563 22948 tablet_bootstrap.cc:492] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:28.119782 22948 ts_tablet_manager.cc:1403] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.216s	user 0.016s	sys 0.021s
W20260709 12:15:28.122828 22642 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:28.101542 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:28.125509 22642 leader_election.cc:343] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.096128 22946 ts_tablet_manager.cc:1434] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:15:28.131513 22946 tablet_bootstrap.cc:492] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:28.131336 22995 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:28.132615 22948 raft_consensus.cc:359] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.135037 22948 raft_consensus.cc:385] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.136799 22948 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.137749 22948 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.133945 22950 tablet_bootstrap.cc:492] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:28.139573 22950 ts_tablet_manager.cc:1403] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.300s	user 0.007s	sys 0.010s
I20260709 12:15:28.140328 22947 tablet_bootstrap.cc:654] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.117661 22989 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.139678 22574 catalog_manager.cc:5697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 1 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.143996 22948 ts_tablet_manager.cc:1434] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:15:28.182641 22948 tablet_bootstrap.cc:492] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:28.171332 22740 tablet_service.cc:1511] Processing CreateTablet for tablet 34c64ab5c19940cdb7e24fb2a2c60bd7 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:28.184149 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c64ab5c19940cdb7e24fb2a2c60bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.184015 22664 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3c57ac6e684973929b4e77a428cb1e (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:28.185644 22664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3c57ac6e684973929b4e77a428cb1e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:28.144304 22623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:28.145044 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:28.189224 22826 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:28.170840 22642 consensus_peers.cc:597] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:28.151944 22662 tablet_service.cc:1511] Processing CreateTablet for tablet 6d52bb84350d4c4ebd55acd59d333846 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:28.192742 22662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d52bb84350d4c4ebd55acd59d333846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.152208 22814 tablet_service.cc:1511] Processing CreateTablet for tablet 22ef3fae5db64ba8b0eae0ce76950f51 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:28.154313 22886 tablet_service.cc:1511] Processing CreateTablet for tablet 22ef3fae5db64ba8b0eae0ce76950f51 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:28.196329 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ef3fae5db64ba8b0eae0ce76950f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.155978 22738 tablet_service.cc:1511] Processing CreateTablet for tablet 6d52bb84350d4c4ebd55acd59d333846 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:28.159525 22950 raft_consensus.cc:359] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.199506 22950 raft_consensus.cc:385] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.160055 22665 tablet_service.cc:1511] Processing CreateTablet for tablet 22ef3fae5db64ba8b0eae0ce76950f51 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:28.167052 22810 tablet_service.cc:1511] Processing CreateTablet for tablet 34c64ab5c19940cdb7e24fb2a2c60bd7 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:28.168289 22891 tablet_service.cc:1511] Processing CreateTablet for tablet 34c64ab5c19940cdb7e24fb2a2c60bd7 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:28.165464 22988 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.199647 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d52bb84350d4c4ebd55acd59d333846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.201160 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c64ab5c19940cdb7e24fb2a2c60bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.170754 22946 tablet_bootstrap.cc:654] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.203305 22665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ef3fae5db64ba8b0eae0ce76950f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.203689 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ef3fae5db64ba8b0eae0ce76950f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.204996 22948 tablet_bootstrap.cc:654] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.207625 22810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c64ab5c19940cdb7e24fb2a2c60bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.207873 22811 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3c57ac6e684973929b4e77a428cb1e (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:28.209637 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3c57ac6e684973929b4e77a428cb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.199988 22950 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.221000 22739 tablet_service.cc:1511] Processing CreateTablet for tablet 7f3c57ac6e684973929b4e77a428cb1e (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:28.228787 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f3c57ac6e684973929b4e77a428cb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.230403 22995 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:28.242913 22988 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:28.247772 22826 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:28.270548 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:28.273100 22995 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.273667 22995 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:28.234444 22888 tablet_service.cc:1511] Processing CreateTablet for tablet f50db8803bc44d8eaab7195399b5ec5f (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:28.286994 22955 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.242051 22950 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.288205 22663 tablet_service.cc:1511] Processing CreateTablet for tablet f50db8803bc44d8eaab7195399b5ec5f (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:28.289089 22948 tablet_bootstrap.cc:492] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:28.289783 22948 ts_tablet_manager.cc:1403] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.005s
I20260709 12:15:28.289821 22663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50db8803bc44d8eaab7195399b5ec5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.241158 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:28.292541 22750 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.235862 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:28.295750 22995 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:28.287088 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50db8803bc44d8eaab7195399b5ec5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.242296 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:28.320276 22642 leader_election.cc:343] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.330302 22950 ts_tablet_manager.cc:1434] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.190s	user 0.013s	sys 0.005s
I20260709 12:15:28.337252 22950 tablet_bootstrap.cc:492] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:28.346174 22740 tablet_service.cc:1511] Processing CreateTablet for tablet f50db8803bc44d8eaab7195399b5ec5f (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:28.347549 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50db8803bc44d8eaab7195399b5ec5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.351841 22887 tablet_service.cc:1511] Processing CreateTablet for tablet 5444065d09a34471bca8963724a74d20 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 12:15:28.352782 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 78910.5us
I20260709 12:15:28.353585 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5444065d09a34471bca8963724a74d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.353017 22947 tablet_bootstrap.cc:492] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:28.356261 22947 ts_tablet_manager.cc:1403] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.322s	user 0.011s	sys 0.011s
I20260709 12:15:28.356720 22948 raft_consensus.cc:359] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.357683 22948 raft_consensus.cc:385] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.357697 22990 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.358245 22948 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.352923 22814 tablet_service.cc:1511] Processing CreateTablet for tablet 5444065d09a34471bca8963724a74d20 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:15:28.364213 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5444065d09a34471bca8963724a74d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.362836 22947 raft_consensus.cc:359] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.367579 22947 raft_consensus.cc:385] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.368017 22947 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.369203 22947 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.371706 22947 ts_tablet_manager.cc:1434] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
W20260709 12:15:28.371248 22717 leader_election.cc:343] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.372864 22947 tablet_bootstrap.cc:492] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:28.375267 22750 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:28.376928 22641 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:28.380541 22990 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.381283 22990 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:28.382205 22990 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.390816 22947 tablet_bootstrap.cc:654] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.382771 22948 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.400007 22575 catalog_manager.cc:5697] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.399580 22948 ts_tablet_manager.cc:1434] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.002s
I20260709 12:15:28.418058 22989 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.420506 22989 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:28.426898 22989 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:28.428889 22946 tablet_bootstrap.cc:492] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:28.429553 22946 ts_tablet_manager.cc:1403] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.298s	user 0.013s	sys 0.005s
I20260709 12:15:28.429432 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:28.430394 22989 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.431628 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:28.433569 22865 leader_election.cc:343] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.436779 22990 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.437635 22990 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.445318 22990 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:28.446240 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:28.447067 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:28.447934 22827 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:28.448717 22753 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:28.448416 22574 catalog_manager.cc:5697] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.449523 22642 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:28.451184 22990 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.451598 22990 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.451965 22990 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.454748 22989 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:28.434716 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 63518.5us
W20260709 12:15:28.461131 22864 leader_election.cc:343] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.461524 22948 tablet_bootstrap.cc:492] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:28.461638 22864 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:28.463478 22958 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.463974 22663 tablet_service.cc:1511] Processing CreateTablet for tablet 5444065d09a34471bca8963724a74d20 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:15:28.464092 22958 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.465459 22663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5444065d09a34471bca8963724a74d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.468242 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:28.468967 22900 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 0.
I20260709 12:15:28.469329 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:28.469172 22946 raft_consensus.cc:359] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:28.470088 22946 raft_consensus.cc:385] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.470417 22946 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.470185 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:28.470836 22958 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:28.471030 22989 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.476768 22958 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.477993 22958 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.478386 22958 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.484355 22740 tablet_service.cc:1511] Processing CreateTablet for tablet 7e28930436db4beaabf3941f9b136f22 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:28.485605 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e28930436db4beaabf3941f9b136f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.475129 22946 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:28.496950 22946 ts_tablet_manager.cc:1434] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.002s
I20260709 12:15:28.498020 22946 tablet_bootstrap.cc:492] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:28.509270 22810 tablet_service.cc:1511] Processing CreateTablet for tablet 7e28930436db4beaabf3941f9b136f22 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:28.510934 22810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e28930436db4beaabf3941f9b136f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.516224 22990 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.523273 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:28.523967 22753 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.521523 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:28.524818 22827 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.527560 22955 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:28.521878 22791 leader_election.cc:343] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.541985 22988 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.542611 22988 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.546118 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:28.546904 22825 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:28.550758 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:28.551673 22900 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:28.553983 22753 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:28.555516 22641 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:28.556644 23011 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.551198 22950 tablet_bootstrap.cc:654] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.559478 22642 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:28.562511 22947 tablet_bootstrap.cc:492] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:28.563108 22947 ts_tablet_manager.cc:1403] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.190s	user 0.040s	sys 0.034s
I20260709 12:15:28.563419 22887 tablet_service.cc:1511] Processing CreateTablet for tablet 7e28930436db4beaabf3941f9b136f22 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:28.564756 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e28930436db4beaabf3941f9b136f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.565853 22947 raft_consensus.cc:359] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:28.566552 22947 raft_consensus.cc:385] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.566854 22947 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.558650 22988 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:28.567615 22947 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:28.567924 22988 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.568571 22988 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.518746 22990 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:28.568949 22988 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.575014 22947 ts_tablet_manager.cc:1434] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:15:28.583151 22947 tablet_bootstrap.cc:492] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:28.577270 22948 tablet_bootstrap.cc:654] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.585843 22946 tablet_bootstrap.cc:654] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.588106 22827 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:28.590607 22663 tablet_service.cc:1511] Processing CreateTablet for tablet bd458323e9194286800a7f592094802c (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:15:28.592283 22663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd458323e9194286800a7f592094802c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.593698 22947 tablet_bootstrap.cc:654] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.594221 22740 tablet_service.cc:1511] Processing CreateTablet for tablet bd458323e9194286800a7f592094802c (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:15:28.595549 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd458323e9194286800a7f592094802c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.598093 22811 tablet_service.cc:1511] Processing CreateTablet for tablet bd458323e9194286800a7f592094802c (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:15:28.600265 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd458323e9194286800a7f592094802c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:28.663380 22642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 104018us
I20260709 12:15:28.665525 22886 tablet_service.cc:1511] Processing CreateTablet for tablet c267ff17b26d4fd08c09792a0ccb9b43 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:28.669027 22948 tablet_bootstrap.cc:492] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:28.669651 22948 ts_tablet_manager.cc:1403] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.208s	user 0.021s	sys 0.005s
I20260709 12:15:28.669839 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c267ff17b26d4fd08c09792a0ccb9b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.665369 22958 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.675707 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:28.676625 22901 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.677569 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:15:28.678996 22791 leader_election.cc:343] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.679796 22958 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:28.682027 22950 tablet_bootstrap.cc:492] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:28.683305 22988 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.685755 22901 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:28.687633 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:28.688457 22900 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.689023 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:28.690769 22958 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.692193 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:28.692528 22958 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:28.692915 22825 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.693953 22955 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.693804 22958 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.694628 22955 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:28.697216 22955 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:28.697559 22900 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:28.699167 22642 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:28.699680 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:28.700255 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:28.700763 22899 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
W20260709 12:15:28.701877 22717 leader_election.cc:343] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.702822 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:28.703742 22950 ts_tablet_manager.cc:1403] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.367s	user 0.010s	sys 0.011s
I20260709 12:15:28.704133 23011 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:28.704233 22955 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.704938 22955 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.705273 23029 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.705361 22955 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.706027 23029 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:28.707067 23029 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.708760 22946 tablet_bootstrap.cc:492] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:28.709334 22946 ts_tablet_manager.cc:1403] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.212s	user 0.010s	sys 0.006s
I20260709 12:15:28.702517 22825 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:28.717132 22665 tablet_service.cc:1511] Processing CreateTablet for tablet c267ff17b26d4fd08c09792a0ccb9b43 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:28.718359 22738 tablet_service.cc:1511] Processing CreateTablet for tablet c267ff17b26d4fd08c09792a0ccb9b43 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:28.719215 22665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c267ff17b26d4fd08c09792a0ccb9b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.719767 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c267ff17b26d4fd08c09792a0ccb9b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.722532 22814 tablet_service.cc:1511] Processing CreateTablet for tablet 599b298e84934cc4969ad7fa2b906b26 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:15:28.723673 22947 tablet_bootstrap.cc:492] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:28.723906 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599b298e84934cc4969ad7fa2b906b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.724320 22947 ts_tablet_manager.cc:1403] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.141s	user 0.025s	sys 0.008s
I20260709 12:15:28.711321 23011 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.746434 22888 tablet_service.cc:1511] Processing CreateTablet for tablet 599b298e84934cc4969ad7fa2b906b26 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:15:28.747987 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599b298e84934cc4969ad7fa2b906b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.748781 22739 tablet_service.cc:1511] Processing CreateTablet for tablet dcb4cae1a1914d1a94e203f082ef12e5 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:28.750058 22739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb4cae1a1914d1a94e203f082ef12e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.750874 22988 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:28.751863 22660 tablet_service.cc:1511] Processing CreateTablet for tablet 599b298e84934cc4969ad7fa2b906b26 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:15:28.753290 22660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599b298e84934cc4969ad7fa2b906b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.760764 22955 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:28.771534 22642 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:28.775425 22948 raft_consensus.cc:359] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:28.776230 22948 raft_consensus.cc:385] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.776499 22948 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.777173 22948 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:28.779994 22946 raft_consensus.cc:359] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.780843 22946 raft_consensus.cc:385] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.781126 22946 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.783097 22946 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.799440 22574 catalog_manager.cc:5697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.801007 22575 catalog_manager.cc:5697] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 1 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.783257 22947 raft_consensus.cc:359] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:28.804764 22947 raft_consensus.cc:385] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.805178 22947 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.806011 22947 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:28.808597 22947 ts_tablet_manager.cc:1434] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.084s	user 0.015s	sys 0.010s
I20260709 12:15:28.784250 22950 raft_consensus.cc:359] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.785526 22815 tablet_service.cc:1511] Processing CreateTablet for tablet dcb4cae1a1914d1a94e203f082ef12e5 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:28.786401 22891 tablet_service.cc:1511] Processing CreateTablet for tablet dcb4cae1a1914d1a94e203f082ef12e5 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:28.811591 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb4cae1a1914d1a94e203f082ef12e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.792495 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:28.815169 22900 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.810640 22815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb4cae1a1914d1a94e203f082ef12e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.810643 22946 ts_tablet_manager.cc:1434] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.005s
I20260709 12:15:28.830109 22950 raft_consensus.cc:385] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.793589 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:28.835268 22676 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.827593 22946 tablet_bootstrap.cc:492] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:28.846532 22946 tablet_bootstrap.cc:654] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.830469 22576 catalog_manager.cc:5697] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:28.847517 22676 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:28.847981 22950 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.862591 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:28.863600 22995 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.863492 22950 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.864152 22995 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:28.865084 22995 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:28.866212 22950 ts_tablet_manager.cc:1434] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.162s	user 0.008s	sys 0.001s
I20260709 12:15:28.853931 22664 tablet_service.cc:1511] Processing CreateTablet for tablet 9c2300ccd50e4d7c9ff19678d7e2519a (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:28.867903 22664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c2300ccd50e4d7c9ff19678d7e2519a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.854351 22947 tablet_bootstrap.cc:492] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:28.871762 23027 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.872301 23027 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:28.876120 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:28.877007 22826 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 1: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:15:28.877830 23027 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:28.892779 22901 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.858270 22740 tablet_service.cc:1511] Processing CreateTablet for tablet 9c2300ccd50e4d7c9ff19678d7e2519a (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:28.894668 22740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c2300ccd50e4d7c9ff19678d7e2519a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.792971 22955 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:28.899828 22811 tablet_service.cc:1511] Processing CreateTablet for tablet 9c2300ccd50e4d7c9ff19678d7e2519a (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:28.901290 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c2300ccd50e4d7c9ff19678d7e2519a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.904153 22955 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.857798 22900 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:28.881871 22660 tablet_service.cc:1511] Processing CreateTablet for tablet fca29e0a7a6342a2b2f2088587de1246 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:28.909545 22660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca29e0a7a6342a2b2f2088587de1246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.912293 22815 tablet_service.cc:1511] Processing CreateTablet for tablet 0e65a9de2bca4c54a85a0988d17f1793 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:28.914031 22815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e65a9de2bca4c54a85a0988d17f1793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.883147 22950 tablet_bootstrap.cc:492] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:28.848384 22948 ts_tablet_manager.cc:1434] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.178s	user 0.008s	sys 0.000s
I20260709 12:15:28.920408 22946 tablet_bootstrap.cc:492] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:28.920733 22948 tablet_bootstrap.cc:492] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:28.920909 22946 ts_tablet_manager.cc:1403] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.094s	user 0.010s	sys 0.002s
I20260709 12:15:28.885008 22947 tablet_bootstrap.cc:654] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.885495 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:28.923797 22946 raft_consensus.cc:359] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:28.924530 22946 raft_consensus.cc:385] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.924477 22864 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:28.925192 22946 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.886454 22888 tablet_service.cc:1511] Processing CreateTablet for tablet 0e65a9de2bca4c54a85a0988d17f1793 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:28.925977 22946 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:28.886672 22738 tablet_service.cc:1511] Processing CreateTablet for tablet fca29e0a7a6342a2b2f2088587de1246 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:28.888628 22891 tablet_service.cc:1511] Processing CreateTablet for tablet fca29e0a7a6342a2b2f2088587de1246 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:28.927196 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e65a9de2bca4c54a85a0988d17f1793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.890247 22665 tablet_service.cc:1511] Processing CreateTablet for tablet 0e65a9de2bca4c54a85a0988d17f1793 (DEFAULT_TABLE table=test-workload [id=9e87e6353c904c0f9d10c2425c2dc336]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:28.927695 22738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca29e0a7a6342a2b2f2088587de1246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.928390 22665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e65a9de2bca4c54a85a0988d17f1793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.928545 22946 ts_tablet_manager.cc:1434] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.003s
I20260709 12:15:28.929590 22946 tablet_bootstrap.cc:492] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:28.931267 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca29e0a7a6342a2b2f2088587de1246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:28.933743 22953 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.934293 22953 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:28.937134 22953 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:28.939477 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:28.940356 22753 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 0.
I20260709 12:15:28.939548 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:28.943693 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:28.944154 22946 tablet_bootstrap.cc:654] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:28.946749 22865 leader_election.cc:343] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.948246 22989 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.948694 22989 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.949029 22989 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.956095 22950 tablet_bootstrap.cc:654] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.965528 22989 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:28.969204 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:28.969938 22753 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.973203 22948 tablet_bootstrap.cc:654] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.980706 22947 tablet_bootstrap.cc:492] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:28.981678 22947 ts_tablet_manager.cc:1403] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.003s
I20260709 12:15:28.984298 22988 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.990314 23027 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.996042 22947 raft_consensus.cc:359] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:28.996830 22947 raft_consensus.cc:385] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.990185 22955 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.010196 22955 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.010869 22955 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:28.997108 22947 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.071746 22989 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:29.074326 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:29.079835 22865 leader_election.cc:343] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:29.075158 22561 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 52814.7us
I20260709 12:15:29.074563 22947 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:15:29.086722 23045 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.061s	user 0.006s	sys 0.011s
I20260709 12:15:29.086951 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:29.088058 22955 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:15:29.090718 22717 leader_election.cc:343] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.114336 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:29.116257 22947 ts_tablet_manager.cc:1434] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.123s	user 0.016s	sys 0.007s
I20260709 12:15:29.117892 22947 tablet_bootstrap.cc:492] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
W20260709 12:15:29.123402 22717 leader_election.cc:343] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.124257 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:29.125584 22955 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:29.137001 22753 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:29.139253 22946 tablet_bootstrap.cc:492] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:29.139845 22946 ts_tablet_manager.cc:1403] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.210s	user 0.050s	sys 0.040s
I20260709 12:15:29.142818 22946 raft_consensus.cc:359] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.143612 22946 raft_consensus.cc:385] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.143893 22946 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.144695 22946 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.145012 23011 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.146272 22950 tablet_bootstrap.cc:492] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:29.147727 22946 ts_tablet_manager.cc:1434] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:29.148782 22946 tablet_bootstrap.cc:492] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:29.148897 22948 tablet_bootstrap.cc:492] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:29.149508 22948 ts_tablet_manager.cc:1403] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.229s	user 0.018s	sys 0.000s
I20260709 12:15:29.152652 22948 raft_consensus.cc:359] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:29.153419 22948 raft_consensus.cc:385] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.153695 22948 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.156059 22947 tablet_bootstrap.cc:654] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.156682 22946 tablet_bootstrap.cc:654] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.154431 22948 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:29.154613 22950 ts_tablet_manager.cc:1403] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.272s	user 0.013s	sys 0.002s
I20260709 12:15:29.159932 22826 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.161118 22948 ts_tablet_manager.cc:1434] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:15:29.161491 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:29.149902 22575 catalog_manager.cc:5697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.166394 22989 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.167042 22989 raft_consensus.cc:697] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:29.167941 22989 consensus_queue.cc:237] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.162765 22948 tablet_bootstrap.cc:492] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:29.170373 22950 raft_consensus.cc:359] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.174767 22950 raft_consensus.cc:385] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.175242 22950 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.182173 22950 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:15:29.193532 22623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:29.194612 23026 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:15:29.195024 22995 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.203661 22995 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.219815 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:29.220742 22676 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:29.220839 22825 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.222823 22950 ts_tablet_manager.cc:1434] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.003s
I20260709 12:15:29.224098 22950 tablet_bootstrap.cc:492] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:29.225298 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:29.226081 22899 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:29.227777 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:29.228955 23046 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:29.229353 23046 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.229681 23046 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.218554 23011 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:15:29.235507 23030 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.237218 22676 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.235584 22948 tablet_bootstrap.cc:654] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.241559 22947 tablet_bootstrap.cc:492] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:29.242136 22947 ts_tablet_manager.cc:1403] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.031s
I20260709 12:15:29.216024 22995 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:29.255779 22947 raft_consensus.cc:359] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.256606 22947 raft_consensus.cc:385] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.256906 22947 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.257642 22947 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.276278 22946 tablet_bootstrap.cc:492] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:29.276950 22946 ts_tablet_manager.cc:1403] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.009s
I20260709 12:15:29.281677 22947 ts_tablet_manager.cc:1434] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:15:29.283264 22947 tablet_bootstrap.cc:492] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:29.297621 22989 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.298336 22989 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:29.300783 22989 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:29.304473 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:29.309930 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:29.310830 22865 leader_election.cc:343] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:29.312631 22865 leader_election.cc:343] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.313220 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:29.314742 22989 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:29.306030 23046 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.328454 23046 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:29.325949 22946 raft_consensus.cc:359] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.330025 22946 raft_consensus.cc:385] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.330441 22946 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.331480 22946 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.333043 22950 tablet_bootstrap.cc:654] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.341874 22947 tablet_bootstrap.cc:654] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.344750 22946 ts_tablet_manager.cc:1434] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.067s	user 0.010s	sys 0.000s
I20260709 12:15:29.346243 22946 tablet_bootstrap.cc:492] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:29.310105 23026 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:15:29.353508 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:29.355883 22948 tablet_bootstrap.cc:492] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:29.356571 22948 ts_tablet_manager.cc:1403] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.194s	user 0.012s	sys 0.010s
I20260709 12:15:29.363703 22946 tablet_bootstrap.cc:654] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.357446 22995 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.367758 22995 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.372766 22995 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:29.378389 23030 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:15:29.392373 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:29.399914 22900 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.436053 22948 raft_consensus.cc:359] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:29.438490 22948 raft_consensus.cc:385] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.439204 22948 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.440480 22948 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:29.625984 22900 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:15:29.628875 22947 tablet_bootstrap.cc:492] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:29.629496 22947 ts_tablet_manager.cc:1403] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.346s	user 0.027s	sys 0.015s
I20260709 12:15:29.632501 22947 raft_consensus.cc:359] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.633234 22947 raft_consensus.cc:385] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.633473 22947 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.634050 22947 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.636005 22947 ts_tablet_manager.cc:1434] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:29.636956 22947 tablet_bootstrap.cc:492] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:29.644860 22947 tablet_bootstrap.cc:654] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.650547 22947 tablet_bootstrap.cc:492] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:29.651233 22947 ts_tablet_manager.cc:1403] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 12:15:29.654547 22947 raft_consensus.cc:359] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.655299 22947 raft_consensus.cc:385] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.655575 22947 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.656332 22947 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.659215 22947 ts_tablet_manager.cc:1434] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:15:29.660326 22947 tablet_bootstrap.cc:492] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:29.667464 22947 tablet_bootstrap.cc:654] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.673686 22947 tablet_bootstrap.cc:492] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:29.674332 22947 ts_tablet_manager.cc:1403] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:15:29.677528 22947 raft_consensus.cc:359] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:29.678295 22947 raft_consensus.cc:385] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.678613 22947 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.444005 22948 ts_tablet_manager.cc:1434] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.087s	user 0.011s	sys 0.000s
I20260709 12:15:29.679319 22947 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:29.680490 22948 tablet_bootstrap.cc:492] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:29.681329 22947 ts_tablet_manager.cc:1434] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:15:29.682294 22947 tablet_bootstrap.cc:492] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:29.686602 22948 tablet_bootstrap.cc:654] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.688366 22947 tablet_bootstrap.cc:654] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.700161 22947 tablet_bootstrap.cc:492] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:29.700454 22948 tablet_bootstrap.cc:492] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:29.700722 22947 ts_tablet_manager.cc:1403] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:15:29.701126 22948 ts_tablet_manager.cc:1403] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.002s
W20260709 12:15:29.702564 22642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 347172us
I20260709 12:15:29.704375 22947 raft_consensus.cc:359] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.705276 22947 raft_consensus.cc:385] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.705549 22947 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.706317 22947 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.708586 22947 ts_tablet_manager.cc:1434] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:15:29.709710 22947 tablet_bootstrap.cc:492] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:29.716545 22947 tablet_bootstrap.cc:654] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.716367 22989 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.717710 22989 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.718871 22950 tablet_bootstrap.cc:492] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:29.719424 22950 ts_tablet_manager.cc:1403] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.496s	user 0.023s	sys 0.023s
I20260709 12:15:29.720083 22989 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:29.722144 22948 raft_consensus.cc:359] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.722946 22948 raft_consensus.cc:385] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.723223 22948 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.724442 22950 raft_consensus.cc:359] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:29.724665 22948 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.726725 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:29.728075 22948 ts_tablet_manager.cc:1434] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
W20260709 12:15:29.728475 22865 leader_election.cc:343] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.729156 22948 tablet_bootstrap.cc:492] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:29.731123 22950 raft_consensus.cc:385] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.731788 22947 tablet_bootstrap.cc:492] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:29.732319 22947 ts_tablet_manager.cc:1403] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 12:15:29.735837 22947 raft_consensus.cc:359] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.736577 22947 raft_consensus.cc:385] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.736882 22947 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.737510 22948 tablet_bootstrap.cc:654] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.737622 22947 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:29.731716 22950 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.739447 22947 ts_tablet_manager.cc:1434] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:29.739208 22950 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:29.740551 22947 tablet_bootstrap.cc:492] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:29.749258 22947 tablet_bootstrap.cc:654] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.752249 22950 ts_tablet_manager.cc:1434] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.006s
I20260709 12:15:29.753655 22950 tablet_bootstrap.cc:492] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:29.769213 23030 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.770085 23030 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:29.772697 23016 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.773319 23030 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:29.773232 23016 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.775512 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:29.776646 22750 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:29.779583 22641 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:29.780833 23030 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.781311 23030 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.781680 23030 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.783811 22946 tablet_bootstrap.cc:492] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:29.784782 22946 ts_tablet_manager.cc:1403] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.439s	user 0.032s	sys 0.021s
I20260709 12:15:29.790205 22946 raft_consensus.cc:359] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.791268 22946 raft_consensus.cc:385] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.791781 22946 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.793116 22946 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.354496 22678 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.839967 22948 tablet_bootstrap.cc:492] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:29.841061 22948 ts_tablet_manager.cc:1403] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.000s
I20260709 12:15:29.847321 22946 ts_tablet_manager.cc:1434] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.001s
I20260709 12:15:29.848999 22946 tablet_bootstrap.cc:492] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:29.851591 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:29.853157 23016 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:15:29.856096 22642 leader_election.cc:343] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.859516 22948 raft_consensus.cc:359] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:15:29.863812 22865 consensus_peers.cc:597] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:29.870250 22948 raft_consensus.cc:385] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.868474 22989 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.871249 22989 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:29.872816 22947 tablet_bootstrap.cc:492] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:29.873358 22947 ts_tablet_manager.cc:1403] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.133s	user 0.036s	sys 0.067s
I20260709 12:15:29.874557 22989 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:29.868899 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:29.864197 23030 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:15:29.881018 22717 leader_election.cc:343] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.881814 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:29.882736 23016 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:29.886184 22948 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.883903 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:29.884757 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:29.890590 23030 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:29.888805 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:29.889689 22900 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:29.887892 22948 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:29.907255 22950 tablet_bootstrap.cc:654] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:29.886690 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 121580us
I20260709 12:15:29.908465 22948 ts_tablet_manager.cc:1434] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 12:15:29.894363 23016 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:29.911913 22947 raft_consensus.cc:359] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.912799 22947 raft_consensus.cc:385] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.913029 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:29.913759 23046 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.913751 23016 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.913070 22947 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
W20260709 12:15:29.916649 22717 leader_election.cc:343] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.917559 22947 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.919735 22995 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:29.920503 22947 ts_tablet_manager.cc:1434] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.002s
I20260709 12:15:29.921545 22946 tablet_bootstrap.cc:654] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.921627 22947 tablet_bootstrap.cc:492] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:29.921618 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:29.922875 22995 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.923274 22995 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.923599 22995 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.925061 22989 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:29.926918 22865 leader_election.cc:343] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.928409 22678 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:15:29.911181 22948 tablet_bootstrap.cc:492] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:29.933934 22947 tablet_bootstrap.cc:654] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.934922 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:29.935640 22899 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:29.922147 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:29.940856 22752 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.943456 23046 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.944021 23046 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:29.946331 23046 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:29.942909 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:29.949117 23046 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.949645 23046 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.950328 23046 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.913831 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:29.957726 22575 catalog_manager.cc:5697] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 1 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.987030 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:29.987870 22901 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:29.991272 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:29.993572 22678 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:29.993916 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:29.995997 23016 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.996671 23016 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.997143 23016 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.998220 23027 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.998939 23027 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.001363 23027 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:30.003580 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:30.005286 22865 leader_election.cc:343] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.006763 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:30.008816 22864 leader_election.cc:343] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.009325 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:30.010640 23027 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.017656 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:30.017876 22642 leader_election.cc:343] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.021421 22948 tablet_bootstrap.cc:654] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.025040 22752 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:30.031874 22946 tablet_bootstrap.cc:492] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:30.032573 22946 ts_tablet_manager.cc:1403] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.184s	user 0.015s	sys 0.002s
I20260709 12:15:30.033314 22641 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:30.036033 23078 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.036783 23078 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:30.036422 23046 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.037971 23078 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.040889 23046 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:30.040593 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:30.041676 22901 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.041719 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:15:30.046377 22865 leader_election.cc:343] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.047109 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:30.048204 23027 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:30.049217 22717 leader_election.cc:343] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.050997 22946 raft_consensus.cc:359] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.053447 22946 raft_consensus.cc:385] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.053879 22946 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.055915 22946 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.053969 22995 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.059800 22948 tablet_bootstrap.cc:492] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:30.060181 22751 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 1: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:15:30.060607 22948 ts_tablet_manager.cc:1403] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.150s	user 0.012s	sys 0.004s
I20260709 12:15:30.064649 22864 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:30.066131 22901 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:30.067282 23027 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.074071 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:30.075963 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:30.077404 22947 tablet_bootstrap.cc:492] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:30.078114 22947 ts_tablet_manager.cc:1403] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.157s	user 0.014s	sys 0.008s
I20260709 12:15:30.090137 22946 ts_tablet_manager.cc:1434] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.001s
I20260709 12:15:30.091629 22946 tablet_bootstrap.cc:492] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:30.064695 22995 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:30.076562 23016 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.103238 22948 raft_consensus.cc:359] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.104912 22948 raft_consensus.cc:385] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:30.088029 22717 leader_election.cc:343] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.105274 22948 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.106033 22948 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.106745 22947 raft_consensus.cc:359] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.112640 22947 raft_consensus.cc:385] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.113117 22947 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.122148 22948 ts_tablet_manager.cc:1434] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 12:15:30.123872 22948 tablet_bootstrap.cc:492] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:30.124899 22947 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.130606 22946 tablet_bootstrap.cc:654] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.132359 23027 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.133770 22948 tablet_bootstrap.cc:654] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.135327 23027 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.123661 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:30.141944 23016 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:30.144392 23016 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.143575 22950 tablet_bootstrap.cc:492] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:30.145701 22950 ts_tablet_manager.cc:1403] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.392s	user 0.027s	sys 0.015s
I20260709 12:15:30.150637 22950 raft_consensus.cc:359] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.151753 22950 raft_consensus.cc:385] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.152220 22950 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.153507 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:30.153956 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:30.154316 22900 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.154770 22676 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.157704 23029 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.145186 23016 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:30.161026 23016 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.161875 22900 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:30.167470 22950 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.158288 23029 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.175365 23029 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:30.175956 22950 ts_tablet_manager.cc:1434] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.006s
I20260709 12:15:30.178030 22950 tablet_bootstrap.cc:492] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:30.182020 22827 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.188297 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:30.188997 22950 tablet_bootstrap.cc:654] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.138409 23027 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.198319 22947 ts_tablet_manager.cc:1434] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.120s	user 0.028s	sys 0.006s
I20260709 12:15:30.200130 22947 tablet_bootstrap.cc:492] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:30.202963 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:30.199317 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:30.216215 22901 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
W20260709 12:15:30.217692 22642 leader_election.cc:343] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:30.220916 22623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:30.229009 22995 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.242728 22642 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:30.242955 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:30.245230 23030 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:30.245859 23030 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.246376 23030 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.249248 22947 tablet_bootstrap.cc:654] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:30.255076 22864 leader_election.cc:343] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.237437 22995 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:30.261349 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:30.264395 22946 tablet_bootstrap.cc:492] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:30.265403 22946 ts_tablet_manager.cc:1403] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.005s
W20260709 12:15:30.264418 22865 leader_election.cc:343] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.267727 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:30.268664 23093 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.270120 22946 raft_consensus.cc:359] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.270989 22946 raft_consensus.cc:385] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.271392 22946 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.262399 22995 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.272330 22946 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.272830 22899 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:30.275414 22948 tablet_bootstrap.cc:492] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:30.275906 22948 ts_tablet_manager.cc:1403] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.152s	user 0.023s	sys 0.013s
I20260709 12:15:30.261790 23027 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:30.285157 22946 ts_tablet_manager.cc:1434] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
I20260709 12:15:30.286571 22948 raft_consensus.cc:359] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.288259 22676 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:30.293017 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:30.290452 22948 raft_consensus.cc:385] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.293753 22948 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.291507 22946 tablet_bootstrap.cc:492] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:30.297542 23094 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.298200 23094 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:30.299094 23094 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.306490 22948 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.313512 22950 tablet_bootstrap.cc:492] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:30.314623 22950 ts_tablet_manager.cc:1403] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.137s	user 0.024s	sys 0.005s
I20260709 12:15:30.313577 22948 ts_tablet_manager.cc:1434] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 12:15:30.316772 22948 tablet_bootstrap.cc:492] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:30.324265 22950 raft_consensus.cc:359] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.325001 22950 raft_consensus.cc:385] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.325289 22950 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.326023 22950 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.328516 22950 ts_tablet_manager.cc:1434] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:15:30.329712 22950 tablet_bootstrap.cc:492] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:30.317587 23030 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.333189 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:30.334846 22642 leader_election.cc:343] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.330279 22946 tablet_bootstrap.cc:654] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.339092 23075 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:30.339766 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:30.339643 23075 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.340389 22899 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.346668 23075 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:30.348033 23027 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.348727 23027 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.349632 22950 tablet_bootstrap.cc:654] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.350982 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:30.352362 22901 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:30.352919 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:30.347889 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:30.355333 22791 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:15:30.357264 22865 leader_election.cc:343] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.357436 23094 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:30.358719 23027 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:30.359442 23072 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:30.359896 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:30.361471 22864 leader_election.cc:343] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.361935 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:30.359483 23075 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.363016 23027 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.363603 23075 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.365360 22947 tablet_bootstrap.cc:492] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:30.366731 22947 ts_tablet_manager.cc:1403] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.167s	user 0.024s	sys 0.041s
I20260709 12:15:30.369967 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:30.369983 22947 raft_consensus.cc:359] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.371197 22947 raft_consensus.cc:385] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.371585 22947 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.373283 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:30.373721 22947 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.375787 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:30.380209 22899 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:30.381157 22947 ts_tablet_manager.cc:1434] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:15:30.382082 22642 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:30.382874 22947 tablet_bootstrap.cc:492] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:30.383145 23029 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.383692 23029 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:30.384570 23029 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.384586 23072 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.372457 23075 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:30.328519 22948 tablet_bootstrap.cc:654] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.422698 22947 tablet_bootstrap.cc:654] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.425304 22995 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.426184 22995 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.430882 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:30.431203 22827 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.431792 22676 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:30.397516 23030 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:30.443548 22995 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:30.445199 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:30.444473 22573 catalog_manager.cc:5697] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.446919 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:30.455339 22995 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:30.458529 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8700 after lost signal to thread 18410
I20260709 12:15:30.459636 22995 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.460734 22995 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:30.461313 22607 debug-util.cc:398] Leaking SignalData structure 0x7b080022db20 after lost signal to thread 22610
I20260709 12:15:30.462275 22946 tablet_bootstrap.cc:492] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:30.462775 22946 ts_tablet_manager.cc:1403] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.172s	user 0.018s	sys 0.039s
I20260709 12:15:30.465127 22950 tablet_bootstrap.cc:492] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:30.468274 22950 ts_tablet_manager.cc:1403] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.139s	user 0.029s	sys 0.032s
W20260709 12:15:30.462740 22607 debug-util.cc:398] Leaking SignalData structure 0x7b0800199100 after lost signal to thread 22702
I20260709 12:15:30.470305 22946 raft_consensus.cc:359] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.471117 22946 raft_consensus.cc:385] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:30.471048 22717 leader_election.cc:343] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.471585 22946 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.472304 22946 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.472348 22950 raft_consensus.cc:359] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.473461 22950 raft_consensus.cc:385] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:30.471366 22607 debug-util.cc:398] Leaking SignalData structure 0x7b080039bee0 after lost signal to thread 22777
I20260709 12:15:30.473265 22676 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:30.474195 22950 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.475528 22950 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.476276 23046 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:30.477385 22607 debug-util.cc:398] Leaking SignalData structure 0x7b0800170c00 after lost signal to thread 22851
I20260709 12:15:30.477622 22948 tablet_bootstrap.cc:492] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:30.478010 22950 ts_tablet_manager.cc:1434] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:15:30.478159 22948 ts_tablet_manager.cc:1403] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.162s	user 0.015s	sys 0.001s
I20260709 12:15:30.479286 22950 tablet_bootstrap.cc:492] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:30.474233 23094 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.480006 23094 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.481247 22948 raft_consensus.cc:359] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.481926 22948 raft_consensus.cc:385] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.482169 23094 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:15:30.482633 22607 debug-util.cc:398] Leaking SignalData structure 0x7b080022bb00 after lost signal to thread 22925
I20260709 12:15:30.483220 22946 ts_tablet_manager.cc:1434] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:15:30.484125 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:30.484798 22899 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:30.484905 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:30.486147 22717 leader_election.cc:343] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.468540 22573 catalog_manager.cc:5697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 2, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 2 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.486945 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:30.488237 23094 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:30.488636 23094 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.488969 23094 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.491175 23075 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.491694 23075 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.482184 22948 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.493444 22946 tablet_bootstrap.cc:492] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
W20260709 12:15:30.495443 23106 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.009s
I20260709 12:15:30.496239 23075 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:30.501329 23094 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.505563 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:30.506392 22750 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:30.494207 22948 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.509316 22950 tablet_bootstrap.cc:654] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.498692 22995 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.515399 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:30.508832 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:30.520797 22717 leader_election.cc:343] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.527419 22995 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:30.529245 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:30.529968 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:30.530597 22678 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:30.531023 22717 leader_election.cc:343] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.531860 22790 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:30.533078 23075 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.542547 22678 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:30.544637 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:30.545850 23016 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.546365 23016 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:30.547207 23016 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.550522 22948 ts_tablet_manager.cc:1434] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.005s
I20260709 12:15:30.550093 23029 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.551689 22948 tablet_bootstrap.cc:492] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:30.570396 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:30.570739 23075 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.571496 22901 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.560660 23093 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.577883 23093 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.580401 23093 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:30.582901 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:30.585253 22865 leader_election.cc:343] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.585752 22946 tablet_bootstrap.cc:654] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.586350 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:30.588172 22865 leader_election.cc:343] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.588670 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:30.590163 23093 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.594954 23093 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.595484 23093 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.597680 22574 catalog_manager.cc:5697] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:30.598889 23094 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:30.600123 23093 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:30.598955 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:30.599929 22574 catalog_manager.cc:5697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.601455 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:30.601933 22865 leader_election.cc:343] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:30.603291 22864 leader_election.cc:343] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.603803 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:30.604777 23093 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.608358 22948 tablet_bootstrap.cc:654] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.610493 23029 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.613262 22947 tablet_bootstrap.cc:492] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:30.613811 22947 ts_tablet_manager.cc:1403] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.231s	user 0.012s	sys 0.015s
I20260709 12:15:30.627265 22950 tablet_bootstrap.cc:492] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:30.630614 22950 ts_tablet_manager.cc:1403] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.035s
I20260709 12:15:30.630755 22947 raft_consensus.cc:359] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.631934 22947 raft_consensus.cc:385] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.632309 22947 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.633519 22947 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.636449 22947 ts_tablet_manager.cc:1434] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:15:30.637835 22947 tablet_bootstrap.cc:492] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:30.639223 22901 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:30.641776 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:30.644192 23075 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.644284 22950 raft_consensus.cc:359] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.645295 22950 raft_consensus.cc:385] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.644963 23075 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.645649 22950 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.646970 23094 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.647686 22946 tablet_bootstrap.cc:492] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:30.654464 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:30.654909 23075 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:30.654543 22946 ts_tablet_manager.cc:1403] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.161s	user 0.008s	sys 0.005s
I20260709 12:15:30.655532 22901 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 1: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:15:30.655817 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:30.657348 22790 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:30.658646 23075 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.659231 22946 raft_consensus.cc:359] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.662604 22946 raft_consensus.cc:385] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.663026 22946 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.660305 22950 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.655578 23094 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:30.661912 22676 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.666133 22947 tablet_bootstrap.cc:654] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.673163 22948 tablet_bootstrap.cc:492] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:30.675328 23046 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:30.676867 23075 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.679862 22948 ts_tablet_manager.cc:1403] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.000s
I20260709 12:15:30.680542 23094 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.683662 22948 raft_consensus.cc:359] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.685099 22948 raft_consensus.cc:385] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.685504 22948 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.684799 22573 catalog_manager.cc:5697] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.686339 22948 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.688808 22573 catalog_manager.cc:5697] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:30.688803 22948 ts_tablet_manager.cc:1434] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:15:30.702549 22948 tablet_bootstrap.cc:492] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:30.704146 22950 ts_tablet_manager.cc:1434] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260709 12:15:30.705607 23016 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.716811 22950 tablet_bootstrap.cc:492] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:30.713830 22947 tablet_bootstrap.cc:492] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:30.727437 22947 ts_tablet_manager.cc:1403] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.000s
I20260709 12:15:30.731118 22947 raft_consensus.cc:359] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.732189 22947 raft_consensus.cc:385] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.732601 22947 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.733636 22947 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.736562 22947 ts_tablet_manager.cc:1434] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:30.737849 22947 tablet_bootstrap.cc:492] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:30.710486 22948 tablet_bootstrap.cc:654] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.716614 22995 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:30.717779 23072 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.714452 22946 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.755296 23082 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:30.763927 23016 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.749642 23072 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.768102 22948 tablet_bootstrap.cc:492] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:30.768618 22948 ts_tablet_manager.cc:1403] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.007s
I20260709 12:15:30.779253 23072 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:30.780622 22948 raft_consensus.cc:359] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.781760 22948 raft_consensus.cc:385] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.782136 22948 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.783195 22948 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.782450 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:30.781761 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:30.787220 22900 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:30.787039 22948 ts_tablet_manager.cc:1434] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.004s
I20260709 12:15:30.765278 23016 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:30.789376 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:30.789757 22948 tablet_bootstrap.cc:492] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:30.790871 23016 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:30.792912 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:30.794921 22990 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:30.795125 22717 leader_election.cc:343] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.795456 22990 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.794409 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:30.800614 22948 tablet_bootstrap.cc:654] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:30.804940 22717 leader_election.cc:343] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.805490 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:30.807612 22990 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:30.810271 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:30.810765 22950 tablet_bootstrap.cc:654] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.816181 23016 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.818231 22946 ts_tablet_manager.cc:1434] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.162s	user 0.011s	sys 0.000s
I20260709 12:15:30.815905 23072 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.819335 22946 tablet_bootstrap.cc:492] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:30.827246 23016 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.828068 23016 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.811035 22900 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:30.832422 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:30.833189 22899 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:30.834650 22642 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:30.835662 22990 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:30.836058 22990 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.836400 22990 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.840148 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:30.823045 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:30.841715 23082 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:30.842286 23082 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.842727 23082 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:30.843669 22642 leader_election.cc:343] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.844933 23016 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:30.848239 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:30.850088 23029 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:30.853622 22946 tablet_bootstrap.cc:654] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:30.856369 22717 leader_election.cc:343] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.863299 22948 tablet_bootstrap.cc:492] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:30.863968 22948 ts_tablet_manager.cc:1403] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.075s	user 0.026s	sys 0.039s
I20260709 12:15:30.840137 22947 tablet_bootstrap.cc:654] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.881381 23029 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.884269 23029 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.889333 23029 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:30.892982 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:30.892731 22948 raft_consensus.cc:359] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.894593 22948 raft_consensus.cc:385] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.896692 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:30.895767 22948 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.897990 22990 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:30.898221 22899 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:30.898555 22948 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.900717 22642 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:30.882769 23082 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.910174 23082 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:30.908207 22990 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:30.911307 23011 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:30.913134 23094 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.927915 23011 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.928416 23011 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.913475 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:30.929137 22676 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.937394 22676 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:30.938439 23072 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.916694 22948 ts_tablet_manager.cc:1434] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.002s
I20260709 12:15:30.920053 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:30.940191 22900 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.940732 22948 tablet_bootstrap.cc:492] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:30.920392 22642 leader_election.cc:343] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.945428 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:30.949823 23016 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.950630 23016 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:30.952142 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:30.951754 23016 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:30.955159 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:30.955960 22899 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:30.961997 22642 leader_election.cc:343] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.949204 23046 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:15:30.973582 22572 catalog_manager.cc:5697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:30.987253 23027 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.987986 23027 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:30.990865 22948 tablet_bootstrap.cc:654] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.993536 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:31.000819 22950 tablet_bootstrap.cc:492] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:31.001420 22950 ts_tablet_manager.cc:1403] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.285s	user 0.013s	sys 0.009s
I20260709 12:15:30.995515 23027 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:30.987612 22572 catalog_manager.cc:5697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.006592 23011 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.003048 22990 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:15:31.012996 22947 tablet_bootstrap.cc:492] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:31.013525 22947 ts_tablet_manager.cc:1403] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.276s	user 0.017s	sys 0.007s
I20260709 12:15:31.015712 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:31.018251 22864 leader_election.cc:343] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:31.020823 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 75467.8us
W20260709 12:15:31.023983 22865 leader_election.cc:343] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.041309 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:31.042655 23027 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.043224 23011 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:31.045182 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:31.046104 22901 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.051240 23027 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.051878 23027 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.055289 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:31.055624 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:31.056890 22948 tablet_bootstrap.cc:492] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
W20260709 12:15:31.057106 22865 leader_election.cc:343] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:31.058126 22864 leader_election.cc:343] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.058599 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:31.059478 23093 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.059535 23027 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:31.061643 22901 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:31.026176 22950 raft_consensus.cc:359] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.063155 22950 raft_consensus.cc:385] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.030936 22899 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:31.038916 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:31.023820 22946 tablet_bootstrap.cc:492] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:31.068755 22946 ts_tablet_manager.cc:1403] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.250s	user 0.068s	sys 0.069s
I20260709 12:15:31.063174 22642 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:15:31.071646 22642 leader_election.cc:343] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.072371 22946 raft_consensus.cc:359] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.072718 22642 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:31.073258 22946 raft_consensus.cc:385] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.073629 22946 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.074817 23029 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:31.074311 22946 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.057404 22948 ts_tablet_manager.cc:1403] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.006s
I20260709 12:15:31.076288 23078 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:31.078966 22948 raft_consensus.cc:359] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.079713 22948 raft_consensus.cc:385] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.080013 22948 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.075549 23029 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:31.081295 23029 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.027737 22900 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:31.084339 22946 ts_tablet_manager.cc:1434] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.005s
I20260709 12:15:31.085595 22948 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.087716 22946 tablet_bootstrap.cc:492] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:31.075613 22950 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
W20260709 12:15:31.090607 22717 consensus_peers.cc:597] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:31.110865 22950 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.091492 23046 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:31.113837 22950 ts_tablet_manager.cc:1434] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.112s	user 0.003s	sys 0.006s
I20260709 12:15:31.037789 22947 raft_consensus.cc:359] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.098435 23078 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:15:31.115186 22717 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:31.119939 22950 tablet_bootstrap.cc:492] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:31.119952 23078 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.124117 22947 raft_consensus.cc:385] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.124940 22947 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.157917 22947 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.157123 22990 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.164942 22947 ts_tablet_manager.cc:1434] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.151s	user 0.007s	sys 0.006s
I20260709 12:15:31.168591 22947 tablet_bootstrap.cc:492] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:31.172147 22948 ts_tablet_manager.cc:1434] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.019s
I20260709 12:15:31.162734 22990 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.183559 22990 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:31.176898 22948 tablet_bootstrap.cc:492] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:31.184695 22946 tablet_bootstrap.cc:654] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.186162 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:31.187040 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:31.192533 22947 tablet_bootstrap.cc:654] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:31.194383 22641 leader_election.cc:343] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.195778 23072 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:31.196077 22642 leader_election.cc:343] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.196552 22642 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:31.196336 23072 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.199321 22990 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.219660 22573 catalog_manager.cc:5697] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:31.220803 23072 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:31.222036 22950 tablet_bootstrap.cc:654] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.222949 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:31.203627 23082 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:15:31.228996 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:31.229900 22901 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:31.232366 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:31.244326 23072 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.254880 22948 tablet_bootstrap.cc:654] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.275549 22946 tablet_bootstrap.cc:492] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:31.276155 22946 ts_tablet_manager.cc:1403] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.189s	user 0.021s	sys 0.002s
I20260709 12:15:31.279404 22947 tablet_bootstrap.cc:492] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:31.280277 22947 ts_tablet_manager.cc:1403] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.112s	user 0.025s	sys 0.015s
I20260709 12:15:31.281042 22950 tablet_bootstrap.cc:492] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:31.281560 22950 ts_tablet_manager.cc:1403] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.009s
I20260709 12:15:31.284377 22950 raft_consensus.cc:359] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.285234 22950 raft_consensus.cc:385] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.285531 22950 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.287297 22946 raft_consensus.cc:359] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.288199 22946 raft_consensus.cc:385] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.288489 22946 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.289182 22946 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.291095 22946 ts_tablet_manager.cc:1434] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:15:31.292559 22946 tablet_bootstrap.cc:492] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:31.286648 22950 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.301355 22950 ts_tablet_manager.cc:1434] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:15:31.302356 22950 tablet_bootstrap.cc:492] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:31.303985 23072 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.310381 22946 tablet_bootstrap.cc:654] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.312525 23082 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.313212 23082 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.318153 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:31.318985 22676 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:31.319254 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:31.320861 22717 leader_election.cc:343] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.321646 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:31.322472 23016 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:31.322885 23016 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.323263 23016 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.315543 23082 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:31.329026 22573 catalog_manager.cc:5697] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:31.337379 22948 tablet_bootstrap.cc:492] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:31.338021 22948 ts_tablet_manager.cc:1403] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.161s	user 0.022s	sys 0.013s
I20260709 12:15:31.340931 22948 raft_consensus.cc:359] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.341655 22948 raft_consensus.cc:385] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.341930 22948 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.343021 23082 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.343237 22947 raft_consensus.cc:359] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.343583 23082 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.344023 22947 raft_consensus.cc:385] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.344300 22947 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.344990 22947 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.345778 23082 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:31.347687 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:31.350682 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:31.351483 22901 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:31.351147 23016 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.352017 23075 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.354005 23075 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.356307 23075 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:31.359357 22947 ts_tablet_manager.cc:1434] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.001s
I20260709 12:15:31.360842 22947 tablet_bootstrap.cc:492] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:31.363008 22573 catalog_manager.cc:5697] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:31.363729 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:31.363799 22717 leader_election.cc:343] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.365167 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:31.342650 22948 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.367687 22950 tablet_bootstrap.cc:654] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.368438 23078 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.373540 22946 tablet_bootstrap.cc:492] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:31.380192 22946 ts_tablet_manager.cc:1403] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.000s
I20260709 12:15:31.379892 23078 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.380887 23131 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:31.381392 23131 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.381734 23131 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.382534 23078 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:31.383225 22946 raft_consensus.cc:359] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.383882 22946 raft_consensus.cc:385] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.383981 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:31.385859 22641 leader_election.cc:343] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:31.352346 22623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:31.389782 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:31.392089 22947 tablet_bootstrap.cc:654] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.391345 23016 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:31.397709 22950 tablet_bootstrap.cc:492] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:31.398273 22950 ts_tablet_manager.cc:1403] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.096s	user 0.007s	sys 0.003s
I20260709 12:15:31.384163 22946 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.399740 22946 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.401104 22950 raft_consensus.cc:359] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.401854 22950 raft_consensus.cc:385] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.401949 22946 ts_tablet_manager.cc:1434] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:15:31.402170 22950 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.375475 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:31.384322 22948 ts_tablet_manager.cc:1434] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.003s
I20260709 12:15:31.403707 22948 tablet_bootstrap.cc:492] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:31.404197 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:31.390569 22900 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:31.405862 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:31.406627 22676 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.409647 22948 tablet_bootstrap.cc:654] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.410851 22946 tablet_bootstrap.cc:492] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:31.411466 22995 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.412093 22995 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.411222 22950 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.412123 22642 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:31.414395 22995 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:31.415457 23078 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:31.415868 23078 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.416251 23078 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.419164 23147 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.421595 22946 tablet_bootstrap.cc:654] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.427088 22950 ts_tablet_manager.cc:1434] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.006s
I20260709 12:15:31.426900 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:31.409190 23131 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.435437 23131 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:31.436355 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:31.438238 23027 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.439080 23027 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.441028 22950 tablet_bootstrap.cc:492] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:31.447886 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:31.449236 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:31.449952 22901 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.450706 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:31.452476 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:31.453629 22865 leader_election.cc:343] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.449386 22947 tablet_bootstrap.cc:492] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:31.456553 22947 ts_tablet_manager.cc:1403] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.005s
W20260709 12:15:31.459708 22865 leader_election.cc:343] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.460340 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:31.461241 23093 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.462651 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:31.463006 23075 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.463894 23075 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.466413 23075 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:31.467305 22717 leader_election.cc:343] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.467530 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:31.468097 22947 raft_consensus.cc:359] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.468914 22947 raft_consensus.cc:385] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.469172 22947 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.469918 22947 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.471530 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:31.471928 22717 leader_election.cc:343] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.472232 23027 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:31.472532 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:31.473456 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:31.474761 23075 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.479009 22901 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:31.478813 23078 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.482656 22946 tablet_bootstrap.cc:492] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:31.493180 22946 ts_tablet_manager.cc:1403] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.090s	user 0.026s	sys 0.006s
I20260709 12:15:31.495024 22950 tablet_bootstrap.cc:654] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.495198 22947 ts_tablet_manager.cc:1434] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:15:31.496716 22947 tablet_bootstrap.cc:492] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
W20260709 12:15:31.488557 22717 leader_election.cc:343] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:31.506681 22717 leader_election.cc:343] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:31.490501 22642 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:31.508888 22826 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.509879 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:31.510665 22901 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.491854 22676 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:31.496553 22946 raft_consensus.cc:359] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.514981 22946 raft_consensus.cc:385] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.515383 22946 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.516203 22946 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.487087 23131 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.519444 22995 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:31.503119 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:31.520308 22751 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.521317 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:31.522025 22947 tablet_bootstrap.cc:654] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.521306 22946 ts_tablet_manager.cc:1434] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:15:31.523471 22995 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:31.524078 22946 tablet_bootstrap.cc:492] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:31.524094 22995 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:31.527587 22995 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.503757 23078 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:31.533885 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:31.534726 23131 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:31.535228 23131 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:31.535899 22947 tablet_bootstrap.cc:492] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:31.536286 22751 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:31.536062 23131 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.537883 22641 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:31.539113 23078 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:31.539839 23078 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:31.505163 22948 tablet_bootstrap.cc:492] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:31.541052 22948 ts_tablet_manager.cc:1403] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.138s	user 0.007s	sys 0.013s
I20260709 12:15:31.540844 23078 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.544137 22948 raft_consensus.cc:359] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.545025 22948 raft_consensus.cc:385] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.545382 22948 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.536533 22947 ts_tablet_manager.cc:1403] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.000s
I20260709 12:15:31.548445 22946 tablet_bootstrap.cc:654] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.532910 22901 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:31.550519 22947 raft_consensus.cc:359] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.562640 22947 raft_consensus.cc:385] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.563678 22947 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.546244 22948 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.564985 22990 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.561436 23131 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:31.565552 22990 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.565855 22947 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.570330 22990 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:31.572472 22947 ts_tablet_manager.cc:1434] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:15:31.574683 22947 tablet_bootstrap.cc:492] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:31.575845 22573 catalog_manager.cc:5697] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.586774 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:31.587580 22900 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:31.587734 23029 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:31.566632 22950 tablet_bootstrap.cc:492] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:31.577832 22990 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:31.579077 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:31.589933 22642 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:31.583048 22947 tablet_bootstrap.cc:654] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.591219 23030 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:31.591706 23030 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.592056 23030 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.589157 22950 ts_tablet_manager.cc:1403] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.003s
I20260709 12:15:31.597978 22950 raft_consensus.cc:359] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:15:31.598745 22642 leader_election.cc:343] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.599020 22950 raft_consensus.cc:385] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.599462 22950 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.567200 22948 ts_tablet_manager.cc:1434] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:15:31.606243 22948 tablet_bootstrap.cc:492] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:31.620498 23030 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.628997 23027 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.654165 23027 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.644811 22825 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.646654 22950 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.661816 22950 ts_tablet_manager.cc:1434] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 12:15:31.667446 23027 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:31.668905 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:31.669656 22948 tablet_bootstrap.cc:654] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.671458 22950 tablet_bootstrap.cc:492] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:31.680744 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:31.684576 22865 leader_election.cc:343] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.686298 23030 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:31.687902 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:31.690907 22827 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.657799 23093 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.693913 23093 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.700690 22946 tablet_bootstrap.cc:492] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:31.705726 22946 ts_tablet_manager.cc:1403] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.182s	user 0.015s	sys 0.004s
W20260709 12:15:31.707607 22864 leader_election.cc:343] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.708266 22864 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:31.708509 23093 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:31.711246 22950 tablet_bootstrap.cc:654] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.711957 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:31.716360 22572 catalog_manager.cc:5697] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.722230 23027 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.725837 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:31.726661 22899 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.727273 22947 tablet_bootstrap.cc:492] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:31.727975 22947 ts_tablet_manager.cc:1403] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.153s	user 0.047s	sys 0.053s
I20260709 12:15:31.713515 22827 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:31.733704 22947 raft_consensus.cc:359] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.734535 22947 raft_consensus.cc:385] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.734859 22947 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.735765 22947 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.737195 22946 raft_consensus.cc:359] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.737938 22947 ts_tablet_manager.cc:1434] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:15:31.739137 22947 tablet_bootstrap.cc:492] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:31.737963 22946 raft_consensus.cc:385] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.739804 22946 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.754848 22946 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:31.764807 22946 ts_tablet_manager.cc:1434] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 12:15:31.766209 22946 tablet_bootstrap.cc:492] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:31.772037 22947 tablet_bootstrap.cc:654] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.762877 22642 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:31.781654 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:31.781922 23030 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:31.782507 23030 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:31.782372 22990 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:31.783704 23030 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:15:31.761971 22864 leader_election.cc:343] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.790530 22573 catalog_manager.cc:5697] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:31.789793 22865 leader_election.cc:343] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.796342 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:31.800115 22899 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:31.803516 22950 tablet_bootstrap.cc:492] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:31.804109 22950 ts_tablet_manager.cc:1403] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.141s	user 0.020s	sys 0.012s
I20260709 12:15:31.807614 23027 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.810242 22946 tablet_bootstrap.cc:654] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.807205 22950 raft_consensus.cc:359] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.811982 22950 raft_consensus.cc:385] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.812376 22950 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.812638 23093 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.813454 23093 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.815424 22950 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.818037 23093 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:31.819381 22950 ts_tablet_manager.cc:1434] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:15:31.819375 23030 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.820238 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:31.821000 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:31.820138 23030 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.823022 22950 tablet_bootstrap.cc:492] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:31.823690 23030 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:15:31.824039 22865 leader_election.cc:343] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.824539 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:31.824869 22865 leader_election.cc:343] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.825335 22751 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:31.825482 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:31.827121 22641 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:31.795810 22948 tablet_bootstrap.cc:492] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:31.829326 22948 ts_tablet_manager.cc:1403] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.223s	user 0.022s	sys 0.026s
I20260709 12:15:31.826963 23093 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.832408 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:31.852607 22642 leader_election.cc:343] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.858314 22948 raft_consensus.cc:359] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.859529 22948 raft_consensus.cc:385] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.859817 22948 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.860469 22948 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.842424 23030 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:31.862282 23030 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.862715 23030 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.864735 22948 ts_tablet_manager.cc:1434] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 12:15:31.865597 22948 tablet_bootstrap.cc:492] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:31.883949 22947 tablet_bootstrap.cc:492] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:31.884290 22948 tablet_bootstrap.cc:654] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.884590 22947 ts_tablet_manager.cc:1403] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.146s	user 0.020s	sys 0.014s
I20260709 12:15:31.892254 22950 tablet_bootstrap.cc:654] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.898164 22947 raft_consensus.cc:359] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.899134 22947 raft_consensus.cc:385] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.899408 22947 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.900456 22947 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.906052 22575 catalog_manager.cc:5697] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:31.911605 22947 ts_tablet_manager.cc:1434] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 12:15:31.912746 22947 tablet_bootstrap.cc:492] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:31.910974 23093 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.916301 23093 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.919495 22946 tablet_bootstrap.cc:492] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:31.920107 22946 ts_tablet_manager.cc:1403] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.154s	user 0.011s	sys 0.014s
I20260709 12:15:31.922860 22946 raft_consensus.cc:359] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.923504 22946 raft_consensus.cc:385] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.923408 23030 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.924041 22946 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.924765 22946 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.926160 23075 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.926846 22946 ts_tablet_manager.cc:1434] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:15:31.926718 23075 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.927096 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:31.927922 22946 tablet_bootstrap.cc:492] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
W20260709 12:15:31.936250 22642 leader_election.cc:343] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.937117 22948 tablet_bootstrap.cc:492] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:31.937755 22948 ts_tablet_manager.cc:1403] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.016s
I20260709 12:15:31.938203 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:31.938947 22751 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.941138 22948 raft_consensus.cc:359] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.942065 22948 raft_consensus.cc:385] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.942363 22948 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.943207 22948 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:31.944828 22948 ts_tablet_manager.cc:1434] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:31.945624 23093 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:31.945884 22948 tablet_bootstrap.cc:492] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:31.946552 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:31.946949 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:31.930951 23030 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:15:31.949218 22864 leader_election.cc:343] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:31.949880 22865 leader_election.cc:343] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:31.950393 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:31.951344 22950 tablet_bootstrap.cc:492] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:31.952522 22950 ts_tablet_manager.cc:1403] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.132s	user 0.015s	sys 0.000s
I20260709 12:15:31.953967 23093 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:31.966166 22717 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:31.958671 22950 raft_consensus.cc:359] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.971118 22950 raft_consensus.cc:385] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.963685 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:31.971845 22950 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.966372 22946 tablet_bootstrap.cc:654] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.972954 22950 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.973265 22751 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:31.967547 23075 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:31.969928 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:31.978834 22948 tablet_bootstrap.cc:654] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.979359 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:31.979408 22641 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:31.981032 23075 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.969322 22947 tablet_bootstrap.cc:654] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.982447 23030 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:31.983283 23030 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:31.991842 22946 tablet_bootstrap.cc:492] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:31.984647 23030 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:31.992480 22946 ts_tablet_manager.cc:1403] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.005s
I20260709 12:15:31.997694 22946 raft_consensus.cc:359] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:31.998445 22946 raft_consensus.cc:385] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.998759 22946 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.999611 22946 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.000257 22995 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:32.004791 22946 ts_tablet_manager.cc:1434] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.005s
I20260709 12:15:32.007848 22946 tablet_bootstrap.cc:492] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:32.014873 23131 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.015695 23131 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.018545 23131 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:32.019995 22946 tablet_bootstrap.cc:654] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.024194 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:32.024453 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:32.026156 22899 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:32.032065 22573 catalog_manager.cc:5697] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.041972 22946 tablet_bootstrap.cc:492] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:32.042563 22946 ts_tablet_manager.cc:1403] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 12:15:32.044751 22827 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.045682 22946 raft_consensus.cc:359] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.046497 22946 raft_consensus.cc:385] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.046834 22946 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.044826 23029 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:15:32.049894 22717 consensus_peers.cc:597] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:32.050747 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:32.052793 22995 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:32.053264 22995 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.053664 22995 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.047561 22946 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.057049 22946 ts_tablet_manager.cc:1434] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:15:32.058337 22946 tablet_bootstrap.cc:492] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
W20260709 12:15:32.065490 22717 leader_election.cc:343] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.010399 22950 ts_tablet_manager.cc:1434] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.003s
I20260709 12:15:32.076411 22950 tablet_bootstrap.cc:492] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:32.112394 23131 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.113299 23131 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.120290 23078 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:15:32.133666 22950 tablet_bootstrap.cc:654] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.134721 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:32.135681 22899 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:32.137950 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:32.139775 23082 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:32.140267 23082 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.151122 23082 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.145681 22948 tablet_bootstrap.cc:492] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:32.155252 22948 ts_tablet_manager.cc:1403] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.210s	user 0.035s	sys 0.063s
I20260709 12:15:32.148078 23131 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:32.149345 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:32.150090 23093 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.159741 23093 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.162127 23093 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:32.164158 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:32.166041 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:32.167796 22946 tablet_bootstrap.cc:654] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:32.168058 22865 leader_election.cc:343] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:32.169787 22717 leader_election.cc:343] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:32.170176 22865 leader_election.cc:343] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.174383 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:32.170825 23181 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:32.158761 22948 raft_consensus.cc:359] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.183523 22947 tablet_bootstrap.cc:492] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:32.183542 22948 raft_consensus.cc:385] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.185532 22948 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.185688 22947 ts_tablet_manager.cc:1403] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.273s	user 0.023s	sys 0.038s
I20260709 12:15:32.216060 22947 raft_consensus.cc:359] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.216907 22947 raft_consensus.cc:385] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.217216 22947 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.218082 22947 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.219769 23030 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.220499 23030 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.222138 23181 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.223008 23181 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.188898 23093 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:32.234361 23181 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:32.193413 23078 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:32.223035 23030 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:32.198642 23082 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.237660 23082 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:32.224427 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:32.226176 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:32.238462 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:32.239372 22898 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:32.239699 22901 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:32.186589 22948 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.245078 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:32.245865 23029 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.246122 22946 tablet_bootstrap.cc:492] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:32.246622 22948 ts_tablet_manager.cc:1434] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260709 12:15:32.192821 22950 tablet_bootstrap.cc:492] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:32.246461 23029 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.247483 22950 ts_tablet_manager.cc:1403] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.171s	user 0.020s	sys 0.028s
I20260709 12:15:32.247745 22948 tablet_bootstrap.cc:492] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:32.267614 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:32.246739 22946 ts_tablet_manager.cc:1403] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.189s	user 0.012s	sys 0.003s
I20260709 12:15:32.249384 23029 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:32.251307 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:32.269778 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:32.270517 22898 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:32.271298 22641 leader_election.cc:343] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.271317 22946 raft_consensus.cc:359] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.272876 22946 raft_consensus.cc:385] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.272130 23029 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.165846 22995 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.273700 23029 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.275689 22995 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:32.275813 23029 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:32.277245 22946 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.277884 22948 tablet_bootstrap.cc:654] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.278053 22946 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.220500 22947 ts_tablet_manager.cc:1434] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:32.252588 22950 raft_consensus.cc:359] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.280237 22947 tablet_bootstrap.cc:492] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:32.280426 22950 raft_consensus.cc:385] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.280731 22950 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.281399 22950 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.281785 22898 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:32.284269 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:32.291323 22750 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:32.300652 22641 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:32.301651 23029 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:32.302095 23029 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.302501 23029 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.285482 22642 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:32.295197 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:32.296202 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:32.283298 22717 leader_election.cc:343] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.304240 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:32.304968 23078 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:32.305378 23078 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.305722 23078 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:32.306061 22642 leader_election.cc:343] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.306996 23131 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:32.308017 23075 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:32.307395 22642 leader_election.cc:343] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.308684 22642 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:32.308634 23075 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.309952 22990 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:32.310194 22642 leader_election.cc:343] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.312083 22947 tablet_bootstrap.cc:654] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.312176 23075 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:32.313784 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:32.312120 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:32.315299 22751 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:32.317150 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:32.280251 22946 ts_tablet_manager.cc:1434] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:15:32.320273 22946 tablet_bootstrap.cc:492] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:32.308020 23131 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.321728 23075 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.305814 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:32.299353 22950 ts_tablet_manager.cc:1434] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.002s
W20260709 12:15:32.327301 22717 leader_election.cc:343] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.332218 22950 tablet_bootstrap.cc:492] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:32.334656 22995 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:32.339744 22995 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:32.323789 23131 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.352324 22948 tablet_bootstrap.cc:492] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:32.352958 22948 ts_tablet_manager.cc:1403] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.006s
I20260709 12:15:32.354719 23181 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.355607 23181 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.360054 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:32.361116 22901 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.360929 22948 raft_consensus.cc:359] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.361788 22948 raft_consensus.cc:385] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.362164 22948 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.363343 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:32.362865 22948 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.369388 23181 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:32.369746 22678 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.373221 22950 tablet_bootstrap.cc:654] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.374940 23075 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:32.376617 22948 ts_tablet_manager.cc:1434] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:15:32.376567 22901 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:32.377694 22948 tablet_bootstrap.cc:492] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:32.379113 22678 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:32.369696 22995 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.384629 22946 tablet_bootstrap.cc:654] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.384899 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:32.385732 22825 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:32.386538 22948 tablet_bootstrap.cc:654] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.388536 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:32.396585 23181 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:32.396288 23078 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.397368 23181 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:32.398386 23181 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.403589 23029 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.404163 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:32.404922 22899 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.405988 23029 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:32.406041 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:32.407693 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:32.407796 22642 leader_election.cc:343] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.409266 22990 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:32.409583 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:32.410434 22750 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.398741 23078 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:32.430977 22947 tablet_bootstrap.cc:492] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:32.431707 22947 ts_tablet_manager.cc:1403] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.152s	user 0.018s	sys 0.020s
I20260709 12:15:32.435506 23131 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.435832 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:32.417522 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:32.436836 22898 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:32.437963 22947 raft_consensus.cc:359] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.445031 22947 raft_consensus.cc:385] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.445734 22947 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.444967 23082 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:32.470052 22947 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.470985 23082 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.472976 23082 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.476938 22947 ts_tablet_manager.cc:1434] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 12:15:32.483141 22947 tablet_bootstrap.cc:492] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:32.505577 22950 tablet_bootstrap.cc:492] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:32.506206 22950 ts_tablet_manager.cc:1403] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.181s	user 0.016s	sys 0.013s
I20260709 12:15:32.506644 23093 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.507483 23093 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.509183 22948 tablet_bootstrap.cc:492] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:32.509707 22948 ts_tablet_manager.cc:1403] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.132s	user 0.017s	sys 0.011s
I20260709 12:15:32.510152 23131 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:32.513135 22946 tablet_bootstrap.cc:492] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:32.512871 22950 raft_consensus.cc:359] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.513624 22946 ts_tablet_manager.cc:1403] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.194s	user 0.014s	sys 0.014s
I20260709 12:15:32.513413 23093 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:32.513691 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:32.515235 22750 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:32.516973 22641 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:15:32.518383 22864 leader_election.cc:343] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.519374 23078 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:32.508971 22899 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:32.520012 23078 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:32.521035 22946 raft_consensus.cc:359] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.521857 22946 raft_consensus.cc:385] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.522126 22946 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.522884 22946 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.519120 22948 raft_consensus.cc:359] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.518178 23082 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.513751 22950 raft_consensus.cc:385] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.523864 22948 raft_consensus.cc:385] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.526341 22950 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.521050 23078 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:15:32.524458 22642 leader_election.cc:343] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.526551 22948 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.525218 22946 ts_tablet_manager.cc:1434] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:15:32.533049 22946 tablet_bootstrap.cc:492] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:32.531404 22642 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:32.535269 22948 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.536828 23082 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:32.537922 22950 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.544862 22950 ts_tablet_manager.cc:1434] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 12:15:32.546141 22950 tablet_bootstrap.cc:492] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:32.545387 22573 catalog_manager.cc:5697] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:32.547595 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:32.548269 22901 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.553243 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:32.558957 23197 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.560000 22947 tablet_bootstrap.cc:654] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.559556 23197 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:15:32.560709 22623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:32.561937 23197 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:32.567096 22948 ts_tablet_manager.cc:1434] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 12:15:32.570009 22990 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:32.570612 22990 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:32.571512 22990 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.575664 22950 tablet_bootstrap.cc:654] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.576599 22948 tablet_bootstrap.cc:492] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:32.575842 22642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 44534.6us
W20260709 12:15:32.581300 22717 leader_election.cc:343] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.586987 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:32.587688 22827 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.590348 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:32.592339 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:32.597790 22676 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:32.594187 23029 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:32.592633 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:32.598996 22899 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.602403 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:32.604846 23131 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:32.608268 23131 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.608705 23131 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:32.612663 22717 leader_election.cc:343] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.591807 22901 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:32.624182 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:32.625023 22575 catalog_manager.cc:5697] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.632333 22899 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:32.635567 22827 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:32.625100 22946 tablet_bootstrap.cc:654] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.638535 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:32.641026 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:32.641283 22995 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:32.642899 23181 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:32.643442 23181 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:32.642098 22573 catalog_manager.cc:5697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:32.659418 22995 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:32.661326 22995 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:15:32.664794 22865 leader_election.cc:343] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.665380 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:32.640352 23029 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:15:32.666168 23093 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:32.670909 23181 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.683298 22826 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.690356 22948 tablet_bootstrap.cc:654] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.696774 22947 tablet_bootstrap.cc:492] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:32.697706 22947 ts_tablet_manager.cc:1403] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.219s	user 0.021s	sys 0.001s
I20260709 12:15:32.709214 23030 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.710050 23030 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.696585 23131 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.711793 22573 catalog_manager.cc:5697] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:32.713034 23030 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:32.713877 23131 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:32.714686 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:32.715260 23082 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.716032 23082 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.717440 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:32.718235 22899 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:32.719376 23082 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:32.720750 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:32.731958 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:32.721695 22642 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:32.732936 22676 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:32.733982 22642 leader_election.cc:343] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:32.716135 22717 leader_election.cc:343] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.735105 23078 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:32.749398 22947 raft_consensus.cc:359] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.750541 22947 raft_consensus.cc:385] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.751617 22947 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.753060 22947 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.745754 23078 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.756247 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:32.756680 23078 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.757085 22899 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:32.758082 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:32.758484 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:32.759478 23181 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:32.759835 23181 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.760174 23181 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.760792 22950 tablet_bootstrap.cc:492] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:32.761394 22950 ts_tablet_manager.cc:1403] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.216s	user 0.012s	sys 0.019s
W20260709 12:15:32.764488 22717 leader_election.cc:343] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.788861 22575 catalog_manager.cc:5697] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.793888 22950 raft_consensus.cc:359] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.794755 22950 raft_consensus.cc:385] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.795104 22950 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.794009 22575 catalog_manager.cc:5697] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.795943 22950 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.802400 22950 ts_tablet_manager.cc:1434] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.004s
I20260709 12:15:32.810652 22947 ts_tablet_manager.cc:1434] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.113s	user 0.013s	sys 0.020s
I20260709 12:15:32.811919 22947 tablet_bootstrap.cc:492] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:32.821131 23093 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.821483 22950 tablet_bootstrap.cc:492] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:32.821795 23093 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.824218 23078 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.825562 22948 tablet_bootstrap.cc:492] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:32.826067 22948 ts_tablet_manager.cc:1403] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.250s	user 0.009s	sys 0.011s
I20260709 12:15:32.826377 23093 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:32.828864 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:32.829545 22899 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.830322 22676 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:32.831908 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:32.833534 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:32.835175 22948 raft_consensus.cc:359] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.835955 23082 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:32.836644 23082 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:15:32.836678 22864 leader_election.cc:343] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.835958 22948 raft_consensus.cc:385] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.843401 22948 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.839582 23131 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:32.844322 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:32.844519 23082 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.844341 22948 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.846987 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:32.847709 22948 ts_tablet_manager.cc:1434] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
W20260709 12:15:32.848356 22642 leader_election.cc:343] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.848716 22948 tablet_bootstrap.cc:492] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:32.846307 22946 tablet_bootstrap.cc:492] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:32.851213 22946 ts_tablet_manager.cc:1403] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.318s	user 0.012s	sys 0.009s
I20260709 12:15:32.859598 22899 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:32.861002 22642 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:32.826404 23078 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:15:32.876430 22865 leader_election.cc:343] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:32.877020 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:32.877835 23093 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:32.871464 23030 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:32.879113 23030 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:32.879954 23030 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.883474 22950 tablet_bootstrap.cc:654] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.919607 23082 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:32.944070 23204 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:32.948010 23011 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.948653 23011 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.953399 22677 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.953428 23181 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:32.959268 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:32.965091 22901 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 1: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:15:32.965325 22948 tablet_bootstrap.cc:654] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.955873 23075 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.966034 23181 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:32.966301 23075 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:32.968640 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:32.969236 23075 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:32.970085 22947 tablet_bootstrap.cc:654] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.969306 22898 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:32.971987 23011 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:32.973436 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:32.974115 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:32.975903 22641 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:32.981920 22950 tablet_bootstrap.cc:492] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:32.984447 22948 tablet_bootstrap.cc:492] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:32.985073 22948 ts_tablet_manager.cc:1403] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.008s
I20260709 12:15:32.985385 22950 ts_tablet_manager.cc:1403] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.164s	user 0.025s	sys 0.017s
I20260709 12:15:32.985368 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:32.986359 22750 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:32.989174 23210 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.989769 23210 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:32.989754 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:32.993444 23210 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:32.995718 22947 tablet_bootstrap.cc:492] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:32.995886 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:32.997042 22947 ts_tablet_manager.cc:1403] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.185s	user 0.015s	sys 0.003s
I20260709 12:15:33.007172 22947 raft_consensus.cc:359] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:33.007990 22947 raft_consensus.cc:385] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.008328 22947 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.009034 22947 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:33.013624 22947 ts_tablet_manager.cc:1434] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:15:33.013490 22898 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:33.016448 22947 tablet_bootstrap.cc:492] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:33.015777 22946 raft_consensus.cc:359] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:32.997378 22948 raft_consensus.cc:359] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.000958 22950 raft_consensus.cc:359] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.001431 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:33.017418 22948 raft_consensus.cc:385] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.017824 22948 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.018824 22950 raft_consensus.cc:385] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.018714 22948 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.019440 22950 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.020601 22950 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.023671 22948 ts_tablet_manager.cc:1434] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
I20260709 12:15:33.025033 22948 tablet_bootstrap.cc:492] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:33.025498 22947 tablet_bootstrap.cc:654] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.016987 22946 raft_consensus.cc:385] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.027359 22946 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.027979 22950 ts_tablet_manager.cc:1434] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 12:15:33.028239 22946 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:32.999843 22717 leader_election.cc:343] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:33.088788 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 88739us
I20260709 12:15:33.094285 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:15:33.094096 22865 leader_election.cc:343] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.101801 22950 tablet_bootstrap.cc:492] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
W20260709 12:15:33.111415 22865 leader_election.cc:343] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.112201 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:33.106089 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:15:33.131192 22642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 48630.2us
I20260709 12:15:33.122745 23011 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:15:33.140934 23093 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.143618 22576 catalog_manager.cc:5697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.158613 23075 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:33.164542 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 58776.6us
I20260709 12:15:33.165720 23210 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.167582 23046 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:33.142381 23093 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:33.192904 22642 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:33.201723 22946 ts_tablet_manager.cc:1434] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.350s	user 0.015s	sys 0.011s
I20260709 12:15:33.217312 22948 tablet_bootstrap.cc:654] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.218947 23093 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:33.221722 22827 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.222136 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:33.225546 22864 leader_election.cc:343] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.239876 22946 tablet_bootstrap.cc:492] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
W20260709 12:15:33.268675 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 157471us
I20260709 12:15:33.269555 23046 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:33.281816 22947 tablet_bootstrap.cc:492] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:33.282840 22947 ts_tablet_manager.cc:1403] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.267s	user 0.014s	sys 0.013s
I20260709 12:15:33.296474 23030 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:33.310324 23075 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.311441 23078 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.280224 23046 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:33.326717 22573 catalog_manager.cc:5697] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:33.335227 23232 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:33.339442 22947 raft_consensus.cc:359] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:33.340389 22947 raft_consensus.cc:385] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.352080 22950 tablet_bootstrap.cc:654] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.357342 22946 tablet_bootstrap.cc:654] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.340758 22947 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.403007 22995 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:15:33.406921 22947 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:33.426302 23230 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:15:33.442700 22947 ts_tablet_manager.cc:1434] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.159s	user 0.009s	sys 0.001s
I20260709 12:15:33.443107 23229 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:33.444353 22947 tablet_bootstrap.cc:492] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:33.444227 23229 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.466943 22947 tablet_bootstrap.cc:654] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.474130 23222 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.468149 23093 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.451150 22674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:33.495338 22674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:33.498072 22865 leader_election.cc:343] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.498687 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:33.499110 23082 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:33.499935 23227 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.481603 23229 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:33.488863 23232 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:15:33.483287 23093 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:33.475713 23222 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.485235 23230 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.531373 23230 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:33.533213 23222 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:33.522279 22948 tablet_bootstrap.cc:492] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:33.539784 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:33.539551 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:33.541985 22948 ts_tablet_manager.cc:1403] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.517s	user 0.011s	sys 0.010s
I20260709 12:15:33.545361 23078 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:33.553714 22946 tablet_bootstrap.cc:492] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:33.554383 22946 ts_tablet_manager.cc:1403] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.315s	user 0.013s	sys 0.022s
I20260709 12:15:33.534258 23230 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:15:33.561187 22717 leader_election.cc:343] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.559410 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:15:33.574765 22642 leader_election.cc:343] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.582877 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:33.583078 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:33.589824 23093 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:33.599846 22947 tablet_bootstrap.cc:492] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:33.600477 22947 ts_tablet_manager.cc:1403] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.156s	user 0.021s	sys 0.009s
I20260709 12:15:33.568483 22898 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:33.608105 22950 tablet_bootstrap.cc:492] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
W20260709 12:15:33.592120 22717 consensus_peers.cc:597] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:33.613452 22950 ts_tablet_manager.cc:1403] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.584s	user 0.036s	sys 0.027s
W20260709 12:15:33.613581 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:33.609202 23011 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:33.604203 22947 raft_consensus.cc:359] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:33.619544 22947 raft_consensus.cc:385] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.619890 22947 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.620760 22947 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:33.589733 22946 raft_consensus.cc:359] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.623210 22946 raft_consensus.cc:385] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.623540 22946 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.624308 22946 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.608826 22948 raft_consensus.cc:359] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:33.625392 22948 raft_consensus.cc:385] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.625690 22948 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.626399 22948 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:33.628695 22947 ts_tablet_manager.cc:1434] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.004s
I20260709 12:15:33.630002 22947 tablet_bootstrap.cc:492] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:33.634325 22948 ts_tablet_manager.cc:1434] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.000s
I20260709 12:15:33.635916 22948 tablet_bootstrap.cc:492] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:33.643806 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:33.596891 22790 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:33.646235 23229 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:33.646395 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 49865.3us
I20260709 12:15:33.651238 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:33.657850 22573 catalog_manager.cc:5697] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.667623 22948 tablet_bootstrap.cc:654] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.672097 22947 tablet_bootstrap.cc:654] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:33.687609 22641 leader_election.cc:343] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.641549 22950 raft_consensus.cc:359] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:33.703344 22641 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:33.703583 22950 raft_consensus.cc:385] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.704953 23250 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.704244 22950 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.706844 22950 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:33.709143 22950 ts_tablet_manager.cc:1434] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.001s
I20260709 12:15:33.710219 22950 tablet_bootstrap.cc:492] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
W20260709 12:15:33.692684 22865 leader_election.cc:343] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.719597 22950 tablet_bootstrap.cc:654] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.725323 22947 tablet_bootstrap.cc:492] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:33.725828 22947 ts_tablet_manager.cc:1403] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.096s	user 0.005s	sys 0.007s
I20260709 12:15:33.733150 22948 tablet_bootstrap.cc:492] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:33.734186 22948 ts_tablet_manager.cc:1403] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.099s	user 0.007s	sys 0.005s
I20260709 12:15:33.751727 22947 raft_consensus.cc:359] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:33.756000 22947 raft_consensus.cc:385] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.756320 22947 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.757130 22947 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:33.759471 22947 ts_tablet_manager.cc:1434] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:15:33.754961 22948 raft_consensus.cc:359] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:33.762147 22948 raft_consensus.cc:385] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.762451 22948 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.763445 22948 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:33.766125 22948 ts_tablet_manager.cc:1434] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:15:33.769164 22947 tablet_bootstrap.cc:492] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:33.769785 22946 ts_tablet_manager.cc:1434] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.214s	user 0.005s	sys 0.003s
I20260709 12:15:33.774340 22950 tablet_bootstrap.cc:492] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:33.775066 22950 ts_tablet_manager.cc:1403] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.028s
I20260709 12:15:33.782094 22947 tablet_bootstrap.cc:654] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:33.783772 22865 leader_election.cc:343] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.784332 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:33.784765 22950 raft_consensus.cc:359] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:33.785844 22950 raft_consensus.cc:385] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.768420 22948 tablet_bootstrap.cc:492] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:33.785715 23093 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.795504 22948 tablet_bootstrap.cc:654] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:33.775844 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 102128us
I20260709 12:15:33.798838 22950 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.799136 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:33.800190 22950 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:33.800947 23197 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:33.801430 23197 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.801810 23197 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.806198 23250 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.806895 23250 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:33.808130 22947 tablet_bootstrap.cc:492] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:33.811893 22947 ts_tablet_manager.cc:1403] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.011s
I20260709 12:15:33.812690 22950 ts_tablet_manager.cc:1434] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:15:33.813058 23250 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:33.812743 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:33.813864 22900 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:33.816186 22642 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:33.817319 23250 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:33.817744 23250 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.818086 23250 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.824088 22950 tablet_bootstrap.cc:492] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:33.824976 22947 raft_consensus.cc:359] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:33.825824 22947 raft_consensus.cc:385] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.826154 22947 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.827014 22947 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:15:33.827613 22642 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:33.832470 22948 tablet_bootstrap.cc:492] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:33.833009 22948 ts_tablet_manager.cc:1403] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.004s
I20260709 12:15:33.833818 22827 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.834148 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:33.836184 22946 tablet_bootstrap.cc:492] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:33.829589 22947 ts_tablet_manager.cc:1434] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:15:33.843222 22947 tablet_bootstrap.cc:492] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:33.847806 23046 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.848500 23046 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.836243 22948 raft_consensus.cc:359] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.850841 22948 raft_consensus.cc:385] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.851274 22948 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.851994 22948 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.854089 23093 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.854573 22948 ts_tablet_manager.cc:1434] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:15:33.850723 23046 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:33.854739 23093 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:33.855916 22948 tablet_bootstrap.cc:492] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:33.858974 23093 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:33.855953 22947 tablet_bootstrap.cc:654] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.860050 22950 tablet_bootstrap.cc:654] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.860136 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:33.862126 22864 leader_election.cc:343] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.873064 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:33.874328 22948 tablet_bootstrap.cc:654] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:33.877360 22865 leader_election.cc:343] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.878046 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:33.879381 23093 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.882491 22950 tablet_bootstrap.cc:492] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:33.883075 22950 ts_tablet_manager.cc:1403] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.005s
W20260709 12:15:33.877637 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 48934.8us
I20260709 12:15:33.886439 22950 raft_consensus.cc:359] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.887468 22950 raft_consensus.cc:385] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.887791 22950 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.888631 22950 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:33.901750 22950 ts_tablet_manager.cc:1434] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:15:33.917550 22950 tablet_bootstrap.cc:492] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:33.928939 22948 tablet_bootstrap.cc:492] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:33.929733 22948 ts_tablet_manager.cc:1403] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.004s
I20260709 12:15:33.937122 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:33.938195 22677 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:33.938405 23075 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.939226 23093 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.939311 23075 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:33.940052 23093 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:33.943524 23075 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:33.945096 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:33.946300 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:33.947197 22824 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:33.944823 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:33.950521 23250 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:33.951536 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:33.953141 23075 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.954967 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:33.956408 22946 tablet_bootstrap.cc:654] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.946427 22948 raft_consensus.cc:359] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:33.926678 22950 tablet_bootstrap.cc:654] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:33.957463 22864 leader_election.cc:343] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.957525 23093 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:33.970853 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:33.962882 23250 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:33.963760 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:33.975904 22899 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.980930 23197 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:33.982401 22750 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 1: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:15:33.964689 22948 raft_consensus.cc:385] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.983530 23197 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:33.988662 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:33.990208 22865 leader_election.cc:343] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.991026 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:33.991888 22947 tablet_bootstrap.cc:492] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:33.992554 23093 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.992693 22947 ts_tablet_manager.cc:1403] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.045s
I20260709 12:15:33.997917 22947 raft_consensus.cc:359] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:33.999035 22947 raft_consensus.cc:385] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.999400 22947 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.001399 22947 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.007949 22947 ts_tablet_manager.cc:1434] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 12:15:34.009182 22947 tablet_bootstrap.cc:492] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:34.016955 22947 tablet_bootstrap.cc:654] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.002988 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:34.024693 23197 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:33.983837 22948 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.039142 23197 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.039621 23197 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.039814 22948 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.042393 22948 ts_tablet_manager.cc:1434] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.000s
I20260709 12:15:34.043635 22948 tablet_bootstrap.cc:492] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:34.053130 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:34.053218 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:34.054010 22677 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:34.056774 23229 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:34.057515 23229 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.057847 22824 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.062001 23093 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.062355 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:34.062646 23093 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.066798 23093 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:34.067787 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:34.069325 22864 leader_election.cc:343] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.073738 23229 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:34.075115 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:34.075227 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:34.077103 22865 leader_election.cc:343] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.077209 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:34.077636 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:34.078728 23093 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.079535 23229 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.081826 22947 tablet_bootstrap.cc:492] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:34.082652 22947 ts_tablet_manager.cc:1403] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.001s
I20260709 12:15:34.089656 23230 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:34.093039 23197 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.096093 23197 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:34.109616 22950 tablet_bootstrap.cc:492] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:34.110237 22950 ts_tablet_manager.cc:1403] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.193s	user 0.039s	sys 0.015s
I20260709 12:15:34.037716 22899 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
W20260709 12:15:34.115854 22623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:34.116499 22642 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:34.117908 23223 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.118506 23223 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:34.119194 22948 tablet_bootstrap.cc:654] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.119504 23223 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.123003 22950 raft_consensus.cc:359] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.123785 22950 raft_consensus.cc:385] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.124042 22950 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.129976 22946 tablet_bootstrap.cc:492] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:34.132539 22946 ts_tablet_manager.cc:1403] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.297s	user 0.017s	sys 0.003s
W20260709 12:15:34.132952 22717 consensus_peers.cc:597] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:34.086472 22947 raft_consensus.cc:359] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.134649 22947 raft_consensus.cc:385] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.135035 22947 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.142465 22947 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.145730 22947 ts_tablet_manager.cc:1434] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:15:34.150075 22946 raft_consensus.cc:359] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.150964 22946 raft_consensus.cc:385] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.151238 22946 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.152136 22946 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.152724 23093 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.140324 22950 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.154942 23093 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.159497 23093 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:34.161598 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:34.162073 22946 ts_tablet_manager.cc:1434] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 12:15:34.163045 22947 tablet_bootstrap.cc:492] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:34.155771 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:34.164884 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:34.165894 23197 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:15:34.167910 22865 leader_election.cc:343] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:34.172923 22865 leader_election.cc:343] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.173341 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:34.175318 22950 ts_tablet_manager.cc:1434] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 12:15:34.179654 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:34.180737 22678 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.176343 23093 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.190233 22950 tablet_bootstrap.cc:492] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:34.192195 22946 tablet_bootstrap.cc:492] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:34.218438 22947 tablet_bootstrap.cc:654] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.242548 23197 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.243335 23197 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.244577 22950 tablet_bootstrap.cc:654] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.244913 22946 tablet_bootstrap.cc:654] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.248013 23197 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:34.250939 22678 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:34.253237 23250 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.263275 23251 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.266561 23251 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.268101 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:34.268621 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:34.269567 22899 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
W20260709 12:15:34.272253 22717 leader_election.cc:343] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.274282 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:34.275054 23197 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.275475 23197 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.275513 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:34.276108 23197 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.276393 22822 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.278396 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:34.280237 23082 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.280743 23082 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:34.281579 23082 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.263252 23250 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.285872 23250 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:34.288712 23251 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:34.291278 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:34.292202 22900 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:34.292441 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:34.292770 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:34.296375 22576 catalog_manager.cc:5697] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:34.299374 22642 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:15:34.300230 22642 leader_election.cc:343] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:34.301913 22642 leader_election.cc:343] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.302822 23251 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.304893 23251 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.313112 23251 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.315237 22572 catalog_manager.cc:5697] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:34.321146 23251 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.323688 22948 tablet_bootstrap.cc:492] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:34.324222 22948 ts_tablet_manager.cc:1403] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.281s	user 0.018s	sys 0.006s
I20260709 12:15:34.324764 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:34.327490 22948 raft_consensus.cc:359] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.328212 22948 raft_consensus.cc:385] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.328467 22948 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
W20260709 12:15:34.329536 22642 leader_election.cc:343] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:34.330435 22641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 51120.5us
I20260709 12:15:34.336047 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:34.337682 23251 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:34.329144 22948 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.338699 22822 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:34.340135 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:34.348999 22900 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.341203 22947 tablet_bootstrap.cc:492] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
W20260709 12:15:34.339455 22641 leader_election.cc:343] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.350543 22947 ts_tablet_manager.cc:1403] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.204s	user 0.017s	sys 0.005s
I20260709 12:15:34.350488 22641 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:34.351536 23011 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.359700 22947 raft_consensus.cc:359] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.360466 22947 raft_consensus.cc:385] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.360744 22947 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.367659 22948 ts_tablet_manager.cc:1434] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 12:15:34.368446 22900 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:34.369791 22947 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.372938 22642 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:34.373594 22947 ts_tablet_manager.cc:1434] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:15:34.374876 22948 tablet_bootstrap.cc:492] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:34.376878 22947 tablet_bootstrap.cc:492] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:34.379207 23011 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.379786 23011 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:34.380626 23011 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.382937 23093 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.383746 23093 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.384995 22950 tablet_bootstrap.cc:492] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:34.385649 22950 ts_tablet_manager.cc:1403] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.000s
I20260709 12:15:34.401602 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:34.403086 22865 leader_election.cc:343] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.402922 23197 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.404731 23093 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:34.405387 23197 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:34.406596 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:34.407943 22950 raft_consensus.cc:359] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.408717 22950 raft_consensus.cc:385] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.408998 22950 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.409196 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:34.410125 22865 leader_election.cc:343] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.410192 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:34.410825 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:34.411000 22899 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.414516 22946 tablet_bootstrap.cc:492] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:34.415369 22946 ts_tablet_manager.cc:1403] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.238s	user 0.013s	sys 0.003s
I20260709 12:15:34.415412 23093 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.417341 22947 tablet_bootstrap.cc:654] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.418733 22946 raft_consensus.cc:359] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:15:34.427074 22717 leader_election.cc:343] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.427702 22946 raft_consensus.cc:385] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.428185 22946 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.422174 22950 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.422479 22899 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:34.436702 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:34.437448 22950 ts_tablet_manager.cc:1434] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 12:15:34.438170 23197 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.439042 22950 tablet_bootstrap.cc:492] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:34.441044 23197 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:34.442174 23197 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.443470 22948 tablet_bootstrap.cc:654] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.447003 23270 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.447758 23270 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.448246 23093 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.448331 23011 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.449122 23093 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.449199 23011 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.451087 23270 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:34.451975 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:34.453884 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:34.453907 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:34.455636 23093 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:34.455752 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:34.457382 22641 leader_election.cc:343] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.441087 22946 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.459048 22790 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:34.460688 22946 ts_tablet_manager.cc:1434] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
W20260709 12:15:34.460980 22865 leader_election.cc:343] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.462327 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:34.464177 22946 tablet_bootstrap.cc:492] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:34.465342 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:34.466825 22864 leader_election.cc:343] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.467262 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:15:34.468214 22642 leader_election.cc:343] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.468648 22642 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:34.469100 23093 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.469511 22990 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.470211 23270 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.469656 23011 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:34.486263 22950 tablet_bootstrap.cc:654] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.489526 22948 tablet_bootstrap.cc:492] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:34.490091 22948 ts_tablet_manager.cc:1403] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.116s	user 0.008s	sys 0.003s
I20260709 12:15:34.492606 23046 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.493419 22948 raft_consensus.cc:359] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.493480 23046 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.500218 22948 raft_consensus.cc:385] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.500692 22948 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.501536 22948 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.502260 23046 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:34.498237 22947 tablet_bootstrap.cc:492] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:34.503538 22947 ts_tablet_manager.cc:1403] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.127s	user 0.020s	sys 0.023s
I20260709 12:15:34.504143 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:34.504519 22948 ts_tablet_manager.cc:1434] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 12:15:34.504736 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:34.505652 22948 tablet_bootstrap.cc:492] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:34.505527 22678 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:34.507164 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:34.507234 22947 raft_consensus.cc:359] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.508159 22947 raft_consensus.cc:385] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.508260 23046 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.508514 22947 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.510905 22947 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.512617 23250 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:34.513783 22717 leader_election.cc:343] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.508706 23046 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.515782 22947 ts_tablet_manager.cc:1434] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:15:34.516112 23046 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.522675 22576 catalog_manager.cc:5697] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:34.523609 22822 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.499871 22946 tablet_bootstrap.cc:654] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.529296 23011 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.530318 23011 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.534075 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:34.534557 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44611.3us
W20260709 12:15:34.535640 22642 leader_election.cc:343] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.535915 22947 tablet_bootstrap.cc:492] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:34.537020 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:34.537690 22900 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:34.538858 22642 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:34.539739 23250 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.540154 23250 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.540609 23250 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.544665 23011 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:34.547679 22947 tablet_bootstrap.cc:654] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.551218 22950 tablet_bootstrap.cc:492] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:34.551792 22950 ts_tablet_manager.cc:1403] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.000s
I20260709 12:15:34.553694 22948 tablet_bootstrap.cc:654] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.556520 22950 raft_consensus.cc:359] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.557577 22950 raft_consensus.cc:385] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.557843 22950 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.558413 23250 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.565582 23250 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:34.566084 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:34.568588 22642 leader_election.cc:343] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.569654 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:34.570444 22900 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.575670 22947 tablet_bootstrap.cc:492] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:34.576285 22947 ts_tablet_manager.cc:1403] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.001s
I20260709 12:15:34.588980 22947 raft_consensus.cc:359] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.589788 22947 raft_consensus.cc:385] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.590085 22947 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.590942 22947 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.593796 22947 ts_tablet_manager.cc:1434] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:15:34.594926 22947 tablet_bootstrap.cc:492] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:34.599809 22947 tablet_bootstrap.cc:654] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.611904 22947 tablet_bootstrap.cc:492] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:34.612589 22947 ts_tablet_manager.cc:1403] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:15:34.613561 23250 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:34.615443 22947 raft_consensus.cc:359] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.616531 22947 raft_consensus.cc:385] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.616820 22947 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.617673 22947 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.619926 22947 ts_tablet_manager.cc:1434] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:34.620976 22947 tablet_bootstrap.cc:492] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:34.558686 22950 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.637012 22950 ts_tablet_manager.cc:1434] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 12:15:34.638144 22950 tablet_bootstrap.cc:492] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:34.558820 22946 tablet_bootstrap.cc:492] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:34.639353 22946 ts_tablet_manager.cc:1403] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.175s	user 0.011s	sys 0.002s
I20260709 12:15:34.558565 23046 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.646850 22946 raft_consensus.cc:359] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.647612 22946 raft_consensus.cc:385] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.647888 22946 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.648613 22946 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.650291 22946 ts_tablet_manager.cc:1434] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:15:34.657886 22946 tablet_bootstrap.cc:492] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:34.634462 22947 tablet_bootstrap.cc:654] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.667958 22950 tablet_bootstrap.cc:654] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.669880 23046 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:34.672963 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:34.676054 22946 tablet_bootstrap.cc:654] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:34.696626 22717 leader_election.cc:343] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.678108 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:34.697857 22900 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:34.698311 22678 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.699149 22642 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:34.699381 22576 catalog_manager.cc:5697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:34.701006 22990 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.701676 22990 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:34.702473 22947 tablet_bootstrap.cc:492] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:34.703030 22947 ts_tablet_manager.cc:1403] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.000s
I20260709 12:15:34.707441 22947 raft_consensus.cc:359] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.681028 22824 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.702919 22990 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.710986 22947 raft_consensus.cc:385] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.712262 22948 tablet_bootstrap.cc:492] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:34.719483 22948 ts_tablet_manager.cc:1403] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.214s	user 0.039s	sys 0.036s
I20260709 12:15:34.722124 22948 raft_consensus.cc:359] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.723048 22948 raft_consensus.cc:385] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.723397 22947 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.724572 22947 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.724014 22948 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.726367 23270 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.726415 22947 ts_tablet_manager.cc:1434] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:15:34.727025 23270 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.736027 23270 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:34.726719 22948 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.737802 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:34.741854 22948 ts_tablet_manager.cc:1434] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:15:34.742674 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:34.745414 22950 tablet_bootstrap.cc:492] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:34.746440 22950 ts_tablet_manager.cc:1403] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.109s	user 0.023s	sys 0.007s
I20260709 12:15:34.742756 23289 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.747236 23289 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.749382 23289 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:34.749539 22950 raft_consensus.cc:359] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.750319 22950 raft_consensus.cc:385] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.750649 22950 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.751001 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:34.751389 22950 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.753997 23289 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.754523 23289 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:34.732967 22678 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:34.729439 22947 tablet_bootstrap.cc:492] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:34.757129 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:34.761227 23251 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.761844 23251 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.763368 22575 catalog_manager.cc:5697] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:34.764039 23251 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:34.764051 23093 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.765015 23082 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.765117 23093 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.765704 23082 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:34.766673 23082 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:34.767452 23093 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:34.754011 23270 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.751966 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:34.755775 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:34.764073 22948 tablet_bootstrap.cc:492] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:34.771338 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:34.772038 22901 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:34.772902 23289 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:34.768136 22947 tablet_bootstrap.cc:654] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.773587 22642 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:15:34.774045 22864 leader_election.cc:343] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.775136 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:34.776064 22678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:34.776329 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:34.776726 22864 leader_election.cc:343] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:34.778010 22641 leader_election.cc:343] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:34.780251 22865 leader_election.cc:343] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.780725 22950 ts_tablet_manager.cc:1434] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:15:34.776412 22990 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.781677 22990 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.781994 22950 tablet_bootstrap.cc:492] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:34.782083 22990 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.783515 23046 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:34.791296 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:34.791554 22865 leader_election.cc:343] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.792553 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:34.793241 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:34.794656 23289 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:34.803346 22865 leader_election.cc:343] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.803995 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:15:34.805326 22865 leader_election.cc:343] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.805800 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:34.806573 23093 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.807358 23093 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:34.808339 22642 consensus_peers.cc:597] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:34.810719 22947 tablet_bootstrap.cc:492] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:34.811658 22947 ts_tablet_manager.cc:1403] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.004s
I20260709 12:15:34.816327 22575 catalog_manager.cc:5697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:34.819578 22950 tablet_bootstrap.cc:654] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.837327 23046 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:34.818111 22947 raft_consensus.cc:359] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.839015 22947 raft_consensus.cc:385] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.839432 22947 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.840687 22947 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.844515 22990 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.856089 22946 tablet_bootstrap.cc:492] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:34.857580 23289 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.861552 23289 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.864058 23289 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:34.865447 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:34.866168 22946 ts_tablet_manager.cc:1403] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.209s	user 0.021s	sys 0.000s
W20260709 12:15:34.867480 22864 leader_election.cc:343] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.871285 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:34.873162 22865 leader_election.cc:343] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.873788 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:34.874971 23289 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.894760 23289 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.895495 23289 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:34.898818 23289 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:34.899791 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:34.872242 22946 raft_consensus.cc:359] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.860944 22948 tablet_bootstrap.cc:654] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.904006 22990 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:34.902498 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:15:34.905280 22864 leader_election.cc:343] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.935360 22901 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.903885 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:15:34.937882 22641 leader_election.cc:343] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.903066 22946 raft_consensus.cc:385] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.939414 22946 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.940241 22946 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:34.902081 22947 ts_tablet_manager.cc:1434] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.000s
I20260709 12:15:34.903252 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:34.942595 22946 ts_tablet_manager.cc:1434] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.076s	user 0.002s	sys 0.004s
I20260709 12:15:34.945200 22946 tablet_bootstrap.cc:492] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
W20260709 12:15:34.945384 22865 leader_election.cc:343] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.945946 22865 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:34.946995 23289 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.949882 23232 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:34.952404 22946 tablet_bootstrap.cc:654] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.917549 22824 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.969172 22901 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:34.961313 23303 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.970022 23251 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.997759 22642 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:34.998003 23251 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:35.004313 22990 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.005025 22990 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:34.999892 23303 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:35.009859 23303 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:35.011421 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:35.015628 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:35.019835 22790 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:35.006018 22990 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:35.028288 23251 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:35.030634 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:35.034678 22642 leader_election.cc:343] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.037927 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:35.040000 22641 leader_election.cc:343] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.040526 22641 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:35.043043 23251 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.045796 23303 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.059054 22947 tablet_bootstrap.cc:492] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Bootstrap starting.
I20260709 12:15:35.060161 22822 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.072247 22950 tablet_bootstrap.cc:492] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:35.072974 22950 ts_tablet_manager.cc:1403] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.291s	user 0.021s	sys 0.000s
I20260709 12:15:35.053966 23251 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:15:35.069679 22948 tablet_bootstrap.cc:492] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:35.074657 22948 ts_tablet_manager.cc:1403] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.330s	user 0.022s	sys 0.029s
I20260709 12:15:35.084782 22946 tablet_bootstrap.cc:492] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:35.085615 22946 ts_tablet_manager.cc:1403] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.141s	user 0.024s	sys 0.031s
I20260709 12:15:35.078349 22948 raft_consensus.cc:359] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:35.091406 22948 raft_consensus.cc:385] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.092160 23232 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.091814 22946 raft_consensus.cc:359] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:35.093282 22946 raft_consensus.cc:385] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.093710 22946 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.091912 22948 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.096750 22948 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:35.100373 22946 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:35.092839 23232 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:35.103294 22946 ts_tablet_manager.cc:1434] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.001s
I20260709 12:15:35.107331 22946 tablet_bootstrap.cc:492] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:35.116101 22946 tablet_bootstrap.cc:654] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.116550 23232 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:35.128180 22950 raft_consensus.cc:359] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:35.129626 22950 raft_consensus.cc:385] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.130040 22950 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
W20260709 12:15:35.140275 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 63493.9us
I20260709 12:15:35.142134 22950 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:35.151412 22948 ts_tablet_manager.cc:1434] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.000s
I20260709 12:15:35.152333 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:35.153249 22901 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:35.170207 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:35.173332 22950 ts_tablet_manager.cc:1434] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.100s	user 0.009s	sys 0.001s
I20260709 12:15:35.184623 22948 tablet_bootstrap.cc:492] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:35.197690 22950 tablet_bootstrap.cc:492] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:35.200381 22947 tablet_bootstrap.cc:654] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.229740 23232 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.230485 23232 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:15:35.245959 22717 leader_election.cc:343] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:35.251415 22642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 67415.9us
I20260709 12:15:35.261945 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:15:35.263815 22623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:15:35.265590 23314 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:15:35.265635 23046 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.268970 23046 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.269395 23046 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.271713 23232 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:35.255949 23197 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:15:35.275493 22946 tablet_bootstrap.cc:492] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:35.276028 22946 ts_tablet_manager.cc:1403] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.170s	user 0.031s	sys 0.027s
I20260709 12:15:35.279433 22946 raft_consensus.cc:359] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:35.280351 22946 raft_consensus.cc:385] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.282163 22946 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.283272 22946 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:35.290824 22946 ts_tablet_manager.cc:1434] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:15:35.294433 22823 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.301641 22575 catalog_manager.cc:5697] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.307672 22946 tablet_bootstrap.cc:492] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
W20260709 12:15:35.311546 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 49749.5us
W20260709 12:15:35.333063 22642 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:35.342638 22674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:35.346127 22947 tablet_bootstrap.cc:492] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: No bootstrap required, opened a new log
I20260709 12:15:35.346975 22947 ts_tablet_manager.cc:1403] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Time spent bootstrapping tablet: real 0.349s	user 0.015s	sys 0.004s
I20260709 12:15:35.353989 22950 tablet_bootstrap.cc:654] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.306175 23046 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:35.353888 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:35.372916 22674 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:35.385290 23251 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:35.403303 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 55330.5us
I20260709 12:15:35.397508 23251 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:35.407608 22642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 70245.9us
W20260709 12:15:35.430482 22717 leader_election.cc:343] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.429494 23232 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:15:35.458983 23046 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:35.449075 23270 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:35.466588 22946 tablet_bootstrap.cc:654] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.513801 23251 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:35.517503 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 78402.4us
I20260709 12:15:35.537114 22950 tablet_bootstrap.cc:492] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:35.537907 22950 ts_tablet_manager.cc:1403] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.344s	user 0.012s	sys 0.011s
I20260709 12:15:35.541836 22950 raft_consensus.cc:359] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:35.545678 22950 raft_consensus.cc:385] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.546006 22950 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.464964 23270 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:35.554404 22948 tablet_bootstrap.cc:654] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.554250 23321 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:35.550999 22950 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:35.551033 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:35.554929 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:35.557252 22900 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.558492 22947 raft_consensus.cc:359] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:35.561524 22947 raft_consensus.cc:385] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.561872 22947 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.562590 22947 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:35.563622 22950 ts_tablet_manager.cc:1434] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.006s
I20260709 12:15:35.568105 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:35.576835 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:35.577430 22901 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:35.584100 22947 ts_tablet_manager.cc:1434] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Time spent starting tablet: real 0.237s	user 0.007s	sys 0.007s
I20260709 12:15:35.578537 23082 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.587790 23342 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.588235 23082 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.588714 23082 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.588528 23342 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:35.591246 23342 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:35.594012 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:35.594928 22750 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:35.580228 22824 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.615269 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:35.643801 22900 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
W20260709 12:15:35.651578 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 81812.5us
W20260709 12:15:35.664677 22717 leader_election.cc:343] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.651458 22641 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:35.644775 23082 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:35.673003 23082 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:35.674988 22950 tablet_bootstrap.cc:492] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:35.684556 23251 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.685130 23251 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.685493 23251 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.688630 22676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:35.690007 22641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55379.4us
I20260709 12:15:35.690451 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:35.691191 22900 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:35.703049 23270 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:35.731593 22950 tablet_bootstrap.cc:654] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.709576 22674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:35.715955 23333 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:15:35.741413 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:35.743709 23270 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:35.744132 22641 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:35.712905 23232 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.748464 23232 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:35.728601 22946 tablet_bootstrap.cc:492] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:35.707216 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:35.751509 22946 ts_tablet_manager.cc:1403] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.448s	user 0.009s	sys 0.018s
W20260709 12:15:35.751679 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 44638.1us
I20260709 12:15:35.752543 23336 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.753050 23336 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:35.753849 23336 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:35.719771 22948 tablet_bootstrap.cc:492] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:35.757037 22948 ts_tablet_manager.cc:1403] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.588s	user 0.020s	sys 0.007s
I20260709 12:15:35.760963 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:35.762390 23093 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.762928 23093 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:35.765067 23093 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:35.765873 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:35.766534 22752 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 0.
I20260709 12:15:35.767922 22864 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:35.768786 23093 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.769148 23093 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.769481 23093 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.772023 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:35.773933 22865 leader_election.cc:343] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.778669 23232 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:35.779248 23093 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:35.779743 22948 raft_consensus.cc:359] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:35.794874 22948 raft_consensus.cc:385] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.737257 23251 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:35.795178 22948 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.799535 22948 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:35.800818 22676 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:35.794210 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:35.807617 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:35.810773 22677 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.813159 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:35.805008 23232 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.815232 23232 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.818256 22948 ts_tablet_manager.cc:1434] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:15:35.823632 22897 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 1: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:35.815593 23232 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.830757 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:35.836159 22946 raft_consensus.cc:359] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:35.837059 22946 raft_consensus.cc:385] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.837344 22946 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.838027 22946 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:35.841667 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:35.842474 22752 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:35.854664 23352 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:15:35.865902 22948 tablet_bootstrap.cc:492] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:35.875509 22950 tablet_bootstrap.cc:492] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:35.875983 23093 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:35.876085 22950 ts_tablet_manager.cc:1403] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.201s	user 0.011s	sys 0.013s
I20260709 12:15:35.890421 22948 tablet_bootstrap.cc:654] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.891115 23329 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:35.892181 22950 raft_consensus.cc:359] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:35.893006 22950 raft_consensus.cc:385] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.893357 22950 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.894093 22950 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:35.896552 22950 ts_tablet_manager.cc:1434] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:35.884181 23251 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:35.888170 22717 leader_election.cc:343] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.901113 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:35.901855 22899 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.902567 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:35.909659 22899 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:35.916038 22642 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:35.916934 23333 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.917460 23333 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:35.918340 23333 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:35.880986 22677 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
W20260709 12:15:35.918916 22717 leader_election.cc:343] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.926101 22946 ts_tablet_manager.cc:1434] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.174s	user 0.006s	sys 0.000s
I20260709 12:15:35.930001 22950 tablet_bootstrap.cc:492] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:35.933341 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:35.930938 22822 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:35.976485 22865 leader_election.cc:343] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.979147 22946 tablet_bootstrap.cc:492] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:35.987604 22950 tablet_bootstrap.cc:654] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.989472 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:35.997098 22948 tablet_bootstrap.cc:492] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:35.997866 22948 ts_tablet_manager.cc:1403] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.132s	user 0.036s	sys 0.059s
I20260709 12:15:35.999447 22572 catalog_manager.cc:5697] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.001372 22948 raft_consensus.cc:359] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.002038 22948 raft_consensus.cc:385] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.002311 22948 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.002993 22948 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.003846 23093 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.004587 23093 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.012296 22948 ts_tablet_manager.cc:1434] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:15:36.012965 23288 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.013546 22948 tablet_bootstrap.cc:492] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:36.013684 23288 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.013684 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:36.016145 23288 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:36.016646 23344 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.017216 22752 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:36.017711 23344 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:36.017943 23329 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.023972 23232 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.025499 22750 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 1: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:15:36.018697 23344 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:36.029099 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:36.029340 22948 tablet_bootstrap.cc:654] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.029965 22677 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 0.
I20260709 12:15:36.031817 23288 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.032505 23288 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.034536 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:36.037510 23289 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.038020 23289 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.029497 23232 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:36.031421 22946 tablet_bootstrap.cc:654] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.038507 23289 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.039215 23346 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.039072 22675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:36.043812 22864 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:36.044832 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:36.041749 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:36.048254 22900 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:36.042979 23346 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:36.055838 23362 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.069721 23346 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:36.071419 23288 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:36.075954 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:36.080461 22675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:36.081174 22675 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
W20260709 12:15:36.082649 22864 leader_election.cc:343] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.086373 22948 tablet_bootstrap.cc:492] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:36.086973 22948 ts_tablet_manager.cc:1403] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.004s
W20260709 12:15:36.086431 22865 leader_election.cc:343] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.060897 23362 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:36.095142 22990 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.096441 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:36.096591 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:36.076889 23093 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:36.100880 22990 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.104599 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:36.107669 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:36.108381 22990 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:36.114260 22717 leader_election.cc:343] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.113422 23318 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.112534 23336 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.112720 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:36.120201 22865 leader_election.cc:343] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.115724 22675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:36.121106 23318 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.127658 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:36.130012 22900 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:36.130208 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:36.123855 23362 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:36.134805 22948 raft_consensus.cc:359] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:15:36.136790 22641 leader_election.cc:343] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.138360 22946 tablet_bootstrap.cc:492] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:36.139604 22946 ts_tablet_manager.cc:1403] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.161s	user 0.022s	sys 0.012s
I20260709 12:15:36.127761 23318 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.135644 22948 raft_consensus.cc:385] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.141131 22948 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.141906 22948 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.123131 22675 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 0.
I20260709 12:15:36.158213 22950 tablet_bootstrap.cc:492] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
W20260709 12:15:36.160820 22865 leader_election.cc:343] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.168632 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:36.170039 23365 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.167919 22948 ts_tablet_manager.cc:1434] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.081s	user 0.004s	sys 0.003s
I20260709 12:15:36.175340 22948 tablet_bootstrap.cc:492] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:36.170490 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:36.168780 22950 ts_tablet_manager.cc:1403] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.239s	user 0.033s	sys 0.023s
I20260709 12:15:36.177727 23365 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.178373 23365 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.178821 23365 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.183701 22950 raft_consensus.cc:359] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:36.184615 22950 raft_consensus.cc:385] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.184978 22950 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.167385 23289 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.187536 23318 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:36.191172 22642 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:36.193948 22946 raft_consensus.cc:359] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.188616 22950 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:36.194990 22946 raft_consensus.cc:385] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.195478 22946 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.195288 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:36.196864 22950 ts_tablet_manager.cc:1434] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:15:36.197435 23322 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:36.197587 22865 leader_election.cc:343] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.198374 23322 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.199084 23322 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.200022 23289 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:36.201953 22675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:36.198292 22950 tablet_bootstrap.cc:492] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:36.203086 22675 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.210491 22950 tablet_bootstrap.cc:654] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.212675 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:36.216084 22677 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.196648 22946 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.224117 22990 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.224856 22990 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.230556 22946 ts_tablet_manager.cc:1434] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.001s
I20260709 12:15:36.231356 23318 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:36.232234 22946 tablet_bootstrap.cc:492] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:36.241087 22820 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.233170 22990 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:36.243396 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:36.244483 22897 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:36.256356 22575 catalog_manager.cc:5697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 1 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:36.258471 22950 tablet_bootstrap.cc:492] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:36.259189 22950 ts_tablet_manager.cc:1403] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.001s
I20260709 12:15:36.259927 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:36.236589 23365 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.264097 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:15:36.271760 22864 leader_election.cc:343] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.274483 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:36.275890 23365 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:36.278721 23344 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:15:36.257144 22642 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:36.284929 22990 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.285370 22990 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.285733 22990 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.279160 22950 raft_consensus.cc:359] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:36.287458 22950 raft_consensus.cc:385] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.290011 22950 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.294838 22950 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:15:36.290531 22717 leader_election.cc:343] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.297741 22674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:36.290675 22677 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:36.296337 22990 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.209568 23322 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.301733 22674 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:36.302114 22990 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:15:36.297550 22642 leader_election.cc:343] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.302955 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:36.303778 23337 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.304328 23337 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:36.305259 23337 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:36.309051 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:36.309798 22900 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.310149 22675 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:36.311231 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:15:36.316776 22641 leader_election.cc:343] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.314073 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:36.233276 22948 tablet_bootstrap.cc:654] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.321882 22900 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:36.318938 23322 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:36.329089 22950 ts_tablet_manager.cc:1434] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 12:15:36.330484 22950 tablet_bootstrap.cc:492] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:36.341607 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:36.342387 23011 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.342633 23365 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.343343 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:36.344503 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:36.345492 23365 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.346050 23365 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:36.346168 22946 tablet_bootstrap.cc:654] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:36.349962 22642 leader_election.cc:343] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.344559 22899 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 1: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:36.356228 22642 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:36.357009 22990 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.356648 23365 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.357569 22990 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:36.358438 22990 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.345317 23337 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.363520 22950 tablet_bootstrap.cc:654] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.380187 22948 tablet_bootstrap.cc:492] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:36.380941 22948 ts_tablet_manager.cc:1403] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.206s	user 0.011s	sys 0.003s
I20260709 12:15:36.393497 22642 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:36.394865 22946 tablet_bootstrap.cc:492] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:36.394122 22948 raft_consensus.cc:359] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:36.395516 22946 ts_tablet_manager.cc:1403] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.000s
I20260709 12:15:36.395524 22948 raft_consensus.cc:385] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.396347 22948 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.438150 22990 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.441741 22946 raft_consensus.cc:359] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.442757 22946 raft_consensus.cc:385] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.443135 22946 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.443922 22946 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.448975 22948 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:36.458885 23322 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.459496 23322 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:36.464344 22948 ts_tablet_manager.cc:1434] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.003s
I20260709 12:15:36.464025 22573 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.465807 22948 tablet_bootstrap.cc:492] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:36.465934 22573 catalog_manager.cc:5697] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.472086 23322 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:36.472833 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:36.478704 23337 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.479324 23337 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:36.480887 22641 leader_election.cc:343] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.481359 23337 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:36.498608 23011 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.499334 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:36.499528 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:36.500365 22950 tablet_bootstrap.cc:492] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:36.500892 22950 ts_tablet_manager.cc:1403] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.171s	user 0.020s	sys 0.001s
I20260709 12:15:36.503619 22950 raft_consensus.cc:359] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.503644 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:36.504292 22950 raft_consensus.cc:385] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.505293 22950 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.505949 22950 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.506630 22946 ts_tablet_manager.cc:1434] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.110s	user 0.005s	sys 0.003s
I20260709 12:15:36.509090 22950 ts_tablet_manager.cc:1434] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:15:36.511363 23303 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.513772 22946 tablet_bootstrap.cc:492] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:36.513324 23303 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:36.513124 22576 catalog_manager.cc:5697] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:36.515074 22948 tablet_bootstrap.cc:654] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.515635 23303 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:36.516829 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:36.517355 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:36.518271 22677 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 1: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:15:36.519608 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:36.520584 22946 tablet_bootstrap.cc:654] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.520902 23303 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:36.526984 22642 leader_election.cc:343] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.527537 22642 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:36.532797 22572 catalog_manager.cc:5697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 1 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.535152 22950 tablet_bootstrap.cc:492] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:36.538462 23289 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.539445 23289 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.539918 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:36.540604 23303 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.540843 23318 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.541729 23011 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.543012 23289 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:36.545172 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:36.549190 22950 tablet_bootstrap.cc:654] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.554427 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:36.557314 22864 leader_election.cc:343] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.563287 23303 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:36.563678 22865 leader_election.cc:343] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.564188 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:36.563957 23303 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.567862 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:36.568631 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:36.569579 22677 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 1: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:36.570569 23303 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:36.570593 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:36.571307 23289 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.571130 23365 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.573341 23289 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:36.575641 23289 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:36.576241 23303 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.576257 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:36.578329 22865 leader_election.cc:343] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.579042 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:36.580708 22865 leader_election.cc:343] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.581149 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:36.581874 23365 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.582389 23365 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:36.584609 23365 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:36.585075 23365 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.586750 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:36.588119 22864 leader_election.cc:343] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.590284 23303 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.590099 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:36.594385 22865 leader_election.cc:343] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.595196 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:36.595118 22572 catalog_manager.cc:5697] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.596534 23289 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.615362 23289 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.616037 23289 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.618413 23289 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:36.619504 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:36.620277 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:36.621089 22864 leader_election.cc:343] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:36.630893 22865 leader_election.cc:343] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.631480 22865 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:15:36.662106 22623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:36.666030 23365 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.671438 22752 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.632572 23289 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.675036 23337 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.695259 23337 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.698144 23337 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:36.693615 23335 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:36.722114 22865 consensus_peers.cc:597] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:36.736804 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:36.738026 22677 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 1: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:36.741312 23318 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.755398 22948 tablet_bootstrap.cc:492] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:36.755416 23289 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.755993 22948 ts_tablet_manager.cc:1403] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.290s	user 0.018s	sys 0.028s
I20260709 12:15:36.756316 23289 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:36.758386 23289 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:36.759388 22948 raft_consensus.cc:359] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.760068 22948 raft_consensus.cc:385] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.760929 22948 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.762615 22948 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:36.763777 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:36.764593 22897 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 1: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:36.760068 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:36.766113 22864 leader_election.cc:343] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.765699 22948 ts_tablet_manager.cc:1434] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:15:36.767620 22948 tablet_bootstrap.cc:492] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:36.781877 22946 tablet_bootstrap.cc:492] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:36.782266 22950 tablet_bootstrap.cc:492] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:36.782435 22946 ts_tablet_manager.cc:1403] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.269s	user 0.050s	sys 0.052s
I20260709 12:15:36.782727 22950 ts_tablet_manager.cc:1403] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.248s	user 0.041s	sys 0.056s
I20260709 12:15:36.785811 22950 raft_consensus.cc:359] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:36.786713 22950 raft_consensus.cc:385] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.788882 22950 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.793370 22950 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:36.812721 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:36.821024 22950 ts_tablet_manager.cc:1434] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:15:36.817839 23335 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.828176 22946 raft_consensus.cc:359] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:36.833706 22946 raft_consensus.cc:385] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.834144 22946 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.822213 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:36.839344 23303 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.848820 23303 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:36.863385 22950 tablet_bootstrap.cc:492] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
W20260709 12:15:36.865710 22865 leader_election.cc:343] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.866449 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:36.871373 22946 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:36.898185 22946 ts_tablet_manager.cc:1434] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.115s	user 0.007s	sys 0.002s
I20260709 12:15:36.884514 23362 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.918044 23335 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.933281 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:36.937049 22946 tablet_bootstrap.cc:492] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
W20260709 12:15:36.947966 23388 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:15:36.926013 23303 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:36.956068 23387 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:15:36.983259 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:36.996693 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:36.997892 22948 tablet_bootstrap.cc:654] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:37.002588 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 58434.6us
I20260709 12:15:37.009418 23392 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.010056 23392 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:37.012764 23303 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.018143 22950 tablet_bootstrap.cc:654] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.024807 23392 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:37.046933 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:37.047868 22899 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:37.072239 22946 tablet_bootstrap.cc:654] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:37.129406 22642 consensus_peers.cc:597] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:37.108451 23398 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:37.138161 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 114789us
I20260709 12:15:37.140302 22990 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:37.144160 22950 tablet_bootstrap.cc:492] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:37.145592 22950 ts_tablet_manager.cc:1403] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.319s	user 0.009s	sys 0.017s
I20260709 12:15:37.140476 22642 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:37.149248 22990 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.149657 22990 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.149986 22990 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.139375 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:37.141965 23289 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:15:37.135949 23398 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:15:37.170718 22641 leader_election.cc:343] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.171959 23398 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:37.159567 22950 raft_consensus.cc:359] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.176133 22950 raft_consensus.cc:385] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.176534 22950 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.189797 22990 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:37.177417 22950 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.206327 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:15:37.208209 22641 leader_election.cc:343] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.209803 22950 ts_tablet_manager.cc:1434] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:15:37.212074 22826 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.218030 22990 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:37.222946 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:37.160894 22948 tablet_bootstrap.cc:492] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:37.224867 22899 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.226197 22948 ts_tablet_manager.cc:1403] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.459s	user 0.007s	sys 0.020s
I20260709 12:15:37.232201 22950 tablet_bootstrap.cc:492] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
W20260709 12:15:37.236766 22717 consensus_peers.cc:597] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:37.245481 22946 tablet_bootstrap.cc:492] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:37.246124 22946 ts_tablet_manager.cc:1403] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.317s	user 0.018s	sys 0.018s
I20260709 12:15:37.249321 22948 raft_consensus.cc:359] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.250059 22948 raft_consensus.cc:385] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.250304 22948 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.255826 22946 raft_consensus.cc:359] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:37.261571 23398 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:15:37.267670 22946 raft_consensus.cc:385] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.278667 22946 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.279554 22946 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:37.283864 22946 ts_tablet_manager.cc:1434] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:15:37.270960 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:37.287951 22897 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:37.272962 23303 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.261689 22899 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:37.277400 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:37.285960 22950 tablet_bootstrap.cc:654] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.288973 23303 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.258085 22948 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.295557 22990 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.296118 22990 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.296947 23303 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:37.299540 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:37.299646 22642 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:37.300647 23392 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.301194 23392 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:37.299902 22990 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:37.289844 22946 tablet_bootstrap.cc:492] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:37.302731 22677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:37.302083 23392 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:37.304953 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:37.306025 23303 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.297340 22948 ts_tablet_manager.cc:1434] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.001s
W20260709 12:15:37.308228 22717 leader_election.cc:343] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.310480 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:37.314044 22948 tablet_bootstrap.cc:492] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:37.317016 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:37.318110 23390 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.318548 23390 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.321888 23390 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.348330 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:37.349328 22899 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 0.
I20260709 12:15:37.360111 22950 tablet_bootstrap.cc:492] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:37.360801 22950 ts_tablet_manager.cc:1403] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.004s
I20260709 12:15:37.361460 22946 tablet_bootstrap.cc:654] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.363960 22950 raft_consensus.cc:359] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.364845 22950 raft_consensus.cc:385] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.365190 22950 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.366129 22950 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.369014 22950 ts_tablet_manager.cc:1434] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:37.370270 22950 tablet_bootstrap.cc:492] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:37.373099 23390 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:37.379549 22950 tablet_bootstrap.cc:654] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.393689 22826 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.397855 22948 tablet_bootstrap.cc:654] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.403034 22642 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:37.404040 23392 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.404413 23392 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.404767 23392 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.406872 23390 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:15:37.415278 22642 leader_election.cc:343] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.419485 23392 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.421298 22950 tablet_bootstrap.cc:492] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:37.426421 23392 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:37.431300 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:37.432101 22572 catalog_manager.cc:5697] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.433735 22950 ts_tablet_manager.cc:1403] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.006s
I20260709 12:15:37.437059 22950 raft_consensus.cc:359] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:15:37.441560 22717 leader_election.cc:343] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.432677 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:37.443092 22899 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.432618 22946 tablet_bootstrap.cc:492] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:37.448426 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:37.454094 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:37.455053 22897 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.468398 22897 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:37.448697 22946 ts_tablet_manager.cc:1403] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.159s	user 0.018s	sys 0.005s
I20260709 12:15:37.470197 22950 raft_consensus.cc:385] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.475132 22950 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.476073 22950 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:37.477375 22899 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:37.478658 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:37.471591 22642 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:37.474166 22946 raft_consensus.cc:359] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.479507 23398 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.479851 22946 raft_consensus.cc:385] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.480083 23398 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:37.480226 22946 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.481364 22946 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.481271 23398 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:37.484459 22946 ts_tablet_manager.cc:1434] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:15:37.485632 22946 tablet_bootstrap.cc:492] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:37.487423 22950 ts_tablet_manager.cc:1434] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 12:15:37.500458 22950 tablet_bootstrap.cc:492] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:37.503234 22990 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:15:37.504429 22642 leader_election.cc:343] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.504673 22990 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:37.505546 22990 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.507267 22948 tablet_bootstrap.cc:492] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:37.507879 22948 ts_tablet_manager.cc:1403] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.194s	user 0.005s	sys 0.008s
I20260709 12:15:37.540066 22819 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.544836 22948 raft_consensus.cc:359] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.545611 22948 raft_consensus.cc:385] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.545863 22948 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.542585 22946 tablet_bootstrap.cc:654] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.558478 23390 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.559203 23390 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:37.559885 22948 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.561443 23390 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:37.564728 22948 ts_tablet_manager.cc:1434] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.011s
I20260709 12:15:37.565900 22948 tablet_bootstrap.cc:492] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:37.569181 22576 catalog_manager.cc:5697] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.572078 22948 tablet_bootstrap.cc:654] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.578001 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:37.578826 22900 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:37.586699 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:37.587404 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:37.588557 22946 tablet_bootstrap.cc:492] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:37.588876 23398 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.589177 22946 ts_tablet_manager.cc:1403] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.001s
I20260709 12:15:37.589469 23398 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.589951 23398 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.592280 22946 raft_consensus.cc:359] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:37.593099 22946 raft_consensus.cc:385] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.593402 22946 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.594305 22946 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:37.596766 22946 ts_tablet_manager.cc:1434] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:37.599105 22950 tablet_bootstrap.cc:654] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.599249 22946 tablet_bootstrap.cc:492] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:37.604493 23398 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:37.606739 23398 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:37.601824 22948 tablet_bootstrap.cc:492] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:37.607565 22948 ts_tablet_manager.cc:1403] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.001s
I20260709 12:15:37.610601 22948 raft_consensus.cc:359] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.611352 22948 raft_consensus.cc:385] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.611644 22948 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.612376 22948 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.614833 22948 ts_tablet_manager.cc:1434] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:37.615926 22948 tablet_bootstrap.cc:492] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:37.618193 22946 tablet_bootstrap.cc:654] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.635357 23313 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.635965 23313 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.638389 23313 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:37.640501 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:37.641645 22573 catalog_manager.cc:5697] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:37.649370 23397 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.650036 23397 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.656458 23397 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:15:37.658413 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 55733.7us
W20260709 12:15:37.659258 22717 leader_election.cc:343] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.659504 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:37.665908 22641 leader_election.cc:343] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.674634 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:37.687685 22642 leader_election.cc:343] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.688859 22642 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:37.689914 23322 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.692828 23416 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.693461 23416 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:37.696818 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:37.697463 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:37.698282 22900 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 1: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:15:37.699803 23416 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:37.702519 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:37.703528 22900 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.707868 22790 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:37.709196 23416 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.724329 22674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:37.725178 22674 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:37.733902 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:37.737036 22946 tablet_bootstrap.cc:492] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:37.737720 22946 ts_tablet_manager.cc:1403] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.139s	user 0.019s	sys 0.019s
I20260709 12:15:37.741071 22750 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.743114 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:37.744161 23397 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.744676 23397 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.745074 23397 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.757979 22950 tablet_bootstrap.cc:492] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:37.758842 22950 ts_tablet_manager.cc:1403] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.259s	user 0.026s	sys 0.027s
I20260709 12:15:37.763542 22950 raft_consensus.cc:359] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.767002 22950 raft_consensus.cc:385] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.769279 23416 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.788770 23322 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:15:37.786463 22900 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:37.805900 22950 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.741101 22946 raft_consensus.cc:359] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:37.807336 22946 raft_consensus.cc:385] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.807014 22950 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.809088 22946 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.810525 22950 ts_tablet_manager.cc:1434] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.004s
I20260709 12:15:37.811699 22946 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:37.812605 22950 tablet_bootstrap.cc:492] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:37.819340 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:37.823288 22950 tablet_bootstrap.cc:654] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.823593 23344 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.825640 23344 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:37.826653 23344 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:37.795886 23397 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.833804 23397 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:15:37.834756 22717 leader_election.cc:343] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.820896 22948 tablet_bootstrap.cc:654] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.836386 22950 tablet_bootstrap.cc:492] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:37.838312 22946 ts_tablet_manager.cc:1434] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.100s	user 0.009s	sys 0.000s
I20260709 12:15:37.838617 22950 ts_tablet_manager.cc:1403] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.006s
I20260709 12:15:37.840624 22946 tablet_bootstrap.cc:492] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e: Bootstrap starting.
I20260709 12:15:37.842721 22950 raft_consensus.cc:359] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.843636 22950 raft_consensus.cc:385] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.845053 22950 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.848809 22950 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.852594 22950 ts_tablet_manager.cc:1434] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:15:37.853802 22950 tablet_bootstrap.cc:492] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:37.855448 23313 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:37.861675 22948 tablet_bootstrap.cc:492] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: No bootstrap required, opened a new log
I20260709 12:15:37.862499 22948 ts_tablet_manager.cc:1403] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.247s	user 0.013s	sys 0.000s
I20260709 12:15:37.865553 22948 raft_consensus.cc:359] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:37.838954 22717 leader_election.cc:343] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.879892 22948 raft_consensus.cc:385] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.880216 22948 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.880961 22948 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:37.883296 22948 ts_tablet_manager.cc:1434] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:15:37.870517 22950 tablet_bootstrap.cc:654] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.874660 22573 catalog_manager.cc:5697] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.906893 22946 tablet_bootstrap.cc:654] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.912782 22950 tablet_bootstrap.cc:492] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:37.913846 22950 ts_tablet_manager.cc:1403] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.007s
I20260709 12:15:37.917017 22950 raft_consensus.cc:359] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:37.925087 22950 raft_consensus.cc:385] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.929167 22950 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.929248 22674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:37.930248 22674 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.938365 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:37.938740 23289 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.939292 22819 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.939433 23289 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:37.941785 23289 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:37.947428 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:37.947933 22623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:15:37.950523 22865 leader_election.cc:343] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.958112 22675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:37.959136 22675 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 0.
I20260709 12:15:37.962500 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:37.964116 23289 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.964713 23289 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.965200 23289 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.966441 23397 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:37.976051 22950 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:37.978578 22950 ts_tablet_manager.cc:1434] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.000s
I20260709 12:15:37.982479 22946 tablet_bootstrap.cc:492] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e: No bootstrap required, opened a new log
I20260709 12:15:37.983165 22946 ts_tablet_manager.cc:1403] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e: Time spent bootstrapping tablet: real 0.143s	user 0.007s	sys 0.009s
I20260709 12:15:37.984117 22819 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:37.985303 22950 tablet_bootstrap.cc:492] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:37.994652 22946 raft_consensus.cc:359] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.995417 22946 raft_consensus.cc:385] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.995697 22946 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.996484 22946 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:37.996732 23403 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.001776 22674 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:38.011147 22946 ts_tablet_manager.cc:1434] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:15:38.018882 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:38.020078 23344 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.020694 23344 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:38.021589 23344 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:38.023419 22950 tablet_bootstrap.cc:654] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.045306 22950 tablet_bootstrap.cc:492] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:38.045809 22950 ts_tablet_manager.cc:1403] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.002s
I20260709 12:15:38.054577 23390 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.055203 23390 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:38.056706 22820 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.057327 23390 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:38.062330 22950 raft_consensus.cc:359] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:38.063879 22950 raft_consensus.cc:385] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.064222 22950 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.065951 23402 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.068591 23322 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.069638 23289 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:38.072959 23289 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:38.074004 22674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:38.068547 22950 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:38.074728 22674 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.077064 22950 ts_tablet_manager.cc:1434] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:15:38.078064 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:38.079269 22865 leader_election.cc:343] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.085004 22674 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:38.085690 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:38.086632 22675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:38.086854 22897 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:38.087719 22675 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 0.
I20260709 12:15:38.088616 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:38.090839 23362 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.091435 23362 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:38.092515 23362 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:38.104554 22950 tablet_bootstrap.cc:492] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Bootstrap starting.
I20260709 12:15:38.127004 22574 catalog_manager.cc:5697] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.153908 22950 tablet_bootstrap.cc:654] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.154506 22573 catalog_manager.cc:5697] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 1 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.177273 22950 tablet_bootstrap.cc:492] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: No bootstrap required, opened a new log
I20260709 12:15:38.177798 22950 ts_tablet_manager.cc:1403] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.013s
I20260709 12:15:38.179848 22950 raft_consensus.cc:359] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:38.180444 22950 raft_consensus.cc:385] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.180688 22950 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.181277 22950 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:38.182718 22950 ts_tablet_manager.cc:1434] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:15:38.189524 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:38.190306 23402 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:38.190670 23402 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.191027 23402 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.206583 23402 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:38.211158 23402 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:38.226720 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:38.227429 22675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:38.228672 22675 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.227664 22899 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.242921 22899 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:38.243752 23344 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.244648 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:38.245690 23402 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.246237 23402 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:38.247151 23402 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:38.263767 22675 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:38.275393 22819 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.278685 22573 catalog_manager.cc:5697] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 0 to 1, leader changed from <none> to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 1 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:38.295310 23344 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.328855 23416 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.329465 23416 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:38.332538 23416 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:38.332798 22675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:38.333597 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:38.333738 22675 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 0.
I20260709 12:15:38.334425 22750 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 0.
I20260709 12:15:38.335386 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:38.336905 23416 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:38.337492 23416 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.337859 23416 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.347558 23416 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:38.349859 23416 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:38.350571 22675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:15:38.351354 22675 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.351414 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:38.352105 22750 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.364943 22675 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:38.366645 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:38.366896 22750 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:38.367786 23416 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.368487 23416 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 1 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:38.371737 23416 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:38.383769 22573 catalog_manager.cc:5697] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 0 to 1, leader changed from <none> to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 1 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:38.393147 22990 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.393837 22990 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:38.396059 22990 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:38.397913 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:38.398725 22752 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:38.399628 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:38.400969 22897 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:38.400153 22641 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:38.402941 23322 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:38.403362 23322 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.405821 23322 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.425486 23322 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:38.427789 23322 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:38.429572 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:38.430364 22752 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.437297 22752 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:15:38.439577 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:38.440338 22900 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.440963 23416 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.441573 23416 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:38.445237 23416 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:38.445676 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:38.448122 22674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:38.449307 22674 raft_consensus.cc:2393] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 1: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:38.450845 22900 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:15:38.451722 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:38.453008 22641 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:38.457602 23313 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:38.458287 23313 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:15:38.459328 23313 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:38.457970 23344 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.455129 23416 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.481395 23397 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.507546 23416 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.517485 23289 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.619838 23387 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.623920 22574 catalog_manager.cc:5697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 0 to 2, leader changed from <none> to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.676680 23398 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.714737 23398 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.829210 23416 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.854247 23466 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.930630 22900 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:38.932076 23404 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.942673 22750 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:38.945776 23313 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:40.246917 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 86890us
I20260709 12:15:40.525462 18407 tablet_server.cc:179] TabletServer@127.17.249.193:0 shutting down...
W20260709 12:15:40.533902 22717 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:40.554534 22717 consensus_peers.cc:597] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:40.558061 22717 consensus_peers.cc:597] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.611013 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:40.612339 18407 tablet_replica.cc:333] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.614512 18407 raft_consensus.cc:2243] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.615262 18407 raft_consensus.cc:2272] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.619464 18407 tablet_replica.cc:333] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.620316 18407 raft_consensus.cc:2243] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.621456 18407 raft_consensus.cc:2272] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.623983 18407 tablet_replica.cc:333] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.624773 18407 raft_consensus.cc:2243] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.625710 18407 raft_consensus.cc:2272] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.628435 18407 tablet_replica.cc:333] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.629428 18407 raft_consensus.cc:2243] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.630015 18407 raft_consensus.cc:2272] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.632269 18407 tablet_replica.cc:333] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.632944 18407 raft_consensus.cc:2243] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.633765 18407 raft_consensus.cc:2272] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.635862 18407 tablet_replica.cc:333] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.636510 18407 raft_consensus.cc:2243] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.636977 18407 raft_consensus.cc:2272] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.638924 18407 tablet_replica.cc:333] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.639535 18407 raft_consensus.cc:2243] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.640355 18407 raft_consensus.cc:2272] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.642431 18407 tablet_replica.cc:333] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.643281 18407 raft_consensus.cc:2243] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.643767 18407 raft_consensus.cc:2272] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.646046 18407 tablet_replica.cc:333] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.646909 18407 raft_consensus.cc:2243] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.647418 18407 raft_consensus.cc:2272] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.649351 18407 tablet_replica.cc:333] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.650133 18407 raft_consensus.cc:2243] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.650655 18407 raft_consensus.cc:2272] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.652833 18407 tablet_replica.cc:333] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.653479 18407 raft_consensus.cc:2243] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.654193 18407 raft_consensus.cc:2272] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.656428 18407 tablet_replica.cc:333] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.657274 18407 raft_consensus.cc:2243] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.658353 18407 raft_consensus.cc:2272] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.661801 18407 tablet_replica.cc:333] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.662952 18407 raft_consensus.cc:2243] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.663595 18407 raft_consensus.cc:2272] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.666105 18407 tablet_replica.cc:333] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.666749 18407 raft_consensus.cc:2243] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.667685 18407 raft_consensus.cc:2272] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.670430 18407 tablet_replica.cc:333] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.671413 18407 raft_consensus.cc:2243] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.672531 18407 raft_consensus.cc:2272] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.675221 18407 tablet_replica.cc:333] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.676138 18407 raft_consensus.cc:2243] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.677253 18407 raft_consensus.cc:2272] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.680269 18407 tablet_replica.cc:333] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.681267 18407 raft_consensus.cc:2243] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.686326 18407 raft_consensus.cc:2272] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:40.688494 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:40.690567 22717 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.691690 18407 tablet_replica.cc:333] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.692873 18407 raft_consensus.cc:2243] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.693534 18407 raft_consensus.cc:2272] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.697072 18407 tablet_replica.cc:333] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
W20260709 12:15:40.698212 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.698589 18407 raft_consensus.cc:2243] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.699944 18407 raft_consensus.cc:2272] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.705170 18407 tablet_replica.cc:333] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.706257 18407 raft_consensus.cc:2243] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.707715 18407 raft_consensus.cc:2272] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.711176 18407 tablet_replica.cc:333] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.712148 18407 raft_consensus.cc:2243] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.713465 18407 raft_consensus.cc:2272] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.717011 18407 tablet_replica.cc:333] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.718307 18407 raft_consensus.cc:2243] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.719882 18407 raft_consensus.cc:2272] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:40.722242 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 49836.9us
I20260709 12:15:40.723498 18407 tablet_replica.cc:333] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.724648 18407 raft_consensus.cc:2243] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.725912 18407 raft_consensus.cc:2272] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:40.727054 22791 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.731328 18407 tablet_replica.cc:333] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.732474 18407 raft_consensus.cc:2243] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.733086 18407 raft_consensus.cc:2272] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.737232 18407 tablet_replica.cc:333] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
W20260709 12:15:40.738905 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.739583 18407 raft_consensus.cc:2243] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.740712 18407 raft_consensus.cc:2272] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:40.741109 22717 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.743654 18407 tablet_replica.cc:333] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.744541 18407 raft_consensus.cc:2243] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.745501 18407 raft_consensus.cc:2272] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.748121 18407 tablet_replica.cc:333] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.748888 18407 raft_consensus.cc:2243] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.749913 18407 raft_consensus.cc:2272] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.752763 18407 tablet_replica.cc:333] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
W20260709 12:15:40.753450 22865 consensus_peers.cc:597] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.753495 18407 raft_consensus.cc:2243] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.755541 18407 raft_consensus.cc:2272] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.758402 18407 tablet_replica.cc:333] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.759164 18407 raft_consensus.cc:2243] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.759735 18407 raft_consensus.cc:2272] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.762691 18407 tablet_replica.cc:333] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.763423 18407 raft_consensus.cc:2243] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.763942 18407 raft_consensus.cc:2272] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.766634 18407 tablet_replica.cc:333] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.767386 18407 raft_consensus.cc:2243] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.767900 18407 raft_consensus.cc:2272] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.771798 18407 tablet_replica.cc:333] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.772656 18407 raft_consensus.cc:2243] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.773631 18407 raft_consensus.cc:2272] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.776031 18407 tablet_replica.cc:333] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.776755 18407 raft_consensus.cc:2243] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.777308 18407 raft_consensus.cc:2272] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.779794 18407 tablet_replica.cc:333] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.780542 18407 raft_consensus.cc:2243] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.781114 18407 raft_consensus.cc:2272] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:40.781450 22717 consensus_peers.cc:597] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.783838 18407 tablet_replica.cc:333] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.784631 18407 raft_consensus.cc:2243] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.785663 18407 raft_consensus.cc:2272] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:40.786015 22717 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.787860 18407 tablet_replica.cc:333] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.788535 18407 raft_consensus.cc:2243] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.789441 18407 raft_consensus.cc:2272] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.791965 18407 tablet_replica.cc:333] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.792768 18407 raft_consensus.cc:2243] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.793224 18407 raft_consensus.cc:2272] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:40.795153 22717 consensus_peers.cc:597] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.795743 18407 tablet_replica.cc:333] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.796295 18407 raft_consensus.cc:2243] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.797151 18407 raft_consensus.cc:2272] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.799320 18407 tablet_replica.cc:333] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.799875 18407 raft_consensus.cc:2243] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.800727 18407 raft_consensus.cc:2272] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.802928 18407 tablet_replica.cc:333] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.803503 18407 raft_consensus.cc:2243] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.803939 18407 raft_consensus.cc:2272] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.805750 18407 tablet_replica.cc:333] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.806272 18407 raft_consensus.cc:2243] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.807124 18407 raft_consensus.cc:2272] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.809056 18407 tablet_replica.cc:333] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.809574 18407 raft_consensus.cc:2243] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.809983 18407 raft_consensus.cc:2272] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.812060 18407 tablet_replica.cc:333] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.812582 18407 raft_consensus.cc:2243] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.813467 18407 raft_consensus.cc:2272] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.815693 18407 tablet_replica.cc:333] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.816336 18407 raft_consensus.cc:2243] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.816855 18407 raft_consensus.cc:2272] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.819460 18407 tablet_replica.cc:333] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: stopping tablet replica
I20260709 12:15:40.826188 18407 raft_consensus.cc:2243] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.827327 18407 raft_consensus.cc:2272] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:40.827693 22717 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:40.885874 22717 consensus_peers.cc:597] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:40.889842 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.915668 18407 tablet_server.cc:196] TabletServer@127.17.249.193:0 shutdown complete.
W20260709 12:15:40.923569 22791 consensus_peers.cc:597] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:40.973665 22717 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:40.991236 22717 consensus_peers.cc:597] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:41.029492 22717 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:41.040401 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:41.054525 23482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:41.054534 23483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:41.056082 23485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:41.057283 18407 server_base.cc:1061] running on GCE node
I20260709 12:15:41.062517 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:41.062889 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:41.063125 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599341063104 us; error 0 us; skew 500 ppm
I20260709 12:15:41.063769 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:41.068146 18407 webserver.cc:533] Webserver started at http://127.17.249.193:40455/ using document root <none> and password file <none>
I20260709 12:15:41.068845 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:41.069090 18407 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:15:41.074049 18407 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.001s
W20260709 12:15:41.092497 22717 consensus_peers.cc:597] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:41.115604 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:41.139106 23491 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:41.140333 18407 fs_manager.cc:730] Time spent opening block manager: real 0.054s	user 0.010s	sys 0.044s
I20260709 12:15:41.140868 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-0-root
uuid: "a89a4b420ea9496aab55475fc38bb6f7"
format_stamp: "Formatted at 2026-07-09 12:15:25 on dist-test-slave-7mcn"
I20260709 12:15:41.141485 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:41.218278 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:41.220309 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:41.239332 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:41.266762 23502 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:15:41.574575 23499 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.575387 23499 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.579399 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:41.582593 23499 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:15:41.589610 22791 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.590896 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:41.591663 23499 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.623924 23490 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.624635 23490 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:41.627152 23490 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:41.630293 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:41.639835 23472 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.640515 23472 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:41.642688 23472 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.648639 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:15:41.650480 22865 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:41.649060 22717 leader_election.cc:336] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.651736 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:41.653488 23490 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.654233 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:41.655292 23471 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.679397 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:15:41.679914 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.418s	user 0.010s	sys 0.005s
I20260709 12:15:41.680333 18407 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:15:41.689201 23502 tablet_bootstrap.cc:492] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:41.712270 23499 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.713001 23499 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.715667 23499 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.721848 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:41.726364 23490 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.727176 23490 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.730504 23502 tablet_bootstrap.cc:492] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:41.732081 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:41.739552 23502 tablet_bootstrap.cc:492] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:41.740338 23502 ts_tablet_manager.cc:1403] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.014s
W20260709 12:15:41.740831 22865 leader_election.cc:336] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.742136 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:15:41.733594 22791 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.744630 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:41.744868 23502 raft_consensus.cc:359] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.745719 23502 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.745797 23499 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.746547 23502 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.737110 23490 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.747907 23496 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.768703 23502 ts_tablet_manager.cc:1434] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 12:15:41.769763 23502 tablet_bootstrap.cc:492] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:41.776796 23397 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.777426 23397 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:41.779496 23397 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:41.779893 23499 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.780483 23499 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.782685 23499 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.783821 23472 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.784389 23472 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:41.786324 23472 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.788156 23397 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.787909 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:41.788774 23397 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:41.790652 23397 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:41.800462 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:41.804159 23490 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.804862 23490 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.805691 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:41.807216 23490 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.809419 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:41.812880 22827 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:41.820765 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:41.822105 23490 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.822705 23490 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.823266 23490 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.825297 23496 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.826123 23496 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.830241 23496 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.832706 23496 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.833570 23496 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.840453 23499 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.850950 23499 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:41.852983 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:41.853179 23499 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:41.840147 23506 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:15:41.804380 22791 leader_election.cc:336] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.847592 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:41.849982 22865 leader_election.cc:336] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.854058 23506 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.862932 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:15:41.864394 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 60042.1us
I20260709 12:15:41.865563 23499 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.866536 23496 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.867624 23496 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.868331 23496 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.862638 23506 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:15:41.872804 22717 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.873198 23499 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.874011 23499 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:41.877414 23499 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:41.885732 23397 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.886340 23397 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:41.888168 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:41.890857 23496 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.891325 23471 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.891821 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:41.891630 23496 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.892694 23496 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.886989 23506 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.895016 23506 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.896358 23397 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.897105 23506 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.897658 23496 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.917999 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:41.928591 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:41.928750 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:41.928478 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:41.933346 22717 leader_election.cc:336] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.934513 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:41.935729 23397 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:41.935966 22717 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.936542 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:41.939337 23397 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.941915 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:41.942544 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:41.930251 23471 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.940014 23496 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.945461 23496 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:41.943333 22820 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:41.945367 23471 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:41.947893 23496 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:41.942687 22822 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:41.948997 23471 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:15:41.938063 22791 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:41.950724 22865 leader_election.cc:336] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.951294 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:41.952607 23496 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:41.956689 22865 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:41.957439 22865 leader_election.cc:336] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.957726 23502 tablet_bootstrap.cc:492] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:41.957950 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:41.959215 23496 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:41.960880 22865 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.961251 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:41.961705 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:41.962890 23490 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.963109 23496 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.965277 23490 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:15:41.966303 22865 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.966626 23502 tablet_bootstrap.cc:492] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:41.967330 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:41.968185 22750 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:15:41.968791 23499 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.969703 23502 ts_tablet_manager.cc:1403] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.200s	user 0.054s	sys 0.086s
W20260709 12:15:41.971463 22791 leader_election.cc:336] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.972036 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:41.973054 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:15:41.973553 22865 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:41.973943 23499 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.975193 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:41.976003 23502 raft_consensus.cc:359] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.977063 23502 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.978046 23502 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.980963 23502 ts_tablet_manager.cc:1434] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:15:41.982070 23502 tablet_bootstrap.cc:492] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:41.982839 23499 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.983477 23499 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:41.985674 23499 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:41.988833 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:41.989524 22899 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:41.990687 23499 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.991148 23508 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:41.991696 23508 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.991340 23499 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:41.992695 23496 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.993198 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:41.994110 23496 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.994298 23473 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.994758 23496 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.994509 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:41.994963 23473 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:41.995448 23496 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.996121 23507 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.996549 23507 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:41.996910 23507 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.997568 23473 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:41.992089 23508 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.001008 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:42.003661 23499 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.004295 23499 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.004987 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:42.005673 22822 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.005801 22865 leader_election.cc:336] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.008312 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:42.008944 22750 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:42.010031 22790 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:41.992189 23490 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:15:42.016239 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 80289.2us
I20260709 12:15:42.017169 22822 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:15:42.024811 23397 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.025449 23397 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.027796 23397 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.028683 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:42.020474 23496 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.005066 23499 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.033581 23499 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.034324 23496 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.035331 23496 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.035982 23496 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.020998 23490 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.041110 23490 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.043129 23508 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.044868 22899 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:42.046211 23508 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.043021 23496 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.021034 23506 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.062013 23506 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.063167 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:42.063926 22750 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:42.064348 23506 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.064927 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:42.065634 22752 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:42.046083 23507 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.068127 23507 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.068847 23471 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.069410 23471 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.071579 23471 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.073166 23502 tablet_bootstrap.cc:492] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:42.073429 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:42.074100 22752 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.074371 23502 tablet_bootstrap.cc:492] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:42.076160 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.077176 23496 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.077585 23490 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.078022 23496 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.080950 23496 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.081429 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.078044 23490 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.080824 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:42.082583 23490 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.082683 23507 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.083971 23507 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.084448 23507 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.075208 23502 ts_tablet_manager.cc:1403] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.093s	user 0.024s	sys 0.005s
I20260709 12:15:42.088276 23502 raft_consensus.cc:359] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.089028 23502 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.083346 22750 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:42.090031 23502 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.092859 23502 ts_tablet_manager.cc:1434] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:42.095520 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:42.096042 23502 tablet_bootstrap.cc:492] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:42.096273 22900 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:42.099429 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:15:42.100364 22865 leader_election.cc:336] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.103653 23496 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.106173 23496 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.106539 23496 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.107892 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 106983us
I20260709 12:15:42.110667 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.112556 23506 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.115480 23506 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:42.116418 23506 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.118677 23511 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.119407 23511 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.119876 23511 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.124071 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.129237 23397 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.129791 23397 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.130148 23397 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.118311 23507 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.134032 23509 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.134975 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:42.128873 23499 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:15:42.148473 22865 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.148456 22899 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 2: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:42.150620 23499 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.146605 23509 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.152529 23517 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.153059 23517 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.153559 23509 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:42.155138 23517 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.155575 23507 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.155650 23517 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.156203 23517 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.157377 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:42.158046 22750 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.158191 23499 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.158880 23499 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.160941 23499 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.161420 23499 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.162006 23499 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.158823 23496 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.167373 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:42.168253 22753 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.168695 23496 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.170465 23499 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.172188 23499 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.172763 23499 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.173712 23511 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.175904 23511 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.158038 23517 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:15:42.149425 22865 leader_election.cc:336] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.178767 22865 leader_election.cc:336] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.178699 23397 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:42.179895 22865 leader_election.cc:336] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.180385 22750 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:15:42.182330 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.183871 23490 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.183713 23496 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.185508 22752 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:15:42.186178 23490 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.185611 23508 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.193545 23508 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:42.197032 23510 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.197706 23510 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.199954 23510 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.196651 23508 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:42.187650 23496 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:15:42.180492 22865 leader_election.cc:336] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.191581 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.208498 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:42.207716 22865 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.208154 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:42.209085 22820 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.209800 22865 leader_election.cc:336] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.209854 22822 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.209081 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:42.210853 22827 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:42.215142 23397 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.215319 23508 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:42.216327 23507 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.216908 23507 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.218504 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:42.219165 23508 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:42.219429 22897 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 2: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:42.220230 23508 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.209450 22574 catalog_manager.cc:5697] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 2 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.222515 23507 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.223592 22820 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:15:42.205472 23496 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.224519 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:42.224818 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:42.226572 22750 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.226684 22827 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:42.225431 22822 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
W20260709 12:15:42.229342 22791 leader_election.cc:336] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.233420 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:42.234066 22897 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.234519 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:42.235481 22752 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:42.238345 23499 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.240705 22753 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:15:42.246174 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:42.247249 22752 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:42.247956 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.248304 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:42.249022 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.249145 22900 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:42.249953 23507 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.250345 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:42.250355 23507 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.251008 23506 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.247948 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:42.251680 23506 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:42.252206 22899 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:42.252888 23506 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.251132 22901 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:42.251461 23507 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.256675 22865 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.260883 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:42.261714 22752 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.263569 22750 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:15:42.264684 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:42.265008 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.265265 22822 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:42.268749 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.272501 22897 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
W20260709 12:15:42.276474 22717 leader_election.cc:336] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.277014 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.266301 23499 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.277841 23499 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.262370 23510 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.280224 23471 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:42.287164 22791 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.286758 23507 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:42.288136 22717 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.289178 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.284305 23490 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.279954 23499 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.311787 23490 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.312497 23490 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.282881 23518 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.313342 23518 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:15:42.313800 22717 leader_election.cc:336] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.314411 22717 leader_election.cc:336] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.314234 23510 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.311843 23521 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.315276 23521 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.312295 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:42.312525 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:42.285079 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.316669 22750 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:42.318076 22790 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.319008 23516 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.319450 23516 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.319806 23516 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.266607 23512 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.323922 23515 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.324275 23512 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.324605 23515 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.325902 23499 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.326349 23499 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.326725 23499 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.327054 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:42.328984 22751 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:42.331068 23521 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.331956 23512 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.332670 23512 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.333132 23512 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:42.334013 23512 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:42.334600 23518 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.332015 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:42.336035 23510 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.336232 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:42.336602 23510 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.336947 23510 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.337049 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:42.337333 23510 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.338070 23511 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.338177 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:42.338457 23511 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.338871 23511 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.339040 23518 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.339447 23518 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.288326 23496 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.339804 23518 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.339910 22752 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:42.343689 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.303246 18407 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:15:42.344514 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:42.345742 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:42.345968 22752 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:42.346396 22822 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
W20260709 12:15:42.348577 22791 leader_election.cc:336] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.349205 22791 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.349725 22791 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.350219 22791 leader_election.cc:336] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.350771 22791 leader_election.cc:336] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.345000 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.665s	user 0.344s	sys 0.006s
W20260709 12:15:42.351517 22791 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.352205 22791 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.353119 22791 leader_election.cc:336] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.354809 23473 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.282394 23520 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.356251 23473 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.356971 23520 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.359498 23520 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.298626 23506 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.360261 23515 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:42.360373 23506 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.360628 23490 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.358503 23473 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:42.360399 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.362131 22897 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:15:42.362835 23513 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.363314 23513 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.363866 23513 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.364593 23507 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.347832 23517 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.365586 23490 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.380760 23502 tablet_bootstrap.cc:492] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:42.383492 23502 tablet_bootstrap.cc:492] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:42.381250 23520 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.381594 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:42.383380 23499 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.384341 22897 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:42.362949 23506 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.385274 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.386606 23502 ts_tablet_manager.cc:1403] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.291s	user 0.018s	sys 0.012s
I20260709 12:15:42.385588 23520 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.390867 23471 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.391001 23520 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.397059 22717 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.412350 23499 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:42.413861 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 60049.2us
I20260709 12:15:42.407032 23502 raft_consensus.cc:359] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:42.417695 23502 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.418552 23511 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.421411 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:42.422338 22897 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:42.424345 23511 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.402622 23516 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.409899 23518 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.429114 23510 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.425783 23502 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:15:42.434186 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 165535us
W20260709 12:15:42.435431 22791 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.435566 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:15:42.436661 22791 leader_election.cc:336] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.438812 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.445122 23502 ts_tablet_manager.cc:1434] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.002s
I20260709 12:15:42.446233 23502 tablet_bootstrap.cc:492] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:42.445803 22865 leader_election.cc:336] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.448743 22865 leader_election.cc:336] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.450073 22865 leader_election.cc:336] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.450969 22865 leader_election.cc:336] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.453678 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.459053 23533 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.460618 23528 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.461362 23528 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.461855 23528 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.464094 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 120472us
I20260709 12:15:42.447219 23508 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.437980 23517 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:42.449805 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:42.452255 23518 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.455519 23496 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:42.506610 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:42.505190 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.507320 22899 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.508332 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51835.1us
I20260709 12:15:42.505897 22790 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.503765 23508 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:42.513088 23496 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.516302 23510 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.511163 23499 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.516975 23499 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.517392 23499 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.505690 22897 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:42.517153 23513 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.518620 23517 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.519847 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:42.520624 22897 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.513338 23508 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.523612 22790 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.510224 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:15:42.527163 22791 leader_election.cc:336] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.527614 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:15:42.527990 22791 leader_election.cc:336] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.528429 22901 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.528843 22791 leader_election.cc:336] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.529405 22791 leader_election.cc:336] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.531199 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:42.535720 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:42.541642 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:42.542806 23531 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.543401 23531 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.543787 23531 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.543869 23525 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:15:42.549551 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.551950 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:42.531114 23510 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.535318 23521 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.555950 23521 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.556412 23521 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.556514 22901 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:15:42.559096 23518 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.559597 23518 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.560009 23518 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.562944 23510 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:42.566947 22899 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:42.571777 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:42.572758 22752 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:15:42.573426 23510 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.576610 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:42.580608 23533 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.581630 23511 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.568825 23499 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.583246 23513 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:42.584128 22822 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 2: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:15:42.589515 22897 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:42.589737 22827 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
W20260709 12:15:42.596839 22791 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.599182 22791 leader_election.cc:336] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.568959 23523 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:15:42.608110 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:42.609275 22897 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.613415 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.613430 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:42.614861 22752 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.585937 23499 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.626245 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:15:42.628746 22717 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.607596 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:42.636986 22752 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:42.617664 23516 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:42.643453 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 326011us
I20260709 12:15:42.628046 23499 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.646329 22790 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.638130 22897 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:42.637902 23511 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.654907 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:42.655855 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:42.656574 22901 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.646344 22825 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:42.667199 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:42.667565 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:42.668334 22752 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.663899 23499 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:42.672053 23499 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.677479 22752 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:15:42.669095 23533 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:15:42.682219 22717 leader_election.cc:336] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.684290 22901 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:42.682715 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.688076 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:42.681425 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:15:42.691424 22865 leader_election.cc:336] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.692014 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:42.665844 23516 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.663177 23518 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:15:42.703872 22865 leader_election.cc:336] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.704934 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:42.677767 23520 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:15:42.707533 22865 leader_election.cc:336] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.709218 22865 leader_election.cc:336] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.693058 23471 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.693006 23533 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:42.719906 23516 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:42.728928 23518 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.729317 23516 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.731567 23531 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.733543 22819 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 2: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:15:42.733927 23531 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:42.711156 23509 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.734838 23509 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.735291 23509 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.736528 22791 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.737995 22791 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.720243 23517 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.726604 23533 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.744669 23521 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.706875 23512 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.711603 23527 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.708343 23508 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.747418 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.742861 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:42.746119 22820 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 2: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:15:42.752257 22901 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.748265 22865 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.757519 22752 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:42.746551 23512 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:42.760497 23512 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.764405 23527 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:42.765492 23527 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:42.768877 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.776866 22717 leader_election.cc:336] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:42.789494 22791 leader_election.cc:336] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.794391 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:42.795346 22752 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.797857 22901 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:42.801025 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:42.769681 23513 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.759231 23517 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:42.806366 22752 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:42.808833 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:42.809803 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:42.750078 23528 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:42.808714 23513 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:15:42.811875 23490 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.807485 23511 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:42.807371 23507 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:15:42.812875 23548 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.848305 22790 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:42.843920 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:42.845249 22572 catalog_manager.cc:5697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.865557 23517 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.867311 22821 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 2: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:15:42.840495 23521 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:42.840859 23513 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.877844 22752 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:42.864943 22819 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:42.915035 23502 tablet_bootstrap.cc:492] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:42.888096 23521 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.885421 23548 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:42.884882 23508 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:15:42.923877 23502 tablet_bootstrap.cc:492] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:42.926297 23502 ts_tablet_manager.cc:1403] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.480s	user 0.036s	sys 0.012s
I20260709 12:15:42.930863 23530 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:15:42.943404 23548 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.923659 23521 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:42.966099 23490 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.973752 23520 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:42.975243 22791 leader_election.cc:336] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:42.943427 23528 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:42.975339 23521 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:42.923166 23511 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:42.984839 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:43.007345 22752 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:42.996172 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:43.016017 22900 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
W20260709 12:15:43.023247 22791 leader_election.cc:336] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:43.023416 22865 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:43.033049 22865 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:43.033650 22865 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:43.034351 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.020889 22819 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.026640 23509 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:43.040634 23509 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:15:43.044763 22791 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:43.045742 22791 leader_election.cc:336] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:43.063148 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:43.068648 23490 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:15:43.072515 23513 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:43.073205 22819 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
W20260709 12:15:43.077081 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 237919us
I20260709 12:15:43.078323 23502 raft_consensus.cc:359] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:43.079074 23502 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.080238 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:43.080252 23502 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:43.083555 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:43.082579 22753 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:15:43.076169 23520 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:43.088511 23527 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:43.092811 23527 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:43.095577 23513 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:15:43.102336 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.089645 23534 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:43.094061 23527 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:43.143528 22900 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.101193 23520 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:43.151856 23502 ts_tablet_manager.cc:1434] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.225s	user 0.017s	sys 0.038s
I20260709 12:15:43.174657 23502 tablet_bootstrap.cc:492] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:43.188444 22865 consensus_peers.cc:597] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.191043 23534 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:43.189492 23520 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:43.192345 23534 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:43.192329 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:43.194124 23550 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:15:43.181186 23521 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:15:43.196581 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:43.211373 22717 leader_election.cc:336] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:15:43.214377 22717 leader_election.cc:336] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:43.215044 22572 catalog_manager.cc:5697] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 2 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.218107 22572 catalog_manager.cc:5697] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 2 to 3, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.221802 22572 catalog_manager.cc:5697] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 2 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.224534 22572 catalog_manager.cc:5697] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 2 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.226946 22572 catalog_manager.cc:5697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 2 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.221277 22819 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:43.233760 22791 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:43.234404 22791 consensus_peers.cc:597] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.229993 22572 catalog_manager.cc:5697] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 2 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.238142 22572 catalog_manager.cc:5697] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 2 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.228832 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:43.239954 22572 catalog_manager.cc:5697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 2 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:43.284124 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55377.8us
I20260709 12:15:43.283455 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:43.286077 23499 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.282194 22749 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:43.317682 23569 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:15:43.295266 23530 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:15:43.303642 23541 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:43.356532 23563 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.066s	user 0.003s	sys 0.002s
I20260709 12:15:43.305543 22818 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.305337 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:43.401814 22819 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 2: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:15:43.435417 22897 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.439555 22897 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.439491 22896 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.444222 22749 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.439502 23552 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.482872 23565 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.484946 23565 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:43.486865 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:43.490439 22826 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.501580 22751 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.503321 22753 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.505975 22749 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:43.519676 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 213446us
W20260709 12:15:43.529611 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 242048us
I20260709 12:15:43.535037 23581 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:15:43.559370 23516 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:15:43.560882 23521 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.561518 23565 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:43.559653 23533 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:15:43.561556 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:15:43.572877 22791 consensus_peers.cc:597] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:43.575452 23520 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.578105 23535 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.583144 23533 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.611527 23565 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.612761 23565 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:43.616166 22818 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.588392 22574 catalog_manager.cc:5697] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.638360 23565 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:43.651566 23533 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.663393 22574 catalog_manager.cc:5697] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.671408 23553 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.666257 22574 catalog_manager.cc:5697] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.726533 22826 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
W20260709 12:15:43.731895 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 71051.2us
I20260709 12:15:43.728971 22574 catalog_manager.cc:5697] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.766954 23502 tablet_bootstrap.cc:492] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:43.767982 23565 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.769105 23565 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:43.768914 23502 tablet_bootstrap.cc:492] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:43.774108 23565 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:43.782476 23502 ts_tablet_manager.cc:1403] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.608s	user 0.029s	sys 0.017s
I20260709 12:15:43.792219 23511 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:43.793165 23511 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:43.803565 23581 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.779414 22574 catalog_manager.cc:5697] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:43.821954 22791 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.812847 23502 raft_consensus.cc:359] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:43.826774 23511 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:43.822670 23502 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
W20260709 12:15:43.841409 22791 consensus_peers.cc:597] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.862939 22901 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:43.873912 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 50535us
I20260709 12:15:43.892802 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:43.893818 22899 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 2: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:15:43.893460 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:43.820762 22574 catalog_manager.cc:5697] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.896332 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:43.899479 23502 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:43.897324 22574 catalog_manager.cc:5697] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.907054 22574 catalog_manager.cc:5697] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.929068 23502 ts_tablet_manager.cc:1434] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.146s	user 0.010s	sys 0.003s
W20260709 12:15:43.915580 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44336.1us
I20260709 12:15:43.936717 23502 tablet_bootstrap.cc:492] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:43.943356 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:43.951232 23603 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:15:43.961714 22865 consensus_peers.cc:597] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:43.973299 22865 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:43.975131 22865 consensus_peers.cc:597] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:43.983414 22823 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:44.011868 22865 consensus_peers.cc:597] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:44.036054 23520 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.036836 23530 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.037458 23520 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:44.038102 23530 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:44.040782 23565 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.041625 23565 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:44.041541 23520 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:44.042495 23530 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:44.043396 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.052826 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:44.056172 23565 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:44.058588 23553 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.059495 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.061097 23520 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.062214 23520 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:44.059690 23553 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:44.059069 23530 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.071238 23506 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.082275 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:44.083123 22826 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:44.085070 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.078924 23553 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:44.082916 23530 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:44.101647 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.065025 23520 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:44.161260 23576 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 12:15:44.094964 23506 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:44.193812 23496 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.194614 23496 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:44.209829 23496 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:44.199848 23511 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:15:44.192577 23581 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.217571 23530 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:44.217324 23581 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:44.228813 23581 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:44.232753 23506 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:15:44.236430 22717 consensus_peers.cc:597] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:44.252146 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 53022us
W20260709 12:15:44.249063 22717 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:44.254537 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:15:44.257521 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 67357.8us
W20260709 12:15:44.262095 22791 consensus_peers.cc:597] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:44.263648 22791 consensus_peers.cc:597] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:44.269623 23397 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:15:44.269968 22717 leader_election.cc:336] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:44.267993 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:44.281584 22573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43984 (request call id 116) took 1064 ms. Trace:
I20260709 12:15:44.282100 22573 rpcz_store.cc:276] 0709 12:15:43.226127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:43.234363 (+  8236us) service_pool.cc:224] Handling call
0709 12:15:44.281351 (+1046988us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42228,"reported_tablets":1}
I20260709 12:15:44.282522 23581 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.283481 23581 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:44.292120 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.292906 23581 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:44.293843 23627 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:44.294446 23627 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.295010 23627 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:44.299206 22717 consensus_peers.cc:597] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:44.285426 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:44.288741 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.306980 23511 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.307845 23511 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:44.310130 23511 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:44.314751 22865 leader_election.cc:336] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:44.315600 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:44.317415 23626 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.320202 23502 tablet_bootstrap.cc:492] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:44.329355 23502 tablet_bootstrap.cc:492] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:44.329468 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.330225 23502 ts_tablet_manager.cc:1403] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.394s	user 0.028s	sys 0.018s
I20260709 12:15:44.332568 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:44.333084 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.334300 23626 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.334991 23626 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:44.334934 23502 raft_consensus.cc:359] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:44.336838 23502 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.347435 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.344826 23502 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:44.350612 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:44.352484 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:44.352684 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:44.354115 23536 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:44.354475 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:44.354730 23536 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:44.356163 23536 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:44.357606 23626 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:44.349362 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.363828 23502 ts_tablet_manager.cc:1434] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:15:44.370411 23502 tablet_bootstrap.cc:492] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:44.364353 23511 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.377581 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:44.378759 23581 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.379034 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:44.382428 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:44.379905 23530 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.374676 22750 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:44.383718 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:44.395648 23528 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.389070 23511 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:44.409065 23530 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.411818 23521 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.412971 23521 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:44.419428 23627 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:44.426522 22896 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:44.447794 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 44089.4us
I20260709 12:15:44.426839 23511 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:15:44.456760 22865 leader_election.cc:336] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:44.457559 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:44.424559 23627 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:44.459553 23553 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.443156 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:15:44.484779 23630 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.089s	user 0.004s	sys 0.000s
W20260709 12:15:44.487555 22865 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:44.470101 23521 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:44.504328 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.507170 22572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 104) took 1416 ms. Trace:
W20260709 12:15:44.534750 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 183582us
I20260709 12:15:44.539796 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:44.541318 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:44.542214 23627 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:44.542750 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.542316 23533 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.546396 22901 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:44.557750 23533 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.547042 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:44.571559 22900 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:44.514190 22572 rpcz_store.cc:276] 0709 12:15:43.094900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:43.098503 (+  3603us) service_pool.cc:224] Handling call
0709 12:15:44.506928 (+1408425us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:43.572259 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:43.572990 (+   731us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:43.573056 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:15:43.573091 (+    35us) tablet.cc:662] Decoding operations
0709 12:15:43.646623 (+ 73532us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:43.646745 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:43.646811 (+    66us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:15:43.648021 (+  1210us) tablet.cc:701] Row locks acquired
0709 12:15:43.648128 (+   107us) write_op.cc:260] PREPARE: finished
0709 12:15:43.648382 (+   254us) write_op.cc:270] Start()
0709 12:15:43.648615 (+   233us) write_op.cc:276] Timestamp: P: 1783599343648283 usec, L: 0
0709 12:15:43.648663 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 12:15:43.649850 (+  1187us) log.cc:844] Serialized 3281 byte log entry
0709 12:15:43.770081 (+120231us) op_driver.cc:464] REPLICATION: finished
0709 12:15:44.116361 (+346280us) write_op.cc:301] APPLY: starting
0709 12:15:44.119041 (+  2680us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:44.166053 (+ 47012us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:44.166224 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:44.167796 (+  1572us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:44.168096 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:15:44.168196 (+   100us) write_op.cc:312] APPLY: finished
0709 12:15:44.168590 (+   394us) log.cc:844] Serialized 64 byte log entry
0709 12:15:44.168846 (+   256us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:44.168986 (+   140us) write_op.cc:454] Released schema lock
0709 12:15:44.169055 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:44.169567 (+   512us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:44.169596 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64608,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":325101,"apply.run_cpu_time_us":4138,"apply.run_wall_time_us":62097,"num_ops":8,"prepare.queue_time_us":94478,"prepare.run_cpu_time_us":7043,"prepare.run_wall_time_us":90554,"replication_time_us":121124,"thread_start_us":267415,"threads_started":2}]]}
I20260709 12:15:44.588397 23536 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:44.589370 23637 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:15:44.591339 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:44.593640 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:44.577467 23533 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.596679 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:44.576808 22574 catalog_manager.cc:5697] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 2 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.606925 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:15:44.609874 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:44.616647 22864 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:15:44.619488 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:44.631677 23627 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.657688 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:44.658491 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:44.659775 23521 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:44.664206 23616 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:44.666210 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:44.667157 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:44.668604 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:44.669469 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:44.683945 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:44.698007 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:44.668624 23565 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.725521 23502 tablet_bootstrap.cc:492] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:44.693205 23511 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.726729 23502 tablet_bootstrap.cc:492] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:44.730475 23502 ts_tablet_manager.cc:1403] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.360s	user 0.023s	sys 0.013s
I20260709 12:15:44.734952 23502 raft_consensus.cc:359] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:44.735858 23502 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.736792 23502 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:44.745754 23649 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:44.756021 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 113119us
I20260709 12:15:44.763728 23616 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:44.765363 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 95981.4us
I20260709 12:15:44.766491 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:44.768029 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:15:44.788614 22717 consensus_peers.cc:597] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:44.794538 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 68655us
I20260709 12:15:44.778163 23649 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:44.806059 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 108156us
I20260709 12:15:44.821928 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:44.818246 23626 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:44.868089 23654 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:44.935161 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 59518.7us
W20260709 12:15:44.949150 22791 consensus_peers.cc:597] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:44.950766 23649 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.982010 23502 ts_tablet_manager.cc:1434] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.251s	user 0.066s	sys 0.118s
I20260709 12:15:44.952966 23626 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:15:44.989266 23651 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:15:44.956835 23533 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:45.007059 23502 tablet_bootstrap.cc:492] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:45.008550 23650 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:15:45.016394 23626 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:45.014010 23533 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:45.040721 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 71557.4us
I20260709 12:15:45.052284 23663 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.053198 23663 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:45.075268 23520 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.080183 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:45.087229 23520 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:45.093959 23663 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:45.097901 23520 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:45.103072 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:45.108851 22749 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.107987 23565 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:45.090382 23658 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.121250 23658 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:45.125937 23658 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:15:45.126178 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.128463 22717 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.140787 22791 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:45.141525 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 186139us
W20260709 12:15:45.142174 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:45.169569 22791 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:45.170493 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:15:45.134662 22717 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.173651 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:45.174634 22747 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:45.176487 22749 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
W20260709 12:15:45.187731 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.192914 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:45.196678 22893 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:45.207784 23502 tablet_bootstrap.cc:492] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:45.209120 23502 tablet_bootstrap.cc:492] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:45.209951 23502 ts_tablet_manager.cc:1403] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.208s	user 0.025s	sys 0.000s
W20260709 12:15:45.228155 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58647.3us
I20260709 12:15:45.229995 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:45.238049 23552 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:45.244648 23616 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:45.244967 23562 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:45.246310 23562 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:45.246677 23562 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:15:45.250403 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:45.225030 22572 catalog_manager.cc:5697] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.257735 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:15:45.262764 22717 consensus_peers.cc:597] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.264225 23520 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:45.265393 23511 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.265654 23520 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.265940 23511 raft_consensus.cc:697] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:45.266062 23520 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.266927 23511 consensus_queue.cc:237] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:45.268332 23502 raft_consensus.cc:359] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:45.269420 23502 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.272166 23502 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:45.264077 22717 consensus_peers.cc:597] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.259548 22572 catalog_manager.cc:5697] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 2 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:15:45.282184 23502 ts_tablet_manager.cc:1434] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.072s	user 0.011s	sys 0.000s
W20260709 12:15:45.277827 22717 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.253575 23562 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:45.293501 23562 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.297024 22574 catalog_manager.cc:5697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 1 to 2, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 2 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:45.289717 22717 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.303992 22865 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.303478 22717 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.332876 23502 tablet_bootstrap.cc:492] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:45.332803 22820 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:45.346629 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:45.382493 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:45.378636 23662 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 12:15:45.427376 22717 consensus_peers.cc:597] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.428195 22717 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:45.455242 22717 consensus_peers.cc:597] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.455773 22717 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.463905 22791 leader_election.cc:336] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:45.466943 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:15:45.470028 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 65123.5us
W20260709 12:15:45.484828 22791 leader_election.cc:336] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:45.488143 23511 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:45.465273 23520 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:15:45.534734 22717 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111) [suppressed 296 similar messages]
W20260709 12:15:45.531219 22791 leader_election.cc:336] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:45.542484 23520 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:45.542002 22791 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:45.544699 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:45.563639 22748 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.591930 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:45.629465 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:45.621556 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:45.643205 23658 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:45.648295 23658 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.648851 23658 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:15:45.650223 22791 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:15:45.664959 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:45.670081 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:45.672273 23693 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:15:45.679868 23658 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:45.681617 23658 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:45.726009 22748 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:15:45.728271 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:15:45.731391 23654 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.732004 23654 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:15:45.733884 23654 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:15:45.746711 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:45.787560 22865 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.793079 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:45.795147 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:45.797106 23698 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:45.802846 23502 tablet_bootstrap.cc:492] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:45.807550 23502 tablet_bootstrap.cc:492] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:45.810261 23502 ts_tablet_manager.cc:1403] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.485s	user 0.019s	sys 0.009s
W20260709 12:15:45.817173 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.822469 22752 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:45.827116 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 67886.8us
I20260709 12:15:45.830106 23502 raft_consensus.cc:359] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:45.831550 23502 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.832526 23502 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:45.834986 23502 ts_tablet_manager.cc:1434] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:15:45.834687 23520 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:45.844971 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.851935 22791 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:45.869683 22574 catalog_manager.cc:5697] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 3, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 3 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:45.876757 22865 consensus_peers.cc:597] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.882368 23502 tablet_bootstrap.cc:492] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:45.884178 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.914633 22865 consensus_peers.cc:597] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:45.918727 23502 tablet_bootstrap.cc:492] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:45.919840 23502 tablet_bootstrap.cc:492] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:45.920542 23502 ts_tablet_manager.cc:1403] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.002s
I20260709 12:15:45.923465 23502 raft_consensus.cc:359] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:45.924218 23502 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.924933 23502 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:45.929510 23502 ts_tablet_manager.cc:1434] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:45.930877 23502 tablet_bootstrap.cc:492] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:45.971686 22865 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.001020 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:46.009235 22573 catalog_manager.cc:5697] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 3, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 3 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:46.069602 23502 tablet_bootstrap.cc:492] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:46.104005 23502 tablet_bootstrap.cc:492] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:46.104816 23502 ts_tablet_manager.cc:1403] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.174s	user 0.030s	sys 0.023s
W20260709 12:15:46.147581 22791 consensus_peers.cc:597] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:46.151435 22865 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:46.131361 23502 raft_consensus.cc:359] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:46.152509 23502 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.153513 23502 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:46.155831 23502 ts_tablet_manager.cc:1434] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.003s
I20260709 12:15:46.164572 23502 tablet_bootstrap.cc:492] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:46.221764 22748 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:46.227695 23683 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:46.305959 23698 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.307133 23698 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:46.312538 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:46.319991 23698 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:46.326085 23502 tablet_bootstrap.cc:492] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:46.327365 23502 tablet_bootstrap.cc:492] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:46.328181 23502 ts_tablet_manager.cc:1403] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.172s	user 0.018s	sys 0.013s
I20260709 12:15:46.331651 23502 raft_consensus.cc:359] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:46.332428 23502 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.338968 23502 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:46.342772 23502 ts_tablet_manager.cc:1434] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:15:46.343948 23502 tablet_bootstrap.cc:492] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:46.356026 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:46.359776 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:46.361511 23698 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:46.398660 23729 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.193:33285 every 8 connection(s)
I20260709 12:15:46.399706 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.193:33285
I20260709 12:15:46.397612 23502 tablet_bootstrap.cc:492] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:46.406383 23502 tablet_bootstrap.cc:492] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:46.411507 23502 ts_tablet_manager.cc:1403] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.005s
I20260709 12:15:46.415241 23502 raft_consensus.cc:359] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:46.443017 23689 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:46.477361 23685 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:46.443109 23502 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.484055 23502 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:46.486460 23502 ts_tablet_manager.cc:1434] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.000s
I20260709 12:15:46.487397 23502 tablet_bootstrap.cc:492] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:46.537091 23731 heartbeater.cc:344] Connected to a master server at 127.17.249.254:41671
I20260709 12:15:46.537936 23731 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:46.539805 23731 heartbeater.cc:507] Master 127.17.249.254:41671 requested a full tablet report, sending...
I20260709 12:15:46.541383 23552 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.542135 23552 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:46.545087 23552 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:46.545993 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:46.546940 22748 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:15:46.547284 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:46.548321 22864 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:46.549307 23552 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:46.549779 23552 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.550284 23552 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.577466 23689 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:46.578034 22717 consensus_peers.cc:597] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:46.593055 22573 ts_manager.cc:194] Re-registered known tserver with Master: a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:46.563306 23552 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:46.606812 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:46.607615 22748 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:46.607947 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:46.609368 23502 tablet_bootstrap.cc:492] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:46.610390 23502 tablet_bootstrap.cc:492] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:46.611037 23502 ts_tablet_manager.cc:1403] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.124s	user 0.025s	sys 0.002s
I20260709 12:15:46.613672 23502 raft_consensus.cc:359] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:46.615979 23502 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.616717 23502 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:15:46.618873 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45347.8us
I20260709 12:15:46.622453 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:46.625828 23695 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:46.627883 23552 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:46.631955 22748 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:15:46.633580 22864 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:46.634495 23741 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:46.635205 23741 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:15:46.636018 22791 consensus_peers.cc:597] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:46.636953 23741 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:46.637646 23502 ts_tablet_manager.cc:1434] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.001s
I20260709 12:15:46.652397 23502 tablet_bootstrap.cc:492] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:46.681783 23695 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:46.697631 22574 catalog_manager.cc:5697] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 3, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:46.714967 23502 tablet_bootstrap.cc:492] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:46.716391 23502 tablet_bootstrap.cc:492] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:46.717177 23502 ts_tablet_manager.cc:1403] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.007s
W20260709 12:15:46.728892 22791 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:46.728664 23502 raft_consensus.cc:359] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:46.733294 23502 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.734305 23502 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:46.736696 23502 ts_tablet_manager.cc:1434] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:15:46.737703 23502 tablet_bootstrap.cc:492] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:46.745651 22573 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57362
I20260709 12:15:46.757943 23731 heartbeater.cc:499] Master 127.17.249.254:41671 was elected leader, sending a full tablet report...
I20260709 12:15:46.761879 23502 tablet_bootstrap.cc:492] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:46.763145 23502 tablet_bootstrap.cc:492] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:46.763851 23502 ts_tablet_manager.cc:1403] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.006s
I20260709 12:15:46.766950 23502 raft_consensus.cc:359] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:46.767676 23502 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.768430 23502 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:46.774489 23502 ts_tablet_manager.cc:1434] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:15:46.775404 23502 tablet_bootstrap.cc:492] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:46.784626 22791 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:46.794610 23695 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:46.800465 23657 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:46.801257 23657 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:46.812044 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:46.813362 22748 raft_consensus.cc:2368] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3.
I20260709 12:15:46.824484 22790 leader_election.cc:400] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3.
I20260709 12:15:46.828614 23502 tablet_bootstrap.cc:492] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:46.834797 22790 leader_election.cc:403] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:46.835011 23502 tablet_bootstrap.cc:492] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:46.842284 23502 ts_tablet_manager.cc:1403] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.019s
I20260709 12:15:46.842208 23654 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.845678 23502 raft_consensus.cc:359] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:46.846503 23502 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.847389 23502 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:46.849969 23502 ts_tablet_manager.cc:1434] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:15:46.859884 23502 tablet_bootstrap.cc:492] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:46.946965 23502 tablet_bootstrap.cc:492] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:46.948097 23502 tablet_bootstrap.cc:492] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:46.948791 23502 ts_tablet_manager.cc:1403] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.098s	user 0.020s	sys 0.006s
I20260709 12:15:46.952639 23502 raft_consensus.cc:359] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:46.953349 23502 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.954128 23502 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:46.956775 23502 ts_tablet_manager.cc:1434] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:46.957721 23502 tablet_bootstrap.cc:492] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:46.906395 23657 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:46.995416 23502 tablet_bootstrap.cc:492] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:46.996517 23502 tablet_bootstrap.cc:492] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:46.997328 23502 ts_tablet_manager.cc:1403] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.003s
I20260709 12:15:47.000422 23502 raft_consensus.cc:359] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:47.001180 23502 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.001983 23502 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:47.004637 23502 ts_tablet_manager.cc:1434] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:47.005522 23502 tablet_bootstrap.cc:492] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:47.031224 23689 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.031631 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:47.037374 23502 tablet_bootstrap.cc:492] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:47.038518 23502 tablet_bootstrap.cc:492] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:47.040060 23502 ts_tablet_manager.cc:1403] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.006s
I20260709 12:15:47.040890 23679 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:47.052498 23502 raft_consensus.cc:359] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:47.053602 23502 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.054769 23502 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:47.057864 23502 ts_tablet_manager.cc:1434] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:15:47.059034 23502 tablet_bootstrap.cc:492] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:47.067888 23682 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:47.114230 23502 tablet_bootstrap.cc:492] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:47.115697 23502 tablet_bootstrap.cc:492] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:47.116729 23502 ts_tablet_manager.cc:1403] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.000s
I20260709 12:15:47.136317 23685 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:47.155360 22717 consensus_peers.cc:597] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:47.163506 23674 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:47.145870 23502 raft_consensus.cc:359] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:47.201103 23502 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.202328 23502 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:47.205935 23502 ts_tablet_manager.cc:1434] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.089s	user 0.017s	sys 0.018s
I20260709 12:15:47.208488 23502 tablet_bootstrap.cc:492] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:47.244771 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 107822us
I20260709 12:15:47.257781 22752 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:47.341025 23752 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:15:47.318444 23654 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3.
W20260709 12:15:47.379452 22791 consensus_peers.cc:597] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:47.379233 23762 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.069s	user 0.004s	sys 0.000s
W20260709 12:15:47.429461 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 175691us
W20260709 12:15:47.468767 22791 consensus_peers.cc:597] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:47.495189 23695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.130s	sys 0.168s
W20260709 12:15:47.495630 23695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.130s	sys 0.168s
I20260709 12:15:47.501034 23685 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:47.509111 23759 log.cc:927] Time spent T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.200s	user 0.001s	sys 0.001s
I20260709 12:15:47.520648 22827 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:47.522128 23666 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:15:47.549398 23506 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:47.559818 23502 tablet_bootstrap.cc:492] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:15:47.561170 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:47.583609 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:47.606166 23502 tablet_bootstrap.cc:492] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:47.607111 23502 ts_tablet_manager.cc:1403] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.400s	user 0.029s	sys 0.023s
W20260709 12:15:47.607242 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 59508.9us
W20260709 12:15:47.649850 22717 consensus_peers.cc:597] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:47.650434 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 57291.5us
I20260709 12:15:47.649416 23502 raft_consensus.cc:359] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:47.653430 23502 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.654280 23502 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:47.660602 23660 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.706408 23502 ts_tablet_manager.cc:1434] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.006s
I20260709 12:15:47.707711 23656 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:47.708004 23502 tablet_bootstrap.cc:492] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:47.767865 22717 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:47.772424 23789 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 12:15:47.773428 22717 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:47.779978 22717 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:47.782212 22717 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:47.816809 22717 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:47.868567 23502 tablet_bootstrap.cc:492] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:47.874655 23502 tablet_bootstrap.cc:492] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:47.884691 23502 ts_tablet_manager.cc:1403] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.177s	user 0.021s	sys 0.000s
I20260709 12:15:47.901551 23502 raft_consensus.cc:359] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:47.921545 23502 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.922362 23502 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:47.933178 23502 ts_tablet_manager.cc:1434] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:15:47.934217 23502 tablet_bootstrap.cc:492] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:47.984198 23502 tablet_bootstrap.cc:492] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:47.985313 23502 tablet_bootstrap.cc:492] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:47.986037 23502 ts_tablet_manager.cc:1403] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.007s
I20260709 12:15:47.989029 23502 raft_consensus.cc:359] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:47.989850 23502 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.990612 23502 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:47.993270 23502 ts_tablet_manager.cc:1434] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 12:15:47.994213 23502 tablet_bootstrap.cc:492] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.029618 23502 tablet_bootstrap.cc:492] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.030731 23502 tablet_bootstrap.cc:492] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.031553 23502 ts_tablet_manager.cc:1403] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.010s
I20260709 12:15:48.034999 23502 raft_consensus.cc:359] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.035949 23502 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.036788 23502 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.039755 23502 ts_tablet_manager.cc:1434] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:15:48.040680 23502 tablet_bootstrap.cc:492] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.077698 23502 tablet_bootstrap.cc:492] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.078925 23502 tablet_bootstrap.cc:492] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.079725 23502 ts_tablet_manager.cc:1403] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.013s
I20260709 12:15:48.083258 23502 raft_consensus.cc:359] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.084147 23502 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.085117 23502 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.087807 23502 ts_tablet_manager.cc:1434] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:15:48.088878 23502 tablet_bootstrap.cc:492] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:48.090520 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:48.113359 23502 tablet_bootstrap.cc:492] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.114566 23502 tablet_bootstrap.cc:492] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.115440 23502 ts_tablet_manager.cc:1403] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.008s
I20260709 12:15:48.118340 23502 raft_consensus.cc:359] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:48.119269 23502 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.120146 23502 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:48.122174 23502 ts_tablet_manager.cc:1434] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:15:48.123091 23502 tablet_bootstrap.cc:492] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.149991 23502 tablet_bootstrap.cc:492] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.151036 23502 tablet_bootstrap.cc:492] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.161029 23502 ts_tablet_manager.cc:1403] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.006s
I20260709 12:15:48.163839 23502 raft_consensus.cc:359] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:48.164579 23502 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.165323 23502 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:48.167450 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:48.169196 23502 ts_tablet_manager.cc:1434] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:15:48.176429 23502 tablet_bootstrap.cc:492] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
W20260709 12:15:48.204870 22865 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:48.230909 23656 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:48.237540 23502 tablet_bootstrap.cc:492] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.240482 23502 tablet_bootstrap.cc:492] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.241266 23502 ts_tablet_manager.cc:1403] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.065s	user 0.024s	sys 0.006s
I20260709 12:15:48.244161 23502 raft_consensus.cc:359] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:48.244897 23502 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.245692 23502 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:48.249114 23502 ts_tablet_manager.cc:1434] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:48.250283 23502 tablet_bootstrap.cc:492] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.267076 23660 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:48.280558 23502 tablet_bootstrap.cc:492] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.282104 23502 tablet_bootstrap.cc:492] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.283027 23502 ts_tablet_manager.cc:1403] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.033s	user 0.024s	sys 0.007s
I20260709 12:15:48.286327 23502 raft_consensus.cc:359] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:48.287328 23502 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.288184 23502 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:48.291105 23502 ts_tablet_manager.cc:1434] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:48.292783 23502 tablet_bootstrap.cc:492] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.331166 23502 tablet_bootstrap.cc:492] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.333170 23502 tablet_bootstrap.cc:492] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.333935 23502 ts_tablet_manager.cc:1403] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.041s	user 0.026s	sys 0.012s
I20260709 12:15:48.337323 23502 raft_consensus.cc:359] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:48.338397 23502 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.339176 23502 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:48.348276 23502 ts_tablet_manager.cc:1434] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:15:48.349272 23502 tablet_bootstrap.cc:492] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.506143 23502 tablet_bootstrap.cc:492] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.507198 23502 tablet_bootstrap.cc:492] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.507939 23502 ts_tablet_manager.cc:1403] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.159s	user 0.042s	sys 0.044s
I20260709 12:15:48.524482 23502 raft_consensus.cc:359] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.525336 23502 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.526139 23502 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.533061 23502 ts_tablet_manager.cc:1434] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 12:15:48.534546 23502 tablet_bootstrap.cc:492] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.580366 23660 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:48.600920 23502 tablet_bootstrap.cc:492] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.602047 23502 tablet_bootstrap.cc:492] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.602870 23502 ts_tablet_manager.cc:1403] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.008s
I20260709 12:15:48.608779 23502 raft_consensus.cc:359] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.611244 23502 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.612025 23502 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.614533 23502 ts_tablet_manager.cc:1434] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:15:48.615509 23502 tablet_bootstrap.cc:492] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.666276 23502 tablet_bootstrap.cc:492] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.667373 23502 tablet_bootstrap.cc:492] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.668089 23502 ts_tablet_manager.cc:1403] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.018s
I20260709 12:15:48.670885 23502 raft_consensus.cc:359] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.671557 23502 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.672209 23502 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.675706 23502 ts_tablet_manager.cc:1434] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:15:48.677783 23502 tablet_bootstrap.cc:492] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.733590 23502 tablet_bootstrap.cc:492] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.734650 23502 tablet_bootstrap.cc:492] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.735374 23502 ts_tablet_manager.cc:1403] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.058s	user 0.024s	sys 0.011s
I20260709 12:15:48.737703 23502 raft_consensus.cc:359] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:48.738318 23502 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.739099 23502 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:48.741133 23502 ts_tablet_manager.cc:1434] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:48.742045 23502 tablet_bootstrap.cc:492] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.788722 23502 tablet_bootstrap.cc:492] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.789920 23502 tablet_bootstrap.cc:492] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.791898 23502 ts_tablet_manager.cc:1403] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.013s
I20260709 12:15:48.795298 23502 raft_consensus.cc:359] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:48.796120 23502 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.796958 23502 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:48.799535 23502 ts_tablet_manager.cc:1434] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:15:48.800936 23502 tablet_bootstrap.cc:492] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.825923 23502 tablet_bootstrap.cc:492] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.827284 23502 tablet_bootstrap.cc:492] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.828166 23502 ts_tablet_manager.cc:1403] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.008s
I20260709 12:15:48.831406 23502 raft_consensus.cc:359] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:48.832245 23502 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.833104 23502 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:48.836050 23502 ts_tablet_manager.cc:1434] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:48.837657 23502 tablet_bootstrap.cc:492] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.859512 23502 tablet_bootstrap.cc:492] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.860679 23502 tablet_bootstrap.cc:492] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.861536 23502 ts_tablet_manager.cc:1403] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:15:48.864643 23502 raft_consensus.cc:359] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:48.865435 23502 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.866225 23502 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:48.868817 23502 ts_tablet_manager.cc:1434] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:48.871699 23502 tablet_bootstrap.cc:492] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.890872 23502 tablet_bootstrap.cc:492] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.892140 23502 tablet_bootstrap.cc:492] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.893047 23502 ts_tablet_manager.cc:1403] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 12:15:48.896221 23502 raft_consensus.cc:359] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.897040 23502 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.898294 23502 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.900956 23502 ts_tablet_manager.cc:1434] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:48.902037 23502 tablet_bootstrap.cc:492] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.938122 23502 tablet_bootstrap.cc:492] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.939383 23502 tablet_bootstrap.cc:492] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.940258 23502 ts_tablet_manager.cc:1403] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.022s
I20260709 12:15:48.943370 23502 raft_consensus.cc:359] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.944151 23502 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.944953 23502 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.952641 23502 ts_tablet_manager.cc:1434] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:15:48.953704 23502 tablet_bootstrap.cc:492] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:48.974587 23502 tablet_bootstrap.cc:492] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:48.975868 23502 tablet_bootstrap.cc:492] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:48.977025 23502 ts_tablet_manager.cc:1403] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 12:15:48.980275 23502 raft_consensus.cc:359] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.981149 23502 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.982015 23502 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:48.984179 23502 ts_tablet_manager.cc:1434] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:15:48.992460 23502 tablet_bootstrap.cc:492] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:49.019657 23660 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.052182 23656 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.060031 23502 tablet_bootstrap.cc:492] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:49.061390 23502 tablet_bootstrap.cc:492] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:49.065956 23502 ts_tablet_manager.cc:1403] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.019s
I20260709 12:15:49.068994 23695 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:49.069208 23502 raft_consensus.cc:359] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:49.070197 23502 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.071059 23502 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:49.073575 23502 ts_tablet_manager.cc:1434] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:15:49.091252 23502 tablet_bootstrap.cc:492] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:49.157652 23502 tablet_bootstrap.cc:492] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:49.158686 23502 tablet_bootstrap.cc:492] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:49.159628 23502 ts_tablet_manager.cc:1403] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.007s
I20260709 12:15:49.163151 23502 raft_consensus.cc:359] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:49.163897 23502 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.167721 23502 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:49.170224 23502 ts_tablet_manager.cc:1434] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:15:49.171120 23502 tablet_bootstrap.cc:492] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap starting.
I20260709 12:15:49.203300 23502 tablet_bootstrap.cc:492] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:49.205176 23502 tablet_bootstrap.cc:492] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Bootstrap complete.
I20260709 12:15:49.205812 23502 ts_tablet_manager.cc:1403] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.003s
I20260709 12:15:49.207960 23502 raft_consensus.cc:359] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:49.208546 23502 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Initialized, Role: FOLLOWER
I20260709 12:15:49.209177 23502 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:49.210644 23502 ts_tablet_manager.cc:1434] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:15:49.286098 23695 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.302208 23660 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.602135 23689 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:55.307044 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 345019us
I20260709 12:15:56.116314 23863 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.117426 23863 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.119575 23860 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.120522 23860 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:55.997985 23864 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.122730 23864 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.131086 23864 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.134572 23867 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.135417 23867 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:56.135722 23868 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.136696 23868 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.138366 23867 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.139219 23866 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.139765 23861 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.140107 23868 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.144898 23865 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.148432 23866 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.156677 23861 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.168620 23861 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.174216 23866 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.165541 23868 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.179085 23868 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.191075 23868 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.175716 23865 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.206050 23865 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.206725 23865 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.207445 23865 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.209734 23865 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.198275 23860 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.179953 23863 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.201169 23868 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.251274 23876 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.252457 23876 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.256455 23876 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.246971 23868 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.285434 23887 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.287137 23887 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.362742 23887 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.363488 23872 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.364197 23872 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.366811 23870 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.367446 23870 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.369885 23875 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.370647 23875 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.370124 23870 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.542833 23870 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.543512 23870 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.545914 23870 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.547581 23877 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.548578 23877 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.360061 23879 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.366551 23872 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.555649 23868 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.552199 23879 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.558666 23879 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.559269 23883 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.582580 23878 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.583518 23878 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.587096 23880 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.561375 23875 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.586589 23878 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.610754 23887 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.587911 23880 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.564070 23861 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.626418 23888 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.629134 23880 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.626461 23878 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:15:56.630198 23498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.005s	sys 0.010s
I20260709 12:15:56.564960 23872 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.611187 23889 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.575734 23879 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.639127 23878 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.643733 23877 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.644336 23877 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.643867 23879 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:56.644938 23877 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.645551 23878 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.646085 23878 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.646450 23879 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.632617 23887 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:15:56.637036 23498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.014s	sys 0.017s
I20260709 12:15:56.641331 23868 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.641913 23880 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.642462 23888 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.623499 23875 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.648293 23866 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.651201 23863 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.646697 23878 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.647230 23861 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.658247 23866 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.659337 23884 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.659955 23863 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.565160 23883 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.648033 23868 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.672508 23888 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.672631 23878 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.674207 23875 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.675083 23880 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.676594 23875 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.677098 23880 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.686169 23887 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.688858 23877 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.688979 23863 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.690028 23863 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.690615 23863 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.691075 23866 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.686269 23892 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.695243 23892 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.668504 23898 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.657735 23872 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.674285 23884 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.666460 23889 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.720135 23888 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.718302 23898 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.752653 23877 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.755267 23887 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.762693 23861 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.764107 23868 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.762969 23895 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.764212 23887 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.763639 23899 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.771272 23887 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.754729 23850 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.756465 23866 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.776369 23866 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.777190 23902 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.757982 23883 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.764712 23868 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.759377 23863 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.776319 23850 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:56.765101 23895 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.778643 23904 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.773659 23878 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.761895 23877 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.793871 23893 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.795482 23900 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.805617 23893 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.796326 23901 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.778203 23902 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.771912 23899 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.796943 23884 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.788940 23863 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.800796 23866 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.775146 23888 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.801283 23868 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.811439 23901 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.811859 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:56.805675 23900 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.796640 23898 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.817196 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:56.819114 23898 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.819766 23898 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:56.821089 23896 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.821898 23896 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:56.801330 23872 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.824411 23876 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.837975 23866 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.838328 23876 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.837828 23904 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.863821 23903 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.865324 23903 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:56.840783 23892 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.870458 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:56.871490 22901 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
W20260709 12:15:56.884233 23493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.430s	user 0.003s	sys 0.032s
W20260709 12:15:56.885218 23493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.432s	user 0.003s	sys 0.032s
I20260709 12:15:56.892642 23905 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.893661 23888 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.893546 23905 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.895692 23850 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.895967 23877 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.896466 23850 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.892715 23868 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.897104 23850 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.899416 23889 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.927968 23910 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.928855 23910 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.937155 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:56.841001 23866 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.938206 22901 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:15:56.799793 23878 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.809921 23863 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.940533 23895 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.937873 23889 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.956832 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.956983 23909 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.957293 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:56.958266 22822 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:56.957969 23909 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.957144 23900 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.959470 23904 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.960371 23901 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.960311 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:56.956068 23888 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.961342 22897 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:15:56.961449 23893 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:56.961678 23850 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.942271 23910 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.962147 23893 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.962306 23892 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.962697 23893 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:56.962956 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:56.962997 23892 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.939479 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:56.976883 23876 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.977993 23892 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.957139 23898 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.978807 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.979679 23866 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:56.968811 23896 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:56.974058 23850 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.980600 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:56.980892 23850 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:56.981117 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.961768 23888 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.982719 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.983721 23888 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.981243 22901 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:15:56.985029 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.964358 23868 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:56.979867 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.980221 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:56.955920 23895 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.988857 22822 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:15:56.990198 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.990586 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:56.991009 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.987036 23910 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.991660 22753 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:15:56.994590 23910 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.991820 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.992331 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.992624 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.971642 22823 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:56.997999 23868 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:56.964526 23889 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:56.999276 23910 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:56.971935 23900 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.988301 23898 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.001433 23850 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.001573 23900 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:57.001835 23898 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:15:57.003921 23495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.532s	user 0.032s	sys 0.039s
I20260709 12:15:57.004101 23898 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.004746 23898 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.000898 23889 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:57.006053 23899 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.006759 23895 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.007292 23909 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.004904 23900 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.007961 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.007093 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.009089 23895 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.009260 23902 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.009282 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.010303 22892 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:15:57.010723 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.011749 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.012271 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.013545 23903 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.015074 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.015221 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.015539 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.016196 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:57.004312 23495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.533s	user 0.032s	sys 0.039s
I20260709 12:15:57.017417 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.018183 23899 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.018829 23899 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:57.017583 23902 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:56.973694 23901 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.992619 23883 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:57.023432 23883 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:57.025507 23883 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:15:57.025954 23883 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:56.993717 23866 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.026109 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:56.996328 23863 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.030222 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.030062 23901 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:57.031435 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.032038 23908 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.031999 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.032979 23907 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.033260 23896 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.032303 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.026473 23866 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:57.044917 23908 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.041502 23900 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.046123 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.040630 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.040805 23893 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.005343 23898 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:57.026460 23883 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.031430 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.044664 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.033670 23902 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:57.033746 23878 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.046370 23900 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:57.047032 22819 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:57.054877 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.055029 23911 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.055300 23908 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.040659 23912 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.055663 23896 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.042377 23909 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.042495 23863 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.064738 22821 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:57.067942 23868 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.072968 22893 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:57.056747 23883 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.072497 23911 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:15:57.077982 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 52986.9us
I20260709 12:15:57.061846 23914 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.066927 23905 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.074954 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.070390 23896 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.059873 23907 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:57.082839 23863 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.096838 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.097529 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.098285 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.083817 23866 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.107857 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.108038 23866 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.106943 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.084339 23900 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.084733 23898 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.084648 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.084357 23905 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:57.109562 23898 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.109699 22901 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:57.109781 23905 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:57.086127 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.112363 23901 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.112449 23905 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.085713 23909 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.086984 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.087869 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.096773 23863 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.088089 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.075294 23899 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.088624 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.070343 23912 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:57.085459 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.090328 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.091271 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.119681 22892 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:57.120791 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.114864 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.119836 23909 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.098973 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.102766 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.103683 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.104772 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.091426 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.105536 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.127655 23912 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.107251 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.112444 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:57.108644 22895 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:15:57.108857 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.130847 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.131561 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.132097 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.132328 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.132804 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.133461 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.134140 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.134547 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:57.086639 23902 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.136024 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.119478 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:15:57.120919 22848 debug-util.cc:398] Leaking SignalData structure 0x7b08001b5ac0 after lost signal to thread 18410
I20260709 12:15:57.107041 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.106309 23907 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.129190 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.135120 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.135365 23912 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:57.113631 23898 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.119815 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.110354 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.136384 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.133535 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.142513 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.108843 23866 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.138582 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.144567 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.144793 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:57.145315 22848 debug-util.cc:398] Leaking SignalData structure 0x7b0800370be0 after lost signal to thread 22610
I20260709 12:15:57.145797 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.145344 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.110848 23911 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.143802 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:15:57.172794 22848 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff5a0 after lost signal to thread 22777
W20260709 12:15:57.174285 22848 debug-util.cc:398] Leaking SignalData structure 0x7b080026ee20 after lost signal to thread 22851
I20260709 12:15:57.147953 23898 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.148916 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.149812 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.136332 23902 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:57.141685 23914 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.176211 23902 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.176683 23902 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:57.178268 23914 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.143501 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.145898 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.180444 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.181586 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.151679 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.147516 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.182762 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.155860 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.184804 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.185045 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.186012 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.157749 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.158046 23494 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:15:57.158423 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.159462 23916 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:57.189093 23916 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:57.191613 23916 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.191696 23914 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:57.160744 23899 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.192478 23899 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.194645 23899 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:57.195611 22848 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff940 after lost signal to thread 22925
I20260709 12:15:57.162626 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.162845 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.196329 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:15:57.197381 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:57.091723 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.164263 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.165729 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.200013 23916 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:57.198447 23914 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.201515 23914 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:57.167459 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.166481 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.169778 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:57.150281 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.161856 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.197997 23899 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:57.203903 23862 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:57.141444 23912 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.204614 23862 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.204818 23912 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:57.205148 23862 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:57.204034 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:15:57.204398 23899 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.206640 23861 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:57.206725 23899 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:57.207141 23861 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.207692 23861 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:57.207870 23866 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:15:57.198383 22848 debug-util.cc:398] Leaking SignalData structure 0x7b0800356f80 after lost signal to thread 23729
I20260709 12:15:57.199397 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:57.200446 23916 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:57.168336 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.160287 23909 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.216710 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.224943 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.226258 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.227978 23911 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.228439 23905 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:57.229041 23905 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:57.229527 23883 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.223774 23909 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.231012 23898 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:57.231427 23898 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:57.231815 23898 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:57.232492 23909 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.233057 23909 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.233564 23909 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:57.234973 23863 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.235559 23863 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.238286 23905 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.239027 23905 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:57.239634 23905 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:57.219223 23866 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.241019 23866 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.241638 23863 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.242240 23863 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.243276 23866 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.243983 23905 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.219599 23916 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:57.251353 23895 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.244848 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.255095 23909 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.256120 23917 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:57.256443 23918 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.256991 23918 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:57.259263 23918 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.261000 23918 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.261499 23918 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.242687 23863 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.263895 23863 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.263899 23918 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.256989 23917 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:57.268116 23917 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.264467 23863 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.269045 23863 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:57.269076 23862 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:15:57.265271 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 65943.3us
I20260709 12:15:57.244280 23866 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:15:57.271392 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 58809.6us
I20260709 12:15:57.273533 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.276798 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.277072 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.277853 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.289443 23689 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:57.278206 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.279052 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:15:57.279878 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.280442 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.280644 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.283145 23861 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:57.285477 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.301100 23861 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.303818 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.304484 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:57.291093 23895 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.307788 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.309152 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.286269 23898 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:57.287046 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:57.290023 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.311440 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.313447 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.313453 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.322760 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.276788 23862 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.322988 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.349502 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.351097 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.326396 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.291942 23866 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.314755 23876 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.314579 23884 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.311915 23878 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:57.361639 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.312139 23868 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:57.356518 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:57.346601 23901 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:57.369441 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 45853.7us
I20260709 12:15:57.346863 23917 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:57.349382 23883 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.324369 23891 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:57.412869 23906 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.415134 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.416013 23660 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
W20260709 12:15:57.358639 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 66530us
I20260709 12:15:57.417665 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.419147 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:57.419595 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.420352 23679 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:57.422196 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.370749 23911 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.426515 23909 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.427134 23909 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:57.313997 23912 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:57.353104 23892 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.357461 23895 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.358408 23877 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.437621 22752 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:57.357580 23918 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.370321 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.439682 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.444761 23689 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
W20260709 12:15:57.445052 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 74884.9us
I20260709 12:15:57.324872 23880 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.371125 23878 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.486709 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.487612 23878 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:57.448411 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.449966 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.441990 23891 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.452059 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.412233 23868 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:15:57.379540 23863 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.455689 23883 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.456024 23866 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.456286 23912 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:57.457206 23685 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:57.497857 23868 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:57.457531 23918 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:57.458952 23901 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:57.500629 23918 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.459466 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:57.502291 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:57.489262 23914 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:15:57.503880 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:15:57.437621 23905 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:57.504838 23905 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:57.460999 23898 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.505302 23905 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:57.507298 23682 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:57.509696 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.509995 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.461095 23919 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:15:57.462019 22753 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:57.511369 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.511216 23919 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.462507 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:57.512751 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.513415 23919 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.513947 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.515168 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.515569 23866 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.515790 23682 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:57.516485 23866 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:57.516911 23866 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:57.509615 23878 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:57.464210 23909 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.371832 23893 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.469820 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.518327 23909 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:57.518908 23689 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:57.475508 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.412127 23917 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:15:57.479210 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:15:57.480093 23495 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45650 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
W20260709 12:15:57.480554 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46914.9us
I20260709 12:15:57.482004 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.482573 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.485098 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.454188 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:57.490257 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 139199us
I20260709 12:15:57.519550 23878 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.489674 23891 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:57.491174 23656 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:15:57.523296 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.523664 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.524047 23685 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:57.524428 23656 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:57.525175 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.525524 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.526254 23656 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:57.495102 23659 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:15:57.521708 23672 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:57.527563 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.519582 23917 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:57.527876 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.528666 23672 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:15:57.528813 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.529457 23659 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:15:57.529626 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.530391 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.520655 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.535907 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.536168 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.517627 23866 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:57.490581 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.537261 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.537366 23679 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:15:57.537919 23689 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:57.538239 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.538430 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.444912 23899 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:15:57.539004 23672 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:15:57.540443 23672 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:57.540691 23899 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:15:57.541507 23674 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:57.531914 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.531966 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.533490 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.522543 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.544566 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.539031 23679 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:57.547353 23893 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:57.548027 23893 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.533761 23659 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:15:57.519722 23495 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45650 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 237)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 248)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 247)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 309)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 310)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 311)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 313)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 314)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 317)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 318)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 238)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 320)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 239)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 321)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 240)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 326)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 200)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 202)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 203)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 204)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 206)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 207)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 209)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 217)
I20260709 12:15:57.533497 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.551425 23656 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:15:57.532709 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.553023 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.553429 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.534742 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.463296 23916 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:15:57.555336 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 58100.3us
I20260709 12:15:57.567747 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.545666 22791 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:57.567888 23901 raft_consensus.cc:3055] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:57.526537 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:15:57.568679 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 54153.4us
I20260709 12:15:57.568951 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.569854 23910 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:57.567690 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.574996 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:15:57.516924 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:15:57.637943 23689 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:57.641659 23695 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:57.575795 23901 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:15:57.649904 23917 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:57.651862 23905 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:15:57.655977 23891 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:57.657780 23910 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:57.878248 23868 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:57.579020 23892 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:57.640203 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:00.503181 22750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 14) took 2883 ms (client timeout 2198 ms). Trace:
W20260709 12:16:00.503727 22750 rpcz_store.cc:269] 0709 12:15:57.619946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.620620 (+   674us) service_pool.cc:224] Handling call
0709 12:16:00.503054 (+2882434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:57.641283 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:15:57.640235 23916 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:57.691144 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:00.510576 22894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 26) took 2851 ms (client timeout 1790 ms). Trace:
W20260709 12:16:00.511085 22894 rpcz_store.cc:269] 0709 12:15:57.659343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.690692 (+ 31349us) service_pool.cc:224] Handling call
0709 12:16:00.510468 (+2819776us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:57.639225 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:00.596553 22897 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
W20260709 12:16:00.597344 22897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 25) took 2978 ms (client timeout 1764 ms). Trace:
I20260709 12:15:57.619995 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:15:57.748682 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:15:57.598439 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:00.618939 23936 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:00.619014 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 3.02038e+06us
I20260709 12:16:00.620291 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:15:58.477530 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 242) took 1016 ms. Trace:
I20260709 12:16:00.321900 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 202) took 2854 ms. Trace:
I20260709 12:16:00.342387 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:00.348170 23926 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.625546 23674 rpcz_store.cc:276] 0709 12:15:57.467797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:00.320861 (+2853064us) service_pool.cc:224] Handling call
0709 12:16:00.321307 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.321533 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:00.321561 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:00.321603 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:00.321642 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.321696 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:00.321826 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:00.626806 23926 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.627606 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.628456 23674 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:00.625478 23689 rpcz_store.cc:276] 0709 12:15:57.454426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.573191 (+118765us) service_pool.cc:224] Handling call
0709 12:15:57.637745 (+ 64554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:58.470472 (+832727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.470867 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:00.629571 23926 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:00.629688 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.351663 23927 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.630613 23674 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:00.631139 23927 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.633733 23927 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:00.370071 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 226) took 3092 ms. Trace:
I20260709 12:16:00.634406 23695 rpcz_store.cc:276] 0709 12:15:57.296317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.306990 (+ 10673us) service_pool.cc:224] Handling call
0709 12:15:57.346644 (+ 39654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:58.460503 (+1113859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.369743 (+1909240us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400292554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:00.369959 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646232320}
W20260709 12:16:00.395738 22865 connection.cc:256] RPC call timeout handler was delayed by -1.9822261130002516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 12:16:00.638377 22865 connection.cc:256] RPC call timeout handler was delayed by -1.9408261130001847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
W20260709 12:16:00.638764 22865 connection.cc:256] RPC call timeout handler was delayed by -1.8607261130000552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 12:16:00.639099 22865 connection.cc:256] RPC call timeout handler was delayed by -1.8211261130002185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 12:16:00.639458 22865 connection.cc:256] RPC call timeout handler was delayed by -1.8157261130002098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 12:16:00.639972 22865 connection.cc:256] RPC call timeout handler was delayed by -1.7734261130001414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 12:16:00.640317 22865 connection.cc:256] RPC call timeout handler was delayed by -1.7266261130000657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 12:16:00.640604 22865 connection.cc:256] RPC call timeout handler was delayed by -1.7185261130000526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 12:16:00.640887 22865 connection.cc:256] RPC call timeout handler was delayed by -1.7113261130002684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 12:16:00.641201 22865 connection.cc:256] RPC call timeout handler was delayed by -1.7005261130002509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 12:16:00.641485 22865 connection.cc:256] RPC call timeout handler was delayed by -1.6861261130002276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 12:16:00.641752 22865 connection.cc:256] RPC call timeout handler was delayed by -1.6584933200001615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 12:16:00.642019 22865 connection.cc:256] RPC call timeout handler was delayed by -1.6458933200001411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 12:16:00.642297 22865 connection.cc:256] RPC call timeout handler was delayed by -1.5916261130000748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 12:16:00.396443 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.643867 23911 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.413250 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 245) took 1113 ms. Trace:
I20260709 12:16:00.416798 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.644834 23682 rpcz_store.cc:276] 0709 12:15:57.472989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.516670 (+ 43681us) service_pool.cc:224] Handling call
0709 12:15:58.547879 (+1031209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:00.646358 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.646270 23911 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.647881 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.649072 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.417258 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.418303 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.651400 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:00.652004 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.652740 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.653210 22746 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:00.422760 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 200) took 2955 ms. Trace:
I20260709 12:16:00.439869 23493 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:00.446552 22827 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:00.458508 22895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 18) took 2924 ms (client timeout 1825 ms). Trace:
I20260709 12:16:00.462984 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.468034 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.470974 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 326) took 3015 ms. Trace:
I20260709 12:16:00.480868 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 432) took 2842 ms. Trace:
I20260709 12:16:00.654072 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:00.642566 22865 connection.cc:256] RPC call timeout handler was delayed by -1.534293320000188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
I20260709 12:16:00.654667 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.650272 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.664746 22746 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
W20260709 12:16:00.664144 22865 connection.cc:256] RPC call timeout handler was delayed by -1.4532933200002844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 12:16:00.657320 23916 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:00.509454 22745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 208) took 2888 ms (client timeout 1718 ms). Trace:
W20260709 12:16:00.668457 22895 rpcz_store.cc:269] 0709 12:15:57.534289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.534433 (+   144us) service_pool.cc:224] Handling call
0709 12:16:00.458355 (+2923922us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:00.668927 22745 rpcz_store.cc:269] 0709 12:15:57.621108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.628511 (+  7403us) service_pool.cc:224] Handling call
0709 12:16:00.509323 (+2880812us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:00.669322 23916 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:00.519709 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.669708 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:00.670022 23916 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:00.532701 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:00.664000 22749 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:00.670517 22895 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:00.672614 23916 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:00.673514 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:00.533999 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:00.674690 22901 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:16:00.675750 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:00.675355 22823 rpcz_store.cc:276] 0709 12:15:57.638226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.638418 (+   192us) service_pool.cc:224] Handling call
0709 12:16:00.480268 (+2841850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.480479 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:00.480507 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:00.480555 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:00.480600 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.480663 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:00.480786 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:00.671936 22753 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:00.536208 22818 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:00.482100 23931 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.537844 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:00.538196 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.899s	user 0.006s	sys 0.027s
W20260709 12:16:00.680548 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.042s	user 0.007s	sys 0.027s
I20260709 12:16:00.681121 23931 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.536382 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:00.683184 22896 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:00.558429 23935 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.687158 23935 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.687501 23930 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.688403 23930 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.689729 23935 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:00.560757 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.540536 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:00.581053 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:15:57.516491 23902 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:00.408879 23869 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:00.697541 23869 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:00.699206 23660 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:00.700637 23928 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.410030 23862 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:00.702736 23862 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:15:58.727319 23866 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.190s	user 0.009s	sys 0.003s
I20260709 12:15:59.211721 23868 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:58.605191 23891 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:15:58.606495 23901 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:58.607548 23905 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:00.478842 23876 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.716653 23916 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:00.717666 23876 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:15:58.475126 23910 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:00.720475 23916 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:00.721110 23910 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.601223 22892 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
W20260709 12:16:00.724072 22892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 27) took 3033 ms (client timeout 1767 ms). Trace:
W20260709 12:16:00.724556 22892 rpcz_store.cc:269] 0709 12:15:57.690445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.748297 (+ 57852us) service_pool.cc:224] Handling call
0709 12:16:00.723981 (+2975684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:00.725665 23866 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:00.728775 23876 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:00.701303 23660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 235) took 3284 ms (client timeout 1951 ms). Trace:
W20260709 12:16:00.729985 23660 rpcz_store.cc:269] 0709 12:15:57.416873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.421945 (+  5072us) service_pool.cc:224] Handling call
0709 12:16:00.701006 (+3279061us) spinlock_profiling.cc:243] Waited 3.28 s on lock 0x7b5400080554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:00.701180 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7534034688}
I20260709 12:16:00.732095 23902 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:00.597831 22897 rpcz_store.cc:269] 0709 12:15:57.618589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.633908 (+ 15319us) service_pool.cc:224] Handling call
0709 12:16:00.597239 (+2963331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62464}
I20260709 12:15:57.505304 23914 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:15:58.605513 23917 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:00.409430 23920 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:00.737897 23920 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:00.741106 23920 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:00.408169 23922 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:00.743393 23922 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:00.744889 22751 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:00.644102 23672 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:00.396845 23929 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:00.747951 23929 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:00.665457 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.752862 22898 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:00.753708 23931 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:00.759272 23929 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:00.746403 23922 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:00.667498 22865 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 1.501s (SENT) [suppressed 79 similar messages]
I20260709 12:16:00.667937 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 796) took 3364 ms. Trace:
I20260709 12:16:00.760936 22827 rpcz_store.cc:276] 0709 12:15:57.303333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.303524 (+   191us) service_pool.cc:224] Handling call
0709 12:15:57.310411 (+  6887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.666234 (+3355823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.667710 (+  1476us) spinlock_profiling.cc:243] Waited 3.14 s on lock 0x7b54001243d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:00.667878 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7211887360}
W20260709 12:16:00.530623 22894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 28) took 2839 ms (client timeout 1726 ms). Trace:
W20260709 12:16:00.656809 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 314495us
W20260709 12:16:00.762640 22894 rpcz_store.cc:269] 0709 12:16:00.525681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:00.530288 (+  4607us) service_pool.cc:211] Skipping call since client already timed out
0709 12:16:00.530508 (+   220us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:16:00.767423 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:00.769567 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:00.770612 23917 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:00.771397 23917 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.771929 23917 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:00.777031 23935 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.777837 23891 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:00.777792 23935 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.778810 23891 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.650132 23911 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:00.671134 23659 rpcz_store.cc:276] 0709 12:15:57.455085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:00.469889 (+3014804us) service_pool.cc:224] Handling call
0709 12:16:00.470345 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.470567 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:00.470603 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:00.470652 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:00.470685 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.470742 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:00.470906 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:00.782369 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.535311 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.562651 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.692713 23930 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:00.701432 23928 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.705165 22895 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:00.710144 22896 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:00.711474 23862 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:00.712474 23685 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:00.705262 22818 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:00.734581 23866 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:00.786752 23891 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:00.736737 23910 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:00.736033 23901 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:00.794665 23679 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:00.790940 23940 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:00.738765 23869 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:00.786532 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 346717us
I20260709 12:16:00.788197 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.784520 22750 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:00.780566 23935 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:00.796491 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 205) took 3327 ms. Trace:
I20260709 12:16:00.810109 23493 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:00.810472 23685 rpcz_store.cc:276] 0709 12:15:57.468771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.649910 (+181139us) service_pool.cc:224] Handling call
0709 12:16:00.712163 (+3062253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.795297 (+ 83134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.796259 (+   962us) spinlock_profiling.cc:243] Waited 3.06 s on lock 0x7b5400080550. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:00.796411 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7041637120}
I20260709 12:16:00.808785 23940 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.811405 23936 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:00.794435 22791 connection.cc:256] RPC call timeout handler was delayed by -2.5721625020000829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 12:16:00.812666 22791 connection.cc:256] RPC call timeout handler was delayed by -2.5524057360000825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 12:16:00.813202 22791 connection.cc:256] RPC call timeout handler was delayed by -2.5368024160000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 12:16:00.813544 22791 connection.cc:256] RPC call timeout handler was delayed by -2.5055625020002026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 12:16:00.666496 23656 rpcz_store.cc:276] 0709 12:15:57.467299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:00.421797 (+2954498us) service_pool.cc:224] Handling call
0709 12:16:00.422178 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.422401 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:00.422431 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:00.422475 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:00.422510 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.422580 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:00.422699 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:00.813998 22791 connection.cc:256] RPC call timeout handler was delayed by -2.2353024159999677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
I20260709 12:16:00.811430 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:00.796983 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.799206 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.824901 23493 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:00.803242 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 135771us
I20260709 12:16:00.798491 23928 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:00.796825 22818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 799) took 3235 ms (client timeout 1606 ms). Trace:
I20260709 12:16:00.826485 23902 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:00.796715 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:00.826512 22818 rpcz_store.cc:269] 0709 12:15:57.561904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.574478 (+ 12574us) service_pool.cc:224] Handling call
0709 12:16:00.796722 (+3222244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107904}
I20260709 12:16:00.817248 23866 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:00.770646 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:00.812002 23940 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:00.803633 23917 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:00.840543 23866 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:00.840962 23866 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.841033 23933 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:16:00.812577 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 130274us
I20260709 12:16:00.827147 23914 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:00.841938 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 71375.1us
I20260709 12:16:00.842015 23933 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.843354 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:00.841243 23930 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.844900 23930 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.845217 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:00.846050 22745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba57a7932934f629e6ed95148994535"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:49294
I20260709 12:16:00.847124 22745 raft_consensus.cc:606] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:00.829612 22898 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:00.847324 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:00.846141 23869 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:00.847529 23928 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:00.841473 23866 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:00.846416 23925 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:16:00.803779 22790 connection.cc:256] RPC call timeout handler was delayed by -1.4225667429998339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260709 12:16:00.848696 23869 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:00.850292 23869 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:00.850659 23869 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:00.828320 23493 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:00.852432 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.853557 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:00.854506 23902 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:00.855275 23902 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:00.855398 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.856564 23656 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:00.856890 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:00.858052 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.847357 23933 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:00.860126 23914 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:00.855732 23930 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:00.860417 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.848861 23922 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:00.861294 23922 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:00.861325 23685 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:00.849154 23925 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:00.861732 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:00.862234 23925 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:00.845372 23941 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:00.859011 23656 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 2: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:00.862648 23922 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:00.864018 23922 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:00.864792 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.865110 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.866039 23656 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:00.867722 22747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:49294
I20260709 12:16:00.867861 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:00.868427 22747 raft_consensus.cc:606] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:00.869160 23914 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:00.842026 23917 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:00.870626 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:00.871984 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.937753 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:00.870638 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.932130 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:00.928359 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.878021 23866 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:00.848702 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:00.902954 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.901402 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:00.825973 22791 connection.cc:256] RPC call timeout handler was delayed by -2.1879057359999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 12:16:00.942256 23922 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:00.887952 23933 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.902926 22895 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:00.848912 23911 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:00.944342 23911 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:00.944087 23933 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:00.940541 23685 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 2: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:00.945310 22894 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:00.897373 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:00.946447 23911 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:00.946911 22818 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:00.947619 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:00.925508 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 77815.7us
I20260709 12:16:00.948899 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:00.949288 23866 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:00.949965 23914 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:00.874711 23931 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.879065 23917 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:00.880034 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.950162 23933 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:00.945154 23925 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:00.881090 23930 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:00.978291 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:00.977128 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:00.989192 22894 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:00.874637 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.965675 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:00.985384 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:00.915820 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:00.942209 23659 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
W20260709 12:16:00.942628 22791 connection.cc:256] RPC call timeout handler was delayed by -2.1625200480000331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 12:16:00.962510 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.895882 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:00.873870 22899 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:00.873383 23656 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:00.888307 22747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:49294
I20260709 12:16:00.894799 23869 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:00.986200 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:00.950551 23914 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:00.909149 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:00.942408 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 93773.7us
I20260709 12:16:00.953044 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.978391 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:00.968251 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.962510 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:00.955097 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.904415 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:00.914889 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:00.956537 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:00.996978 23940 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:01.007385 23930 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:01.025422 23672 raft_consensus.cc:2393] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 2: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:01.027087 23930 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:01.008198 22825 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 2: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:01.028208 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:01.028631 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.008728 23925 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:01.009590 22824 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:01.009895 23660 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:01.010432 22818 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:01.010653 22896 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.013195 23674 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:00.947893 23911 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.015793 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:01.013696 22747 raft_consensus.cc:606] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:01.016692 23917 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:01.016763 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:01.034931 23917 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:01.017788 22753 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 3. Current term is 4. Ops: []
W20260709 12:16:01.018261 22899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 905) took 3399 ms (client timeout 1606 ms). Trace:
I20260709 12:16:01.036398 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:01.036711 22899 rpcz_store.cc:269] 0709 12:15:57.619068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.619745 (+   677us) service_pool.cc:224] Handling call
0709 12:16:01.018088 (+3398343us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54002fe754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:01.018198 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574475520}
I20260709 12:16:01.037359 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:01.018276 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:01.018821 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:01.036111 23917 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:01.018272 22823 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 2: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:01.039127 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:01.019850 23689 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:01.040068 23922 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:01.040474 23922 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:01.040587 23916 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:01.040967 23922 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.041162 23916 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:01.015906 23869 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:01.042280 23916 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:01.043058 23685 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:01.043422 23869 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:01.021996 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 117675us
I20260709 12:16:01.024493 23901 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:01.008248 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.003407 22827 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:01.009435 23679 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
W20260709 12:16:01.012691 22791 connection.cc:256] RPC call timeout handler was delayed by -2.1334711030001472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:16:01.049365 22791 connection.cc:256] RPC call timeout handler was delayed by -2.0824200480001309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 12:16:01.028142 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:01.049638 22791 connection.cc:256] RPC call timeout handler was delayed by -2.0411625020001338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
W20260709 12:16:01.050123 22791 connection.cc:256] RPC call timeout handler was delayed by -2.0320200480000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 12:16:01.050412 22791 connection.cc:256] RPC call timeout handler was delayed by -1.9342673940002442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 12:16:01.050673 22791 connection.cc:256] RPC call timeout handler was delayed by -1.7989200480001273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
W20260709 12:16:01.051159 22791 connection.cc:256] RPC call timeout handler was delayed by -1.7071200480002062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
W20260709 12:16:01.051477 22791 connection.cc:256] RPC call timeout handler was delayed by -1.6423200480001015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 12:16:01.051789 22791 connection.cc:256] RPC call timeout handler was delayed by -1.6198200480000651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
I20260709 12:16:01.053941 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:01.019212 23682 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:01.056160 22752 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.056408 23866 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:01.026475 23940 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:01.019667 22821 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:01.003330 23931 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:01.013984 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.060470 23656 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:01.017644 23914 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:01.066318 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:01.067118 22899 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.067921 22898 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.019992 22822 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:01.075426 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:01.076294 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.077221 23939 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:01.077593 23939 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.077915 23939 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:01.024020 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 69745.1us
I20260709 12:16:01.093123 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:01.094190 22895 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.098418 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:01.099756 22897 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.094240 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:01.105700 23901 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:01.106282 23901 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:01.107147 23901 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.123785 23940 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:01.124617 23940 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:01.126555 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 87496.5us
I20260709 12:16:01.127781 23940 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:01.127769 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:01.128749 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:01.129441 23925 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:01.130307 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:01.132014 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:01.132921 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.133912 23928 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.134709 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:01.135628 22892 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.135382 23941 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:01.136925 23869 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:16:01.137208 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 92261.6us
I20260709 12:16:01.137393 23869 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:01.138306 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:01.138706 23869 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:01.139694 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.140264 23940 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:01.140769 23940 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:01.140899 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:01.141220 23940 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:01.142215 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.142632 23928 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:01.143951 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:01.145804 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:01.146457 23928 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:01.147271 23928 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:01.147805 23928 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.149329 23910 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:01.144443 23931 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:01.152732 23869 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.154239 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:01.155397 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.156569 23910 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.157058 23910 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.157516 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:01.158283 22893 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.157485 23910 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.130555 22896 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:01.167351 23936 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.167860 23936 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.168228 23936 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.168377 23941 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:01.169911 23925 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:01.170323 23925 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:01.171168 23925 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:01.171516 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.172969 22865 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.173839 23925 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.175752 22892 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:01.176620 23910 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:01.179059 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.179469 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.180020 23891 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.180471 23891 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.181697 22893 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:01.183826 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:01.184609 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.186429 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.150245 23940 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:01.187745 22895 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:01.205260 22897 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:01.181217 23876 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:01.208273 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:01.209587 22752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:49294
I20260709 12:16:01.218021 22752 raft_consensus.cc:606] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:01.199360 23494 connection.cc:256] RPC call timeout handler was delayed by -2.1217575509999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:16:01.209801 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.181344 23931 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.197603 22899 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:01.220074 23493 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.180676 23910 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:01.186642 23866 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:01.220470 23951 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:01.210179 23926 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.180843 23891 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.267230 23928 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:01.269635 23946 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:16:01.185979 23929 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:01.270939 22572 catalog_manager.cc:5697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 3, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.273108 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:01.273841 22819 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.237103 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.237412 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.210362 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.200055 23917 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:01.264464 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44513.8us
I20260709 12:16:01.284097 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.218861 23916 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:01.238770 23494 connection.cc:256] RPC call timeout handler was delayed by -2.1055575509999471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 12:16:01.239343 23931 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.239542 23930 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:01.246611 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 96483.4us
W20260709 12:16:01.259956 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.221004 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:01.239171 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.280416 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:01.291484 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 70593.1us
I20260709 12:16:01.281430 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.269779 23928 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:01.279635 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 74359.5us
I20260709 12:16:01.237486 23936 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:01.237856 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.283515 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.210896 23902 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:01.240175 23914 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:01.281314 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:01.350755 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58370.2us
I20260709 12:16:01.283216 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.277053 23905 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:01.218709 23933 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:01.292444 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.300532 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:01.279982 23951 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:01.402839 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 118813us
I20260709 12:16:01.277900 23926 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.298434 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:01.404577 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:01.405975 23493 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.402441 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.386150 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.285972 23917 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:01.373243 23934 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:16:01.317138 23868 consensus_queue.cc:1059] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.128s
I20260709 12:16:01.457270 22896 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.458145 23868 raft_consensus.cc:3055] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:01.458246 22819 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:01.289163 23866 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:01.294044 23910 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:01.408147 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:01.483278 22899 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:16:01.408782 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:01.444898 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:01.420660 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:01.488883 22893 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
W20260709 12:16:01.408035 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.292951 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.309381 23940 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:01.405717 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:01.287889 23494 connection.cc:256] RPC call timeout handler was delayed by -2.0497575509998569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 12:16:01.430151 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:01.297178 22898 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
W20260709 12:16:01.493002 23494 connection.cc:256] RPC call timeout handler was delayed by -1.9795575509999708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 12:16:01.493242 22900 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
W20260709 12:16:01.493630 23494 connection.cc:256] RPC call timeout handler was delayed by -1.9786575509999693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 12:16:01.494269 23494 connection.cc:256] RPC call timeout handler was delayed by -1.9696575509999548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260709 12:16:01.494630 23494 connection.cc:256] RPC call timeout handler was delayed by -1.9138575509998645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:16:01.495129 23494 connection.cc:256] RPC call timeout handler was delayed by -1.7275575510000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 12:16:01.495846 23494 connection.cc:256] RPC call timeout handler was delayed by -1.6924575509999613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
I20260709 12:16:01.318149 23891 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:01.453424 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 161103us
I20260709 12:16:01.312438 23931 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.453137 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:01.444103 23925 raft_consensus.cc:993] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: : Instructing follower a89a4b420ea9496aab55475fc38bb6f7 to start an election
I20260709 12:16:01.409440 23493 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:01.409225 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:01.391649 23914 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:01.407774 23926 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.455233 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:01.506902 22827 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.507710 23920 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:01.458735 23868 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:01.509168 23868 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:01.510504 23868 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:01.506095 23941 raft_consensus.cc:1081] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Signalling peer a89a4b420ea9496aab55475fc38bb6f7 to start an election
I20260709 12:16:01.458866 22896 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:01.459302 23936 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:01.459683 23934 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:01.515491 23934 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:01.516456 23934 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:01.517783 23934 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.293483 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.401347 22821 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:16:01.411026 23916 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:01.520881 23916 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:01.521364 23916 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:01.506433 23866 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:01.523203 23866 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:01.523729 23866 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.454854 23911 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.406587 23951 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.529701 23891 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:01.305773 23939 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:01.532696 23939 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:01.410995 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:01.395114 23902 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:01.533602 22895 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:16:01.534714 22818 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:01.534947 23902 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:01.455196 23917 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.467629 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.537783 22900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:01.322373 23922 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:01.539929 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.541025 23922 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:01.542013 22745 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:01.538493 22900 raft_consensus.cc:606] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:01.307987 23901 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:01.499642 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.476677 22894 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:01.527055 23911 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:16:01.544755 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45216.4us
I20260709 12:16:01.544938 23911 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.544948 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:01.545554 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:01.546556 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.547009 23930 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:01.547261 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:01.547619 23930 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.548110 23930 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.548775 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:01.551805 23952 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.552345 23952 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.552757 23952 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.553107 22892 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:01.538446 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:01.498859 23494 connection.cc:256] RPC call timeout handler was delayed by -1.6789575509999395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
W20260709 12:16:01.576099 23494 connection.cc:256] RPC call timeout handler was delayed by -1.6492575509998915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 12:16:01.576534 23494 connection.cc:256] RPC call timeout handler was delayed by -1.5286575509999238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
W20260709 12:16:01.576865 23494 connection.cc:256] RPC call timeout handler was delayed by -1.5232575509999151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
I20260709 12:16:01.502610 22897 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:01.576983 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.578140 22823 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 2: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:16:01.503389 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 94021.7us
W20260709 12:16:01.504760 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 95627.2us
I20260709 12:16:01.580390 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.582106 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:01.506757 23914 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.446561 23905 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:01.566309 22827 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:01.585956 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:01.568900 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:01.587224 23672 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.587303 23952 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:01.588866 23917 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:01.569311 23933 consensus_queue.cc:1059] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:01.571426 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:01.571979 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.572958 23916 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:01.593225 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:01.594193 23920 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:01.595582 23679 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.595978 23941 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:01.596390 23941 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:01.596493 23933 raft_consensus.cc:3055] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:01.596988 23933 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:01.597380 23941 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:01.594058 23911 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:01.577191 23494 connection.cc:256] RPC call timeout handler was delayed by -1.515157550999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 12:16:01.599211 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:01.599377 23494 connection.cc:256] RPC call timeout handler was delayed by -1.4250991080000404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 12:16:01.601048 23911 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:01.604516 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:01.605100 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.605924 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.605995 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:01.597838 23933 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:01.608247 23725 debug-util.cc:398] Leaking SignalData structure 0x7b080036b960 after lost signal to thread 18410
I20260709 12:16:01.610714 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.611104 23656 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:01.612181 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.612499 23914 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:01.613044 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.614236 23682 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:01.612735 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.594659 23949 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:01.619299 23949 raft_consensus.cc:697] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:01.615597 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.620551 22744 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 4: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:01.614816 23914 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:01.620215 23949 consensus_queue.cc:237] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:01.607556 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.621156 23931 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:01.616380 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:01.611060 23725 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1480 after lost signal to thread 22610
I20260709 12:16:01.623819 22892 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:01.624315 23725 debug-util.cc:398] Leaking SignalData structure 0x7b0800176760 after lost signal to thread 22777
I20260709 12:16:01.612347 23901 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:01.617863 23917 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:01.608481 23941 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.629153 23866 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:01.626765 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.634549 22818 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
W20260709 12:16:01.501099 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 55758.2us
I20260709 12:16:01.637986 23866 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:01.626688 23914 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:01.592803 23926 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:01.643368 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.647001 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.651412 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:01.651805 22751 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 2: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:01.652629 23901 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:01.653543 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.646123 23958 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:16:01.653894 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.642030 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.655021 22752 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:01.656329 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.658056 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.646189 23952 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:01.659343 22750 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:01.659426 23685 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:01.641333 23930 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:01.625763 23933 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.663875 23868 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:16:01.653543 23725 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6940 after lost signal to thread 22851
I20260709 12:16:01.650568 23951 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:01.670487 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:01.675097 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 93071.9us
I20260709 12:16:01.676644 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.654858 23901 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.664877 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.654949 23958 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:01.686949 23958 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:01.672756 23931 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:01.687714 23725 debug-util.cc:398] Leaking SignalData structure 0x7b080024c9e0 after lost signal to thread 22925
I20260709 12:16:01.687944 23958 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:01.688696 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:01.689399 23725 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd500 after lost signal to thread 23729
I20260709 12:16:01.689469 23958 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.669677 23910 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:01.661307 23916 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:01.673429 23952 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.670837 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.668659 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.680176 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.681877 22826 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.693549 23959 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:01.683212 22818 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.694199 23959 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:01.685254 23672 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:01.695523 23959 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:01.698978 23910 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.696081 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.684537 22745 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:01.684672 22821 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.675479 23868 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:01.701216 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.685134 23928 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:01.678905 23901 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.672648 23914 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:16:01.706593 23931 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.707245 23931 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.691722 23952 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.708380 23931 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.708813 23952 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.709627 23930 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:01.710616 23901 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.683633 23911 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.719058 23911 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.719677 23911 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.721436 23689 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:01.684067 23926 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:01.702935 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.725373 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.701862 23868 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:01.727514 22717 connection.cc:256] RPC call timeout handler was delayed by -2.6955664869999509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 12:16:01.726503 23891 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.728418 23891 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.729069 23891 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:01.730165 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.730655 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.731421 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:01.732065 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.705087 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.705399 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:01.705756 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.703646 23939 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:16:01.708524 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.699540 23910 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.715216 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.735703 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.736945 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.742848 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:01.737484 23926 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.779392 23926 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.779953 23926 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.746946 23928 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:01.782914 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:01.737486 23934 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.784318 23934 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.784633 23901 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:01.738598 23695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:45644
I20260709 12:16:01.787753 23679 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:01.788945 22826 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:01.784742 23934 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.758395 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:01.757735 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:01.813365 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 55087.9us
W20260709 12:16:01.814623 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 57063.3us
I20260709 12:16:01.819032 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:01.814235 23928 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.737596 23936 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:01.819710 23939 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:01.829071 23928 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.791213 23935 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.787994 23951 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:01.739554 23930 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:01.740392 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:01.741334 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:01.838495 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:01.841322 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.849210 22899 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.739508 23914 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:01.832511 23939 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:01.740896 23910 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:01.737412 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 131999us
I20260709 12:16:01.843964 22897 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.885946 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:01.832711 23928 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:01.831498 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 85217.6us
I20260709 12:16:01.890214 22827 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.894373 22897 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.896631 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:01.897377 23672 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.897011 23939 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:01.836927 23935 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.880193 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:01.903973 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.847936 23930 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:01.833033 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:01.907545 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:01.908215 23656 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:01.832526 23936 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:16:01.887617 23914 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:01.831784 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:01.915930 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 99622.9us
I20260709 12:16:01.903698 23659 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:01.903048 23935 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.917999 22897 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.922837 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:01.911369 23901 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:01.927579 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:01.918602 23949 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:16:01.905566 23930 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.926581 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:01.931896 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:01.893362 23931 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:01.915380 23869 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:16:01.936682 23911 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:01.946892 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.947883 23659 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:01.949168 23911 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:01.949716 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.951030 22899 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.951331 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.952159 23682 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:16:01.952471 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.953598 23955 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:01.953418 23891 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:01.953820 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.954150 23955 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:01.955041 22894 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.955168 23922 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:01.956507 23926 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:01.955098 23931 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:01.957681 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:01.949180 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.959627 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.962309 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:01.963716 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:01.976745 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:01.977861 23674 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 2: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:16:01.978071 23962 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:16:01.931444 23920 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:16:01.982848 23660 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:01.985267 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:01.956578 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:01.943112 23936 consensus_queue.cc:1059] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:16:01.988211 23869 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:01.988253 23695 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:01.965391 23959 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:16:01.953441 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:01.990487 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:02.007454 22897 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.009547 23695 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.010349 23659 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:01.998802 23914 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.026980 23682 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:02.028120 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:02.028769 23682 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:02.029700 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:02.032594 23674 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:02.033788 23934 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.009156 23869 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:01.998750 23952 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.017069 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:02.018687 23891 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:02.043751 23922 raft_consensus.cc:697] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.021224 23862 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:16:02.075292 22901 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.075932 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:02.083304 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:02.087636 22826 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 4: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:02.097503 23660 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:02.081899 23891 raft_consensus.cc:3055] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.103767 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:02.110926 23672 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:02.113956 22897 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:02.103389 23967 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:16:02.100381 23891 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:02.088260 23656 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
W20260709 12:16:02.124354 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.120302 23660 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 3. Current term is 4. Ops: []
W20260709 12:16:02.126559 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47887.9us
I20260709 12:16:02.118866 23685 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:02.137917 22893 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:02.151392 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 128742us
I20260709 12:16:02.100930 23935 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.157308 22897 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:02.119398 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:02.130419 23674 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:02.159485 22573 catalog_manager.cc:5697] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 1 to 2, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 2 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.167626 23869 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.019351 23955 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.169893 23695 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.170324 22894 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:02.171439 22898 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:02.172134 23672 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:02.172643 22821 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:02.173933 22900 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.174427 23935 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:02.152400 22818 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:02.175261 23934 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:02.139180 23862 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.180968 22827 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.189965 23891 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.190438 22822 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.197525 23928 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.204177 23695 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:02.251760 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 120690us
I20260709 12:16:02.248643 23862 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.268599 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.237839 23954 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:16:02.270258 22750 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.272130 22750 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.272527 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:02.180158 23922 consensus_queue.cc:237] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.272738 23869 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.280939 22750 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.271463 23891 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.282897 22750 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.274535 23959 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:16:02.287273 23928 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:02.291076 23941 raft_consensus.cc:3055] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.291620 23941 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.285243 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.293926 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:02.295883 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.277933 23939 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:16:02.281399 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:02.305778 23672 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.300859 23862 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.320446 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:02.300551 23936 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.313609 23977 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.299567 23978 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:02.282559 23910 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.323418 23959 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:02.329126 23959 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:02.329523 23959 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.328467 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.332321 22899 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:02.332592 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:02.337368 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:02.340039 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.340297 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.341519 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:02.301563 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.328179 23977 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.338373 23935 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:02.331868 23980 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.347904 23659 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:02.345747 23934 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.349359 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.361229 23916 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:02.342845 23914 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:02.362857 23929 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.363188 23914 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.363379 23929 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.346160 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.299086 23941 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.332074 23975 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.330754 23978 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:02.336834 23862 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.355533 23689 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.356696 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.357421 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.351754 23936 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.358017 22895 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.351042 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.358505 23977 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.342547 23939 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.359203 23910 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:02.360344 23949 raft_consensus.cc:3055] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.360841 23987 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:02.360354 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 58977.7us
W20260709 12:16:02.370812 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45859.5us
I20260709 12:16:02.375835 22750 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:02.367774 23978 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.385771 23493 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:02.387385 23929 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:02.388192 23916 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:02.388892 23968 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.389441 23968 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:02.380743 23930 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.391278 23958 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.391633 23930 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:02.391752 23958 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:02.392369 22896 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.392658 23958 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.393895 23958 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.383217 23949 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.395292 23975 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:02.395995 23975 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.396446 23914 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:02.398444 23975 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:02.393728 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:02.422613 23959 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.424706 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.425563 23672 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:02.400544 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:02.436197 23974 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.242s	user 0.000s	sys 0.004s
I20260709 12:16:02.401724 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:02.402225 23981 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 12:16:02.386441 23977 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.403443 23949 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.390576 23968 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.417411 23952 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:02.395332 23987 consensus_queue.cc:1243] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:16:02.447780 23949 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.448284 22747 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.448833 22747 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.449862 22747 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.451521 23968 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.452392 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:02.453434 22746 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:02.443048 23925 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:02.456236 23674 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.456368 23925 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.456931 22818 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.456449 23659 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.440491 23995 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:02.441385 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.441761 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.444706 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.446094 22744 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:02.465180 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.437877 23914 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:02.442087 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.472208 22827 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.455593 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.474246 22823 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.475422 22825 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.476438 23891 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:02.461580 22747 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.480388 22822 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:02.439924 23916 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:02.484649 23916 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:02.488981 22865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.012s	sys 0.012s
I20260709 12:16:02.463606 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:02.492899 22865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.014s	sys 0.013s
W20260709 12:16:02.493462 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 553863us
I20260709 12:16:02.445688 23982 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:16:02.468060 22826 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.466135 23862 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:16:02.425750 23959 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:02.457718 23925 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:02.499773 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 158326us
I20260709 12:16:02.497997 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:02.500789 23929 consensus_queue.cc:1059] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:16:02.502413 23987 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.500680 23951 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:16:02.503094 23929 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.503090 23987 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.503656 23929 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:02.503434 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:02.504045 23982 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.499330 23920 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:16:02.504666 23982 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.505823 23982 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.507314 23951 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:02.507763 23951 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:02.508592 23951 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.507334 23982 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:02.510267 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.504839 23987 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.512431 23987 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.443264 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.513963 23973 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.514427 23914 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:02.514602 23973 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.515120 23914 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:02.516270 23914 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.510154 23951 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:02.518517 23970 raft_consensus.cc:993] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: : Instructing follower a89a4b420ea9496aab55475fc38bb6f7 to start an election
I20260709 12:16:02.519071 23970 raft_consensus.cc:1081] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Signalling peer a89a4b420ea9496aab55475fc38bb6f7 to start an election
I20260709 12:16:02.521071 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:02.523031 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.531558 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.532061 22865 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.534148 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.509810 23936 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:02.535852 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.536593 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.523574 23911 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:02.537667 23910 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.537577 23939 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.535071 23935 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:16:02.538444 23911 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:02.547091 23911 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:02.548139 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.550091 22818 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:02.551174 23969 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.551707 23969 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:02.552361 23959 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:02.553169 22572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57362 (request call id 51) took 1355 ms. Trace:
I20260709 12:16:02.555342 23926 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:02.524138 23891 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:02.538312 23934 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.504673 23929 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.547729 23978 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.546772 23928 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.540993 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.557446 23891 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:02.561743 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 124490us
I20260709 12:16:02.568595 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.534376 23958 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:02.579797 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:02.535456 23952 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:02.557730 23955 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.586503 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:02.586369 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:02.539430 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 113323us
I20260709 12:16:02.575613 23891 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.569159 23910 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.596925 22574 catalog_manager.cc:5697] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.599288 23659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:45644
I20260709 12:16:02.599565 23928 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:02.599931 23935 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.600714 23949 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:02.590883 23980 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:16:02.617759 23928 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:02.618647 23980 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.619201 23980 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:02.618898 23928 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.617081 22747 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.621055 23935 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.623669 23935 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:02.590804 23926 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:16:02.604278 23972 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:02.605350 23868 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:02.586733 23933 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:02.572340 23862 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:16:02.624825 23949 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.635767 23949 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.636763 23862 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.637285 23862 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.639214 23926 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.639691 23926 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:02.609071 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.586431 23920 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.615083 23990 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:16:02.617249 23941 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.615238 23954 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:16:02.632666 23922 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:02.634907 23985 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:02.615797 23986 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:02.653396 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44397.8us
I20260709 12:16:02.657442 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.620249 23980 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.627844 23659 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:02.553628 22572 rpcz_store.cc:276] 0709 12:16:01.198063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:01.198255 (+   192us) service_pool.cc:224] Handling call
0709 12:16:02.553067 (+1354812us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:01.500432 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:01.636424 (+135992us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:01.636485 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:16:01.636526 (+    41us) tablet.cc:662] Decoding operations
0709 12:16:01.637006 (+   480us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:01.637131 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:01.637166 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:16:01.637488 (+   322us) tablet.cc:701] Row locks acquired
0709 12:16:01.637543 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:16:01.637745 (+   202us) write_op.cc:270] Start()
0709 12:16:01.637934 (+   189us) write_op.cc:276] Timestamp: P: 1783599361637664 usec, L: 0
0709 12:16:01.637971 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:16:01.665190 (+ 27219us) log.cc:844] Serialized 543 byte log entry
0709 12:16:02.165494 (+500304us) op_driver.cc:464] REPLICATION: finished
0709 12:16:02.348469 (+182975us) write_op.cc:301] APPLY: starting
0709 12:16:02.348587 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:02.348699 (+   112us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:02.348825 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:02.349146 (+   321us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:02.349476 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:16:02.349535 (+    59us) write_op.cc:312] APPLY: finished
0709 12:16:02.349820 (+   285us) log.cc:844] Serialized 22 byte log entry
0709 12:16:02.350033 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:02.350105 (+    72us) write_op.cc:454] Released schema lock
0709 12:16:02.350191 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:02.350594 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:02.350620 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":165092,"apply.run_cpu_time_us":2143,"apply.run_wall_time_us":5110,"num_ops":1,"prepare.queue_time_us":173990,"prepare.run_cpu_time_us":24110,"prepare.run_wall_time_us":328744,"raft.queue_time_us":270254,"raft.run_cpu_time_us":65322,"raft.run_wall_time_us":177270,"replication_time_us":527346,"thread_start_us":649362,"threads_started":4,"wal-append.queue_time_us":167372}]]}
I20260709 12:16:02.664414 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:02.671928 22899 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:02.668541 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:02.674176 22900 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:02.675557 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:02.678143 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:02.678158 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:02.679245 22899 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:02.641515 23973 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:02.683012 22900 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:02.655993 23935 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:02.655814 23972 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:02.631603 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.688687 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.675416 23939 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:02.675655 23659 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.710181 23939 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:02.637136 23949 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.640690 23926 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.711163 23939 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.713534 23949 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.717646 23891 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.680910 23862 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.723489 23862 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:02.724040 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:02.699467 23979 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:16:02.698937 23966 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:02.701207 23989 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.701749 23972 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.687873 23935 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:02.689519 23959 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 12:16:02.734396 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 147986us
I20260709 12:16:02.707686 23969 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.709527 23960 raft_consensus.cc:3055] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:16:02.719703 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 106324us
I20260709 12:16:02.721752 23980 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.722283 23926 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.653582 23920 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.728142 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.760349 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:02.675544 23952 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:02.705693 22896 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:02.739781 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:02.719722 23997 raft_consensus.cc:2764] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Leader election decision vote started in defunct term 2: won
I20260709 12:16:02.760777 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:02.735050 23978 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:02.774693 22823 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:02.776614 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:02.767161 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.777448 23996 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.778992 24001 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:02.779534 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:02.779297 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:02.775840 23934 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:16:02.781193 23952 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.742121 23935 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.816309 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:02.816879 23935 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:02.817283 22898 raft_consensus.cc:2393] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:02.818305 23987 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.785405 23869 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.818737 23987 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.818981 23869 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.819380 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:02.819725 23987 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.820075 23869 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.820959 23987 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.821266 23869 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.810030 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:02.823952 22747 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.785657 23920 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:02.779311 22827 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:02.782349 22894 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.736227 23989 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.787997 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:02.831894 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 43934.9us
I20260709 12:16:02.832827 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:02.832901 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.746364 23959 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.796005 23968 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.793779 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:02.797119 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:02.747504 23891 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:02.798545 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:02.841435 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:02.843289 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:02.805385 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:02.805864 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:02.751716 23966 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:02.755853 23960 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.786712 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:02.809722 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:02.809753 23969 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.811781 22896 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:02.825831 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.750543 23986 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:16:02.793566 23955 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:02.835213 22899 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.825263 22574 catalog_manager.cc:5697] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 2 to 3, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.849229 23989 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:02.850404 24002 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.154s	user 0.000s	sys 0.002s
I20260709 12:16:02.851027 23925 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:02.844871 23934 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.828435 23951 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.895800 23971 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:16:02.896286 23951 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.898774 23951 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:02.836666 23970 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:02.794237 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.838559 23920 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:02.858873 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:02.905237 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46483.9us
I20260709 12:16:02.827108 24001 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:02.869987 23941 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 12:16:02.876551 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.835377 23959 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:02.907307 23966 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.910526 23959 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.912755 23959 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.913417 24001 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.914281 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:02.915262 22895 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:02.909168 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:02.916563 23960 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.919535 23960 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:02.920172 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 145315us
I20260709 12:16:02.921165 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:02.922107 23914 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:02.922737 23914 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:02.885923 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:02.886579 23955 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:02.854764 23929 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.922828 23941 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.895551 23984 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:02.932514 23958 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:02.933881 23659 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:02.935284 23914 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:02.926535 23955 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.939117 23934 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:02.921834 22572 catalog_manager.cc:5697] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.932225 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:02.941676 23659 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:02.942181 23689 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:02.934212 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:02.939188 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:02.943434 22746 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:02.945139 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:02.946311 23926 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:02.947217 23978 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:02.928107 23916 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:02.948887 23916 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:02.888226 23922 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:16:02.950106 23916 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:02.951447 22864 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:02.951798 23922 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.952256 23922 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.952886 23973 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:02.953465 23973 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:02.953980 23973 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:02.953222 23922 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:02.930652 23941 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:02.941054 23934 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:02.974529 22572 catalog_manager.cc:5697] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.927259 23986 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:02.957551 23862 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:02.963431 23922 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.967103 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:02.964582 23989 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.949851 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:02.977543 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.000705 22824 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:02.978314 22822 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:02.922878 23695 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:03.001157 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51588.2us
I20260709 12:16:02.931146 23939 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:03.007310 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:03.021839 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 174626us
I20260709 12:16:03.022604 22822 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:03.005818 23926 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:03.023738 23862 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:03.024895 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:03.006165 23986 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:03.027235 23986 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:03.032058 23979 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:03.023406 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:03.032793 23979 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:03.033553 23979 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:03.033669 23977 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.994462 23936 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:16:03.034330 23977 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:03.035415 23993 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:03.035800 23993 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:03.036769 23993 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:03.043787 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:03.050316 23993 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:03.006812 23997 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:03.057227 23995 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:03.064122 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:03.083959 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:03.087248 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:03.067946 23929 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:03.103303 23689 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:03.005146 23941 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:03.090966 22865 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:03.086107 22748 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:03.129626 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:03.130609 23911 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:03.131165 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:03.092646 23928 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:03.063133 23977 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:03.090713 23952 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:16:03.159611 24003 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:03.160449 24008 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:03.155771 23930 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:03.085475 24001 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:03.163583 22753 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:03.176636 23955 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:03.176868 24025 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:03.092728 23987 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:16:03.158602 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:03.197619 24001 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:03.152959 23929 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:03.120769 23925 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:16:03.209327 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:03.155920 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 55847.5us
I20260709 12:16:03.178974 23941 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:03.213593 22821 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:16:03.214449 22753 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:03.130641 24022 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 12:16:03.212790 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 54345us
I20260709 12:16:03.202739 23997 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:03.223592 22900 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:03.290088 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:03.225823 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:03.218145 23972 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:03.238510 23955 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:03.241449 22897 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:03.292660 22745 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:03.293602 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:03.293896 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:03.294966 23955 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:03.295481 23955 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:03.242312 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:03.243036 24022 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:03.248525 22901 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:03.296887 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:03.250209 22893 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:03.254683 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:03.298943 23977 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:03.307340 22819 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:03.307466 22818 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 2: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:03.308637 22894 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:03.309178 22818 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:03.309779 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:03.296270 23914 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:03.311105 23997 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:03.311527 23914 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:03.311766 23682 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:03.313652 23914 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:03.207973 23995 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:03.180984 23979 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:03.315711 23995 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:03.316745 23979 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:03.256651 24017 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:16:03.319425 22898 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:03.319171 22573 catalog_manager.cc:5697] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 3, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:03.321076 22573 catalog_manager.cc:5697] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 1 to 3, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:03.261649 23493 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:03.261758 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:03.267246 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:03.268486 22823 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:03.271265 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.271715 23973 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:03.273733 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:03.299238 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:03.305323 23679 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:03.306535 24003 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:03.339715 22897 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:03.322655 22573 catalog_manager.cc:5697] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 1 to 2, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:03.354463 22826 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:16:03.355186 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 56029.9us
W20260709 12:16:03.364413 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 102897us
I20260709 12:16:03.359269 22573 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 1 to 2, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:03.367522 22573 catalog_manager.cc:5697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 3, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:03.372712 22893 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:03.373526 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.373791 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.375226 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.297255 23911 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.374264 22826 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:03.378044 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:03.380564 22820 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:03.307535 22748 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:03.378736 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:03.391726 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.392619 22826 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:03.369220 23941 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.364629 23951 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:03.357221 24003 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:03.377281 24010 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.379182 23931 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:16:03.415844 22827 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:03.451085 24026 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:03.401027 23949 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.403858 23926 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:03.379077 23960 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:16:03.382892 23979 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:16:03.465253 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:03.473589 23960 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:03.474087 23960 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:03.402253 23987 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:16:03.475029 23952 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.475807 23952 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:03.446347 23955 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:03.480480 24008 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:16:03.478209 23952 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:03.483140 23679 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:03.484551 23689 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:03.389706 23911 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:03.486894 23911 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:03.487600 23969 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:03.487725 24003 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:03.489108 24003 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:03.467444 24026 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:03.491794 24026 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:03.495920 23973 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:03.459952 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:03.498862 23949 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:03.475065 23960 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:03.502596 23916 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:03.503331 23916 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:03.505726 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:03.393002 23982 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:16:03.507213 23982 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:03.507643 23982 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:03.508653 23982 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:03.511335 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:03.511873 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.512843 22823 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:03.514554 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.515782 22825 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:03.517134 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.522588 22898 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:03.405350 23941 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:03.526640 22893 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:03.528729 22747 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
W20260709 12:16:03.530378 24027 log.cc:927] Time spent T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.078s	user 0.004s	sys 0.000s
I20260709 12:16:03.531503 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:03.534516 22748 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:03.548678 24029 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:16:03.552191 23930 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.552734 23980 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:03.552943 23930 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:03.465435 23934 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:16:03.554375 23959 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:03.534047 23986 consensus_queue.cc:1175] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:16:03.566195 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:03.568116 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 192677us
I20260709 12:16:03.577098 22900 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:03.597293 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:03.581712 22824 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:03.585083 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:03.567909 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.598912 22823 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:03.594321 22822 raft_consensus.cc:2376] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2. Re-sending same reply.
W20260709 12:16:03.469308 24018 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.302s	user 0.005s	sys 0.005s
I20260709 12:16:03.619153 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:03.623128 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 117437us
I20260709 12:16:03.625064 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.619115 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:03.626401 22823 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:03.608986 22893 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:03.610855 23973 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:16:03.622371 23960 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:03.609956 23982 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:03.656323 22826 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:03.666599 23660 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:03.671528 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:03.672916 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:03.674211 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:03.637271 23941 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:03.460992 24010 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:03.705111 24033 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:03.657912 23997 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:03.709257 23951 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.720065 23916 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:03.720631 23910 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:03.650643 22892 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:03.658337 23993 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
W20260709 12:16:03.743201 24016 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.004s
I20260709 12:16:03.732383 23914 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:03.657274 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:03.885833 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:03.743453 23910 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:03.906842 23936 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.910686 23960 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.740967 23931 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.988402 23931 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:03.991856 23914 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:03.993121 23914 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:03.996366 22744 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:03.996140 23936 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:03.999246 23969 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.000284 23969 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:04.000397 23910 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:04.002074 22818 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:04.003603 23973 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:04.005345 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 359866us
I20260709 12:16:04.007092 23928 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:04.010703 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.911937 23941 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:03.990097 22572 catalog_manager.cc:5697] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 2, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 2 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.012377 23941 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:03.626957 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:04.015136 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.017916 23969 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:03.915331 23933 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.019425 23933 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:04.014029 22572 catalog_manager.cc:5697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 2 to 3, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.021797 24043 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:04.022351 23933 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:03.666599 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:03.783553 23987 raft_consensus.cc:3055] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:04.051227 23987 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:04.053009 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.053298 23987 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:04.034430 23926 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:04.034339 24008 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:16:03.734424 23997 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:03.648851 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:03.750730 22895 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:03.780582 23930 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:03.743347 23951 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:03.750008 24028 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.003s
I20260709 12:16:03.788419 24010 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:03.944882 22573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57362 (request call id 52) took 1007 ms. Trace:
I20260709 12:16:03.953073 23971 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.110883 23674 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:04.111655 23971 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:04.118886 23656 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:03.975787 23659 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.098899 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:03.986979 24001 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.788810 23949 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:04.023990 23993 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:04.023833 22572 catalog_manager.cc:5697] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 2 to 3, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.130986 23936 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:04.028193 22893 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.029726 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:04.029578 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:04.030900 23685 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.031903 23960 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:04.002243 23910 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.049672 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:04.004784 23973 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:04.002385 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:04.055138 23931 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:04.054754 23987 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:03.974200 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:04.059348 23997 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.131263 22900 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:04.066118 23989 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:04.055500 23926 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:04.122920 23969 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.026880 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.151751 23979 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.153371 23984 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.165072 23966 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:04.166244 24001 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:04.169566 23914 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:04.133147 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:04.212098 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 53269.9us
W20260709 12:16:04.190914 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 603177us
W20260709 12:16:04.213210 22748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.006s	sys 0.036s
W20260709 12:16:04.213855 22748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.006s	sys 0.036s
I20260709 12:16:04.176128 22574 catalog_manager.cc:5697] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:04.218194 22574 catalog_manager.cc:5697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:04.219774 22826 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:04.220096 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:04.220568 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.221079 22827 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:04.220695 22574 catalog_manager.cc:5697] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 2, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 2 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:04.221918 23682 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:04.224717 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:04.226955 23966 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:04.230005 24044 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.230656 24044 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:04.233229 24044 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:04.234732 24043 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.234561 23984 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:04.235643 24043 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:04.235755 23997 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:04.237056 23679 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:04.238188 23997 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:04.238277 24043 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:04.239171 23971 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:04.222654 22574 catalog_manager.cc:5697] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 3 to 4, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 4 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:16:04.240208 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.242034 24001 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:04.242867 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:04.244499 23951 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:04.245142 23989 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:04.177450 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:04.248777 23960 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:04.249312 23936 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:16:04.189662 22896 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:04.304986 23951 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.305466 24043 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:04.306133 23951 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:04.308133 22750 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:04.308739 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.311264 23933 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.312129 23933 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:04.312672 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:04.249594 22819 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:04.315104 23933 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:04.316956 23989 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:04.317274 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:04.317911 23949 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:04.318931 23949 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:04.250871 22825 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:04.237784 23984 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:04.322255 23949 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:04.255673 23973 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:04.262260 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.263579 23969 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:04.264283 23920 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.110210 22573 rpcz_store.cc:276] 0709 12:16:02.937086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:02.937999 (+   913us) service_pool.cc:224] Handling call
0709 12:16:03.944462 (+1006463us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:03.406716 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:03.479034 (+ 72318us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:03.479073 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:16:03.479087 (+    14us) tablet.cc:662] Decoding operations
0709 12:16:03.479852 (+   765us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:03.479913 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:03.479953 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:16:03.480538 (+   585us) tablet.cc:701] Row locks acquired
0709 12:16:03.480555 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:16:03.480719 (+   164us) write_op.cc:270] Start()
0709 12:16:03.480834 (+   115us) write_op.cc:276] Timestamp: P: 1783599363480671 usec, L: 0
0709 12:16:03.480858 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:16:03.481583 (+   725us) log.cc:844] Serialized 2108 byte log entry
0709 12:16:03.484973 (+  3390us) op_driver.cc:464] REPLICATION: finished
0709 12:16:03.485448 (+   475us) write_op.cc:301] APPLY: starting
0709 12:16:03.485544 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:03.485732 (+   188us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:03.485830 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:03.486535 (+   705us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:03.486724 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:16:03.486771 (+    47us) write_op.cc:312] APPLY: finished
0709 12:16:03.489090 (+  2319us) log.cc:844] Serialized 46 byte log entry
0709 12:16:03.489281 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:03.489392 (+   111us) write_op.cc:454] Released schema lock
0709 12:16:03.489436 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:03.489809 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:03.489836 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":97951,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":241,"apply.run_cpu_time_us":2311,"apply.run_wall_time_us":4328,"num_ops":5,"prepare.queue_time_us":2532,"prepare.run_cpu_time_us":3891,"prepare.run_wall_time_us":78385,"replication_time_us":3987}]]}
I20260709 12:16:04.188890 23941 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:04.249361 22820 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.867s	user 0.015s	sys 0.012s
I20260709 12:16:04.189436 22818 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
W20260709 12:16:04.285096 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:04.287236 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:04.287880 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 198091us
I20260709 12:16:04.288313 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:04.289765 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 287852us
I20260709 12:16:04.291251 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:04.291203 23659 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:04.293771 23926 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:04.427382 23926 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:04.427923 23926 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.428398 23926 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.431018 23941 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.431932 23941 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:04.295087 23960 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.435933 23960 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:04.296854 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:04.298058 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:04.440346 22751 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:04.299528 23929 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:04.254662 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.287365 22897 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:04.323926 22827 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:16:04.308156 23925 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:04.339457 23951 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:04.421836 22820 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:04.282758 23674 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
W20260709 12:16:04.425583 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 159031us
I20260709 12:16:04.340281 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:04.426452 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 369) took 1065 ms. Trace:
I20260709 12:16:04.250365 23979 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:04.314545 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:04.345461 23984 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.440989 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:04.497943 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:04.502286 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:04.503681 23989 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:04.504357 23989 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.505160 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 847) took 1116 ms. Trace:
W20260709 12:16:04.505913 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 56816.1us
I20260709 12:16:04.482108 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:04.447822 22748 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:04.446585 23925 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:04.510011 22820 rpcz_store.cc:276] 0709 12:16:03.377711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:03.377816 (+   105us) service_pool.cc:224] Handling call
0709 12:16:04.476981 (+1099165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:04.524518 22822 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:04.469726 22821 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:04.497094 24001 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:04.508651 23931 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.515935 23989 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.548841 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.550004 23660 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:04.552066 23979 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:04.552896 24026 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:16:04.553340 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:04.554463 22896 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:16:04.548907 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:04.555423 23931 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:04.556728 23966 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:04.559729 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:04.560163 24001 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:04.557946 23931 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:04.562026 23941 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:04.541692 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:04.566390 23914 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:04.567173 22746 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:04.568218 23891 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:04.541671 23951 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:04.568634 23656 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:04.566672 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:04.539918 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.470069 23659 rpcz_store.cc:276] 0709 12:16:03.360962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:03.368894 (+  7932us) service_pool.cc:224] Handling call
0709 12:16:03.767511 (+398617us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b58002c3a98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:04.426305 (+658794us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17708928}
I20260709 12:16:04.568750 23891 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.582662 22864 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:04.582767 23891 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:04.574348 23997 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:04.585034 23997 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:04.544492 23926 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:04.587015 23928 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:04.587576 23928 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.588171 23928 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.588598 23926 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:04.536167 23984 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:04.592031 23984 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:04.587494 23997 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:04.540642 22745 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:04.536968 23960 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:04.594623 24001 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:04.579030 23969 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:04.593284 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 116204us
I20260709 12:16:04.582263 23672 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:16:04.598536 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 50795.1us
I20260709 12:16:04.470582 23920 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:04.603421 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:04.610137 22752 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:04.603122 23914 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:04.625068 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:04.610209 23979 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.622017 23951 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:04.671072 24010 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:04.671768 24010 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.672223 24010 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.613231 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:04.692549 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 79468.6us
I20260709 12:16:04.695101 23914 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:04.697968 23920 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:04.699901 23925 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:04.701506 23925 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:04.710386 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:04.713393 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 107848us
W20260709 12:16:04.716208 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 234199us
I20260709 12:16:04.666535 23949 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.707324 23951 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.638908 24026 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:16:04.732738 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:04.727882 23951 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.718262 23979 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:04.747771 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:04.745965 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:04.752513 22893 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.752745 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:04.763294 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:04.764401 22892 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:04.754662 23997 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:04.739323 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:04.739672 23949 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:04.775169 23997 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:04.777326 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:04.779354 23997 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:04.745990 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:04.779448 23960 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:04.791924 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:04.804042 22752 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:04.798906 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.804751 23933 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:04.805253 23960 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.796672 23929 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:16:04.797035 24071 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:04.806210 23928 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:04.790170 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 150680us
I20260709 12:16:04.813622 23949 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:04.815946 23979 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:04.816758 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.800900 23966 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.787863 23920 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:16:04.846357 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:04.906397 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:04.971336 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 243961us
I20260709 12:16:04.986466 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:05.042122 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 238130us
I20260709 12:16:05.043520 24010 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:04.930390 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:04.967993 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:04.990048 23951 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:04.834601 23960 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:04.966715 23891 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:04.975653 23984 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:04.939621 23980 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.968075 23679 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:04.996371 23931 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:04.848824 24071 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:04.942329 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.001781 23933 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:04.890071 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 89155.6us
I20260709 12:16:04.984664 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:04.992493 23997 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:04.999676 23928 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.003094 24072 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:04.847450 23989 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:04.940802 24076 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:04.973345 24026 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:04.973886 24001 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.067252 24001 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.069716 24001 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:05.000675 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.040961 24077 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:05.038532 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.050025 23949 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:05.050583 23980 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.090317 23980 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.047793 22893 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:05.059976 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.091969 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.063238 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.092687 24026 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:05.064779 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.065474 24076 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:05.094067 24077 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:05.095745 24076 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.063949 23674 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:05.035887 23925 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:05.096992 23925 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.097198 24077 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.051592 24071 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.051311 23951 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.071790 23973 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.072747 23891 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.099116 23925 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:05.070958 23933 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:05.074304 23997 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:05.075398 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.076216 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:05.100984 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:05.101290 23933 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.101632 22750 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.101861 23933 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.789991 24043 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:05.103125 24043 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:05.104212 24043 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.075475 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:05.111023 22749 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.077908 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.079135 24010 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.078500 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.082410 23931 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:05.084614 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46202.2us
W20260709 12:16:05.085994 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.092960 22752 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:05.093578 24026 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:05.098666 23973 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.076833 22748 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.139052 22750 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:05.128742 23949 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:05.139261 23660 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:05.102319 23933 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:05.142885 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 110317us
W20260709 12:16:05.151612 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.151510 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.153110 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:05.113986 23979 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:05.157970 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.058706 23984 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.054442 23966 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.160640 22893 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:05.142911 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.143673 24026 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.163499 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:05.165088 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.166715 23933 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:05.166620 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.167606 23925 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:05.168095 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.169672 23689 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:05.169718 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.170499 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:05.170987 23973 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:05.150483 24010 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.163214 23979 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.170770 23949 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.206112 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.205835 24010 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.160815 23891 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:05.207003 23891 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:05.207444 23891 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.172217 23960 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.208086 22900 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:05.208317 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:05.208736 22747 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 3: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:05.209007 22897 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.209345 24010 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.209722 23960 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:05.172920 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.173554 23951 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.210762 23951 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.213213 24081 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:05.213383 23951 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:05.174151 24040 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.213936 24081 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:05.215044 24081 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:05.214155 24040 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:05.218451 24040 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.176393 23984 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:05.080341 24072 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.143121 22745 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:05.189337 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:05.199743 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.200614 22752 raft_consensus.cc:2368] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:05.201874 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.230885 22750 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:05.195454 23682 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:05.168262 23982 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.205101 22895 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:05.206341 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:05.188758 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.237627 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.239939 23997 raft_consensus.cc:2764] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:16:05.227175 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.247769 22864 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.292999 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:05.242013 23997 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:05.298346 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 50664.5us
I20260709 12:16:05.237834 23659 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.247432 23960 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:05.275725 24080 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:16:05.299823 22751 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:05.287448 24010 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.246145 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.280335 24085 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.320151 22749 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:05.319075 23493 leader_election.cc:400] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:05.320945 23493 leader_election.cc:403] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:05.320878 24085 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.303508 23928 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:05.279596 23936 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:05.322685 23928 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.323060 24077 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.279793 23980 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.237287 23925 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:05.295588 23971 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.241142 23982 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.312021 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:05.312811 23934 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:05.337133 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.337512 24085 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:05.337992 22827 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:16:05.338585 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.339252 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.339392 22901 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.339756 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.339967 22827 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:16:05.340530 22825 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.340852 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.339411 24086 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:05.341583 22822 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:05.341970 24086 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:05.343824 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.345008 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.344926 24086 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.345906 22818 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.310407 23989 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:05.347091 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.337244 23934 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.349515 23982 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:05.302284 23997 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:05.313927 24072 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:05.314977 24001 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.318929 23969 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:05.318971 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.323206 23928 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.324323 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.303907 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.323196 23936 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.313117 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.353343 22897 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:05.322372 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.320523 23966 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.330518 23980 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.245493 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.362597 22893 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.393560 22897 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:05.350633 23934 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.363886 22824 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:05.372968 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:05.370857 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:05.398420 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:05.323833 24010 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:05.347101 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 200318us
I20260709 12:16:05.351975 22748 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:05.364605 22896 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:05.360512 23931 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.393687 24044 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:05.400513 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.365789 22746 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:05.420254 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.419860 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.422606 23936 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:05.412217 24072 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:05.436178 24072 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:05.431984 23920 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:05.412101 23951 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:05.437098 23920 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.437315 23951 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.423406 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.439200 22901 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:05.424669 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.425233 22819 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.441954 23979 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:05.443104 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.443835 22900 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.444769 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.445765 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.446013 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.366078 23969 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.446969 22818 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.447119 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.447933 22749 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:05.448123 23920 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:05.446998 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.448829 23969 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.451015 24010 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.451176 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:05.397419 24001 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.426097 23934 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.420117 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.464717 22897 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:05.463649 23928 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.464986 24072 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.467058 23934 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.469895 23934 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.471087 22892 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:05.471181 23925 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.472698 24026 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:05.417682 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:05.420903 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.430920 22790 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:16:05.431217 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 66515.2us
I20260709 12:16:05.434108 22893 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.430855 22898 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:05.452844 22826 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:05.459017 24001 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:05.459707 24083 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:16:05.460285 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.460844 23980 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:05.409377 23891 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:05.462941 24070 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:16:05.476118 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58527.3us
I20260709 12:16:05.475162 23695 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.484948 22751 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
W20260709 12:16:05.485044 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 64228.6us
I20260709 12:16:05.484212 23934 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:05.487136 23928 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:05.487928 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:05.489547 23997 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.459018 23951 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:05.432641 24044 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:05.499038 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:05.499593 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.500310 24096 raft_consensus.cc:2764] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:16:05.503527 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.518186 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.518882 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.519157 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.518205 24085 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:05.519793 22900 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:05.520365 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.492856 23925 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:16:05.494161 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 63765.2us
I20260709 12:16:05.507691 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.500972 23934 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.508965 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.505949 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.520071 24085 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.525070 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.526129 23689 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:16:05.501631 24001 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:05.523783 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.528316 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:05.529058 23660 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:05.529423 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.544725 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.540463 22893 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.516856 23980 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.539263 24085 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.539376 23979 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:05.532019 23925 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.526650 22790 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:05.546978 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.558014 22900 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.534021 23934 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.556861 22864 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.560025 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:05.550622 23928 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:05.565708 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.533854 23936 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:16:05.545799 24090 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:05.593062 24090 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.594662 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.595544 24090 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:05.548142 23949 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:05.597203 23949 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.597666 23949 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.598011 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.551153 24092 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:05.554541 24026 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.583205 23989 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:05.587031 23959 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:05.579234 23971 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:05.595767 23695 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:05.580559 24010 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:05.580204 22790 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:05.603617 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:05.582062 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.605010 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.563678 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.553293 23960 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:05.563215 23926 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:05.561815 23925 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.553078 23979 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.544148 24001 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:05.620857 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:05.623536 24090 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.623904 23982 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:16:05.580858 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 127321us
W20260709 12:16:05.624336 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 60749us
I20260709 12:16:05.608388 24092 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.622138 23960 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.607126 23928 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:05.624240 23966 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:05.653517 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.554091 23980 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.625900 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.627971 23979 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.633287 23891 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.637755 24085 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.630151 24001 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.669198 24085 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:05.669580 24071 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.571s	user 0.000s	sys 0.015s
I20260709 12:16:05.641086 23910 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:05.641867 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:05.624707 23926 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:05.637832 23936 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:05.628166 23951 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:05.644544 23925 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.650951 24092 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.649237 23982 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.622452 24010 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.615768 23989 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.655771 23966 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.660265 23973 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:05.654264 23960 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.673738 23926 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.668027 23928 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:05.651604 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.671617 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:05.691105 22901 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.599772 24044 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.685094 23966 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.680807 23982 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.684633 23973 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.680060 23936 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.682106 24010 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.678960 23951 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:05.668350 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:05.686601 22752 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:05.680840 23933 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:05.709770 24077 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:05.723263 23933 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.709916 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.723791 23933 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.723996 24072 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:05.724084 23679 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:05.724730 24072 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.696419 23925 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:05.688217 23955 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:05.694706 23989 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:05.727133 24072 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.727365 23936 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.703261 23973 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:05.727854 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 59619.4us
I20260709 12:16:05.727988 24043 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:05.728883 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:05.732911 24090 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:05.689901 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:05.687083 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45401.1us
I20260709 12:16:05.736420 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:05.703775 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:05.701720 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.710289 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:05.674511 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 53761.5us
I20260709 12:16:05.739675 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:05.740065 23695 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.741673 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:05.670025 24071 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.746768 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.714257 23980 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:05.767011 24071 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.759765 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.768818 22750 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:05.722563 23951 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.729183 24043 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:05.730510 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:05.771920 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.772171 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.757066 24099 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.760095 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.775115 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:05.780216 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 43926.8us
I20260709 12:16:05.754480 23936 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:05.783603 22751 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:05.774253 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:05.756441 23959 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:05.785853 22750 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.790678 22899 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:05.796602 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.777134 23931 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:05.796221 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.795027 22901 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:05.764766 23982 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:05.803704 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:05.788187 23980 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.808341 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:05.809954 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 68382.8us
I20260709 12:16:05.810259 22824 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:05.787599 23936 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:05.798024 23925 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:05.808219 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.790512 23959 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.808125 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:05.817612 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:05.803288 23931 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.819449 23931 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.820091 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.820986 23679 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:05.812696 23984 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:05.815519 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.821998 23984 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:05.822559 23984 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.811400 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.824048 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.825266 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.797914 23955 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:05.826267 23955 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.816672 23959 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:05.817667 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 87269us
I20260709 12:16:05.815673 23936 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.820209 24081 raft_consensus.cc:2764] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:16:05.817777 24072 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:05.834167 24072 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:05.814082 24077 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.826767 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:05.836539 24103 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.815207 23925 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.837455 23925 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:05.838210 23659 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.527s	user 0.014s	sys 0.000s
I20260709 12:16:05.838629 23659 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:05.784838 24043 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:05.837249 24103 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.843387 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:05.812650 23689 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:05.836256 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.811780 24001 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.851377 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:05.836737 22819 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.862939 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:05.866544 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.866947 24001 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:05.869025 23960 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.872073 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:05.872207 23934 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.873034 24010 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.876933 22750 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:05.877905 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:05.874522 24103 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.887101 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:05.894629 24107 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:05.901607 24107 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.902115 24107 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.902258 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:05.910331 22572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 126) took 2572 ms. Trace:
I20260709 12:16:05.879997 23920 raft_consensus.cc:2764] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:16:05.887223 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:05.877187 23934 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.889873 24001 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:05.903156 22821 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.933709 22790 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:05.937566 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 117820us
I20260709 12:16:05.939112 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:05.888886 23989 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:16:05.946594 24108 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:05.950249 22819 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:05.952960 23973 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:05.930356 24001 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:05.933068 23966 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:05.954923 23982 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:05.910949 22572 rpcz_store.cc:276] 0709 12:16:03.376371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:03.385693 (+  9322us) service_pool.cc:224] Handling call
0709 12:16:05.900034 (+2514341us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:04.589701 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:04.590553 (+   852us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:04.590623 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:16:04.590646 (+    23us) tablet.cc:662] Decoding operations
0709 12:16:04.591369 (+   723us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:04.591466 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:04.591494 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:16:04.591968 (+   474us) tablet.cc:701] Row locks acquired
0709 12:16:04.592022 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:16:04.592205 (+   183us) write_op.cc:270] Start()
0709 12:16:04.592415 (+   210us) write_op.cc:276] Timestamp: P: 1783599364592140 usec, L: 0
0709 12:16:04.592452 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:16:04.593354 (+   902us) log.cc:844] Serialized 1325 byte log entry
0709 12:16:05.226317 (+632963us) op_driver.cc:464] REPLICATION: finished
0709 12:16:05.434966 (+208649us) write_op.cc:301] APPLY: starting
0709 12:16:05.462950 (+ 27984us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:05.463169 (+   219us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:05.463337 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:05.464120 (+   783us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:05.464681 (+   561us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:16:05.464767 (+    86us) write_op.cc:312] APPLY: finished
0709 12:16:05.465095 (+   328us) log.cc:844] Serialized 34 byte log entry
0709 12:16:05.465321 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:05.465454 (+   133us) write_op.cc:454] Released schema lock
0709 12:16:05.465533 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:05.466034 (+   501us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:05.466074 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":138300,"apply.run_cpu_time_us":3390,"apply.run_wall_time_us":48044,"num_ops":3,"prepare.queue_time_us":355410,"prepare.run_cpu_time_us":70158,"prepare.run_wall_time_us":148233,"raft.queue_time_us":386242,"raft.run_cpu_time_us":26055,"raft.run_wall_time_us":145488,"replication_time_us":596915,"thread_start_us":656681,"threads_started":4,"wal-append.queue_time_us":207580}]]}
I20260709 12:16:05.962105 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:05.976709 23695 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:05.986292 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:05.935465 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:05.934991 23891 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.957273 24043 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:05.935781 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 103563us
I20260709 12:16:06.017216 22790 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:05.983157 24001 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.963882 24010 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:06.022011 22573 catalog_manager.cc:5697] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 1 to 2, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 2 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:05.982475 23960 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:06.059156 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:05.984393 24076 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:06.034286 22573 catalog_manager.cc:5697] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 2 to 3, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 3 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:06.060012 22819 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.039024 22574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43994 (request call id 146) took 2022 ms. Trace:
I20260709 12:16:06.014950 24090 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:06.073522 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:06.080924 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:06.075474 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 136487us
I20260709 12:16:06.083328 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:06.016254 23934 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:06.109791 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:06.085325 22892 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:06.121505 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:06.122665 22750 raft_consensus.cc:2368] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:06.024305 23891 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:06.076751 24090 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.085748 23955 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:06.134956 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:06.067749 22574 rpcz_store.cc:276] 0709 12:16:04.005360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:04.014166 (+  8806us) service_pool.cc:224] Handling call
0709 12:16:06.027557 (+2013391us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:04.777661 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:04.928625 (+150964us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:04.930536 (+  1911us) write_op.cc:435] Acquired schema lock
0709 12:16:04.940100 (+  9564us) tablet.cc:662] Decoding operations
0709 12:16:05.001862 (+ 61762us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b5c0047068c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa971331 00007fadfa971221 00007fadfa96bf6c 00007fadf80c7370 00007fadf81c9e74 00007fadf81b50a6 00007fadf81b4d58 00007fadf81b99f1 00007fadf81b99a9 00007fadf81b9939 00007fadf81b9901
0709 12:16:05.036213 (+ 34351us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:05.037408 (+  1195us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:05.047122 (+  9714us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:16:05.177709 (+130587us) tablet.cc:701] Row locks acquired
0709 12:16:05.177755 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:16:05.200091 (+ 22336us) write_op.cc:270] Start()
0709 12:16:05.237308 (+ 37217us) write_op.cc:276] Timestamp: P: 1783599365197570 usec, L: 0
0709 12:16:05.239794 (+  2486us) op_driver.cc:348] REPLICATION: starting
0709 12:16:05.351596 (+111802us) log.cc:844] Serialized 1717 byte log entry
0709 12:16:05.588720 (+237124us) op_driver.cc:464] REPLICATION: finished
0709 12:16:05.592368 (+  3648us) write_op.cc:301] APPLY: starting
0709 12:16:05.592459 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:05.592630 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:05.592653 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:05.593285 (+   632us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:05.593470 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:16:05.593533 (+    63us) write_op.cc:312] APPLY: finished
0709 12:16:05.593789 (+   256us) log.cc:844] Serialized 40 byte log entry
0709 12:16:05.593953 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:05.594053 (+   100us) write_op.cc:454] Released schema lock
0709 12:16:05.594093 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:05.610600 (+ 16507us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b54007bb454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477ae28 00007fadf81b5581 00007fadf81b4d58 00007fadf81b99f1 00007fadf81b99a9 00007fadf81b9939 00007fadf81b9901 00007fadf81b8b2d 0000000000388634 0000000000388479
0709 12:16:05.625914 (+ 15314us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:05.628399 (+  2485us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":253775,"reported_tablets":5,"spinlock_wait_cycles":179456,"child_traces":[["op",{"apply.queue_time_us":295,"apply.run_cpu_time_us":2071,"apply.run_wall_time_us":2071,"num_ops":4,"prepare.queue_time_us":309486,"prepare.run_cpu_time_us":17578,"prepare.run_wall_time_us":840900,"replication_time_us":323268,"spinlock_wait_cycles":191003776}]]}
I20260709 12:16:06.112331 24071 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:06.146049 22750 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:06.120023 23960 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.083823 24076 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:06.156847 23493 leader_election.cc:400] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:06.157337 23493 leader_election.cc:403] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:16:06.159862 24115 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:06.160470 24115 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.160868 24115 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.164937 24040 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:06.165532 24040 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.165921 24040 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.133685 24072 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:06.167272 24116 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:06.167591 24072 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:06.167968 24116 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:06.168216 24072 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:06.169122 24116 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:06.172663 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:06.174455 24043 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.141374 24090 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.149829 22821 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:06.155427 23674 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:06.141181 23672 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:16:06.149155 24092 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:06.201519 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44941.5us
I20260709 12:16:06.109328 23949 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:06.209667 22819 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
W20260709 12:16:06.211700 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 294413us
I20260709 12:16:06.187510 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.182418 24107 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:06.187263 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:06.175635 23973 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:06.199934 23926 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:06.200680 23960 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:06.213539 24043 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:06.216717 23949 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:06.208838 23979 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
I20260709 12:16:06.225425 23695 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:06.179145 24071 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:06.188859 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:06.182211 24010 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.193166 23891 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:06.191373 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:06.210592 23997 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.303694 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:06.174705 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:06.189224 23933 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:06.319032 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:06.309779 22819 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:16:06.310241 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.311437 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:06.323318 23660 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.324182 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:06.325083 22820 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:06.307663 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 97273.8us
W20260709 12:16:06.304379 22717 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.544s (SENT) [suppressed 45 similar messages]
I20260709 12:16:06.211344 23936 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:06.300526 24092 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:06.338376 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:06.343333 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:06.354676 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:06.305073 23955 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:06.321973 23931 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.000s
I20260709 12:16:06.300185 23656 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:06.393766 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:06.394829 22751 raft_consensus.cc:2368] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3.
I20260709 12:16:06.315095 22749 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
W20260709 12:16:06.343515 23959 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.516s	user 0.014s	sys 0.001s
I20260709 12:16:06.357389 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:06.369659 22823 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:06.379187 22820 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
W20260709 12:16:06.403762 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 49201.6us
I20260709 12:16:06.383852 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:06.384874 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:06.405234 22822 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:06.334822 24109 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.302863 23979 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:06.303079 23984 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:06.399544 22824 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:06.379940 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:06.406406 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:06.411633 22826 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:06.411976 22819 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:06.315464 24010 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:06.405527 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:06.407195 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:06.416051 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:06.395962 22752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "2c3a0d56045540b7802937559599f09c"
 from {username='slave'} at 127.0.0.1:49294
I20260709 12:16:06.340042 23891 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:16:06.465647 22752 raft_consensus.cc:606] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Received request to transfer leadership to TS 2c3a0d56045540b7802937559599f09c
I20260709 12:16:06.466153 22752 raft_consensus.cc:614] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:06.450944 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:06.418936 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:06.474632 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 69168.2us
I20260709 12:16:06.485143 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:06.477701 22897 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.488780 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:06.453315 23984 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:06.449556 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:06.451366 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:06.460340 23936 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:06.456869 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:06.493024 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 93753.5us
I20260709 12:16:06.401899 23955 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:06.403008 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:06.400689 23931 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:06.450531 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:06.503140 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:06.483029 23910 raft_consensus.cc:2764] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:16:06.508373 22897 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:06.499958 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:06.474118 22744 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:06.573451 22897 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:16:06.512041 24127 log.cc:927] Time spent T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:16:06.512511 23933 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:06.578532 22899 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:16:06.563676 23925 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.004s
I20260709 12:16:06.407160 23959 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:06.512152 23951 consensus_meta.cc:287] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.719s	user 0.007s	sys 0.008s
I20260709 12:16:06.570120 23660 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:06.530169 22825 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:16:06.531296 24077 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.003s
W20260709 12:16:06.575439 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 50484.2us
I20260709 12:16:06.513803 23960 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:06.591477 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:06.592054 22901 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.579790 22898 raft_consensus.cc:2368] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3.
I20260709 12:16:06.525873 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.528772 24108 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.531615 22753 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.464905 24071 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:06.524075 24117 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:06.494414 24115 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:06.588677 22752 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:06.595633 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:06.595726 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:06.596330 22897 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.596935 22752 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:06.598299 22752 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.590627 22893 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:06.587704 23925 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:06.603241 24136 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:06.603824 24131 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:16:06.416826 24109 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:06.604663 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:06.588325 22746 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:06.610209 22897 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:06.603947 22748 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 3: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:06.618868 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:06.581583 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 407032us
I20260709 12:16:06.604456 24077 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.611667 24107 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:06.622255 24126 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.624061 22826 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:06.621402 24097 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:06.589531 24076 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:06.588330 23926 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:06.639740 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:06.603955 23925 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:06.622453 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:06.651923 23931 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:06.656344 23959 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:06.657536 24141 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:06.588251 23951 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:06.659155 24134 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:06.659696 24134 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:06.661230 24115 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:06.661568 24001 consensus_meta.cc:287] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.001s
I20260709 12:16:06.658174 24141 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:06.603961 24136 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:06.665254 24136 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:06.646504 23910 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:16:06.666217 24136 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:06.665277 23966 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:06.662091 24001 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:06.658232 22901 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:06.666411 24141 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:06.674342 24141 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:06.674542 24001 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:06.612944 24108 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:06.674976 24097 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:06.675302 24141 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:06.675988 24097 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:06.676970 24108 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:06.643980 23979 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:06.669200 22790 leader_election.cc:400] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3.
I20260709 12:16:06.659708 23955 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:06.673385 22819 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:06.666584 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:06.638274 24121 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:16:06.658412 24040 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:06.660997 23951 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:06.689136 22752 raft_consensus.cc:2368] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3.
I20260709 12:16:06.689419 22900 raft_consensus.cc:2410] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:06.678179 22790 leader_election.cc:403] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:16:06.711422 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:06.691890 23660 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:06.742875 23660 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:06.743247 22901 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:16:06.711477 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 407117us
W20260709 12:16:06.744602 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 259538us
I20260709 12:16:06.743659 23660 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:06.746474 23660 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.752403 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:06.755208 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 86239.4us
I20260709 12:16:06.755266 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:06.697446 23980 consensus_meta.cc:287] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.872s	user 0.007s	sys 0.007s
W20260709 12:16:06.697796 24099 consensus_meta.cc:287] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.906s	user 0.006s	sys 0.007s
I20260709 12:16:06.703486 22745 raft_consensus.cc:2410] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:16:06.698944 24090 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
I20260709 12:16:06.773742 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:06.724960 23997 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:06.680745 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.777959 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:06.698655 24040 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:06.680368 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.662036 24134 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:06.703318 24010 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:06.763487 24128 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:06.729909 24044 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:06.703332 23931 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.680908 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 954) took 1041 ms. Trace:
I20260709 12:16:06.700506 24109 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:06.677986 24141 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:06.792980 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:06.795054 23660 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:16:06.829609 23660 pending_rounds.cc:85] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 1
I20260709 12:16:06.699702 22753 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:06.787765 24099 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.817536 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:06.830381 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:06.830627 22820 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.765740 23979 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:06.820024 22824 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:06.777415 23980 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.775064 24115 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:06.698956 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:06.762977 24143 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:16:06.852576 24143 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:06.853000 24143 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:06.853508 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:06.853948 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 279) took 1108 ms. Trace:
I20260709 12:16:06.854260 22825 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.854395 22748 rpcz_store.cc:276] 0709 12:16:05.745844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.751390 (+  5546us) service_pool.cc:224] Handling call
0709 12:16:05.871864 (+120474us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:06.853694 (+981830us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b540043f654. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:06.853858 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702480384}
I20260709 12:16:06.856972 22818 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:06.858275 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:06.859071 22898 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.859808 24129 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.868371 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:06.868870 22898 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:06.869202 22821 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.822520 24044 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:06.876051 24044 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:06.876650 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.877557 24044 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.879418 23659 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.883003 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:06.884778 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:06.886482 23674 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:06.809293 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:06.898461 22897 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:06.797482 23925 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.831773 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:06.835381 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:06.833976 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:06.837626 23695 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:06.838485 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:06.832654 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:06.901412 22899 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.797559 24090 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:06.903601 22893 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:06.904147 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:06.904608 22790 leader_election.cc:400] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3.
I20260709 12:16:06.904984 22790 leader_election.cc:403] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:16:06.814196 23951 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.840699 22823 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:06.829864 23660 pending_rounds.cc:107] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:16:06.906742 23660 raft_consensus.cc:2889] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:06.821945 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:06.829355 23931 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:06.909931 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:06.910801 23969 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.911562 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.912416 23931 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:06.840422 23979 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:06.913208 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.796833 23984 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:16:06.853991 24143 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:06.838413 23960 raft_consensus.cc:2764] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:16:06.846602 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 147728us
I20260709 12:16:06.914078 24110 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:06.917435 22825 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:06.918087 24110 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:06.847357 24147 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.848750 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:06.919872 22819 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:06.919237 24110 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:06.838863 24109 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.920269 24072 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:06.920814 24109 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:06.914515 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:06.914549 22822 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:06.924228 24125 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:06.843631 22820 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:06.850597 24122 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3.
W20260709 12:16:06.887090 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.824980 22892 rpcz_store.cc:276] 0709 12:16:05.639153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.639508 (+   355us) service_pool.cc:224] Handling call
0709 12:16:05.843138 (+203630us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b58001e3398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:06.680669 (+837531us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54004b6ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:06.680802 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400344192}
I20260709 12:16:06.888134 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:06.894227 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:06.943926 23656 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:06.945096 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.946399 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.896225 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:06.958421 22750 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.958890 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:06.955545 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:06.961733 24147 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.964259 22897 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:06.964643 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:06.965381 22900 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:06.965505 23679 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:06.965505 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:06.967361 22897 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:06.955448 24109 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:06.896817 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:06.900766 22826 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:06.907994 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 72704.9us
I20260709 12:16:06.909060 24121 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:06.909606 23982 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:06.912616 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.914742 23979 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:06.970556 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.971473 22749 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:06.972581 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.972620 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:06.972922 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:06.939371 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.975056 23982 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:06.976528 24126 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:06.964125 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 869) took 1162 ms. Trace:
I20260709 12:16:06.978181 24129 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:06.977334 24126 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:06.974624 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:06.979176 24126 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.979596 24126 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.980858 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:06.977311 23982 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:06.982394 24121 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.983178 24121 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.915413 23925 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:06.915791 24143 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.986191 22900 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:06.829800 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:06.986622 24147 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:06.987115 24147 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:06.987486 24147 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:06.970858 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 74126.2us
I20260709 12:16:06.989986 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:06.991458 22895 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:06.992604 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:06.951618 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:06.951958 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:06.915125 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:06.995229 22745 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:06.989321 22752 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:06.921586 22821 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:06.957194 22751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:49294
I20260709 12:16:06.917309 24090 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:06.994489 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:07.000447 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:07.001972 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:06.953718 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:06.990013 24099 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:07.000665 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:07.007128 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:06.957593 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 125898us
I20260709 12:16:07.009128 22573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43984 (request call id 154) took 2309 ms. Trace:
I20260709 12:16:07.023408 22897 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:07.013955 22826 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:07.017309 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:07.019632 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:07.020037 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:07.034857 22901 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:07.021399 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:07.015770 22747 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:06.948611 22899 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:06.977919 22818 rpcz_store.cc:276] 0709 12:16:05.801515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.801645 (+   130us) service_pool.cc:224] Handling call
0709 12:16:06.963870 (+1162225us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540045c754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:06.964057 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2370600704}
I20260709 12:16:07.024199 22573 rpcz_store.cc:276] 0709 12:16:04.700121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:04.702968 (+  2847us) service_pool.cc:224] Handling call
0709 12:16:04.748152 (+ 45184us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b54007bb454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e9090 00007fadf4787f3a 00007fadfa53de9c 00007fadfa63c04e 00007fadf8afd2a4 00007fadf8afd232 00007fadf8afd161 00007fadf8afd0dc 00007fadf8afc392 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:07.009040 (+2260888us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:06.134961 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:06.176988 (+ 42027us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:06.177044 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:16:06.177055 (+    11us) tablet.cc:662] Decoding operations
0709 12:16:06.177541 (+   486us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:06.177614 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:06.177641 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:16:06.177997 (+   356us) tablet.cc:701] Row locks acquired
0709 12:16:06.178017 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:16:06.178184 (+   167us) write_op.cc:270] Start()
0709 12:16:06.178330 (+   146us) write_op.cc:276] Timestamp: P: 1783599366178130 usec, L: 0
0709 12:16:06.178351 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:16:06.193612 (+ 15261us) log.cc:844] Serialized 934 byte log entry
0709 12:16:06.723037 (+529425us) spinlock_profiling.cc:243] Waited 84.1 ms on lock 0x7b54007bb9a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e9090 00007fadf46f66b8 00007fadf46f62fa 00007fadf477a965 00007fadf477ae09 00007fadf81b5581 00007fadf81b4d58 00007fadf81b99f1 00007fadf81b99a9 00007fadf81b9939 00007fadf81b9901
0709 12:16:06.723475 (+   438us) op_driver.cc:464] REPLICATION: finished
0709 12:16:06.891822 (+168347us) write_op.cc:301] APPLY: starting
0709 12:16:06.891912 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:06.892072 (+   160us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:06.892100 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:06.892563 (+   463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:06.892747 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:16:06.892800 (+    53us) write_op.cc:312] APPLY: finished
0709 12:16:06.893001 (+   201us) log.cc:844] Serialized 28 byte log entry
0709 12:16:06.893172 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:06.893261 (+    89us) write_op.cc:454] Released schema lock
0709 12:16:06.893300 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:06.893626 (+   326us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:06.893655 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":357411,"reported_tablets":12,"spinlock_wait_cycles":55715072,"child_traces":[["op",{"apply.queue_time_us":168055,"apply.run_cpu_time_us":1793,"apply.run_wall_time_us":1794,"num_ops":2,"prepare.queue_time_us":12193,"prepare.run_cpu_time_us":10505,"prepare.run_wall_time_us":600695,"replication_time_us":544956,"spinlock_wait_cycles":193532672,"thread_start_us":83357,"threads_started":1}]]}
I20260709 12:16:07.023241 22750 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:07.016474 23969 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3.
I20260709 12:16:07.033139 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:06.992708 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:07.043581 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:07.044189 22790 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:07.051123 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 44109.8us
I20260709 12:16:07.051249 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:07.052167 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:07.053252 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:07.053805 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:07.056108 23925 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:07.052183 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:07.054983 24129 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:07.061110 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:07.063467 23969 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:07.065449 24081 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:07.066128 24081 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:07.066425 24129 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:07.064548 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:07.036701 24122 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:07.067193 24121 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:07.067680 23925 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:07.039575 24109 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:16:07.069182 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:07.031548 23672 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:07.073796 23925 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.070959 23933 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:07.074311 23925 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:07.074864 23933 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:07.075582 23925 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:07.076081 23933 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:07.079869 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:07.080969 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:07.083129 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:07.022521 24090 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:16:07.084664 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:07.086900 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:07.093555 22901 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:16:07.025755 24099 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:07.096787 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:07.071425 24092 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:07.102202 23660 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:07.079363 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:07.085429 24112 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.085224 23982 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.067323 24081 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:07.121093 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:07.090533 24121 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:07.112896 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:07.114405 22791 leader_election.cc:400] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3.
I20260709 12:16:07.118145 24099 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:07.119164 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:07.096068 24125 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:07.126955 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:07.085599 23960 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:16:07.131332 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:07.145187 22751 raft_consensus.cc:606] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:07.145810 22751 raft_consensus.cc:614] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:07.145859 24122 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:07.146608 24122 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:07.147902 22896 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:07.147771 24122 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:07.137514 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:07.068212 24117 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:16:07.146257 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:07.108008 24116 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.151252 22745 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:07.151500 24116 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:07.151726 24117 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:07.152268 24117 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:07.152648 24116 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:07.153298 24117 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:07.154989 23969 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:07.156031 24107 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:07.159430 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:07.125005 23682 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:07.160426 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:07.111521 24092 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:07.163604 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:07.128139 23494 connection.cc:256] RPC call timeout handler was delayed by -2.2876684559998921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 12:16:07.112049 23659 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:07.165560 24112 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:07.167379 23494 connection.cc:256] RPC call timeout handler was delayed by -1.9942684559998725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 12:16:07.170288 23494 connection.cc:256] RPC call timeout handler was delayed by -1.9159684559999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260709 12:16:07.128816 24157 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.131965 24141 raft_consensus.cc:476] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 12:16:07.164992 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:07.104081 24072 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:16:07.200199 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:07.161690 24125 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:07.131577 23982 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:07.166091 23910 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:16:07.216444 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:07.158461 24117 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.167065 24103 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:07.166477 23951 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:07.235862 24124 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:07.169414 23934 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:07.168358 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:07.199676 24157 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:07.201802 24010 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:07.252907 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:07.246414 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 75316.2us
W20260709 12:16:07.248742 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 80502.1us
I20260709 12:16:07.268339 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:07.197206 24147 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:07.288736 24160 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.087s	user 0.003s	sys 0.000s
I20260709 12:16:07.289738 22896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:07.254732 23934 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:07.291996 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:07.291862 23955 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:07.296941 24147 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:07.209517 23931 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:16:07.263087 24044 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:16:07.298177 23494 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:07.300369 24125 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:07.301271 23672 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:07.239904 23997 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:07.247830 23951 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:07.316052 22752 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:07.199072 24121 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:07.260464 24010 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:07.274883 22745 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:07.301271 23969 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:07.276829 24130 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:07.216409 22753 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:07.316758 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:07.326375 22896 raft_consensus.cc:606] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:07.351691 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 257711us
I20260709 12:16:07.323107 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 313) took 1434 ms. Trace:
I20260709 12:16:07.347236 24103 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:16:07.429916 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 131856us
I20260709 12:16:07.385439 24134 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.316838 23982 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:07.323132 24112 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:07.425411 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:07.277637 24092 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:07.425006 22896 raft_consensus.cc:614] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:07.430994 24116 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.460713 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:07.461548 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:07.462280 24166 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.440761 24130 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:07.446543 24134 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:07.377275 24010 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:07.485440 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:07.491763 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:07.385965 23969 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:07.494503 23494 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:07.492565 23689 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:07.443624 24076 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:16:07.374187 23997 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:07.429005 23659 rpcz_store.cc:276] 0709 12:16:05.888760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.892961 (+  4201us) service_pool.cc:224] Handling call
0709 12:16:07.312613 (+1419652us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54000221d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:07.320755 (+  8142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986338176}
I20260709 12:16:07.507143 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:07.571911 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 244636us
I20260709 12:16:07.576946 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:07.578277 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:07.475085 24148 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:16:07.443234 24157 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:07.502812 23969 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.504544 24097 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:16:07.519472 24143 consensus_meta.cc:287] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
I20260709 12:16:07.481271 24116 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:07.557947 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:07.523034 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:07.510979 24076 consensus_queue.cc:1243] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:16:07.594758 24148 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:07.594739 24090 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:07.596876 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:07.639783 24170 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:16:07.603291 24166 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:07.644429 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 163781us
W20260709 12:16:07.668227 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 184232us
I20260709 12:16:07.668905 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:07.669518 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 65091.6us
I20260709 12:16:07.670848 24076 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.684553 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:07.682163 22898 raft_consensus.cc:2410] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:07.686046 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:07.686195 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:07.686856 22901 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.687021 22892 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:16:07.689078 24126 consensus_meta.cc:287] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.709s	user 0.009s	sys 0.003s
I20260709 12:16:07.689512 24126 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:07.620759 24130 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:07.695541 24173 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:16:07.697012 23997 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:07.699168 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:07.661351 24148 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:07.643693 22746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:49294
W20260709 12:16:07.667011 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:07.703186 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:07.683660 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:07.718603 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:07.658448 24134 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:07.620708 24097 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:07.673136 24122 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:07.719420 22897 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:07.721405 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:07.716454 22901 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
W20260709 12:16:07.723132 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51543us
I20260709 12:16:07.724376 22893 raft_consensus.cc:2368] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4.
I20260709 12:16:07.735394 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:07.726362 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 57551.2us
I20260709 12:16:07.718127 22746 raft_consensus.cc:606] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:07.684427 24044 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:16:07.736075 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:07.745324 24164 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
I20260709 12:16:07.732046 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:07.718217 22821 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:07.729743 24183 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.750029 24040 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.752714 22746 raft_consensus.cc:614] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:07.737112 23997 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:16:07.776474 24126 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:07.776907 23984 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.779654 24184 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:07.783088 24188 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.783577 24172 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:07.783809 24188 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:07.788894 24116 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:07.789752 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:07.790602 22896 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:07.792178 24097 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:07.793187 24040 raft_consensus.cc:697] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:07.794562 24040 consensus_queue.cc:237] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:07.795650 24147 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:07.796339 24147 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:07.797452 24147 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:07.801429 24188 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:07.803289 24165 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:16:07.806870 23984 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:07.809952 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:07.812628 22717 leader_election.cc:400] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4.
I20260709 12:16:07.813220 22717 leader_election.cc:403] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:07.829754 24180 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:16:07.830214 24147 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:07.830859 23682 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.631s	user 0.014s	sys 0.000s
I20260709 12:16:07.831358 23682 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:07.831979 24099 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:07.832450 24099 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:07.832759 24076 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:07.833338 24099 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:07.836133 23969 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:07.838518 23969 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:07.840619 24180 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4.
I20260709 12:16:07.844702 24147 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:07.845355 24147 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:07.803370 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:07.782320 24010 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:07.846987 24147 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:07.857460 24147 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:07.858246 24010 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:07.811698 24183 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:07.863096 24183 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:07.778477 24166 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:07.867722 22747 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:07.811206 24148 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:07.827826 24157 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:16:07.853421 24171 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 12:16:07.892218 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 293696us
I20260709 12:16:07.866495 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:07.890170 24175 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:16:07.925194 22897 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:07.907292 24157 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:07.924782 23682 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:16:08.049705 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 237206us
W20260709 12:16:08.030049 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:08.051656 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 239210us
I20260709 12:16:08.026399 24185 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:08.026870 24117 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:08.064853 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:08.038959 24010 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.075177 24128 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:08.077395 24184 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:08.080791 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:08.083724 24194 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:16:08.088304 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:08.051708 23682 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:08.097673 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:08.109592 22901 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:08.092581 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:08.113745 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 342802us
I20260709 12:16:08.115411 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:08.096328 24184 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:08.096124 24128 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:08.124840 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:08.100015 24076 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.127969 24076 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:08.129123 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:08.131145 22823 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:08.131610 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.132453 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.132817 22822 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:08.133009 22824 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:16:08.133265 22826 raft_consensus.cc:2368] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:08.134318 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.134353 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:08.135659 22827 raft_consensus.cc:2368] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:08.138224 24076 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:08.140200 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.141340 22819 raft_consensus.cc:2368] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:08.068830 24185 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:08.110417 24134 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.114177 24180 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:08.099659 24117 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:08.099100 24010 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:08.154486 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:08.177803 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:08.146212 24044 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:16:08.154876 24112 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:08.171882 22748 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.680s	user 0.013s	sys 0.000s
I20260709 12:16:08.189236 22748 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:08.154953 24076 raft_consensus.cc:476] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 12:16:08.124801 24157 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:08.179539 24134 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:08.196131 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:08.163450 23997 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:08.179762 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:08.220794 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:08.232967 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 114124us
I20260709 12:16:08.206068 24040 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.221788 22818 raft_consensus.cc:2368] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:08.240972 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:08.212208 24134 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:08.235749 24112 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:08.241659 22896 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:16:08.256954 24199 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
I20260709 12:16:08.258373 24204 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:08.259196 24204 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:08.260396 24204 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:08.244024 24040 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:08.267684 24040 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:08.243023 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:08.246920 24168 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:08.251713 24148 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:08.294656 24148 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:08.295367 24201 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:16:08.295923 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:08.297276 24148 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:08.277267 24214 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:16:08.299827 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:08.300458 24185 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:08.301998 24010 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:08.286665 24181 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:08.277905 23656 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:08.303855 22748 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:08.305223 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:08.308897 24202 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:16:08.237386 24184 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:08.310392 24184 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:08.292344 23685 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:16:08.292446 24209 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:16:08.293145 24117 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:08.319989 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.322006 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.310002 22574 catalog_manager.cc:5697] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 1 to 2, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:08.324137 22574 catalog_manager.cc:5697] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 3, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:08.327597 22824 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:16:08.327980 22820 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:08.329124 22824 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:08.329304 22820 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:08.326454 22574 catalog_manager.cc:5697] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 1 to 2, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:08.255429 24134 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:08.291039 23674 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:08.335098 23674 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:08.336274 23674 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:08.337945 23674 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.312376 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.332644 22824 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:08.333757 22821 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:08.342376 22574 catalog_manager.cc:5697] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 3, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:08.347565 24097 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:08.286692 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.348192 24097 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:08.348814 22574 catalog_manager.cc:5697] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 3, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 3 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:08.349805 24097 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:08.298908 24214 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:08.351737 24214 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:08.351742 24097 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.352777 24214 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:08.354216 24214 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:08.355309 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:08.356421 24203 consensus_queue.cc:1059] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:08.357019 24181 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:08.351346 22574 catalog_manager.cc:5697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 1 to 2, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:08.357421 24203 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:08.357757 24181 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:08.357921 24203 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:08.359046 22574 catalog_manager.cc:5697] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 1 to 2, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:08.341135 22819 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:08.330639 22820 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:08.371433 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:08.384750 24071 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:08.389039 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:08.376490 24090 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:08.391363 24198 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:16:08.401902 24147 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.001s
W20260709 12:16:08.399183 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 158294us
I20260709 12:16:08.413966 23674 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:16:08.418959 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:08.419605 23695 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:08.420967 23674 pending_rounds.cc:85] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 1
I20260709 12:16:08.341037 23682 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:08.421241 24198 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.426249 24148 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:08.391722 24203 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:08.458899 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:08.459882 22900 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:08.425303 23674 pending_rounds.cc:107] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:16:08.442240 23682 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:08.463917 23695 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:16:08.467451 23695 pending_rounds.cc:85] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 2
I20260709 12:16:08.467778 23695 pending_rounds.cc:107] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:16:08.468066 23695 raft_consensus.cc:2889] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:08.468487 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.464568 24157 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:08.469959 22824 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:08.449824 24148 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:08.441262 24122 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.475805 24122 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:08.472069 22901 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:16:08.449977 24198 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:08.475332 24148 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.465415 23674 raft_consensus.cc:2889] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:08.474012 24157 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:08.487107 22898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 60) took 1501 ms (client timeout 1585 ms). Trace:
I20260709 12:16:08.490127 22892 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:08.465068 23973 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:08.500520 22819 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:08.515100 22820 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:08.520150 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.504978 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:08.517760 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:08.541859 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.547040 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:08.515743 22898 rpcz_store.cc:269] 0709 12:16:06.985717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.989673 (+  3956us) service_pool.cc:224] Handling call
0709 12:16:08.486720 (+1497047us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b540015a254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:08.487002 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452800896}
W20260709 12:16:08.550630 24141 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:16:08.536322 22896 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:08.558884 24112 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:08.560223 24157 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:08.525041 23973 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:08.570709 24128 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:08.572144 24128 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.572584 23973 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:08.573617 24099 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:08.565897 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:08.574643 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:08.580336 23682 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:16:08.580842 23682 pending_rounds.cc:85] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 2
I20260709 12:16:08.581068 23682 pending_rounds.cc:107] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:16:08.581321 23682 raft_consensus.cc:2889] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:08.583666 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.586083 23656 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:08.584816 22819 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:08.586423 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:08.570335 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:08.592706 23494 leader_election.cc:400] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:08.594655 23494 leader_election.cc:400] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:08.595695 23494 leader_election.cc:400] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:08.596596 23494 leader_election.cc:400] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:08.584090 24147 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:08.597438 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:08.599628 23679 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:16:08.611191 23679 pending_rounds.cc:85] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 2
I20260709 12:16:08.611513 23679 pending_rounds.cc:107] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:16:08.611745 24122 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:08.611788 23679 raft_consensus.cc:2889] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:08.599314 24147 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:08.618896 24044 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:08.621490 23951 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.622109 23951 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:08.638510 23951 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:08.647511 24203 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:08.653795 24229 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 12:16:08.628422 24147 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:08.629014 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:08.632009 23960 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:08.632480 24157 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:08.633061 24180 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:08.636338 24141 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:08.639882 22898 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:08.641561 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:08.599613 24181 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:08.598682 24198 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:08.626878 24134 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:08.661399 22750 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:08.662024 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:08.663604 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:08.722014 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:08.693974 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:08.701023 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:08.685349 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 56407.7us
I20260709 12:16:08.702108 22819 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:08.701658 24157 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:08.727222 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:08.727782 24157 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:08.691658 24099 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:08.724988 24148 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:08.728566 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:08.727926 24117 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.674108 24168 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:08.735193 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:08.736852 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:08.739462 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:08.730700 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:08.747222 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:08.715237 23973 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.817225 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:08.817378 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:08.823776 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:08.824941 23660 raft_consensus.cc:2410] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:08.692374 23982 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:16:08.732873 24107 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:16:08.738986 24157 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:08.835489 24157 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:08.817332 24196 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:08.836604 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 89515.4us
I20260709 12:16:08.837858 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:08.837999 24157 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:08.838620 24181 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:08.838989 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 100650us
W20260709 12:16:08.839356 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 98247.1us
I20260709 12:16:08.739717 24044 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:08.840257 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:08.840898 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:08.738643 24198 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.701552 24180 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:08.845443 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 128942us
I20260709 12:16:08.842563 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:08.702373 24141 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:08.728569 24214 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 12:16:08.727286 24125 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 12:16:08.817611 24172 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:08.836724 22746 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:08.850808 22747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:49294
I20260709 12:16:08.851250 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:08.822150 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:08.701855 23960 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:08.861207 22750 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:08.746572 24040 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 12:16:08.868142 22747 raft_consensus.cc:606] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:08.849160 23925 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:08.755084 24117 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:08.750088 24081 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:16:08.850921 24097 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:08.842912 24090 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:08.849764 24099 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:08.849611 24157 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:08.963372 23960 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:08.934942 22747 raft_consensus.cc:614] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:16:08.930389 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 51651.9us
W20260709 12:16:08.964658 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 254931us
I20260709 12:16:08.864981 24206 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:08.827363 23973 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:08.875721 24185 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:08.963258 24157 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:08.869190 22752 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:08.867288 24010 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:16:08.750708 24168 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:08.928086 23982 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.852383 24198 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:08.951478 23925 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:08.939006 22892 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:08.974901 22752 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:08.937752 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 340) took 1043 ms. Trace:
I20260709 12:16:09.074190 24185 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.934223 24196 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:09.075069 24185 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:08.980646 23982 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:09.077638 24185 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:09.056525 23659 rpcz_store.cc:276] 0709 12:16:07.891565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:07.892572 (+  1007us) service_pool.cc:224] Handling call
0709 12:16:08.041645 (+149073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:08.222148 (+180503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:08.229756 (+  7608us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:08.274440 (+ 44684us) log.cc:844] Serialized 26 byte log entry
0709 12:16:08.530911 (+256471us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:08.827400 (+296489us) log.cc:844] Serialized 14 byte log entry
0709 12:16:08.849408 (+ 22008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:08.858525 (+  9117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:08.867610 (+  9085us) raft_consensus.cc:1685] finished
0709 12:16:08.875440 (+  7830us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:08.935125 (+ 59685us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25189,"prepare.queue_time_us":63869,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":62733,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":34553,"thread_start_us":477740,"threads_started":3,"wal-append.queue_time_us":249546}
I20260709 12:16:09.080209 22746 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:08.974448 24206 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:08.977680 24081 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.108s
W20260709 12:16:09.092962 24236 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:16:09.097412 24198 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:09.075096 24196 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:09.100044 24196 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.105094 24157 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:09.056740 24124 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.106849 24124 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.110010 24124 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:09.119156 24214 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.119983 24214 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.123986 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:09.125017 22744 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:09.130115 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 413) took 1055 ms. Trace:
I20260709 12:16:09.130627 23689 rpcz_store.cc:276] 0709 12:16:08.074887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:08.297411 (+222524us) service_pool.cc:224] Handling call
0709 12:16:08.297811 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:08.298137 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:16:08.471638 (+173501us) log.cc:844] Serialized 14 byte log entry
0709 12:16:09.129395 (+657757us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b1800256b40. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a
0709 12:16:09.129709 (+   314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:09.129769 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:09.129820 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:09.129901 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:09.130046 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25992,"prepare.queue_time_us":241568,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":4881,"spinlock_wait_cycles":4484864,"thread_start_us":289901,"threads_started":2,"wal-append.queue_time_us":137274}
W20260709 12:16:09.132423 24238 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:16:09.134327 24117 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:09.075537 23925 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:09.134409 24148 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:09.148007 24180 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:09.148571 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:09.154269 24203 consensus_meta.cc:287] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 12:16:09.157361 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:09.164825 23960 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:09.165562 24181 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:09.136291 24168 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:09.168467 24214 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:08.967458 24090 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.150422 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:09.190586 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:16:09.196527 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 346967us
W20260709 12:16:09.190659 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 333862us
I20260709 12:16:09.197873 24117 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:09.142392 24166 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.204384 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:16:09.208870 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 170135us
I20260709 12:16:09.217594 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:09.233028 24243 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:09.222437 24166 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:09.234702 24240 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.235441 24240 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:09.236485 24128 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:09.195499 23960 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:09.233304 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:09.239665 23960 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:09.241214 24090 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:09.242341 24081 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:09.225097 24117 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:09.243199 24242 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:09.244428 24117 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:09.247575 22753 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:09.244836 24242 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:09.235918 24166 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:09.199898 24181 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:09.265832 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:09.266682 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.268290 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.268959 23685 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:09.272516 24206 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:09.280587 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 72729.3us
I20260709 12:16:09.216164 24198 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:16:09.289409 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:09.258247 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:09.309947 24239 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:16:09.296972 24246 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:09.302760 23934 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:09.266722 22892 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:09.293421 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:09.303040 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:09.273729 24233 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.215s	user 0.002s	sys 0.000s
I20260709 12:16:09.252915 24242 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:09.341675 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 83585.4us
W20260709 12:16:09.342634 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 54540.5us
I20260709 12:16:09.343924 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:09.347625 22827 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:16:09.290061 24235 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.002s
I20260709 12:16:09.373509 22901 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:09.373973 23689 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:16:09.374467 23689 pending_rounds.cc:85] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 2
I20260709 12:16:09.374800 23689 pending_rounds.cc:107] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:16:09.374995 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:09.375773 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:09.344905 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:09.354313 24243 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.375100 23689 raft_consensus.cc:2889] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:09.383136 24243 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.384411 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.384696 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.385141 23659 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:09.385452 23689 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:09.386209 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.389743 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.362326 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:09.363401 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:09.365217 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 399375us
I20260709 12:16:09.293007 24090 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:16:09.400252 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:09.347970 24189 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:09.362880 24206 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.363293 24121 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.409327 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:09.386377 24243 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:09.424707 24242 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.422245 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:09.427589 22825 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:09.407668 22744 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:09.432554 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:09.407390 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:09.407745 24214 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.410763 24203 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:09.457406 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:09.451184 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:09.426260 24242 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:09.443656 24204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.007s	sys 0.037s
I20260709 12:16:09.462379 24124 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.423647 24172 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:16:09.474324 24124 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:09.475035 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:09.427188 24040 consensus_queue.cc:1175] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a89a4b420ea9496aab55475fc38bb6f7" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:16:09.451295 23659 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:09.427004 24121 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.426204 24090 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:16:09.426867 24115 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:09.428892 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.478268 24244 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:09.422925 24206 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:09.478298 24115 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:09.480209 24115 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:09.481544 24206 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:09.483542 24099 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:09.484067 24099 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:09.465394 22898 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
W20260709 12:16:09.471251 24234 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 12:16:09.473842 24204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.007s	sys 0.038s
I20260709 12:16:09.463052 24214 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.479494 24124 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:09.463289 24097 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.472285 24181 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:09.458518 23951 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:16:09.499487 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:09.485520 24099 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:09.451814 24010 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:09.459313 24178 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:09.478487 24121 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:09.461126 24203 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:09.533406 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:09.464479 24081 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:16:09.527158 24206 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.453341 24243 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
W20260709 12:16:09.538618 24250 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:16:09.566697 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:09.557598 24124 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:09.558964 24178 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:09.555794 24181 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.568094 24099 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:09.567167 24203 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.569280 24121 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:09.593608 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.602674 23656 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:09.557193 24097 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:09.569752 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:09.609973 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 212625us
I20260709 12:16:09.562934 24010 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:09.588665 24204 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.588166 24148 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:09.595714 24178 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:09.631860 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:09.574298 24206 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:09.610735 24179 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:09.637457 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:09.618063 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:09.642863 24214 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:09.644464 24097 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:09.634944 24148 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:09.634814 23934 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:16:09.647814 24044 raft_consensus.cc:3055] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:09.651666 24240 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:09.621170 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:09.653393 22892 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:09.680168 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:09.601866 24181 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:09.655263 23973 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:09.628300 24125 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:16:09.628782 24247 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.630306 22895 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:09.636050 24204 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.678855 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:09.670542 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:09.698851 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:09.680943 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:16:09.818324 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 137495us
I20260709 12:16:09.820542 24214 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:09.821141 24214 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:09.821544 24214 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:09.821295 24247 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.823385 24204 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:09.824174 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 153751us
I20260709 12:16:09.824288 24128 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:09.828467 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:16:09.663439 24252 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:16:09.665199 24196 consensus_meta.cc:287] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.003s
W20260709 12:16:09.832758 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 154367us
I20260709 12:16:09.681321 24179 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:09.708236 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:09.663311 24010 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:09.696710 24122 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:09.682317 24044 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:09.669216 24081 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:09.842844 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:09.846167 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.823868 24247 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:09.849496 24266 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:16:09.837996 24204 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:09.851359 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.851598 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.843148 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.854118 24125 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:09.916621 24125 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.855676 23951 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.917924 23951 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:09.919294 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:09.856400 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:09.857721 24181 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:09.858240 24196 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:09.674098 24206 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:09.858631 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:09.849496 24148 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:09.859166 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:09.935127 22899 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:09.863235 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:09.894297 24204 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:09.864624 22745 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:09.815501 23960 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:09.834909 24128 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:09.767678 24243 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.880441 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:09.922463 24099 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:09.922833 23951 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:09.662752 24178 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.678395 24115 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.674872 24255 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.206s
I20260709 12:16:09.892913 22900 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:09.889550 23695 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:09.876703 22753 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:09.877362 23973 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:09.994599 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:09.910959 24214 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:09.997253 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 320) took 1177 ms. Trace:
I20260709 12:16:09.997874 22752 rpcz_store.cc:276] 0709 12:16:08.819559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.039245 (+219686us) service_pool.cc:224] Handling call
0709 12:16:09.039533 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:09.076665 (+ 37132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:09.076703 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:09.076753 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:09.076808 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:09.996921 (+920113us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b5400413554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:09.996986 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:09.997169 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84665088}
I20260709 12:16:09.907615 24141 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:09.889755 24121 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.953886 24128 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:09.864089 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:10.007148 22747 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:09.878499 24179 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:09.889859 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 47189us
W20260709 12:16:10.010252 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:09.953397 23960 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.011155 24071 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.011426 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.011660 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.011821 24071 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.012913 23960 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.013052 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.013767 23682 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:10.014020 24071 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.014969 22750 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:10.015328 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.016706 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.017380 22899 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:10.018095 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.020267 24214 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.021165 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.020974 24121 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.021888 23672 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:09.956380 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:10.024621 24178 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:10.025920 23672 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:16:10.026383 23672 pending_rounds.cc:85] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 2
I20260709 12:16:09.908591 24203 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.004531 23973 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:10.028033 24179 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.028703 22893 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:10.028910 24203 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:09.989907 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.030495 23659 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:16:10.031607 22901 raft_consensus.cc:2368] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5.
I20260709 12:16:09.947952 24125 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:09.891728 24247 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:09.951306 24204 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:09.936859 24181 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.968806 24099 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:09.950259 23934 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:09.994473 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.024675 24115 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:10.026621 23672 pending_rounds.cc:107] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:16:10.052805 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:09.959244 24243 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.014711 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:09.952450 22749 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:10.029016 23973 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.074921 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.071282 23672 raft_consensus.cc:2889] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:09.950331 24044 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:10.077636 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.081425 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:10.083437 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 219210us
I20260709 12:16:10.085484 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.074671 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:10.058571 24181 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:10.089236 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.089437 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.091509 22825 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:10.092911 22826 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:10.094084 22898 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:10.094462 24270 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.095096 24270 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:10.095664 22898 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:10.097426 24270 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.095444 22899 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:10.101392 23982 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.101471 24270 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:10.102253 24270 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:10.102546 22827 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:10.104988 24270 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.106160 24125 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.106966 24260 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.107247 24107 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:10.106740 24125 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.107667 24260 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.107788 24107 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:10.108250 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.109094 22823 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:10.109472 24125 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.110040 24260 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:10.110385 24125 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.110327 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.111084 24265 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.110525 24107 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.111707 24122 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:10.112659 24246 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:10.132620 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.117758 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:10.119024 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:10.133616 22826 raft_consensus.cc:2393] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 2: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:10.127373 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.062284 22893 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:10.132365 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.117216 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.119745 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.135926 23493 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:10.138895 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.142638 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.093564 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.143350 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.143373 22826 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 1.
I20260709 12:16:10.144434 22820 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:10.144558 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:10.146052 22824 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:16:10.147328 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.148825 22820 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:10.150457 22819 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:10.153067 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.156005 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:10.138933 24270 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:10.224128 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:10.225627 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 74425us
I20260709 12:16:10.174358 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.126631 24125 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:10.231175 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 306784us
I20260709 12:16:10.233971 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:10.231823 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.235054 22819 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:10.237547 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:10.238236 22747 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:10.152531 24141 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:10.137599 24122 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:10.249058 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:10.225692 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.127933 24265 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.166358 23982 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:10.151592 24040 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:16:10.235671 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.156877 24196 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:10.145074 24247 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 12:16:10.237218 24214 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:10.245071 24141 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.242139 23682 raft_consensus.cc:2393] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 2: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:10.228225 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:10.139668 24246 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.273077 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:10.245285 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.237417 24148 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:10.156307 24179 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:10.253383 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:10.278228 22826 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.247015 24279 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.264242 24280 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.261521 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:10.275161 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:10.303488 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:10.250849 24270 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:10.274276 22827 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:10.251091 23951 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.284708 24010 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:10.267059 23982 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.288123 24179 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.290098 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:10.293089 24125 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:10.294080 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:10.295816 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.280418 23672 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:10.298611 24279 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:10.300029 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:10.301579 24265 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.264853 24117 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:10.325950 23679 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:16:10.307961 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46555.2us
I20260709 12:16:10.263839 22892 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:10.363184 24117 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:10.365541 24117 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:10.367274 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:10.371117 24279 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.371884 24121 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:10.372841 23689 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:10.352566 24203 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:10.373832 24203 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:10.377552 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:10.377769 24203 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.374073 23689 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
W20260709 12:16:10.379925 24283 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:16:10.380312 23689 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:10.380563 24179 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:10.353423 23973 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:10.381819 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.381908 23973 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.382618 23973 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:10.321534 24189 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:16:10.378365 22748 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:10.389051 23672 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:10.390199 23982 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.274031 24214 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:10.277742 24141 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.280792 24148 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:10.337212 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 70057.2us
I20260709 12:16:10.405400 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:10.406376 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:10.280157 24099 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:10.347035 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48678.4us
I20260709 12:16:10.310587 24040 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.315016 24271 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:10.315474 24243 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.332934 23951 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.275627 24247 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:10.329473 24270 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.392737 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:10.324867 22826 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
W20260709 12:16:10.391912 24281 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 12:16:10.366220 24128 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.410693 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:10.431815 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:10.414111 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 58297.6us
I20260709 12:16:10.414834 23982 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.425602 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:10.348610 23682 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:10.437701 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.438419 23494 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:10.439821 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:10.415273 24271 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:10.316242 24280 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.448380 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:10.457177 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.413374 24040 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:10.450151 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:10.449838 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:10.438446 23682 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:10.431427 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.459918 22826 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.423565 24247 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:10.421370 24181 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:10.458212 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.430056 24099 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:10.448657 24279 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:10.429853 24289 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:10.433601 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:10.475558 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.436365 23982 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:10.450973 24206 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.452008 24010 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:10.486248 24122 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.457276 24271 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:10.457003 24214 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.459033 24240 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:10.489226 24240 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:10.455313 24239 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:10.491225 24239 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:10.491858 24240 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.492728 24270 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.493816 24239 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.494027 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.494695 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.495419 22898 raft_consensus.cc:2368] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:10.496968 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.497680 24280 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.498344 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:10.477092 24279 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:10.478396 24265 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.477298 22892 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:10.474368 24099 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.509395 23494 leader_election.cc:400] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:10.509788 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.514393 23494 leader_election.cc:403] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:10.515688 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.515792 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:10.517037 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:10.511409 22826 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:10.463080 24040 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.518349 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:10.519008 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.499898 24279 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.520429 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.499490 23982 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:10.500720 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.502247 24099 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:10.501008 24246 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:10.501909 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:10.455607 23951 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:10.481000 24285 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:16:10.470345 24179 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:10.518225 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:10.516389 22822 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:10.476912 24289 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.475263 24134 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:10.525166 22895 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:16:10.559609 24291 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:16:10.513681 24196 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:10.539321 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.479229 24181 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:16:10.556362 24289 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.547247 24270 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.498772 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.569988 24172 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:10.553601 24179 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.560904 23934 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:10.500319 24265 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.580821 24134 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.583298 24099 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:10.584729 24204 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 12:16:10.585258 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.581147 23682 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:10.581427 24172 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.586949 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 354) took 1218 ms. Trace:
I20260709 12:16:10.499642 24247 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:10.588117 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.581534 24179 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.561888 23973 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.604185 23934 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:10.617408 22825 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:10.625989 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.627411 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.628675 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.624790 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:10.632994 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.610944 24204 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:10.635241 23695 raft_consensus.cc:2368] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5.
I20260709 12:16:10.637112 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:10.637766 22748 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:10.639560 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.645043 23973 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:10.645251 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:10.646080 22745 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:16:10.612993 23674 rpcz_store.cc:276] 0709 12:16:09.368335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.394335 (+ 26000us) service_pool.cc:224] Handling call
0709 12:16:09.668669 (+274334us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b58002c3a98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:09.672680 (+  4011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:09.923104 (+250424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:09.929438 (+  6334us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:09.948891 (+ 19453us) log.cc:844] Serialized 26 byte log entry
0709 12:16:10.220796 (+271905us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:10.229409 (+  8613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:10.244860 (+ 15451us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:10.586584 (+341724us) raft_consensus.cc:1685] finished
0709 12:16:10.586612 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:10.586867 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8379,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":5251,"spinlock_wait_cycles":13788416,"thread_start_us":441178,"threads_started":2,"wal-append.queue_time_us":328505}
I20260709 12:16:10.648223 22896 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:10.612534 24172 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.651418 24265 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.653273 24204 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.575016 24141 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:10.655993 24294 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:16:10.656730 24141 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.657671 24247 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.657979 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 355) took 1289 ms. Trace:
I20260709 12:16:10.658375 23660 rpcz_store.cc:276] 0709 12:16:09.368838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.368993 (+   155us) service_pool.cc:224] Handling call
0709 12:16:10.390146 (+1021153us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b58002c3a98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:10.390352 (+   206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:10.390742 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.390770 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:10.391335 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:16:10.512687 (+121352us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:10.512751 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:10.512870 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:10.657651 (+144781us) raft_consensus.cc:1685] finished
0709 12:16:10.657673 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:10.657920 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293,"raft.queue_time_us":10769,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":5736,"spinlock_wait_cycles":6907264,"thread_start_us":120728,"threads_started":1,"wal-append.queue_time_us":158170}
I20260709 12:16:10.661412 23660 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:10.661608 23679 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:10.634235 24099 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.662336 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:10.664428 23679 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 12:16:10.667563 24214 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:10.666193 23660 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:16:10.633975 23682 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:10.672986 23982 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:10.624661 23934 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.675645 23982 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:10.680204 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 55490.6us
W20260709 12:16:10.695940 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 177714us
I20260709 12:16:10.702968 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:10.705058 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:10.706743 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:10.707558 22898 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:10.719583 24184 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:10.721025 23934 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.724360 23934 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:10.610257 24040 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.692387 24279 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.728789 24040 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:10.731542 23656 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:10.693879 24273 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:10.726239 24172 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:10.695870 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:10.734481 24107 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:16:10.736074 24274 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:16:10.749173 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:10.752995 23660 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.753688 24265 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.753973 24107 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:10.754505 24107 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:10.755510 24107 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.756057 24172 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:10.756155 24099 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:10.759217 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:10.754253 24265 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.733537 24271 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.763787 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.756883 24107 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.757964 24273 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:10.761735 24172 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:10.756920 24099 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.772547 23660 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:10.767251 24279 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.783463 24271 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:10.779521 22827 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:10.815466 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:10.770751 24273 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.815516 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:10.786576 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:10.824270 24303 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:10.829923 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:10.832690 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:10.839704 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:10.841080 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:10.826601 24256 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:10.844802 24256 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:10.850629 24256 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.836342 24204 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:10.859282 24099 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.836143 24299 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:10.857669 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:10.860298 24090 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.827214 24289 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:10.865670 22894 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:10.865938 24289 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:10.868003 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:10.869103 22752 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 4: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:10.870136 22826 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:10.871779 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 79) took 1456 ms. Trace:
I20260709 12:16:10.879313 24265 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:10.880842 22898 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:10.880992 24148 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.870292 24204 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:10.872265 22894 rpcz_store.cc:276] 0709 12:16:09.412688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.416394 (+  3706us) service_pool.cc:224] Handling call
0709 12:16:10.865245 (+1448851us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b58001e3398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ae9c 00007fadf165aa5b 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:10.865464 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:10.866234 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:10.868976 (+  2742us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23317888}
I20260709 12:16:10.868464 24090 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.887763 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:10.859907 24179 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:10.889842 24299 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:10.899797 24299 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:10.900869 24299 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:10.907128 24178 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:10.907991 24178 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:10.891464 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.890837 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:10.892382 24090 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:10.918578 24179 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:10.893154 24204 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:10.918392 24178 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:11.906280 22895 consensus_meta.cc:287] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.032s	user 0.010s	sys 0.009s
W20260709 12:16:11.933264 22774 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6160 after lost signal to thread 18407
W20260709 12:16:12.865393 22774 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6340 after lost signal to thread 18410
I20260709 12:16:12.865362 22895 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
W20260709 12:16:12.866146 22895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 104) took 2024 ms (client timeout 2042 ms). Trace:
W20260709 12:16:12.866510 22895 rpcz_store.cc:269] 0709 12:16:10.842086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.857330 (+ 15244us) service_pool.cc:224] Handling call
0709 12:16:12.866075 (+2008745us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:12.866847 22774 debug-util.cc:398] Leaking SignalData structure 0x7b080021fe80 after lost signal to thread 22610
W20260709 12:16:12.867280 22774 debug-util.cc:398] Leaking SignalData structure 0x7b0800257c20 after lost signal to thread 22623
I20260709 12:16:12.867908 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:12.868561 22895 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:12.868678 22774 debug-util.cc:398] Leaking SignalData structure 0x7b0800083060 after lost signal to thread 22777
W20260709 12:16:12.869045 22774 debug-util.cc:398] Leaking SignalData structure 0x7b0800200d80 after lost signal to thread 22778
W20260709 12:16:12.870362 22774 debug-util.cc:398] Leaking SignalData structure 0x7b0800333780 after lost signal to thread 22851
W20260709 12:16:12.870664 22774 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1240 after lost signal to thread 22852
W20260709 12:16:12.872031 22774 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef780 after lost signal to thread 22925
W20260709 12:16:12.872352 22774 debug-util.cc:398] Leaking SignalData structure 0x7b08003d01e0 after lost signal to thread 22926
W20260709 12:16:12.873785 22774 debug-util.cc:398] Leaking SignalData structure 0x7b08001b57c0 after lost signal to thread 23729
I20260709 12:16:12.079440 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 106) took 1191 ms. Trace:
W20260709 12:16:12.084024 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.622s	user 0.002s	sys 0.023s
W20260709 12:16:12.190372 22752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 140) took 1532 ms (client timeout 1526 ms). Trace:
W20260709 12:16:12.211401 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:12.242591 24256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.389s	user 0.023s	sys 0.017s
I20260709 12:16:12.247526 22748 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:12.252903 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 535) took 2113 ms. Trace:
W20260709 12:16:12.280678 23494 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.585s (SENT)
I20260709 12:16:12.281505 24147 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:12.293355 24134 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:12.304395 23982 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:12.874091 22774 debug-util.cc:398] Leaking SignalData structure 0x7b0800134ba0 after lost signal to thread 23731
I20260709 12:16:12.309295 24270 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:12.883152 24270 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:12.885639 24270 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:12.309769 24290 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:12.886467 24290 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:12.313032 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 141) took 1644 ms. Trace:
W20260709 12:16:12.318872 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:12.322986 24243 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:12.301451 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:12.435608 22864 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.194:36669 timed out after 2.041s (SENT) [suppressed 3 similar messages]
W20260709 12:16:12.688360 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:12.709043 24198 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:12.879675 24134 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:12.889189 24290 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:12.893126 24198 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:12.893944 24290 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:12.895207 24134 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:12.895771 24198 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:12.719465 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 129) took 2601 ms. Trace:
I20260709 12:16:12.721669 24316 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:12.724754 24185 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:12.896512 22753 rpcz_store.cc:276] 0709 12:16:10.117568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.122892 (+  5324us) service_pool.cc:224] Handling call
0709 12:16:12.718519 (+2595627us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aeee 000000000036eb39 00007fadf96ce1e0 00007fadf97970c4 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:12.718700 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:12.718961 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:12.718992 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:12.719036 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:12.719080 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.719141 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:12.719295 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16212224}
I20260709 12:16:12.897652 24185 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:12.899075 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:12.879029 24276 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:12.726451 24244 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:12.727399 24317 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:12.731860 24318 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:12.900820 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:12.879153 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:12.901546 24317 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:12.901678 24318 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:12.893728 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 592392us
I20260709 12:16:12.734985 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 908) took 2598 ms. Trace:
I20260709 12:16:12.736477 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 507) took 2486 ms. Trace:
W20260709 12:16:12.874681 23695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 436) took 2954 ms (client timeout 1706 ms). Trace:
I20260709 12:16:12.901153 24244 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:12.904389 22750 rpcz_store.cc:276] 0709 12:16:10.249718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.250256 (+   538us) service_pool.cc:224] Handling call
0709 12:16:10.250601 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:10.354354 (+103753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.354405 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:10.354473 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:10.354522 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.736137 (+2381615us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400406fd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:12.736204 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:12.736392 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237911936}
W20260709 12:16:12.904783 23695 rpcz_store.cc:269] 0709 12:16:09.920073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.989533 (+ 69460us) service_pool.cc:224] Handling call
0709 12:16:12.874381 (+2884848us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54003a84d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:12.874595 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391351552}
I20260709 12:16:12.896824 24316 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:12.906126 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:12.906755 22750 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:12.879446 24147 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:12.907815 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:12.754942 24282 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:12.730242 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:12.908658 24282 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:12.909279 22744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 130) took 2791 ms (client timeout 1885 ms). Trace:
W20260709 12:16:12.909740 22744 rpcz_store.cc:269] 0709 12:16:10.117870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.122668 (+  4798us) service_pool.cc:224] Handling call
0709 12:16:12.729956 (+2607288us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:12.909194 (+179238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6904064}
W20260709 12:16:12.755296 24273 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.926s	user 0.013s	sys 0.017s
I20260709 12:16:12.910246 24206 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:12.910738 24273 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:12.911077 24321 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:12.911273 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:12.911753 24321 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:12.912568 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:12.912954 24273 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:12.768772 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 974) took 2887 ms. Trace:
I20260709 12:16:12.913534 24097 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:12.771279 24274 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:12.769960 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 374) took 2301 ms (client timeout 1604 ms). Trace:
I20260709 12:16:12.874979 22894 rpcz_store.cc:276] 0709 12:16:10.887918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.891128 (+  3210us) service_pool.cc:224] Handling call
0709 12:16:12.079335 (+1188207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:12.771687 24265 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:12.772007 24271 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:12.783126 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 371) took 2661 ms. Trace:
I20260709 12:16:12.783281 22899 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:16:12.915251 24265 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:12.776881 22893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 77) took 3366 ms (client timeout 1994 ms). Trace:
W20260709 12:16:12.783123 22901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 82) took 3313 ms (client timeout 1585 ms). Trace:
W20260709 12:16:12.808650 22896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 87) took 2704 ms (client timeout 1856 ms). Trace:
I20260709 12:16:12.814460 24203 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:12.815310 24214 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:12.816015 24099 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:12.816403 24184 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:12.817392 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:12.818149 22825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 549) took 2309 ms (client timeout 1604 ms). Trace:
I20260709 12:16:12.821943 24044 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:12.903580 22824 rpcz_store.cc:276] 0709 12:16:10.137017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.149140 (+ 12123us) service_pool.cc:224] Handling call
0709 12:16:10.149420 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:10.266047 (+116627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.266099 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:10.266153 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:10.266187 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.734672 (+2468485us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002d9e54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:12.734738 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:12.734921 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267710208}
I20260709 12:16:12.913733 22897 rpcz_store.cc:276] 0709 12:16:09.881651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.882260 (+   609us) service_pool.cc:224] Handling call
0709 12:16:09.882559 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:10.035459 (+152900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.035493 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:10.035537 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:10.035564 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.768413 (+2732849us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003d2f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:12.768467 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:12.768652 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351112448}
W20260709 12:16:12.823272 22900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 85) took 3143 ms (client timeout 1857 ms). Trace:
W20260709 12:16:12.875757 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.423s	user 0.003s	sys 0.024s
W20260709 12:16:12.920660 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 2.46749e+06us
I20260709 12:16:12.920723 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:12.832067 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:12.834307 22892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 91) took 2728 ms (client timeout 2508 ms). Trace:
I20260709 12:16:12.844255 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 329) took 2789 ms. Trace:
W20260709 12:16:12.846863 22747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 335) took 2573 ms (client timeout 2193 ms). Trace:
I20260709 12:16:12.847433 24324 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:12.852134 22576 catalog_manager.cc:5697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 3, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:12.853933 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 352) took 3006 ms. Trace:
I20260709 12:16:12.857215 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 547) took 2588 ms. Trace:
I20260709 12:16:12.857826 24322 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:12.910917 24279 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:12.941257 24214 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:12.941371 24279 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:12.940743 22827 rpcz_store.cc:276] 0709 12:16:10.268634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.321675 (+ 53041us) service_pool.cc:224] Handling call
0709 12:16:10.321991 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:10.819482 (+497491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.856887 (+2037405us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54007a1554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:12.857139 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1039311744}
I20260709 12:16:12.890630 22898 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:12.914237 24097 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:12.890934 24243 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:12.919091 22825 rpcz_store.cc:269] 0709 12:16:10.508279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.508435 (+   156us) service_pool.cc:224] Handling call
0709 12:16:12.814706 (+2306271us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x7b5400300f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:12.818009 (+  3303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220906752}
I20260709 12:16:12.938287 24204 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:12.921341 24099 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:12.877003 22752 rpcz_store.cc:269] 0709 12:16:10.657491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.662115 (+  4624us) service_pool.cc:224] Handling call
0709 12:16:12.190007 (+1527892us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54001e64d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:12.190261 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472733440}
I20260709 12:16:12.921747 24198 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:16:12.877379 24256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.023s	user 0.024s	sys 0.017s
I20260709 12:16:12.877646 23960 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:12.877776 22748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 138) took 2241 ms (client timeout 1863 ms). Trace:
I20260709 12:16:12.879905 23982 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:12.940028 24324 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:12.900277 24276 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:12.904223 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:12.742568 24295 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:12.910871 24206 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:12.948567 24279 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:12.957136 24243 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:12.943382 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:12.958297 24206 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:12.913259 22744 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:12.959411 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:10.343849 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:12.960794 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:12.918090 22896 rpcz_store.cc:269] 0709 12:16:10.104154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.381515 (+277361us) service_pool.cc:224] Handling call
0709 12:16:12.808336 (+2426821us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54003101d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:12.808554 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607885184}
I20260709 12:16:12.764325 24128 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:12.914523 24274 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:12.963373 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:12.964144 24321 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:12.902477 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:12.944275 22818 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
W20260709 12:16:12.965976 22818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 105) took 2836 ms (client timeout 1856 ms). Trace:
I20260709 12:16:12.966346 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:12.966485 22818 rpcz_store.cc:269] 0709 12:16:10.129223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.132296 (+  3073us) service_pool.cc:224] Handling call
0709 12:16:12.817238 (+2684942us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b5800011498. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aeee 000000000036eb39 00007fadf96ce1e0 00007fadf97970c4 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:12.965892 (+148654us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10036480}
I20260709 12:16:12.967804 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:12.948299 24099 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:12.915189 23672 rpcz_store.cc:276] 0709 12:16:10.121469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.391013 (+269544us) service_pool.cc:224] Handling call
0709 12:16:10.391311 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:10.432373 (+ 41062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.435550 (+  3177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:10.452765 (+ 17215us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:10.460409 (+  7644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.782763 (+2322354us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b54002904d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:12.782852 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:12.783019 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70742400}
W20260709 12:16:12.940266 22749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 131) took 2822 ms (client timeout 2222 ms). Trace:
W20260709 12:16:12.916320 22893 rpcz_store.cc:269] 0709 12:16:09.410439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.410613 (+   174us) service_pool.cc:224] Handling call
0709 12:16:09.880293 (+469680us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b58001e3398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:12.776692 (+2896399us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b540057add4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:12.776800 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191309952}
W20260709 12:16:12.970435 22749 rpcz_store.cc:269] 0709 12:16:10.118341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.123733 (+  5392us) service_pool.cc:224] Handling call
0709 12:16:12.831844 (+2708111us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:12.940159 (+108315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10438016}
I20260709 12:16:12.971505 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:12.788152 22745 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 2.142s	user 0.026s	sys 0.011s
I20260709 12:16:12.972620 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:12.973130 22745 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
W20260709 12:16:12.973735 22745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 139) took 2328 ms (client timeout 1788 ms). Trace:
W20260709 12:16:12.974120 22745 rpcz_store.cc:269] 0709 12:16:10.644850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.645009 (+   159us) service_pool.cc:224] Handling call
0709 12:16:12.973662 (+2328653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:12.975421 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:12.789647 24272 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:12.917498 24271 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:12.932979 22746 rpcz_store.cc:276] 0709 12:16:10.054969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.071171 (+ 16202us) service_pool.cc:224] Handling call
0709 12:16:12.819995 (+2748824us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:12.820279 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:12.829035 (+  8756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:12.829085 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:12.829851 (+   766us) log.cc:844] Serialized 26 byte log entry
0709 12:16:12.843172 (+ 13321us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:12.843253 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.843367 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:12.843806 (+   439us) raft_consensus.cc:1685] finished
0709 12:16:12.843836 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:12.844159 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18071,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":187,"spinlock_wait_cycles":4233472,"thread_start_us":20541,"threads_started":2,"wal-append.queue_time_us":10623}
I20260709 12:16:12.919502 22750 raft_consensus.cc:2376] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5. Re-sending same reply.
I20260709 12:16:12.917057 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 374) took 3002 ms. Trace:
I20260709 12:16:12.877912 22820 rpcz_store.cc:276] 0709 12:16:10.139582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.149501 (+  9919us) service_pool.cc:224] Handling call
0709 12:16:10.149840 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:10.159224 (+  9384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.159306 (+    82us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:10.218357 (+ 59051us) log.cc:844] Serialized 26 byte log entry
0709 12:16:12.249288 (+2030931us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b1800405f40. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:16:12.250109 (+   821us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:12.250160 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.250257 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:12.252547 (+  2290us) raft_consensus.cc:1685] finished
0709 12:16:12.252573 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:12.252818 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15056,"raft.queue_time_us":13649,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":20788,"spinlock_wait_cycles":3300224,"thread_start_us":568,"threads_started":1,"wal-append.queue_time_us":2013134}
I20260709 12:16:12.921525 22897 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:12.991607 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:12.920264 22900 rpcz_store.cc:269] 0709 12:16:09.679455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.679809 (+   354us) service_pool.cc:224] Handling call
0709 12:16:12.822993 (+3143184us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002fe4d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:12.823178 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448853248}
I20260709 12:16:12.993187 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:12.993785 22900 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:12.994556 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:12.995098 22900 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:12.995788 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:12.914464 23656 rpcz_store.cc:269] 0709 12:16:10.468270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.475141 (+  6871us) service_pool.cc:224] Handling call
0709 12:16:12.769674 (+2294533us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400375d54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:12.769834 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578442624}
I20260709 12:16:12.934671 22576 catalog_manager.cc:5697] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 2 to 3, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:12.935676 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 654982us
I20260709 12:16:12.937866 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:12.997548 23494 connection.cc:256] RPC call timeout handler was delayed by -1.0766169890000583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260709 12:16:12.933233 22747 rpcz_store.cc:269] 0709 12:16:10.276489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.846599 (+2570110us) service_pool.cc:211] Skipping call since client already timed out
0709 12:16:12.846744 (+   145us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:16:12.996292 22900 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:12.939069 24184 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:12.974218 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:12.956072 24178 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:12.889550 22751 rpcz_store.cc:276] 0709 12:16:12.296059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.312101 (+ 16042us) service_pool.cc:224] Handling call
0709 12:16:12.312579 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:12.312777 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:12.312799 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:12.312829 (+    30us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:12.312849 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.312887 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:12.312983 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:12.918385 24203 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:12.944943 22898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 105) took 2075 ms (client timeout 2242 ms). Trace:
I20260709 12:16:12.878499 22895 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
W20260709 12:16:13.009388 22898 rpcz_store.cc:269] 0709 12:16:10.869719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.888939 (+ 19220us) service_pool.cc:224] Handling call
0709 12:16:12.944743 (+2055804us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54000ee2d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:12.944874 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250311552}
I20260709 12:16:12.947547 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:12.948392 22748 rpcz_store.cc:269] 0709 12:16:10.636666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.636834 (+   168us) service_pool.cc:224] Handling call
0709 12:16:12.877675 (+2240841us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:12.951339 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47189.4us
I20260709 12:16:13.012506 24282 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:12.950608 24324 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:12.972759 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.017057 22893 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:13.003453 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:12.827683 23493 connection.cc:256] RPC call timeout handler was delayed by -1.0197840889998133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
I20260709 12:16:12.976307 22745 raft_consensus.cc:2410] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:16:12.933727 22892 rpcz_store.cc:269] 0709 12:16:10.105381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.834016 (+2728635us) service_pool.cc:211] Skipping call since client already timed out
0709 12:16:12.834187 (+   171us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:16:12.998488 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 60721.6us
I20260709 12:16:13.035107 24270 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:13.035609 23674 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 12:16:13.035856 24134 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:13.036499 24134 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:13.037957 24328 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:13.038183 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.038512 24328 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:13.039680 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.040015 24204 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:13.040596 24204 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.040920 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.042183 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.042299 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.043061 23656 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 1.
I20260709 12:16:13.043972 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.044485 24184 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:13.044837 22744 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:13.045181 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:12.950915 23659 rpcz_store.cc:276] 0709 12:16:09.847712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.854564 (+  6852us) service_pool.cc:224] Handling call
0709 12:16:09.854986 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:10.031033 (+176047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.853565 (+2822532us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54000221d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:12.853855 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402917632}
I20260709 12:16:13.045751 23689 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.046066 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.035712 24270 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:13.047021 24279 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:13.047286 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.047637 24279 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:13.048791 24270 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.049764 24279 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:13.050953 22894 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:13.020761 24178 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:13.053678 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.054472 23672 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:13.054275 24178 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:13.055049 24147 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:12.917404 22901 rpcz_store.cc:269] 0709 12:16:09.469866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.470053 (+   187us) service_pool.cc:224] Handling call
0709 12:16:10.011238 (+541185us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b58001e3398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:12.782763 (+2771525us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b540015a254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:12.783022 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75644672}
I20260709 12:16:13.057622 22745 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:13.000324 22574 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57362 (request call id 53) took 6133 ms. Trace:
I20260709 12:16:12.941138 24322 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:12.964768 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.004235 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:12.943765 24214 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:12.964881 24274 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:13.013633 24321 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:12.950901 24276 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.011499 24316 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:12.947417 24273 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:12.945653 24097 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.076778 23689 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
W20260709 12:16:13.013803 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 92300.1us
I20260709 12:16:13.019188 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 103) took 2178 ms. Trace:
I20260709 12:16:12.969870 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.010598 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:12.986773 24272 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:13.032711 24206 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:12.983117 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:13.002166 24243 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:12.942718 24181 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:16:13.001377 24099 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:13.003436 24185 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.052980 24203 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:12.989576 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 553151us
I20260709 12:16:12.948436 23960 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.051180 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.112023 23660 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:12.989681 22899 rpcz_store.cc:276] 0709 12:16:09.915086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.099022 (+183936us) service_pool.cc:224] Handling call
0709 12:16:12.782970 (+2683948us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:12.915613 (+132643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.916855 (+  1242us) spinlock_profiling.cc:243] Waited 2.68 s on lock 0x7b540015a250. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:12.916993 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6171572480}
I20260709 12:16:13.044525 23656 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:13.052018 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.066102 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.000026 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.013553 24265 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.007421 22576 catalog_manager.cc:5697] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 3, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:13.072168 22896 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:13.044875 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:12.950008 23982 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:13.013659 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:13.157671 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 144112us
I20260709 12:16:12.956548 24295 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:13.092258 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 109185us
I20260709 12:16:13.119642 22900 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:13.078433 24273 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:13.153714 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.161986 22791 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.163296 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:13.164397 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:13.081681 24214 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:13.064510 22574 rpcz_store.cc:276] 0709 12:16:06.845941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.847597 (+  1656us) service_pool.cc:224] Handling call
0709 12:16:12.978950 (+6131353us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:08.610561 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:08.611260 (+   699us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:08.611301 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:16:08.611324 (+    23us) tablet.cc:662] Decoding operations
0709 12:16:08.612394 (+  1070us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:08.612456 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:08.612482 (+    26us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:16:08.613170 (+   688us) tablet.cc:701] Row locks acquired
0709 12:16:08.613188 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:16:08.613368 (+   180us) write_op.cc:270] Start()
0709 12:16:08.613514 (+   146us) write_op.cc:276] Timestamp: P: 1783599368613317 usec, L: 0
0709 12:16:08.614493 (+   979us) op_driver.cc:348] REPLICATION: starting
0709 12:16:08.615820 (+  1327us) log.cc:844] Serialized 2890 byte log entry
0709 12:16:09.662943 (+1047123us) op_driver.cc:464] REPLICATION: finished
0709 12:16:10.130915 (+467972us) write_op.cc:301] APPLY: starting
0709 12:16:10.135118 (+  4203us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:10.216049 (+ 80931us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:10.237710 (+ 21661us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:10.301396 (+ 63686us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:10.301678 (+   282us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:16:10.301743 (+    65us) write_op.cc:312] APPLY: finished
0709 12:16:10.302109 (+   366us) log.cc:844] Serialized 58 byte log entry
0709 12:16:10.302347 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:10.302508 (+   161us) write_op.cc:454] Released schema lock
0709 12:16:10.302574 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:10.303056 (+   482us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:10.303084 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66302,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":422223,"apply.run_cpu_time_us":4054,"apply.run_wall_time_us":180142,"num_ops":7,"prepare.queue_time_us":194928,"prepare.run_cpu_time_us":24253,"prepare.run_wall_time_us":207622,"raft.queue_time_us":219933,"raft.run_cpu_time_us":24257,"raft.run_wall_time_us":349857,"replication_time_us":1030564,"thread_start_us":730158,"threads_started":4,"wal-append.queue_time_us":345230,"wal-append.run_cpu_time_us":60579,"wal-append.run_wall_time_us":3768948}]]}
I20260709 12:16:13.126855 24318 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.165292 24214 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.167091 24272 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:13.168507 24272 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.122413 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.169884 24256 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:13.093832 22892 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:13.170827 24256 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.170836 22892 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:13.171309 24256 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.171788 24256 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.111310 24099 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:13.168007 24273 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:13.172756 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.077109 24321 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:13.180059 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:13.173316 22751 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:16:13.133639 22576 catalog_manager.cc:5697] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 3 to 4, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 4 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:13.081043 24324 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 12:16:13.172109 22892 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:13.208468 24328 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.209865 24244 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:13.254062 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.255878 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.096549 24147 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:13.197901 24265 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.211180 24273 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.211555 24271 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:13.212765 23685 raft_consensus.cc:2410] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:13.191210 24214 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.213304 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.172407 23679 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:13.216058 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.218993 24322 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.266613 24265 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.096199 24090 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:13.219990 24276 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.212659 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:13.220590 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 194937us
I20260709 12:16:13.236865 22576 catalog_manager.cc:5697] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 1 to 3, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:13.079495 22895 rpcz_store.cc:276] 0709 12:16:10.840369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.867568 (+2027199us) service_pool.cc:224] Handling call
0709 12:16:13.018242 (+150674us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:13.111315 24317 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:13.263079 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 83115.9us
I20260709 12:16:13.171869 22753 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:13.160949 24097 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:13.271847 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.213006 24134 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:13.275803 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:13.098189 24206 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.268153 24244 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:13.172747 24185 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.280927 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.268467 24181 consensus_queue.cc:1243] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:16:13.283501 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 201347us
I20260709 12:16:13.268152 24147 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.292114 24276 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.294351 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:13.354817 24276 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:13.355636 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 61366us
I20260709 12:16:13.356504 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:13.356731 24206 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.357565 24206 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:13.358021 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:13.351151 24185 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:13.359409 24185 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.359865 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.360504 24321 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.361346 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.363283 24044 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:13.363704 24099 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.364434 24044 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:13.364907 24044 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:13.365103 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.365890 24184 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:13.366540 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.263827 24198 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 12:16:13.336462 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 123922us
I20260709 12:16:13.343649 22576 catalog_manager.cc:5697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 3 to 4, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 4 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:13.349452 22717 leader_election.cc:400] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5.
I20260709 12:16:13.276259 24196 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:13.369259 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:13.287809 24265 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.270649 22892 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.369989 22576 catalog_manager.cc:5697] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 3 to 4, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 4 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:13.370170 22747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "790207f3e8474996938608fcdf438660"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:49294
I20260709 12:16:13.345566 24090 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.373062 24295 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.373392 24090 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.373936 24090 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.375484 24198 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:13.375931 24198 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:13.376322 24196 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:13.376861 24198 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:13.378391 24198 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:13.380445 24147 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.381851 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.348381 24097 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:13.353325 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.283075 22745 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:13.365356 24044 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:13.308501 22864 leader_election.cc:336] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Timed out: RequestConsensusVote RPC to 127.17.249.194:36669 timed out after 2.063s (SENT)
I20260709 12:16:13.369508 22717 leader_election.cc:403] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:13.395017 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:13.395387 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46099.4us
I20260709 12:16:13.349756 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.352257 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.370137 23494 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:13.398345 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:13.371750 22747 raft_consensus.cc:606] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:13.393556 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.386386 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.397176 22751 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:13.399591 22752 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:13.396210 24240 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:13.400197 24071 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.400812 24071 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.401209 24071 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.367301 24206 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:13.403355 24097 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:13.403028 24206 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:13.404403 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.405210 24147 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:13.405761 24147 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.406165 24147 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:13.394205 24243 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.406958 24181 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:13.409425 23685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 349) took 3567 ms (client timeout 4358 ms). Trace:
W20260709 12:16:13.410030 23685 rpcz_store.cc:269] 0709 12:16:09.842425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.842664 (+   239us) service_pool.cc:224] Handling call
0709 12:16:13.409159 (+3566495us) spinlock_profiling.cc:243] Waited 3.3 s on lock 0x7b5400462b54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:13.409350 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7580452608}
I20260709 12:16:13.405216 22749 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:13.397938 24295 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5.
W20260709 12:16:13.421451 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 125629us
W20260709 12:16:13.422407 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:13.423395 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:13.423668 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:13.399591 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:13.428743 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 120315us
I20260709 12:16:13.425974 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:13.431067 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.371546 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.436846 22900 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:16:13.431802 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.427345 22750 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:13.433398 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:13.434298 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.437034 24184 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:13.441478 24184 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:13.441924 24184 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:13.444730 24318 consensus_queue.cc:1059] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:13.447032 23973 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:13.447576 23973 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:13.448148 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.448455 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.448149 24010 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:13.428220 24244 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:13.450230 22897 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:13.428589 24322 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:13.438997 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:13.450762 24244 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:13.452191 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.455076 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.455094 24010 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.461108 24010 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.461907 24010 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.464684 24196 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.466382 24282 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:13.466863 24282 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:13.448642 23973 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.467749 24282 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.468118 24256 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:13.469126 24282 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:13.470424 24256 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:13.437459 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:13.470956 22747 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 4: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:13.468128 23973 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.474366 24317 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.474836 24240 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:13.428292 24260 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
W20260709 12:16:13.488955 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 48213us
I20260709 12:16:13.489415 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:13.499011 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 61687.1us
I20260709 12:16:13.428979 24097 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:13.500516 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.509454 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:13.509948 22748 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:13.499037 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:13.500633 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:13.503939 24243 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:13.498713 24240 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:13.505926 24044 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:13.506870 23960 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:13.515272 24322 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:13.518133 24322 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:13.512638 24295 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:16:13.518525 24322 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:13.519652 24338 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:13.493522 24317 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.520571 24317 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.523676 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:13.515224 24196 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:13.524662 24196 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.524528 23982 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:13.525127 24196 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.526836 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:13.528430 24240 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.528851 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:13.531102 24204 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.516494 23934 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:13.531642 24349 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:13.532271 23934 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:13.532675 24010 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:13.508631 24340 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:13.508251 24181 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:16:13.529605 24338 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:13.534760 23982 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:13.535820 24010 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.530598 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:13.532816 24349 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:13.520071 24324 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:16:13.507315 24276 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:13.540896 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:13.548708 24324 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:13.511693 23493 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.436553 24185 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:13.538147 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48809.3us
I20260709 12:16:13.540259 24338 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:13.542958 24349 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:13.557143 24338 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:13.557505 24044 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:13.558202 24097 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:13.543622 24071 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:13.560158 24147 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.534631 23934 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:13.544844 24010 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.551502 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:13.552832 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:13.555224 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.555460 22749 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:13.574481 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:13.576200 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:13.570504 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:13.577111 23685 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:13.577315 24340 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:13.577328 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:13.573540 22749 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:13.578351 22753 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:13.562119 24071 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:13.579149 22749 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:13.580582 22749 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.575842 24324 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:13.575984 24044 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.582296 24044 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.582821 24044 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.563591 24147 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.562498 24010 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.584139 24010 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.584283 24185 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.558225 24338 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.561961 24265 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:13.587919 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 161660us
I20260709 12:16:13.589432 24265 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:13.590185 24071 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:13.562741 24276 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:13.590605 24260 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:13.593277 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.607061 24340 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:16:13.607303 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:13.608054 23685 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.608551 24147 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:13.609189 24147 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:13.597779 24181 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:13.601725 24324 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:16:13.610270 24147 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.611604 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:13.602922 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:13.593920 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.597456 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:13.619213 22820 raft_consensus.cc:2410] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:13.622516 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.625042 22900 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:13.626942 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:13.629856 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.632936 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.635412 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.636739 22827 raft_consensus.cc:2410] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:13.638458 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.638833 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.549067 24090 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:13.617671 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.650257 22897 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:16:13.651908 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58096.6us
I20260709 12:16:13.653064 22791 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:13.650272 23695 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:13.643604 24196 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.656634 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.657451 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:13.655802 24256 raft_consensus.cc:3055] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:13.659379 24256 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:13.659947 24350 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:16:13.660291 24256 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:13.661327 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.661690 24256 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:13.601547 24071 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:13.663100 24071 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:13.663178 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.664147 22821 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:13.664786 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:13.665512 22821 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:13.657358 22823 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:13.667223 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.668182 22823 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:13.668468 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.669422 22823 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:13.669880 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.670487 22899 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:13.671543 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.672755 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.674082 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.674839 22818 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:13.675779 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.676843 24260 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:13.677433 24260 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:13.678424 24260 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:13.663301 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.680153 23682 raft_consensus.cc:2410] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:16:13.601105 23973 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:16:13.656843 24272 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:13.681416 24272 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:13.682626 24272 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:13.665650 23674 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:13.685174 24322 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:13.575995 24317 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:13.670504 22823 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
W20260709 12:16:13.712674 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:13.719823 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 65167.5us
I20260709 12:16:13.714279 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.721863 22747 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:13.723479 22753 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:13.723551 23493 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:13.731942 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 79013.7us
I20260709 12:16:13.732777 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.733618 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:13.734203 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:13.728647 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:13.737563 22825 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:13.740338 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.741374 23656 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:13.744273 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:13.739503 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 66097.7us
I20260709 12:16:13.746548 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.748804 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:13.751750 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.753610 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.754266 23689 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 4: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:13.727911 24272 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.759256 22823 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:13.759758 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.758169 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.760998 22825 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:13.763471 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.764447 23660 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:13.765570 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.766991 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:13.767696 23660 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.761368 23656 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:13.770023 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.770901 23689 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:13.771055 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.771072 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:13.772799 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:13.773914 24353 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:16:13.769505 24318 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:13.776729 24318 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:13.739081 24206 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:13.743223 24273 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:13.779448 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.743301 24204 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:13.780103 23656 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:13.742976 23934 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:13.782409 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:13.784150 22900 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:13.656807 24181 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 12:16:13.739312 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:13.755182 24240 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:13.822379 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.824903 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:13.805838 22747 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:13.790194 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:13.822045 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.849080 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:13.828212 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45901.2us
I20260709 12:16:13.849738 22823 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
W20260709 12:16:13.821991 24350 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:16:13.830511 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:13.758901 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:13.818521 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.835520 23494 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.857890 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.839479 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:13.861399 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.862231 24134 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:13.863269 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.865001 22818 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:16:13.865494 22818 pending_rounds.cc:85] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 3
I20260709 12:16:13.865790 22818 pending_rounds.cc:107] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:16:13.866086 22818 raft_consensus.cc:2889] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:13.821712 24273 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:13.868084 24273 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.777516 24318 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:13.871500 24318 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.828045 23934 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:13.873528 23934 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.839956 24204 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:13.879810 24204 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.883716 24328 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:13.884125 24322 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.884859 23672 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:13.885138 24090 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:13.887048 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.828398 24317 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:13.891167 24184 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:13.893023 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.893445 24184 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.845108 24244 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.894198 24244 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.894953 24244 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:13.896019 24338 raft_consensus.cc:993] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: : Instructing follower a89a4b420ea9496aab55475fc38bb6f7 to start an election
I20260709 12:16:13.896727 24358 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:13.788488 24206 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:13.846046 23660 raft_consensus.cc:2410] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:13.850636 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.905014 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:13.851442 22899 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:13.829383 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:13.761647 24196 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:13.894368 22749 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:13.833606 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:13.908704 22900 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:13.909214 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.778888 22821 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:13.921753 23660 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:13.922859 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:13.923269 23660 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:13.793586 24243 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:13.836907 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.864915 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:13.839893 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:13.844524 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:13.902824 22751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:49294
I20260709 12:16:13.929157 22751 raft_consensus.cc:606] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:13.905143 22823 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 1.
I20260709 12:16:13.852459 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:13.839901 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:13.905053 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 47627.7us
I20260709 12:16:13.931702 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:13.938941 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.931645 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:13.929730 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 64885.3us
I20260709 12:16:13.932117 22826 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:13.940629 22900 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:13.920858 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:13.910516 22825 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
W20260709 12:16:13.944739 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 92372us
I20260709 12:16:13.946153 22790 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:16:13.953831 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:13.845470 24097 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:16:13.908444 24206 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:13.920161 24255 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:13.966169 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:13.969732 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:13.983582 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 62841.7us
I20260709 12:16:13.974349 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.920028 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:13.943568 24329 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:16:13.980782 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:13.956547 24321 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:13.985744 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.004989 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:14.009637 22751 raft_consensus.cc:2376] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5. Re-sending same reply.
I20260709 12:16:14.023276 22825 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:13.927824 24243 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.956390 24240 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:13.957096 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:14.024806 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:13.975663 24185 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:13.977563 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:14.049540 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:13.959412 24357 raft_consensus.cc:1081] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Signalling peer a89a4b420ea9496aab55475fc38bb6f7 to start an election
W20260709 12:16:14.030086 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44446.9us
I20260709 12:16:14.050441 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:14.053303 22826 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:14.007936 24198 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:14.050362 22824 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:13.972427 24328 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:16:14.004468 24178 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.056561 22751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:49294
I20260709 12:16:14.008972 22899 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:14.007266 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.025506 24128 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:14.029404 24243 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:14.072026 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:14.062327 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 92493.5us
I20260709 12:16:14.076987 24328 consensus_queue.cc:1243] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:16:14.079813 22751 raft_consensus.cc:606] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:14.085163 23695 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:14.048813 24185 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:14.086926 22899 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:14.051821 24317 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:14.060169 24265 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:14.099177 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:14.098557 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:14.058327 24198 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:14.115414 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 121908us
W20260709 12:16:14.139839 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:14.149490 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 183376us
I20260709 12:16:14.150327 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:14.144021 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 92639.2us
I20260709 12:16:14.155702 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:14.152669 22864 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:14.158926 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 133088us
I20260709 12:16:14.109423 24185 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.092500 24128 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:14.172545 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.130338 24198 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.130868 24196 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:14.143054 24321 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:14.177384 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.161166 24134 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:14.185376 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.168289 24316 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.188884 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:14.180156 24317 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:14.173662 24214 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260709 12:16:14.215237 24360 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:16:14.217555 23685 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.008s
W20260709 12:16:14.196338 24256 consensus_meta.cc:287] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.002s
I20260709 12:16:14.216339 23934 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:14.188148 24189 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.231491 24147 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:14.186539 24196 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:16:14.232575 24044 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.004s
I20260709 12:16:14.232801 24128 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:14.233179 24196 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:14.236542 24328 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:14.237011 24328 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:14.237562 24244 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:14.238744 24328 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:14.192895 24178 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.239982 24328 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.229530 24321 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:14.254266 24265 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:14.254992 24265 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:14.255923 24355 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.358s	user 0.007s	sys 0.000s
W20260709 12:16:14.245412 24071 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.007s
I20260709 12:16:14.258507 24134 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:14.251219 24044 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:14.312106 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.008s	sys 0.000s
W20260709 12:16:14.383185 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.009s	sys 0.000s
W20260709 12:16:14.383939 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 626548us
I20260709 12:16:14.385736 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:14.315477 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.386451 24206 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:14.389595 23674 raft_consensus.cc:2393] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:14.392887 24206 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:14.098374 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:14.317464 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:14.400892 24181 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:14.401535 24181 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:14.402640 22750 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:14.403869 24181 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:14.405793 24044 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:14.325294 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:14.326061 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.330896 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:14.332162 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:14.331985 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:14.419533 22821 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:14.336129 22823 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:14.336251 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:14.338079 22827 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:14.423934 22824 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:14.336323 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:14.338117 22822 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:14.426559 22826 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
W20260709 12:16:14.344192 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 158727us
W20260709 12:16:14.345749 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 156937us
W20260709 12:16:14.344776 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 155824us
W20260709 12:16:14.347718 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.431948 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.432337 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.366217 23934 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:14.268778 24185 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:14.259670 24071 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:14.376979 24189 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:14.441061 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.442174 24189 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:14.444604 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.388049 23682 raft_consensus.cc:2368] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4.
I20260709 12:16:14.405704 24181 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.447129 22898 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:16:14.447824 22745 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:16:14.398283 24010 consensus_meta.cc:287] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.813s	user 0.011s	sys 0.010s
I20260709 12:16:14.442320 22894 raft_consensus.cc:2376] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2. Re-sending same reply.
I20260709 12:16:14.451229 24010 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:14.452872 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.415344 22818 raft_consensus.cc:2368] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4.
I20260709 12:16:14.453630 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:14.416280 22820 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:14.349411 23685 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:14.455688 22901 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:14.459501 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:14.439661 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:14.460455 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:14.460788 24189 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.462147 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:14.437896 24185 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:14.457319 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:14.468246 24185 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:14.462568 22900 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:14.469579 22893 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:14.469579 24189 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:14.470664 24189 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:14.459678 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:14.474419 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:14.381732 24134 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:14.457693 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:14.450309 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:14.478536 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:14.478372 24189 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:14.441125 24071 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:14.471376 22900 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:14.472232 22901 raft_consensus.cc:2410] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:14.473081 23982 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:14.473804 22744 pending_rounds.cc:85] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 1
W20260709 12:16:14.471980 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 86666.6us
I20260709 12:16:14.271270 24243 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:14.276237 24244 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:14.268342 24273 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:14.457302 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.491075 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.454754 24010 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:14.499627 22893 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:14.501361 22898 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.501406 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.488436 23982 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:14.504921 22819 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:14.505213 23982 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:14.490970 22744 pending_rounds.cc:107] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:16:14.506603 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.512698 22901 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:14.487381 24265 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:14.511327 22744 raft_consensus.cc:2889] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:14.532905 24273 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:14.533438 24243 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:14.534893 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:14.536427 22894 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:14.536530 24382 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:14.538589 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:14.542587 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.543555 24321 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:14.543612 24328 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:14.544981 24265 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:14.544731 24328 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:14.544672 24321 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:14.545756 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.547611 24328 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:14.548954 24196 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:14.547621 24321 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:14.549698 22899 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:16:14.548367 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 102168us
I20260709 12:16:14.551527 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.552745 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:14.554023 22819 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:14.541867 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:14.539664 22749 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.550027 24196 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:14.567305 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:14.559900 24189 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:14.570667 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.575678 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:14.582643 24396 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:14.583300 24396 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:14.583808 24396 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:14.578128 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:14.587112 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:14.587296 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:14.587766 22751 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:14.588049 23682 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:14.583173 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:14.572623 24196 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:14.596328 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:14.598660 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:14.600566 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:14.601925 23660 raft_consensus.cc:2410] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:16:14.603587 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 52422.8us
W20260709 12:16:14.603384 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 95673.6us
I20260709 12:16:14.609323 23494 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.610669 24328 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.611617 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:14.612352 22898 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
W20260709 12:16:14.616314 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.618069 23973 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:14.613160 24328 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.619529 23973 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:14.619962 23973 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:14.620296 24265 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.622414 24181 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:14.622952 24181 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:14.623483 24181 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:14.624116 23973 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:14.626504 23973 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:14.628584 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:14.627688 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:14.629627 22827 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:14.630143 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:14.633217 23685 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:14.629168 22818 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:16:14.590965 24395 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.220s	user 0.002s	sys 0.000s
I20260709 12:16:14.639804 22901 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:14.656059 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:14.666173 22827 raft_consensus.cc:2368] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5.
I20260709 12:16:14.660562 24206 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:14.687286 23660 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:16:14.690646 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:14.691824 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 65337.1us
I20260709 12:16:14.693135 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:14.681548 24206 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:14.694049 24206 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:14.698256 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:14.709381 24196 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:14.714143 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:14.714823 22717 leader_election.cc:400] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4.
I20260709 12:16:14.722723 22717 leader_election.cc:403] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:14.715081 24358 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:14.717032 24372 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:16:14.731295 22747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:49294
I20260709 12:16:14.734643 22747 raft_consensus.cc:606] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:14.702630 23982 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:14.722721 24196 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:14.735178 22747 raft_consensus.cc:614] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:14.742480 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:14.745810 24358 consensus_queue.cc:1243] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:16:14.746517 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:14.740813 24196 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:14.762354 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47832.5us
I20260709 12:16:14.757354 24243 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:14.771355 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 78407.7us
I20260709 12:16:14.777581 23982 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:14.777508 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:14.780467 22826 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:14.781622 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.781574 24328 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:14.765482 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 47312.7us
I20260709 12:16:14.765239 23685 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 4: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:14.783085 22892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:14.783263 24206 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:14.799587 23493 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.794032 24134 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:16:14.798197 24400 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
I20260709 12:16:14.792984 24243 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:16:14.806550 22892 raft_consensus.cc:606] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:14.804864 24134 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:14.819016 24387 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.820869 22749 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:14.821530 24358 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4.
W20260709 12:16:14.826448 24404 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.005s
I20260709 12:16:14.829368 24382 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:14.829995 24382 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:14.827533 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.831394 24243 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.836071 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:14.836653 24178 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.017s
I20260709 12:16:14.837316 24178 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.837810 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:14.838686 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46204.9us
I20260709 12:16:14.839288 24273 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.839498 24265 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:16:14.829239 24198 consensus_meta.cc:287] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.015s
I20260709 12:16:14.847165 24198 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:14.850833 22820 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:14.851665 24382 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:14.855319 24198 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:14.817097 24134 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:14.817991 22892 raft_consensus.cc:614] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:16:14.860409 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:14.849484 24402 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:16:14.862593 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 81143.6us
I20260709 12:16:14.861157 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:14.863580 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.881378 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:14.880424 24044 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:14.885998 22820 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:14.883684 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:14.887657 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:14.885535 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:14.879536 24382 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.893540 22747 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:14.880544 24189 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.893577 22826 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:14.898016 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.901705 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:16:14.910346 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.906756 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:14.926812 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:14.930378 24243 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.895884 24044 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:14.931126 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:14.907553 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:14.932934 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:14.948355 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:14.951195 24198 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:14.937067 22900 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:14.941095 22826 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:14.940991 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.941745 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:14.942339 23660 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:14.925407 24181 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:14.955999 23695 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:14.959666 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 146628us
I20260709 12:16:14.950587 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:14.963346 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:14.963670 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:14.965436 24377 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:14.965839 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.966977 24265 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.967564 24071 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:14.968173 23934 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:14.969563 24181 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:14.967641 22748 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:14.961539 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:14.971817 24377 raft_consensus.cc:2764] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:16:14.972307 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 82743.5us
I20260709 12:16:14.973312 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:14.974462 24377 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:14.975454 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.977115 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.968190 24071 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:14.981894 24071 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:14.984015 22896 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:14.987571 24377 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:14.933197 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:14.988665 24377 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:14.988554 24396 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:14.992652 24406 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:16:14.994117 24184 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:14.998392 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:14.999462 22892 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:15.003216 24044 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:15.005016 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:15.007030 24265 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:15.011610 23660 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:15.012949 23656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "790207f3e8474996938608fcdf438660"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:45644
I20260709 12:16:15.013721 23656 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:15.014087 23656 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:15.018175 23685 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:15.008988 24396 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:14.960564 23659 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:15.012843 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:14.946041 24196 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:15.025274 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 62104.4us
I20260709 12:16:15.047906 24189 consensus_queue.cc:1059] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:15.048363 24196 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:15.033206 22893 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:15.049135 24189 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:15.050175 24378 raft_consensus.cc:3055] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:15.050626 24378 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:15.048363 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.051599 24378 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.053522 24378 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:15.022439 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.034942 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:15.020097 24317 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:15.058650 24198 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:15.059998 24260 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:15.060431 24260 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:15.061465 24260 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:15.064513 24244 consensus_queue.cc:1059] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:15.066015 24128 raft_consensus.cc:3055] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:15.066362 24128 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:15.067338 24128 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.024938 23934 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:15.073648 22747 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:16:15.074651 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.024210 22745 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:16:15.075364 22745 pending_rounds.cc:85] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 1
I20260709 12:16:15.023563 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:14.980290 24206 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:15.042714 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.008913 22573 catalog_manager.cc:5697] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:15.044386 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:15.073824 24260 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:15.035794 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:15.039990 22576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 127) took 5663 ms. Trace:
I20260709 12:16:15.075691 22745 pending_rounds.cc:107] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:16:15.083736 23656 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:15.094453 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58741.5us
I20260709 12:16:15.027655 24265 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:15.098976 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.105086 22822 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:15.107146 23656 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:15.088327 22745 raft_consensus.cc:2889] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:15.082347 24196 consensus_queue.cc:1059] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:16:15.100068 24198 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:16:15.097499 24243 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:15.117648 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:15.081730 24317 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:16:15.117686 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:15.127166 24265 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:15.151041 22820 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:15.151793 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:15.152613 23695 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:15.153812 22750 raft_consensus.cc:3055] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:15.160327 22750 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:15.148033 24128 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:15.175845 22750 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.176419 24265 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:15.181903 22750 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:15.151026 23934 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.161320 24181 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.200034 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:15.177057 24244 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:15.193907 22573 catalog_manager.cc:5697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:15.212247 24134 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:15.216881 24134 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:15.217891 24071 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:15.219297 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 128211us
I20260709 12:16:15.220309 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:15.220680 24071 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:15.229753 22892 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:15.234005 23973 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:15.208577 24181 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.236807 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:15.242883 24396 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:15.243373 24396 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:15.237094 24181 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:15.237257 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:15.211009 23659 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:15.207820 24244 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:15.194343 23934 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:15.251000 22750 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:15.260979 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:15.255182 22573 catalog_manager.cc:5697] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 2 to 3, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 3 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:15.267457 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 290478us
I20260709 12:16:15.269163 22865 leader_election.cc:400] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5.
I20260709 12:16:15.269704 22865 leader_election.cc:403] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:16:15.250964 24244 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:15.275693 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:15.086680 22576 rpcz_store.cc:276] 0709 12:16:09.376637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.378465 (+  1828us) service_pool.cc:224] Handling call
0709 12:16:15.039699 (+5661234us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:13.925360 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:14.154093 (+228733us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:14.160205 (+  6112us) write_op.cc:435] Acquired schema lock
0709 12:16:14.164774 (+  4569us) tablet.cc:662] Decoding operations
0709 12:16:14.244744 (+ 79970us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:14.244806 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:14.244838 (+    32us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:16:14.251171 (+  6333us) tablet.cc:701] Row locks acquired
0709 12:16:14.252640 (+  1469us) write_op.cc:260] PREPARE: finished
0709 12:16:14.260211 (+  7571us) write_op.cc:270] Start()
0709 12:16:14.260376 (+   165us) write_op.cc:276] Timestamp: P: 1783599374260115 usec, L: 0
0709 12:16:14.260403 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:16:14.264774 (+  4371us) log.cc:844] Serialized 2890 byte log entry
0709 12:16:14.281741 (+ 16967us) op_driver.cc:464] REPLICATION: finished
0709 12:16:14.823408 (+541667us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b180006bf20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:16:14.824016 (+   608us) write_op.cc:301] APPLY: starting
0709 12:16:14.824207 (+   191us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:14.824586 (+   379us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:14.824633 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:14.826042 (+  1409us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:14.826516 (+   474us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:16:14.826601 (+    85us) write_op.cc:312] APPLY: finished
0709 12:16:14.856235 (+ 29634us) log.cc:844] Serialized 58 byte log entry
0709 12:16:14.858109 (+  1874us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:14.858400 (+   291us) write_op.cc:454] Released schema lock
0709 12:16:14.858492 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:14.925388 (+ 66896us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:14.932744 (+  7356us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":82121,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":395220,"apply.run_cpu_time_us":5096,"apply.run_wall_time_us":66747,"num_ops":7,"prepare.queue_time_us":354092,"prepare.run_cpu_time_us":10420,"prepare.run_wall_time_us":417779,"raft.queue_time_us":979,"raft.run_cpu_time_us":9790,"raft.run_wall_time_us":427452,"replication_time_us":21168,"spinlock_wait_cycles":4842240,"thread_start_us":636785,"threads_started":4,"wal-append.queue_time_us":13343}]]}
I20260709 12:16:15.258431 24181 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:15.244318 24396 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.284126 22573 catalog_manager.cc:5697] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 2 to 4, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.272701 24198 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:15.286398 22820 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:15.289873 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:15.271736 24317 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:15.281147 24378 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5.
I20260709 12:16:15.298856 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:15.277676 24189 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:16:15.289309 24273 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:15.303695 24198 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:15.316320 24198 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:15.306257 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:15.320147 23982 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:15.321159 24273 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:15.321856 24273 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:15.321900 24387 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:15.323068 24273 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:15.304206 22573 catalog_manager.cc:5697] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 3, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 3 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.335955 22573 catalog_manager.cc:5697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 3, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 3 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:15.337915 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 52221.9us
I20260709 12:16:15.337915 22573 catalog_manager.cc:5697] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 2 to 4, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:15.340245 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.343905 22573 catalog_manager.cc:5697] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:16:15.346678 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:15.345760 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 67404.6us
I20260709 12:16:15.346664 22573 catalog_manager.cc:5697] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:15.345000 23934 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:15.357829 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 75979.7us
I20260709 12:16:15.356000 22573 catalog_manager.cc:5697] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 3 to 4, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.358260 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:15.363435 24189 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:15.364308 24189 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:15.367311 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:15.366626 22820 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:15.371495 23934 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:15.372009 23934 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:15.372956 23934 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:15.374182 22820 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:15.382762 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:15.384876 24206 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:15.385353 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:15.385566 24206 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.386108 23659 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:15.386741 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.387988 24206 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:15.391016 22791 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:15.392896 24044 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:15.382527 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:15.366602 24189 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:15.400626 22820 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:15.402901 23493 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:15.396448 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:15.382059 24387 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.415550 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:15.427873 23494 leader_election.cc:400] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4.
I20260709 12:16:15.429154 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:15.431174 24328 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:15.431452 24396 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:15.430680 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:15.444566 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:15.447326 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.401873 24189 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:15.411142 24071 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:15.415108 24422 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.462708 23973 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.463419 23973 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.464262 24189 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:15.465610 23973 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:15.466895 24421 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:16:15.456642 23982 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:16:15.471573 24349 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.449923 24387 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.417565 24134 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:16:15.477329 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:15.462308 24422 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.421227 24206 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:15.466470 24189 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:15.500927 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:15.501914 22750 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:15.496546 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:15.510686 24206 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:15.512120 24206 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.514106 24419 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:15.478838 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:15.494208 24071 raft_consensus.cc:697] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:15.516201 24424 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:16:15.515902 24071 consensus_queue.cc:237] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:15.486515 24377 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:15.532950 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 88210.1us
I20260709 12:16:15.533209 24382 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:15.566857 22826 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:15.570158 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:15.519057 24349 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:15.571902 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 87318.8us
I20260709 12:16:15.573248 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:15.574039 22893 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:15.575310 22898 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:15.589113 23674 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:16:15.589557 23674 pending_rounds.cc:85] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 2
I20260709 12:16:15.589814 23674 pending_rounds.cc:107] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:16:15.590011 24349 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:15.585774 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:15.593915 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:15.595569 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 70799.5us
I20260709 12:16:15.578841 24273 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:15.581777 24328 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:15.599466 23689 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:15.590057 23674 raft_consensus.cc:2889] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:15.600632 24349 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:16:15.610306 23682 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: []
W20260709 12:16:15.608577 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 177505us
I20260709 12:16:15.601184 24396 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.587580 24378 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:16:15.632251 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:15.618583 24422 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:15.611168 24425 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:16:15.639184 22746 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:15.641382 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:15.647349 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:15.650974 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:15.655141 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:15.602178 24128 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:16:15.667179 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:15.621500 24181 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:15.610713 24387 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:15.632351 24273 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:15.629091 24434 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:15.607133 23982 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:16:15.681640 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:15.689340 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:15.688957 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 89899.8us
I20260709 12:16:15.692576 23493 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:15.695897 22893 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:15.697535 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:15.697927 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:15.698537 22894 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:15.681171 24434 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.700429 24434 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:15.701208 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:15.647846 24396 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:15.704757 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:15.705847 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 109585us
I20260709 12:16:15.710508 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:15.711318 22750 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:15.709657 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:15.690582 24358 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:15.705955 24206 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:15.721669 22898 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:16:15.722074 22898 pending_rounds.cc:85] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 2
I20260709 12:16:15.722285 22898 pending_rounds.cc:107] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:16:15.722478 22898 raft_consensus.cc:2889] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:15.702502 24244 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:15.728279 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:15.730342 22896 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:15.734452 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:15.735355 22895 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:15.736792 24244 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:15.695479 24273 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:15.739295 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:15.739849 24273 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:15.740459 23672 raft_consensus.cc:2410] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:16:15.723951 24358 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:15.741683 24426 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:16:15.742084 24358 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.743229 24377 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:15.744246 24407 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:15.744673 24407 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:15.745898 24407 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:15.748116 22819 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:15.753329 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:15.753383 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 129235us
I20260709 12:16:15.746865 23659 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:15.706868 24189 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:16:15.722916 24206 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.761101 23695 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:15.760061 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:15.718046 24128 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:16:15.757833 22749 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:15.773432 22749 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:15.780036 22749 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:15.764586 24206 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:15.764340 24044 raft_consensus.cc:2764] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:16:15.778198 24447 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:15.776662 24377 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:15.820152 24407 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:15.815637 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.803064 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:15.815196 22749 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:15.857694 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 127862us
I20260709 12:16:15.858660 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:15.857905 24189 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:15.870494 24411 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:15.878078 24435 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:15.879297 22819 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:15.883004 24396 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:15.883800 23982 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:15.864135 24419 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.888062 23672 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:15.855852 24377 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:15.890980 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:15.931430 22823 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:15.869774 24128 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.924196 24189 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:15.930008 22892 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:15.939548 23934 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.932430 24435 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:15.946228 24396 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:15.942481 24419 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:15.975219 24377 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:15.983566 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 92723.9us
I20260709 12:16:15.953447 24128 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:15.986809 24419 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:15.992273 22749 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:15.992353 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:15.996832 24396 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:15.997526 24396 consensus_queue.cc:1243] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:16:15.994596 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:16.001543 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.004009 24189 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.005229 24434 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:16.005744 24189 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:16.005460 24435 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.006935 24435 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:16.020321 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.960285 23934 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.001852 24178 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:16.106475 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 97743.5us
W20260709 12:16:16.108364 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:16.112950 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 128672us
I20260709 12:16:16.113974 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:16.112568 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:16.123530 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.094146 24455 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:16.105860 24244 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.112368 24321 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:16.138988 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 356505us
I20260709 12:16:16.121567 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:16.149251 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:16.149881 23685 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:16.128634 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:16.215405 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 51793.3us
W20260709 12:16:16.183763 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.112706 24178 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:16.217185 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 58752.7us
I20260709 12:16:16.141266 24411 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:16.142340 24434 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:16.227582 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:16.233959 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 114730us
I20260709 12:16:16.215890 23973 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:16.236251 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 90031.3us
I20260709 12:16:16.243841 23494 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:16.139943 24244 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:16.161237 24377 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:16:16.219022 22744 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:16.229990 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:16.137279 24455 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:16.232733 24272 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:16.233319 24372 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:16.159595 24321 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:16.251875 24433 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:16.277894 22901 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:16.275971 24272 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:16.281229 24458 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260709 12:16:16.251394 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.250900 24457 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:16.295338 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:16.295984 22827 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:16.300454 22826 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:16.274809 24464 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:16.249615 24396 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:16:16.292774 24184 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:16:16.299165 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.290443 24372 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:16.309661 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:16.287443 24419 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:16.315783 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:16.315922 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 203436us
W20260709 12:16:16.308525 24445 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 12:16:16.320083 22818 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:16.320269 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:16.327368 24272 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:16.327723 24178 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:16.328166 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:16.329254 23674 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:16.311995 24464 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.331053 24457 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:16.332365 24464 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:16.332137 24457 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:16.332952 22894 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:16.333364 24382 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:16.335194 24372 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.337564 24396 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:16.339080 24321 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:16.339866 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:16.347800 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.343436 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:16.353823 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.343902 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:16.351565 23660 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:16.355310 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:16.355782 22901 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:16:16.319164 23934 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:16.357945 23494 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:16.360132 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.360917 22900 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:16.362406 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:16.363085 23695 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:16.348163 24184 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:16.363201 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:16.347922 24396 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:16.373974 22892 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:16.373920 24396 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.375620 24396 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:16.376397 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.366986 24433 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:16.380378 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:16.371821 24444 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:16.359452 24321 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:16.372498 24184 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:16.362191 24407 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:16.408548 23973 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:16.357512 24467 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:16.380625 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.387090 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:16.345418 24419 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:16.424356 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:16.429548 23660 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:16.388001 24321 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:16.389005 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:16.397727 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:16.400120 24244 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:16.409389 24455 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:16.410320 24440 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.565s	user 0.008s	sys 0.006s
I20260709 12:16:16.372028 24430 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:16.412282 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:16.415299 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:16.423581 23656 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:16.437580 24198 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:16.438259 24419 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:16.466490 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.438112 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:16.414645 24206 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.581s	user 0.005s	sys 0.005s
I20260709 12:16:16.453842 23660 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:16.456463 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:16.459113 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:16.469353 23689 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:16.470103 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:16.448863 24321 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:16.473285 22892 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 2: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:16.474223 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:16.454777 23934 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.458863 22746 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:16.480547 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:16.463860 24430 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:16.487089 24184 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:16.490737 23672 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:16.474915 24206 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:16.492362 24431 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:16.492859 24431 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:16.493227 24431 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:16.493263 24206 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:16.484355 24328 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:16.472916 24071 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:16:16.483909 24044 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:16.495659 24044 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:16.496969 24044 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:16.472481 24407 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:16.483459 23934 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:16.507975 24407 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:16.521577 24471 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:16.522393 24471 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:16.525720 24471 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:16.477246 24467 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:16.528018 24467 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:16.528533 24467 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:16.494997 24430 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:16.536154 23934 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:16.539628 24181 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:16.540150 24181 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:16.551476 24471 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:16.557109 24471 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:16.559600 24471 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:16.544531 24181 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:16.565778 24181 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:16.567108 24407 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:16.553594 24467 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:16.583236 24321 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:16.587963 24477 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:16.593659 24321 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:16.597376 24430 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:16.597425 24431 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.663968 24431 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:16.666694 24430 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:16.690104 24128 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:16.700176 24377 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.700981 24377 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.703542 24377 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:16.726718 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.727484 22897 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:16.729290 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:16.729982 24377 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:16.730307 24377 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:16.730589 24377 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:16.738960 24377 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.743664 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:16.743818 24377 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:16.744328 22898 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:16.744287 24422 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.745183 24422 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:16.746275 24468 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.746949 24468 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:16.747712 24422 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:16.749607 24468 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:16.751592 22898 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:16.752902 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:16.753573 24377 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:16.754046 24377 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:16.755590 24377 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.802511 24430 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.803048 24430 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.805238 24430 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:16.809466 24181 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.810266 24181 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:16.813257 24181 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:16.834906 24447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.014s	sys 0.047s
W20260709 12:16:16.835527 24447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.014s	sys 0.047s
I20260709 12:16:16.835852 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:16.836755 22822 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:16.836789 24450 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:16.840778 24358 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:16.841205 24358 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:16.842073 24358 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:16.843309 24358 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:16.866937 24481 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.867885 22895 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:16.867762 24481 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:16.869648 24044 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:16.870888 24044 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:16.871248 24044 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:16.871654 24481 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:16.872150 24044 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:16.873529 24044 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:16.889623 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.890609 22898 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:16.892931 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:16.893743 23682 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:16.893975 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:16.894982 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:16.895653 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:16.895010 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:16.896823 22897 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:16.897112 24272 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:16.897742 24272 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:16.895879 22818 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:16.895054 23672 raft_consensus.cc:2410] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:16.900216 24272 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:16.897174 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:16.904132 22824 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 2: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:16.896369 23674 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:16.907074 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:16.907886 22818 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:16.908155 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:16.915257 22824 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:16.916325 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:16.921785 22818 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:16.924540 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.925611 22898 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:16.928465 22897 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:16.915964 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:16.930258 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.931107 22898 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:16.932878 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:16.940119 24430 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:16.940995 24387 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.941679 24387 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.942749 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:16.944878 24467 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.945513 24467 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:16.949571 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.951488 24467 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:16.952039 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:16.937125 24481 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:16.952831 22898 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:16.953074 24434 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:16.953531 24434 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:16.956423 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:16.958102 22897 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:16.959442 23494 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:16.954350 24434 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.963768 24321 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:16.966331 24434 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:16.963238 24431 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:16:16.960516 24430 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:16:16.966646 24321 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:16.957365 24387 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:16.970682 24321 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:16.959746 24481 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:16.975159 24481 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.959098 24044 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:16.978087 24044 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:16.978578 24044 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:16.980741 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:16.981925 23695 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:16.962343 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:16.985791 23660 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:16.956775 23674 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:16.986829 24431 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:17.006577 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:17.015161 24071 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.021095 24071 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:17.021418 24419 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:16:17.021910 22746 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.525s	user 0.014s	sys 0.001s
I20260709 12:16:17.022130 24419 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.022369 22746 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:17.022596 24419 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:17.023523 24071 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:16.988843 24371 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:16:17.025689 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:17.001891 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:17.027386 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:17.029035 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:17.017340 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:17.002300 24422 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:16:17.043010 22897 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:17.031777 24260 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:17.045943 24260 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.046346 24260 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:17.048717 23682 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:17.055114 23679 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:17.030848 23659 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:17.037635 24478 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:17.058015 24478 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.058387 24478 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:17.031016 24430 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:17.069317 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:17.070370 23659 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:17.075742 23659 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:16:17.077849 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:17.078593 22897 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:17.080633 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:17.081336 22827 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:17.092932 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:17.082106 24430 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:17.110698 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:17.111577 22892 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:17.098440 24273 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:17.116313 24430 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:17.118055 22894 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:17.099050 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:17.132930 22892 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:17.099519 24272 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:16:17.136756 24265 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:16:17.161705 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 152029us
I20260709 12:16:17.170995 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:17.174650 22865 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:17.181135 22865 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:17.167147 24265 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:17.181934 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 98680us
I20260709 12:16:17.173260 24455 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:17.189150 24468 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:17.191841 24468 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.192425 24468 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:17.195539 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:17.200157 24494 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:17.207388 24494 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:17.208204 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:17.208889 22899 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:17.207137 24044 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:17.211627 23672 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:17.212513 24044 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:17.205785 24431 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:17.217783 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 837450us
I20260709 12:16:17.216030 24260 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:17.196581 24455 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.210572 24498 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.219439 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 201) took 1596 ms. Trace:
I20260709 12:16:17.221413 24491 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.223326 24321 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:17.194459 24265 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:17.182746 24422 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:17.228510 22752 rpcz_store.cc:276] 0709 12:16:15.623103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.623215 (+   112us) service_pool.cc:224] Handling call
0709 12:16:15.631608 (+  8393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:15.632100 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:15.632145 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:15.632684 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:16:15.712267 (+ 79583us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:15.712314 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.712389 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:16.374311 (+661922us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:17.218983 (+844672us) raft_consensus.cc:1685] finished
0709 12:16:17.219011 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:17.219329 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":114,"spinlock_wait_cycles":53155712,"thread_start_us":79062,"threads_started":1,"wal-append.queue_time_us":122350}
I20260709 12:16:17.236442 24422 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:17.193516 24349 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:17.239169 24349 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.239717 24349 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:17.188526 24189 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.225838 22899 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:17.232395 24272 consensus_queue.cc:1243] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:17.227021 24455 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:17.232595 24497 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.232874 24273 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:17.233382 24371 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:17.233747 24358 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:17.244144 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:17.255405 24272 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:17.261967 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:17.262439 24260 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:17.270328 24431 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:17.271663 24431 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:17.276101 22818 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:17.277027 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:17.278030 23659 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 5: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:17.278178 22818 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:17.259023 24189 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:17.282013 24422 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:17.285631 24478 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:17.287079 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:17.287847 24468 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:17.292416 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.302740 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:17.278826 24447 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:17.303576 22892 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:17.255769 24071 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:16:17.290464 24468 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:17.305792 24181 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:17.315677 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:17.319754 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 106794us
I20260709 12:16:17.306056 24483 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:17.320955 22901 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:17.324724 22898 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:17.324958 22822 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:17.325248 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:17.325997 22820 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:17.326337 22819 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:17.326654 22892 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:17.326823 22819 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:17.327749 22819 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:17.328979 22819 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:17.329789 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:17.330711 24493 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:17.331260 24493 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:17.332159 24493 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:17.332355 22820 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:17.338073 24377 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:17.339190 22819 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:16:17.339722 22819 pending_rounds.cc:85] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 3
I20260709 12:16:17.340116 22819 pending_rounds.cc:107] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:16:17.340404 22819 raft_consensus.cc:2889] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:17.342527 24377 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:17.343369 24411 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:17.345481 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:17.267445 24358 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:17.234182 24498 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:17.283563 24431 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:17.208707 24494 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:17.245270 24491 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:17.267979 24272 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:17.346287 24411 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:16:17.351748 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 64773.9us
I20260709 12:16:17.318089 24447 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:17.279155 24371 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:17.354578 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:17.266063 24497 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:17.360805 22750 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:17.361370 22750 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:17.317879 24419 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:17.353737 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:17.357905 24447 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:17.369333 22750 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:17.353297 24377 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:16:17.385736 23682 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:17.408911 22750 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:17.421679 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:17.385565 24434 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.357576 24502 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:16:17.349121 24483 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:17.440676 22750 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:16:17.441114 22750 pending_rounds.cc:85] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 1
I20260709 12:16:17.355240 24273 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:17.443996 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:17.441412 22750 pending_rounds.cc:107] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:16:17.447260 22750 raft_consensus.cc:2889] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:17.448367 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 403) took 1439 ms. Trace:
W20260709 12:16:17.437678 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 83236us
I20260709 12:16:17.436874 24515 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:17.457114 24515 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:17.457563 24272 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:17.458001 24497 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:17.459219 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:17.459651 24419 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:17.460026 22895 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:17.461256 24491 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:17.457610 24515 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:17.435701 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:17.468082 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:17.465461 22750 rpcz_store.cc:276] 0709 12:16:16.008817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:16.008979 (+   162us) service_pool.cc:224] Handling call
0709 12:16:16.009335 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:17.360689 (+1351354us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54004adba0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf47811c0 00007fadf4782231 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c
0709 12:16:17.448075 (+ 87386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:17.448299 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943435520}
I20260709 12:16:17.476583 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:17.479110 23695 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:17.426671 24349 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:17.468747 23982 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:17.479447 23656 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:17.484064 24189 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:17.447768 24321 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:17.440807 24434 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:17.485366 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 97200.9us
I20260709 12:16:17.486352 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:17.495508 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:17.455171 24411 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:16:17.503228 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.503918 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:17.515767 23656 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:17.517186 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:17.524112 23695 raft_consensus.cc:2410] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:17.505520 22822 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:17.491468 22896 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:17.540678 24513 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.548844 24513 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:17.513729 24483 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:17.551661 24272 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.552316 24272 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:17.487040 24371 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:17.555454 24272 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:17.514151 24358 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:17.534634 23982 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:17.491227 24455 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:17.561748 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 400) took 1535 ms. Trace:
I20260709 12:16:17.561321 24491 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:17.580709 24468 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.612090 24468 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:17.602572 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:17.574649 24447 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:17.599540 24443 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:16:17.619668 22895 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:17.603547 23982 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:17.587457 24491 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.819788 24491 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:17.626554 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:17.828264 24491 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:17.830476 24491 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:17.639020 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 46566us
I20260709 12:16:17.833356 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:17.834275 24450 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.834975 24450 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:17.837751 24450 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:17.627784 24443 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:17.960327 24443 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:17.624260 24458 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:16:17.965987 22790 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.194:36669 timed out after 1.649s (SENT) [suppressed 20 similar messages]
I20260709 12:16:17.964802 24458 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.968111 24458 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:17.674847 24515 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:17.670285 24455 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:17.668560 24447 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:17.677318 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58186.3us
I20260709 12:16:17.584770 22749 rpcz_store.cc:276] 0709 12:16:16.007904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:16.017895 (+  9991us) service_pool.cc:224] Handling call
0709 12:16:17.463633 (+1445738us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:17.478075 (+ 14442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:17.478319 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:17.481088 (+  2769us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:17.495236 (+ 14148us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:17.496457 (+  1221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:17.504905 (+  8448us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:17.543622 (+ 38717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5212416}
I20260709 12:16:17.691181 22896 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:17.701650 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:18.060917 22897 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:17.710863 24513 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:17.721807 24349 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:17.740573 24498 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:17.782123 23682 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:17.839180 24483 consensus_queue.cc:1059] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:18.064347 24483 raft_consensus.cc:3055] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:18.064817 24483 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:18.065724 24483 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:17.839857 24478 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:17.838510 24450 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:16:18.106727 24483 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:18.107239 24450 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:18.107790 24450 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:18.108739 24450 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:18.110119 24450 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:18.115237 24538 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.115833 24538 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:18.117969 24538 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:17.846670 24265 consensus_meta.cc:287] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.600s	user 0.004s	sys 0.008s
I20260709 12:16:18.119104 24265 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:18.121392 24265 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:18.121529 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.122197 24358 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:18.122555 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:18.122816 24358 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:18.124413 22749 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:18.124974 24358 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:17.904206 24181 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:18.125859 24181 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:18.127144 24181 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:17.908077 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.927062 24044 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:18.131253 24044 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:16.941092 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:18.133591 24044 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:17.854029 24468 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:17.937270 22573 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43994 (request call id 147) took 9212 ms. Trace:
I20260709 12:16:17.943712 24471 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.141368 24471 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:18.139238 22573 rpcz_store.cc:276] 0709 12:16:08.725180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:08.739002 (+ 13822us) service_pool.cc:224] Handling call
0709 12:16:17.937137 (+9198135us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:15.455822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:15.577371 (+121549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:15.582742 (+  5371us) write_op.cc:435] Acquired schema lock
0709 12:16:15.584169 (+  1427us) tablet.cc:662] Decoding operations
0709 12:16:15.614608 (+ 30439us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:15.614731 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:15.614762 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:16:15.615692 (+   930us) tablet.cc:701] Row locks acquired
0709 12:16:15.615749 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:16:15.615939 (+   190us) write_op.cc:270] Start()
0709 12:16:15.616102 (+   163us) write_op.cc:276] Timestamp: P: 1783599375615871 usec, L: 0
0709 12:16:15.616126 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:16:15.616866 (+   740us) log.cc:844] Serialized 4063 byte log entry
0709 12:16:15.721412 (+104546us) op_driver.cc:464] REPLICATION: finished
0709 12:16:16.016147 (+294735us) write_op.cc:301] APPLY: starting
0709 12:16:16.017861 (+  1714us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:16.127904 (+110043us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:16.157405 (+ 29501us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:16.323584 (+166179us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:16.323927 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:16:16.324001 (+    74us) write_op.cc:312] APPLY: finished
0709 12:16:16.324422 (+   421us) log.cc:844] Serialized 76 byte log entry
0709 12:16:16.324724 (+   302us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:16.324943 (+   219us) write_op.cc:454] Released schema lock
0709 12:16:16.325016 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:16.325479 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:16.325514 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":273,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":271829,"apply.run_cpu_time_us":5496,"apply.run_wall_time_us":318189,"num_ops":10,"prepare.queue_time_us":20308,"prepare.run_cpu_time_us":6044,"prepare.run_wall_time_us":161417,"replication_time_us":79853,"thread_start_us":200883,"threads_started":2}]]}
I20260709 12:16:17.945776 22895 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:17.950017 24537 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:18.143669 24471 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:17.627118 24411 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:17.973891 24515 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:17.974411 24443 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:17.855422 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:18.147542 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 292210us
I20260709 12:16:17.979401 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.150434 22750 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
W20260709 12:16:17.988798 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.995330 24434 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:18.027887 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 156) took 1302 ms. Trace:
I20260709 12:16:18.034338 24535 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:18.044243 23982 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:18.042393 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 209090us
I20260709 12:16:17.986222 24458 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:18.047219 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 81260.5us
I20260709 12:16:18.177415 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.178288 22750 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:18.048235 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 148) took 1771 ms. Trace:
I20260709 12:16:18.062453 23494 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:16:18.183199 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 120872us
I20260709 12:16:18.075135 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:18.076433 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:18.205835 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:18.206715 22822 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:18.075177 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:18.207296 23695 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:18.207404 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.079739 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.193454 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.084062 22865 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:18.096746 22576 catalog_manager.cc:5697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 4 to 5, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 5 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.192639 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.105703 22572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43984 (request call id 155) took 9267 ms. Trace:
I20260709 12:16:18.118592 22752 pending_rounds.cc:85] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 2
I20260709 12:16:18.119436 22745 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:18.143873 24537 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:17.972991 22820 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
W20260709 12:16:18.152356 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.169963 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:18.173538 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:18.217267 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.217767 22892 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:18.217927 22898 raft_consensus.cc:2368] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6.
I20260709 12:16:18.219022 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.219666 22897 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:18.175540 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:18.220355 22895 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:18.182678 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 152359us
I20260709 12:16:18.191236 23656 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:18.194519 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:18.181270 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:18.197582 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:18.180375 22893 rpcz_store.cc:276] 0709 12:16:16.276501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:16.276685 (+   184us) service_pool.cc:224] Handling call
0709 12:16:17.867492 (+1590807us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b58001e3398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:17.867736 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:18.033863 (+166127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:18.033901 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:18.034467 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:16:18.042090 (+  7623us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:18.042143 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:18.042220 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:18.047897 (+  5677us) raft_consensus.cc:1685] finished
0709 12:16:18.047920 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:18.048148 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165683,"raft.queue_time_us":168512,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"spinlock_wait_cycles":14769536,"thread_start_us":7233,"threads_started":1,"wal-append.queue_time_us":7638}
I20260709 12:16:18.203213 24513 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:18.213081 22752 pending_rounds.cc:107] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:16:18.223407 22752 raft_consensus.cc:2889] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:18.213934 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:18.214190 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 130238us
I20260709 12:16:18.214640 23660 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:18.212530 22572 rpcz_store.cc:276] 0709 12:16:08.838365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:08.849516 (+ 11151us) service_pool.cc:224] Handling call
0709 12:16:18.105397 (+9255881us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2163122,"reported_tablets":15}
I20260709 12:16:18.210183 23685 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:18.211617 22576 catalog_manager.cc:5697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:16:18.182039 24493 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.226164 22898 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:18.152259 22900 rpcz_store.cc:276] 0709 12:16:16.725231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.594339 (+869108us) service_pool.cc:224] Handling call
0709 12:16:17.594684 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:17.594917 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:17.679199 (+ 84282us) log.cc:844] Serialized 14 byte log entry
0709 12:16:18.027472 (+348273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:18.027535 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:18.027587 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:18.027658 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:18.027792 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":322411,"prepare.queue_time_us":100581,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":326325,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":76466,"threads_started":2,"wal-append.queue_time_us":40232}
I20260709 12:16:18.226714 22576 catalog_manager.cc:5697] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 4 to 5, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 5 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.227825 23689 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:16:18.228983 22901 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:18.224152 22818 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 1.
I20260709 12:16:18.176843 24515 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:18.229387 22864 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:18.204557 24387 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:18.232539 24071 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:18.248627 24044 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:16:18.237391 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:18.253796 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:18.254590 22745 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:18.256240 24463 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.257658 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:18.241751 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:18.242067 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:18.259331 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:18.243351 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:18.244297 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.262684 22750 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:18.244572 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.246237 22827 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:18.247171 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:18.237490 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.282907 22893 raft_consensus.cc:2368] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7.
I20260709 12:16:18.218026 23659 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:18.239135 22895 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:18.256973 24463 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:18.296501 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.298229 24463 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:18.273300 24537 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:18.298280 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.300940 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.301509 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.302758 23679 raft_consensus.cc:2410] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:18.305073 23679 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:18.307461 23656 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:18.308897 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.312251 22745 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:18.319057 24071 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:18.320374 24071 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:18.324177 24458 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:18.274039 24494 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:18.274590 24387 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:18.274968 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.256428 24455 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:18.336089 24537 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:18.257297 24181 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:18.341977 24537 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:18.342438 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.342087 24387 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:18.189989 23982 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:18.343834 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.344491 22748 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:18.344520 24537 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:18.276742 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.277899 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.278292 22898 raft_consensus.cc:2393] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:18.278612 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.279122 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.349488 23660 raft_consensus.cc:2393] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:18.279243 24483 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:18.279378 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.279788 24468 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:18.280519 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.287222 23695 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
W20260709 12:16:18.332083 22717 connection.cc:256] RPC call timeout handler was delayed by -1.3994429740000669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260709 12:16:18.264860 22576 catalog_manager.cc:5697] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 3 to 4, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 4 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:16:18.356734 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.354547 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:18.261849 22892 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:18.291699 22897 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:18.360088 22900 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 5. Ops: [3.2-3.2]
I20260709 12:16:18.356853 22750 raft_consensus.cc:2376] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7. Re-sending same reply.
I20260709 12:16:18.292407 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:18.361821 22822 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:18.289805 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:18.327019 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.328992 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.334945 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:18.334627 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 87068.2us
I20260709 12:16:18.222083 24541 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:18.232810 24515 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.342298 24181 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:18.277750 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.364871 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.346086 22753 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:18.345503 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:18.357965 22747 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:18.368930 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:18.370051 22747 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:16:18.370657 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:18.374382 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:18.375370 22820 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:18.190317 24535 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:18.381089 22893 raft_consensus.cc:2368] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4.
I20260709 12:16:18.364925 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:18.357942 22576 catalog_manager.cc:5697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 3 to 4, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:16:18.345479 23982 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:18.403700 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:18.404628 22819 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:18.351141 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:18.359342 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 104672us
I20260709 12:16:18.237574 24493 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:18.385739 22892 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:18.381489 22896 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:16:18.381671 22901 raft_consensus.cc:2368] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5.
I20260709 12:16:18.429141 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:18.387233 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 132448us
I20260709 12:16:18.385486 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:18.400444 22576 catalog_manager.cc:5697] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 2 to 3, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.356894 23973 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:18.416963 22791 leader_election.cc:400] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6.
I20260709 12:16:18.415144 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.415118 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.417490 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:18.418840 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:18.382009 24515 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:18.420490 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.422019 24181 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:18.422444 22749 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:18.423352 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:18.363160 24483 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:18.392447 24189 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:18.444948 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 171) took 1095 ms. Trace:
I20260709 12:16:18.450019 22748 raft_consensus.cc:2410] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:16:18.433952 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 48555us
I20260709 12:16:18.451282 22791 leader_election.cc:403] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:16:18.453238 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.389480 22820 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:18.454845 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.440003 22746 raft_consensus.cc:2410] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:18.451749 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:18.409019 24504 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:16:18.457208 22900 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:18.449728 22899 rpcz_store.cc:276] 0709 12:16:17.349453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.350228 (+   775us) service_pool.cc:224] Handling call
0709 12:16:17.699274 (+349046us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b58001e3398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:17.699551 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:18.027389 (+327838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:18.027439 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:18.028195 (+   756us) log.cc:844] Serialized 26 byte log entry
0709 12:16:18.262596 (+234401us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:18.262652 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:18.262749 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:18.444602 (+181853us) raft_consensus.cc:1685] finished
0709 12:16:18.444629 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:18.444879 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":327233,"raft.queue_time_us":331040,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":104,"spinlock_wait_cycles":2696064,"thread_start_us":233828,"threads_started":1,"wal-append.queue_time_us":397955}
I20260709 12:16:18.460008 24044 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:18.460530 24044 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.460667 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.460896 24044 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:18.436655 24463 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:18.461664 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.462054 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:18.460986 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.460856 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:18.463933 22898 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:18.464246 22753 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:18.464994 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:18.454741 22717 leader_election.cc:400] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7.
I20260709 12:16:18.468043 22717 leader_election.cc:403] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:16:18.468290 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.469208 22748 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:18.470294 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:18.465524 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 48124.8us
I20260709 12:16:18.463032 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.471616 23682 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:18.404628 24541 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:18.407981 24506 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:18.473193 22576 catalog_manager.cc:5697] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 3 to 5, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 5 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.467056 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:18.474539 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:18.479717 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.479880 22748 raft_consensus.cc:2410] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:18.462652 22746 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:18.433429 24481 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:18.428224 22896 pending_rounds.cc:85] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 1
I20260709 12:16:18.487540 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.484697 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.488651 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:18.463195 24265 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:18.503998 22864 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:18.488001 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:18.457261 24189 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.485253 23682 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:18.411314 24358 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:16:18.445179 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.476331 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:18.447363 24535 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:18.442889 24493 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:18.483369 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:18.534121 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50818.9us
I20260709 12:16:18.481818 22751 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:18.536695 22820 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:18.537761 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:18.466161 24548 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.508461 22747 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:18.485980 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.482911 24455 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:18.436218 24443 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:16:18.539872 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:18.481040 23982 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7.
I20260709 12:16:18.500849 24498 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:18.553381 24498 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:18.504632 22896 pending_rounds.cc:107] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:16:18.543989 22748 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:18.480952 24538 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:18.545370 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:18.506388 23493 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:18.541751 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:18.504452 24494 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:18.485867 23973 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:18.548834 22820 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:18.508574 24502 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:18.501389 24506 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:18.507208 24189 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:18.503407 24349 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:18.511510 24489 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:18.552474 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 76220.9us
I20260709 12:16:18.545104 23674 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:18.573849 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:18.543069 22747 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:18.575755 22747 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:18.534827 24377 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:18.485816 24547 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:16:18.544800 24273 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:18.549288 24493 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:18.564011 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 57755.5us
I20260709 12:16:18.549880 24455 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:18.577092 22747 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:18.612339 22747 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:18.507827 24481 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:18.564219 22896 raft_consensus.cc:2889] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:18.592481 22717 leader_election.cc:400] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4.
I20260709 12:16:18.617311 22717 leader_election.cc:403] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:18.571866 24541 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:18.629796 24273 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:18.563817 24494 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:18.615967 24455 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:18.631085 24494 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:18.568631 24358 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:18.547787 24548 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:18.571439 24502 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:18.689414 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 144662us
I20260709 12:16:18.591284 24181 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:16:18.697052 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 104789us
I20260709 12:16:18.748500 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:18.751669 22717 leader_election.cc:400] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5.
I20260709 12:16:18.752266 22717 leader_election.cc:403] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:16:18.566821 24538 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:18.720988 22747 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:16:18.609609 24387 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:18.585438 24458 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:16:18.684027 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 73470.1us
W20260709 12:16:18.763995 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 220146us
W20260709 12:16:18.745151 24546 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 12:16:18.761297 22747 pending_rounds.cc:85] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 2
I20260709 12:16:18.771456 22747 pending_rounds.cc:107] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:16:18.771819 22747 raft_consensus.cc:2889] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:18.765663 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:18.755709 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:18.724009 24434 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:16:18.672770 22922 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce860 after lost signal to thread 18410
I20260709 12:16:18.745486 24502 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:18.743273 23982 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4.
I20260709 12:16:18.753082 24443 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:18.617396 24493 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:18.799248 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:18.790261 24458 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:18.897675 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 142043us
I20260709 12:16:18.790653 24483 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:18.801816 24481 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:18.780874 24471 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:16:18.795647 24506 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:18.803787 24554 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:16:18.907176 23659 consensus_meta.cc:287] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.006s
I20260709 12:16:18.933722 22747 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:18.871960 24181 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:18.948858 22753 raft_consensus.cc:2410] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:16:18.906561 22922 debug-util.cc:398] Leaking SignalData structure 0x7b0800162e40 after lost signal to thread 22610
I20260709 12:16:18.905702 24349 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:18.952097 24349 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:18.805646 24044 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:18.874764 24547 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 12:16:18.963541 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 179881us
I20260709 12:16:18.845681 23973 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:18.941684 24554 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:18.928422 24443 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:16:18.802057 24498 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:18.805012 24273 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:18.949990 23659 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:19.009603 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:16:19.014406 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.988680 24554 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:19.101285 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:18.995522 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:18.997939 24489 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:19.095558 22749 consensus_meta.cc:287] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.000s
W20260709 12:16:19.106343 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 135108us
W20260709 12:16:19.096123 22922 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8a80 after lost signal to thread 22777
I20260709 12:16:19.151520 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:19.102988 24548 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:19.101853 24558 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:19.176254 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:18.997761 24458 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:19.127912 24549 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:19.142917 22922 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4d60 after lost signal to thread 22778
I20260709 12:16:19.215404 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:19.150354 24557 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 12:16:19.180110 24515 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.001s
W20260709 12:16:19.214799 24552 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
W20260709 12:16:19.248915 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 239420us
I20260709 12:16:19.153146 24044 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:19.176450 24550 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.417s	user 0.000s	sys 0.002s
I20260709 12:16:19.139535 22749 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:19.270697 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:19.177167 24483 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:19.130519 24559 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.135s
I20260709 12:16:19.175160 24566 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:19.224139 24181 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:19.217278 24541 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:19.144564 24489 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:19.280680 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:19.233965 24570 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:19.245643 24493 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:19.276494 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:19.270680 24515 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:19.234845 24565 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 12:16:19.281237 24447 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5.
W20260709 12:16:19.298923 22922 debug-util.cc:398] Leaking SignalData structure 0x7b08002283c0 after lost signal to thread 22851
I20260709 12:16:19.321645 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 427) took 1044 ms. Trace:
I20260709 12:16:19.289961 24569 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:19.287657 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 426) took 1006 ms. Trace:
I20260709 12:16:19.297626 24181 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.292254 24443 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.330067 22892 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:19.333647 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:19.349663 22826 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 5. Ops: []
I20260709 12:16:19.349915 22747 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:19.247628 24549 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:19.339763 22922 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2a80 after lost signal to thread 22852
I20260709 12:16:19.341909 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 208) took 1224 ms. Trace:
I20260709 12:16:19.355300 22752 rpcz_store.cc:276] 0709 12:16:18.117050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.117993 (+   943us) service_pool.cc:224] Handling call
0709 12:16:18.118337 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:18.281394 (+163057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:18.281429 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:18.282105 (+   676us) log.cc:844] Serialized 52 byte log entry
0709 12:16:18.477588 (+195483us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:18.477626 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:18.477697 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:19.341648 (+863951us) raft_consensus.cc:1685] finished
0709 12:16:19.341671 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:19.341843 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1332,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":44535,"thread_start_us":195062,"threads_started":1,"wal-append.queue_time_us":282684}
I20260709 12:16:19.339874 22751 rpcz_store.cc:276] 0709 12:16:18.277496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.277637 (+   141us) service_pool.cc:224] Handling call
0709 12:16:19.321347 (+1043710us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54001e7dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:19.321530 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306972544}
I20260709 12:16:19.291340 24483 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:19.337018 24570 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:19.364463 24434 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.365180 24434 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:19.366406 24570 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:19.300818 24541 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:19.360935 24572 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:19.361989 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 572) took 1044 ms. Trace:
I20260709 12:16:19.351357 24181 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:19.354379 24443 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:19.296670 24566 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:19.363947 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 569) took 1047 ms. Trace:
I20260709 12:16:19.427768 22892 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:19.345778 22749 rpcz_store.cc:276] 0709 12:16:18.277257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.310555 (+ 33298us) service_pool.cc:224] Handling call
0709 12:16:19.284076 (+973521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:19.368543 24549 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:19.369307 24463 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.371541 24515 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:19.373159 22750 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:19.357062 24559 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:19.374655 24578 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:19.224860 24558 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:19.378225 22751 rpcz_store.cc:276] 0709 12:16:18.317400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.361049 (+1043649us) service_pool.cc:224] Handling call
0709 12:16:19.361416 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:19.361630 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:19.361659 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:19.361706 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:19.361739 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:19.361798 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:19.361929 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:19.424849 23493 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:19.534121 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 109385us
W20260709 12:16:19.359562 24189 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.001s
I20260709 12:16:19.423514 24571 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.467608 22747 rpcz_store.cc:276] 0709 12:16:18.316488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.363085 (+1046597us) service_pool.cc:224] Handling call
0709 12:16:19.363430 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:19.363614 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:19.363642 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:19.363686 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:19.363719 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:19.363776 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:19.363887 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:19.375494 24564 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:19.423514 24265 consensus_meta.cc:287] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.912s	user 0.006s	sys 0.007s
I20260709 12:16:19.528745 22750 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:19.536391 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 579) took 1039 ms. Trace:
W20260709 12:16:19.537498 22922 debug-util.cc:398] Leaking SignalData structure 0x7b0800192b80 after lost signal to thread 22925
I20260709 12:16:19.538566 23679 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:19.465737 24565 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:19.568164 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:19.573834 22750 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:19.352573 24569 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:19.576542 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:19.553108 22751 rpcz_store.cc:276] 0709 12:16:18.497175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.534774 (+1037599us) service_pool.cc:224] Handling call
0709 12:16:19.535644 (+   870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:19.535892 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:19.535938 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:19.536010 (+    72us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:19.536062 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:19.536146 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:19.536304 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:19.581655 22749 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:19.546283 24549 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:19.545056 24273 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:19.580189 22922 debug-util.cc:398] Leaking SignalData structure 0x7b0800143cc0 after lost signal to thread 22926
I20260709 12:16:19.586007 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:19.578083 24265 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6.
W20260709 12:16:19.588218 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 406883us
I20260709 12:16:19.540450 24463 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:19.587567 24455 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.862s	user 0.013s	sys 0.001s
I20260709 12:16:19.596295 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:19.598031 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:19.539820 24554 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:19.464114 24572 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:19.590507 24493 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:19.545135 24189 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:19.606498 22824 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:19.606819 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:19.588739 24549 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.602378 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:19.610028 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 462) took 1370 ms. Trace:
I20260709 12:16:19.609880 24588 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:19.584575 24574 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:19.586036 24565 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:19.615659 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:19.616288 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:19.618556 24580 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.619781 24572 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:19.620479 24589 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:16:19.544729 24559 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:19.632007 23695 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:19.633586 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:19.616623 24549 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:19.642948 22823 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:19.569929 24564 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:19.657223 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:19.614748 24493 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.660018 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:19.660319 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:19.601823 24273 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:19.554433 24571 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:19.610826 24455 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:19.726034 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:19.728441 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 71341.5us
I20260709 12:16:19.730159 22823 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:19.657100 24377 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.048s	user 0.014s	sys 0.000s
W20260709 12:16:19.658295 22922 debug-util.cc:398] Leaking SignalData structure 0x7b0800206c60 after lost signal to thread 23729
I20260709 12:16:19.737048 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:19.737962 22901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1012) took 1285 ms (client timeout 1590 ms). Trace:
W20260709 12:16:19.738308 22901 rpcz_store.cc:269] 0709 12:16:18.452386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.452525 (+   139us) service_pool.cc:224] Handling call
0709 12:16:19.736885 (+1284360us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b58001e3398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:19.737870 (+   985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9173760}
I20260709 12:16:19.649183 24265 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:19.744985 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 76793.4us
I20260709 12:16:19.745437 22823 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:19.722668 22746 consensus_meta.cc:287] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.217s	user 0.007s	sys 0.008s
I20260709 12:16:19.667739 24493 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:19.752066 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:19.752951 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 87493.7us
I20260709 12:16:19.752405 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:19.657811 24580 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:19.777663 22901 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:19.775283 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:19.758901 22899 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:19.788662 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:19.793804 22892 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
W20260709 12:16:19.776536 24587 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:16:19.756264 24502 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.938s	user 0.011s	sys 0.002s
I20260709 12:16:19.819795 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:19.617038 23679 rpcz_store.cc:276] 0709 12:16:18.231768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.313499 (+ 81731us) service_pool.cc:224] Handling call
0709 12:16:19.486905 (+1173406us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b58002c3a98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165af8c 00007fadf165aef6 000000000036eb39 00007fadf96ce1e0 00007fadf97970c4 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:19.538334 (+ 51429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:19.579505 (+ 41171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:19.602061 (+ 22556us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51416832}
I20260709 12:16:19.647004 24574 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:19.825522 22824 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:19.776115 24541 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:19.777781 24592 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:19.785725 24483 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:19.777563 24553 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 12:16:19.854225 22825 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:19.774257 24489 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:19.835193 24554 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:19.657253 24588 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:19.835917 24608 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:19.815508 24478 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:16:19.836898 24463 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:19.838259 24595 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:16:19.839421 24599 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:16:19.777000 24577 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:19.776172 24566 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:19.978150 23689 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:19.843858 24189 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:19.845168 24387 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.076s	user 0.010s	sys 0.004s
I20260709 12:16:19.776965 24558 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:19.845656 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51567.2us
I20260709 12:16:19.883028 24605 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:19.758044 22746 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:19.760782 24377 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:19.785312 24443 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:19.750968 24498 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:16:19.758675 24265 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:19.870272 24494 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.238s	user 0.013s	sys 0.003s
I20260709 12:16:19.876358 24578 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:19.785962 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:19.885191 22896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
W20260709 12:16:19.978107 24589 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:16:20.015493 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 198188us
I20260709 12:16:19.848136 24502 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:20.029690 23685 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:20.024362 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:19.982380 24554 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:20.040843 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:19.991416 24387 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:19.851995 24592 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:19.983114 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 417) took 1744 ms. Trace:
I20260709 12:16:19.990432 24608 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:20.030576 24569 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:20.075528 24564 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:20.076556 24559 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:20.039407 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 434) took 1709 ms. Trace:
I20260709 12:16:20.078810 24502 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:20.079748 24615 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:20.083448 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:20.084430 24609 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:20.020565 24577 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:20.085160 24548 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.085850 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 428) took 1808 ms. Trace:
I20260709 12:16:20.037672 24494 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:20.129243 24273 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:20.077193 24588 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:20.213683 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 172959us
I20260709 12:16:20.220952 23659 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:20.100075 24565 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:20.233142 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 149777us
I20260709 12:16:20.251797 22790 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:20.210112 24580 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:20.139456 24265 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:20.253175 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 362807us
I20260709 12:16:20.227839 24553 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:20.036023 24605 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:20.228390 24455 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:20.111613 24554 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:20.261953 22790 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:20.238523 24559 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:20.211683 22746 rpcz_store.cc:276] 0709 12:16:18.314993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.461794 (+146801us) service_pool.cc:224] Handling call
0709 12:16:20.024465 (+1562671us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:20.299496 22790 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:20.264026 24553 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:20.274138 24565 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:20.239108 24548 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:20.311964 24553 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:20.316414 24494 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:20.317054 24577 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:20.153963 24608 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:20.233026 24615 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:20.255345 24609 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:20.328085 24625 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:20.322636 24434 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.000s
I20260709 12:16:20.235662 22745 rpcz_store.cc:276] 0709 12:16:18.277750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.313174 (+ 35424us) service_pool.cc:224] Handling call
0709 12:16:19.753234 (+1440060us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:20.085729 (+332495us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13284608}
I20260709 12:16:20.276822 23672 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:20.327904 24592 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:20.110505 22744 rpcz_store.cc:276] 0709 12:16:18.239011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.257758 (+ 18747us) service_pool.cc:224] Handling call
0709 12:16:18.275761 (+ 18003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:18.414631 (+138870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:18.414667 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:18.414732 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:18.414801 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:19.891233 (+1476432us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54001e6ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:19.895287 (+  4054us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:19.979731 (+ 84444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311884160}
I20260709 12:16:20.355767 24608 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:20.358322 24615 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:20.359896 24181 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.874s	user 0.008s	sys 0.004s
I20260709 12:16:20.391197 24181 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:20.361222 24609 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:20.339148 24610 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:20.393064 24610 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.393630 24610 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:20.367846 24554 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:20.395917 24181 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:20.330685 24548 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:20.373799 24605 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:20.280526 24580 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:16:20.376130 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 231) took 1131 ms. Trace:
I20260709 12:16:20.275518 24478 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:16:20.313136 24565 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:20.384729 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 234) took 1053 ms. Trace:
I20260709 12:16:20.378856 24434 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:20.371834 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 192) took 1156 ms. Trace:
W20260709 12:16:20.379494 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 76270.2us
I20260709 12:16:20.476446 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:20.489075 22892 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:20.478124 22901 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:16:20.485224 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:20.487792 22897 rpcz_store.cc:276] 0709 12:16:19.215826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.353925 (+138099us) service_pool.cc:224] Handling call
0709 12:16:19.354295 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:19.537931 (+183636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:19.537968 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:19.538015 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:19.538048 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.371477 (+833429us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54003d2f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:20.371544 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:20.371752 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310937344}
I20260709 12:16:20.491055 23656 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:20.496824 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:20.497504 22892 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:20.500214 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:20.485056 24565 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:20.505052 23682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.018s	sys 0.060s
W20260709 12:16:20.506408 23682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.019s	sys 0.060s
W20260709 12:16:20.508363 22900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.011s	sys 0.029s
W20260709 12:16:20.508963 22900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.011s	sys 0.029s
W20260709 12:16:20.508769 22865 connection.cc:256] RPC call timeout handler was delayed by -1.0470364470002096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 12:16:20.513114 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:20.514043 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 271376us
I20260709 12:16:20.504602 22896 raft_consensus.cc:606] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:20.511796 24493 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.003s
I20260709 12:16:20.506942 24559 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:20.520804 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:20.530171 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:20.530299 24633 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:20.531042 24633 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:20.531742 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:20.533260 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:20.526383 24549 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.799s	user 0.014s	sys 0.000s
I20260709 12:16:20.535212 24549 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:20.535893 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.534359 24633 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:20.534730 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:20.539146 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:20.534453 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.509912 24189 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:20.541240 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:20.527704 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:20.543080 22901 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:20.572391 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 83333.1us
W20260709 12:16:20.573436 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45830.6us
I20260709 12:16:20.573791 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:20.545620 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:20.484911 22744 rpcz_store.cc:276] 0709 12:16:19.331722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.383367 (+1051645us) service_pool.cc:224] Handling call
0709 12:16:20.383916 (+   549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:20.384202 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:20.384248 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:20.384322 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:20.384372 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.384456 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:20.384634 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:20.520289 22896 raft_consensus.cc:614] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:20.551632 24549 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:20.551970 24434 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:20.553995 24610 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:20.556809 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:20.577142 22898 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:16:20.528540 24523 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:20.563347 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:20.519134 24044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.003s	sys 0.006s
I20260709 12:16:20.583756 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:20.585392 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:20.587749 24559 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:20.588130 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:20.576954 24548 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:20.589509 22790 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:20.591938 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 235) took 1259 ms. Trace:
I20260709 12:16:20.593639 22901 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:20.478827 22746 rpcz_store.cc:276] 0709 12:16:19.244272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.341401 (+1097129us) service_pool.cc:224] Handling call
0709 12:16:20.375329 (+ 33928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:20.375593 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:20.375639 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:20.375699 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:20.375753 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.375828 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:20.376059 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:20.599574 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:20.580001 24189 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:20.601042 24523 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:20.602350 22790 connection.cc:256] RPC call timeout handler was delayed by -1.3609672979998777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 12:16:20.602319 24523 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:20.587070 24044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.003s	sys 0.010s
I20260709 12:16:20.607479 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:20.612975 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.555707 24493 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:20.616515 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:20.597946 24559 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:20.594466 24616 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:20.635517 24616 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:20.638011 24616 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:20.586198 24636 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:20.638813 24636 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:20.639303 24636 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:20.642220 22750 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:20.608736 24553 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:20.646178 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 187) took 2166 ms. Trace:
I20260709 12:16:20.646811 22900 rpcz_store.cc:276] 0709 12:16:18.479877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.480035 (+   158us) service_pool.cc:224] Handling call
0709 12:16:19.849554 (+1369519us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b58001e3398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:19.849886 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:19.850497 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:19.850536 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:19.860269 (+  9733us) log.cc:844] Serialized 52 byte log entry
0709 12:16:20.509513 (+649244us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:20.509592 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.509702 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:20.645712 (+136010us) raft_consensus.cc:1685] finished
0709 12:16:20.645740 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:20.646064 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71247,"raft.queue_time_us":2049,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":31654,"spinlock_wait_cycles":2903296,"thread_start_us":626263,"threads_started":1,"wal-append.queue_time_us":672077}
I20260709 12:16:20.648140 24553 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:20.649142 23656 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:20.650200 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 168) took 2114 ms. Trace:
W20260709 12:16:20.650439 22895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1010) took 2365 ms (client timeout 1733 ms). Trace:
I20260709 12:16:20.650578 22819 rpcz_store.cc:276] 0709 12:16:18.535924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.537208 (+  1284us) service_pool.cc:224] Handling call
0709 12:16:18.550251 (+ 13043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:18.633529 (+ 83278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:18.633567 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:18.633624 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:18.633668 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.649944 (+2016276us) spinlock_profiling.cc:243] Waited 83 ms on lock 0x7b540045c754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:20.650004 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:20.650142 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190885760}
W20260709 12:16:20.651214 22895 rpcz_store.cc:269] 0709 12:16:18.284999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.295477 (+ 10478us) service_pool.cc:224] Handling call
0709 12:16:20.650066 (+2354589us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54002fdd54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:20.650243 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109868928}
I20260709 12:16:20.592510 22744 rpcz_store.cc:276] 0709 12:16:19.332672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.586211 (+1253539us) service_pool.cc:224] Handling call
0709 12:16:20.591320 (+  5109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:20.591523 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:20.591565 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:20.591613 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:20.591660 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.591720 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:20.591871 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:20.628046 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 236) took 1292 ms. Trace:
I20260709 12:16:20.653100 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.653265 22746 rpcz_store.cc:276] 0709 12:16:19.335694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.608932 (+1273238us) service_pool.cc:224] Handling call
0709 12:16:20.627306 (+ 18374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:20.627579 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:20.627613 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:20.627683 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:20.627722 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.627801 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:20.627966 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:20.628489 24535 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:20.655043 24535 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:20.655287 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.629820 24610 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:20.659101 23674 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:20.632372 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 936) took 2387 ms. Trace:
I20260709 12:16:20.660326 22826 rpcz_store.cc:276] 0709 12:16:18.245314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.246615 (+  1301us) service_pool.cc:224] Handling call
0709 12:16:18.246931 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:19.350409 (+1103478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.632029 (+1281620us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001266d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:20.632265 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2535393024}
W20260709 12:16:20.633891 22822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 170) took 2097 ms (client timeout 1794 ms). Trace:
W20260709 12:16:20.661676 22822 rpcz_store.cc:269] 0709 12:16:18.536660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.539065 (+  2405us) service_pool.cc:224] Handling call
0709 12:16:20.633612 (+2094547us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002e8954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:20.633768 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2400532736}
I20260709 12:16:20.622112 24189 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:20.673511 22750 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:20.674026 22825 raft_consensus.cc:2368] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:20.615899 24639 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:20.678686 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 222) took 2427 ms. Trace:
I20260709 12:16:20.678997 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.595391 24633 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:16:20.680567 23660 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:20.680899 22823 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:20.681725 22750 rpcz_store.cc:276] 0709 12:16:18.249936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.541033 (+291097us) service_pool.cc:224] Handling call
0709 12:16:18.541360 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:19.373049 (+831689us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b54002cd6a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf47811c0 00007fadf4782231 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c
0709 12:16:20.642039 (+1268990us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b58000a46d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46db0aa 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4
0709 12:16:20.676064 (+ 34025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.676804 (+   740us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457532544}
W20260709 12:16:20.678386 24537 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:16:20.674891 24610 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.677827 24044 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:20.685926 24610 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:20.686247 24044 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:20.688433 24610 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:20.689630 24044 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:20.692260 24493 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:20.661887 23674 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:20.680267 24639 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:20.695297 24639 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:20.704838 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 474) took 1556 ms. Trace:
I20260709 12:16:20.705545 23659 rpcz_store.cc:276] 0709 12:16:19.148498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.150805 (+  2307us) service_pool.cc:224] Handling call
0709 12:16:19.247210 (+ 96405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:20.243085 (+995875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.704451 (+461366us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54002909d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:20.704739 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219682560}
I20260709 12:16:20.717813 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.718067 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.718423 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.719484 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.682112 24565 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:20.722519 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:20.723117 22819 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:20.721935 23674 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:20.727345 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:20.728816 22826 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:20.733122 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 473) took 1585 ms. Trace:
I20260709 12:16:20.733654 23685 rpcz_store.cc:276] 0709 12:16:19.148190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.148313 (+   123us) service_pool.cc:224] Handling call
0709 12:16:19.218923 (+ 70610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:20.055874 (+836951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.732809 (+676935us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54007080d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:20.733026 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1863908224}
I20260709 12:16:20.751871 24498 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:20.752440 24498 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:20.753372 24498 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:20.755070 24636 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:20.762444 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.762810 22826 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
W20260709 12:16:20.758057 23672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 448) took 2601 ms (client timeout 3243 ms). Trace:
W20260709 12:16:20.763415 23672 rpcz_store.cc:269] 0709 12:16:18.156855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.174921 (+ 18066us) service_pool.cc:224] Handling call
0709 12:16:18.988426 (+813505us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b58002c3a98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aeee 000000000036eb39 00007fadf96ce1e0 00007fadf97970c4 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:20.757804 (+1769378us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002be8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:20.757952 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729002112}
I20260709 12:16:20.769232 22819 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:20.769773 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:20.754699 24498 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:20.789852 24565 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:20.800685 24636 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:20.803411 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 225) took 2552 ms. Trace:
I20260709 12:16:20.804126 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:20.803925 22748 rpcz_store.cc:276] 0709 12:16:18.250900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.580860 (+329960us) service_pool.cc:224] Handling call
0709 12:16:18.581361 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:18.581673 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:16:18.888968 (+307295us) log.cc:844] Serialized 14 byte log entry
0709 12:16:20.802770 (+1913802us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b1800475600. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf1694a40 00007fadf168f4e4 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287 00007fadf479a208
0709 12:16:20.802994 (+   224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:20.803056 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:20.803112 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.803201 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:20.803342 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9471,"prepare.queue_time_us":671099,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":85,"spinlock_wait_cycles":8923904,"thread_start_us":651367,"threads_started":2,"wal-append.queue_time_us":487630}
I20260709 12:16:20.809830 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:20.807842 24568 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:20.808956 24565 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:20.826633 23494 leader_election.cc:400] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:20.830134 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:20.830421 23494 leader_election.cc:403] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:16:20.830320 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 233724us
I20260709 12:16:20.831104 22819 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:20.831379 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:20.824561 24273 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:20.829111 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:20.835606 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.838927 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:20.836203 24493 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:20.842300 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:20.809832 24594 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:16:20.843889 22826 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:20.845414 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 436) took 2529 ms. Trace:
I20260709 12:16:20.832717 24565 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:20.859671 24565 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:20.863356 24483 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:20.864319 22893 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:20.864109 24483 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:20.865175 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 189) took 1931 ms. Trace:
I20260709 12:16:20.865582 22893 rpcz_store.cc:276] 0709 12:16:18.934015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.934219 (+   204us) service_pool.cc:224] Handling call
0709 12:16:20.863891 (+1929672us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b58001e3398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:20.864117 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:20.864906 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.865113 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8542464}
I20260709 12:16:20.846037 22753 rpcz_store.cc:276] 0709 12:16:18.315827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.963117 (+647290us) service_pool.cc:224] Handling call
0709 12:16:18.963707 (+   590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:19.100072 (+136365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:19.100119 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:19.112536 (+ 12417us) log.cc:844] Serialized 26 byte log entry
0709 12:16:19.282157 (+169621us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:19.423813 (+141656us) log.cc:844] Serialized 14 byte log entry
0709 12:16:20.845068 (+1421255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.845149 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:20.845215 (+    66us) raft_consensus.cc:1685] finished
0709 12:16:20.845226 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:20.845355 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1420708,"prepare.queue_time_us":16986,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":138873,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":10651,"thread_start_us":282366,"threads_started":3,"wal-append.queue_time_us":195331}
W20260709 12:16:20.849802 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:20.835995 24467 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:20.837627 24583 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:20.833082 24273 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:20.867952 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:20.852326 24128 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:20.853806 24523 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:20.872787 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 461) took 1235 ms. Trace:
I20260709 12:16:20.877384 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:20.898026 23659 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:20.883097 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:20.893441 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:20.876508 24639 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:20.899039 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:20.896342 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:20.903509 22752 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:20.870961 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.867018 24443 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.899094 22750 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:20.911844 24443 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:20.913928 24443 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:20.906883 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:20.876825 24273 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:20.897670 23682 rpcz_store.cc:276] 0709 12:16:19.637087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.637203 (+   116us) service_pool.cc:224] Handling call
0709 12:16:19.637747 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:19.852278 (+214531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:19.852307 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:19.854704 (+  2397us) log.cc:844] Serialized 26 byte log entry
0709 12:16:20.507792 (+653088us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:20.508213 (+   421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.872328 (+364115us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540059d8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:20.872379 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:20.872426 (+    47us) raft_consensus.cc:1685] finished
0709 12:16:20.872439 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:20.872709 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3417,"raft.queue_time_us":110052,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":86720,"spinlock_wait_cycles":279528192,"thread_start_us":597330,"threads_started":2,"wal-append.queue_time_us":629013}
I20260709 12:16:20.926401 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:20.924763 23659 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:20.911341 22821 raft_consensus.cc:2410] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:16:20.919343 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:20.905874 22753 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:20.920631 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:20.866690 24483 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:20.868139 24467 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:20.929337 22823 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:20.923503 24455 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:20.931707 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:20.928505 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:20.927701 22748 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:20.933459 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:20.903692 23973 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.902925 24189 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:20.903223 24636 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:20.932024 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:20.939453 22826 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:20.924520 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:20.935796 24647 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:20.964816 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:20.942026 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.968112 23659 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:20.943629 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:20.871598 24583 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:20.942996 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.969504 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:20.967940 22717 connection.cc:256] RPC call timeout handler was delayed by -1.3193735849997665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
I20260709 12:16:20.972285 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:20.983762 22819 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:20.992093 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:20.949553 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:20.995745 22748 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:20.996745 22753 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:20.998018 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:20.932902 24467 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:20.999696 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:20.998358 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:21.022971 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:21.024797 22892 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:20.941051 24443 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:21.029044 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 97086.7us
I20260709 12:16:21.033649 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:21.034181 22717 connection.cc:256] RPC call timeout handler was delayed by -1.1906735849997858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 12:16:21.034938 22717 connection.cc:256] RPC call timeout handler was delayed by -1.1600735849997363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 12:16:21.035241 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0333078219998697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
W20260709 12:16:21.035485 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0288078219998624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 12:16:21.036990 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:20.972949 24358 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:20.937675 24483 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:21.042128 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:20.999070 24575 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:21.023867 24636 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:21.047876 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:20.990903 24574 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:21.050961 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:21.094264 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46031.4us
I20260709 12:16:21.101131 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.101608 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:21.094641 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44114.2us
I20260709 12:16:21.001304 24590 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:20.963209 24189 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:20.938588 23973 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:21.039892 24455 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:21.110061 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.046574 24584 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:21.108243 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 57369.5us
W20260709 12:16:21.113830 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 71756.8us
I20260709 12:16:21.047197 24651 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:21.114529 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:21.114604 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.043762 23982 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:21.047005 24653 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.117024 24518 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:21.117636 24518 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:21.117393 24584 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:21.118110 24518 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:21.118978 24447 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:21.119239 24652 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:21.096433 24483 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:21.119669 24447 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:21.121444 24483 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:21.108836 24649 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:21.044273 24443 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:21.123411 24649 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:21.123817 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.125114 24538 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:21.125361 24568 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:21.125715 24443 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:21.125836 24649 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:21.126231 24568 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:21.127198 24568 consensus_queue.cc:1243] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:16:21.128587 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.128895 24189 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:21.130106 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 464) took 1489 ms. Trace:
W20260709 12:16:21.128974 23689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 462) took 1490 ms (client timeout 1954 ms). Trace:
I20260709 12:16:21.131572 22753 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:21.120076 24584 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:21.133133 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:21.122268 24447 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:21.130570 23695 rpcz_store.cc:276] 0709 12:16:19.641236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.670454 (+ 29218us) service_pool.cc:224] Handling call
0709 12:16:19.670825 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:19.729313 (+ 58488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:19.729343 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:19.729381 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:19.729410 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:21.129845 (+1400435us) spinlock_profiling.cc:243] Waited 58.3 ms on lock 0x7b5400704c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:21.129908 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:21.130043 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134077312}
W20260709 12:16:21.131934 23689 rpcz_store.cc:269] 0709 12:16:19.638727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.660032 (+ 21305us) service_pool.cc:224] Handling call
0709 12:16:21.128734 (+1468702us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540073b9d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:21.128859 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":720962816}
I20260709 12:16:21.148568 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.149588 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.041193 24577 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
W20260709 12:16:21.139300 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 207865us
I20260709 12:16:21.150149 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.045293 24647 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:21.145380 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:21.145570 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.154341 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:21.110488 24590 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:21.159442 22899 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:21.093607 24468 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:16:21.172279 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:21.094828 24565 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:21.132211 24594 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:21.119705 24652 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:21.131238 24443 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:21.125870 24538 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:21.131034 24181 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:16:21.178135 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:21.196220 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 61764.4us
I20260709 12:16:21.049163 24358 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:21.179755 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 77067.4us
I20260709 12:16:21.175849 22753 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:21.174439 22864 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.141826 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:21.103649 24575 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:21.169601 24189 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:21.198199 23685 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:21.198575 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:21.171660 24633 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:21.144680 24483 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:16:21.194139 24128 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:21.205900 24657 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:21.207192 24590 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:21.153887 24584 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:16:21.145318 24569 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:16:21.205966 24128 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:21.144975 24649 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:16:21.212154 22748 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:21.214043 23685 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:21.181981 24594 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:21.196322 22899 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:21.206517 24657 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:21.217969 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:21.170704 24651 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:21.218976 24468 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:16:21.220254 24563 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 2.222s	user 0.001s	sys 0.026s
I20260709 12:16:21.213521 24128 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:21.223541 24569 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:21.227877 23973 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:21.143635 24653 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:21.202167 24634 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:21.231078 22898 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:21.192821 24652 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:21.256141 24657 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:21.258757 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:21.259428 22897 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:21.297658 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:21.260934 24538 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:21.299765 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:21.263500 24358 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:21.276533 24569 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:21.214987 22746 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:21.230350 24594 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:21.228997 24583 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:21.388154 22895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:21.389004 22895 raft_consensus.cc:606] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:21.389820 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:21.252981 24189 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:21.216389 24447 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
W20260709 12:16:21.293382 24654 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:16:21.262253 24651 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:21.230445 24502 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:16:21.302135 23982 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:21.305205 24273 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:21.308305 24518 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:21.309898 24565 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:21.269869 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.275319 24639 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:21.334484 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:21.334491 22897 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
W20260709 12:16:21.426414 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:21.337342 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:21.256950 24666 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:16:21.339735 24571 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:21.344273 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:21.352773 22818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 935) took 3107 ms (client timeout 1767 ms). Trace:
I20260709 12:16:21.358633 24652 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:21.388939 24584 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 12:16:21.384585 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:21.385214 24622 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 1.007s	user 0.000s	sys 0.007s
W20260709 12:16:21.388401 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 88702us
W20260709 12:16:21.230392 24655 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:16:21.253661 24468 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.457208 24652 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:21.457523 24468 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:21.461229 24639 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.461766 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 229) took 2221 ms. Trace:
I20260709 12:16:21.389467 22895 raft_consensus.cc:614] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:21.230165 24455 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:21.463042 24467 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:21.465449 24467 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:21.326303 24663 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:21.462410 22749 rpcz_store.cc:276] 0709 12:16:19.240304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.591076 (+350772us) service_pool.cc:224] Handling call
0709 12:16:19.591429 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:20.908938 (+1317509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:20.908966 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:20.909435 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:16:20.997712 (+ 88277us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:20.997764 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.997829 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:21.461351 (+463522us) raft_consensus.cc:1685] finished
0709 12:16:21.461389 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:21.461660 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1258743,"raft.queue_time_us":1275695,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"thread_start_us":135480,"threads_started":2,"wal-append.queue_time_us":144016}
I20260709 12:16:21.467089 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 226) took 2233 ms. Trace:
I20260709 12:16:21.389451 22896 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:21.388232 24583 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:21.467492 22747 rpcz_store.cc:276] 0709 12:16:19.233655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.546095 (+312440us) service_pool.cc:224] Handling call
0709 12:16:19.546546 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:20.909532 (+1362986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:20.910751 (+  1219us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:20.911387 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 12:16:21.036509 (+125122us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:21.215465 (+178956us) log.cc:844] Serialized 14 byte log entry
0709 12:16:21.231798 (+ 16333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:21.231901 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:21.466891 (+234990us) raft_consensus.cc:1685] finished
0709 12:16:21.466910 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:21.467037 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1319350,"prepare.queue_time_us":220150,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1362807,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":12137,"spinlock_wait_cycles":83712,"thread_start_us":294946,"threads_started":3,"wal-append.queue_time_us":257536}
I20260709 12:16:21.469125 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:21.469462 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:21.473488 24273 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:21.428671 24387 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:21.431303 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 161578us
I20260709 12:16:21.432439 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:21.365543 24535 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:21.409536 24636 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:21.583956 24663 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:21.584642 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:21.584854 24663 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:21.585155 24387 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:21.461817 24639 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:21.587460 24663 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:21.587651 24387 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:21.588482 24639 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:21.589432 24535 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:21.430961 22818 rpcz_store.cc:269] 0709 12:16:18.245002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.246929 (+  1927us) service_pool.cc:224] Handling call
0709 12:16:21.352404 (+3105475us) spinlock_profiling.cc:243] Waited 3.09 s on lock 0x7b5400302854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:21.352610 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7098244864}
W20260709 12:16:21.427618 24493 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.000s
I20260709 12:16:21.442888 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.593159 24493 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3.
I20260709 12:16:21.594134 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.446075 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.595626 23689 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:21.447049 24579 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:21.596503 24579 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:21.447366 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.447412 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.448386 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.450205 24518 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:21.451184 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:21.635600 22750 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:21.410027 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 177) took 1643 ms. Trace:
I20260709 12:16:21.476598 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:21.470526 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:21.483266 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 50928.3us
I20260709 12:16:21.638953 24493 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:21.637775 22824 rpcz_store.cc:276] 0709 12:16:19.752177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.778835 (+ 26658us) service_pool.cc:224] Handling call
0709 12:16:19.779152 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:19.826037 (+ 46885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:21.395401 (+1569364us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b54007a1554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:21.395589 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91984256}
I20260709 12:16:21.578480 24653 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:21.638161 22747 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:21.581158 24273 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:21.582854 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.641155 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:21.641896 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 59121.1us
I20260709 12:16:21.432251 24569 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:21.636669 24594 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:21.439153 24605 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:21.433492 24578 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.643924 24493 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:21.644541 24578 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:21.641987 22747 raft_consensus.cc:2376] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5. Re-sending same reply.
W20260709 12:16:21.620770 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:21.638463 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 161922us
I20260709 12:16:21.583845 24652 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:21.646733 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.637248 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:21.647322 24652 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:21.647837 22750 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:21.648288 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.648391 24652 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:21.649242 24605 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:21.649417 24493 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:21.649747 24652 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:21.650077 24493 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:21.646733 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:21.651333 22747 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:21.651345 24493 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:21.652668 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:21.653358 22747 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:21.654333 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:21.654729 24594 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:21.656175 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:21.657814 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:21.658699 22750 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:21.664947 22750 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:21.665454 22750 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:21.666519 22750 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:21.667891 22750 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:21.675849 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:21.545799 24654 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:16:21.680348 22750 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:16:21.681015 22750 pending_rounds.cc:85] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 2
I20260709 12:16:21.681284 22750 pending_rounds.cc:107] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:16:21.681623 22750 raft_consensus.cc:2889] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:21.681733 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:21.682588 22749 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:21.683564 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:21.684659 22750 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:21.687212 24605 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:21.691129 24128 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:21.693487 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:21.694276 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:21.694576 22864 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:21.695427 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:21.699178 22827 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:16:21.701047 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:21.704833 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:21.706171 22823 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:21.708930 24657 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:21.710632 22901 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:21.711021 24349 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:21.711551 24349 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.711989 24349 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:21.712206 22746 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:21.713593 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:21.715972 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:21.716758 22821 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:21.717137 24468 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:21.718881 24506 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:21.719310 22790 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:21.720914 24506 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:21.721571 24506 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:21.714282 22746 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:21.731068 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:21.698673 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:21.733664 23682 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:21.744624 22749 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:21.722659 24590 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:21.756635 22747 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:16:21.757481 22747 pending_rounds.cc:85] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 1
I20260709 12:16:21.757892 22747 pending_rounds.cc:107] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:16:21.758247 22747 raft_consensus.cc:2889] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:21.692842 24518 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:16:21.779700 22749 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:21.745312 24669 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:21.723481 24605 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:16:21.752516 24590 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:21.733314 24506 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:21.799878 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 466) took 1253 ms. Trace:
W20260709 12:16:21.786612 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 220576us
I20260709 12:16:21.801456 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.803766 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.800539 23660 rpcz_store.cc:276] 0709 12:16:20.546609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.616182 (+ 69573us) service_pool.cc:224] Handling call
0709 12:16:21.799577 (+1183395us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b54002ff8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:21.799782 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141271936}
I20260709 12:16:21.783353 24669 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:21.805598 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 154548us
I20260709 12:16:21.811559 23493 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.812515 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:21.813028 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:21.790578 24590 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:21.805591 24535 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:21.815400 24669 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:21.831313 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.813748 24652 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:21.820169 23982 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:21.836424 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.841796 23695 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:21.825476 24577 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:21.841531 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.842355 24443 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:21.852319 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:21.853842 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:21.859583 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 463) took 1369 ms (client timeout 1522 ms). Trace:
W20260709 12:16:21.860150 23656 rpcz_store.cc:269] 0709 12:16:20.489938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.495511 (+  5573us) service_pool.cc:224] Handling call
0709 12:16:21.859339 (+1363828us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54003552d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:21.859511 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340143360}
I20260709 12:16:21.862320 23659 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:21.865705 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 479) took 1044 ms. Trace:
I20260709 12:16:21.866089 23659 rpcz_store.cc:276] 0709 12:16:20.820959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.972217 (+151258us) service_pool.cc:224] Handling call
0709 12:16:21.862090 (+889873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:21.864598 (+  2508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:21.865470 (+   872us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54003552d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:21.865635 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931107712}
I20260709 12:16:21.870245 24579 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:21.872387 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:21.873284 22749 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:21.875126 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:21.878257 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:21.845289 24577 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:21.887176 22748 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:21.871706 24128 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:21.877494 24535 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:21.893098 22749 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:21.896652 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:21.898687 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 87229.3us
I20260709 12:16:21.899637 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:21.900007 23656 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:16:21.886029 24513 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.886327 24577 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:21.901764 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:21.901948 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:21.904093 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.902685 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:21.906688 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:21.907084 23659 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:21.891575 24657 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:21.909008 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:21.910420 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.894119 24535 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:21.901183 24579 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.900905 24636 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:21.904121 24666 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:21.915198 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:21.905804 24513 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:21.913735 24535 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:21.907591 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:21.924355 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:21.937259 23493 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:21.896440 24673 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:16:21.908011 23982 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:21.916549 24493 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:21.911703 24584 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:21.942204 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:21.913309 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:21.913939 24663 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:21.955647 23493 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:21.956389 23659 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:16:21.957425 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:21.963981 24562 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:21.965238 24513 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:21.916913 24666 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:21.939461 24574 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:21.941303 24443 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:21.991348 24443 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.992051 24443 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:21.949592 24493 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:21.994436 24493 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:21.969241 24666 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:21.969532 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:21.949671 24584 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:21.998971 24584 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:22.000770 24673 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:22.001597 24673 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:21.953004 24349 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.002947 24128 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:22.003528 24128 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:22.004818 24349 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:22.005772 24128 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:22.006152 22900 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:16:22.002591 24673 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:21.951763 24578 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:22.008766 24584 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:22.009961 24578 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:21.971990 24668 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:21.980581 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:21.964705 24518 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:21.981652 24680 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:16:21.950912 24636 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:21.966624 24583 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:21.969818 24574 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:21.935871 24579 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:21.970050 24562 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:21.987700 24590 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:21.950260 24657 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:22.017571 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.022823 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:22.015710 24581 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:16:22.016475 24668 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:22.026763 24579 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:22.020206 24044 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:22.027936 24044 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:22.028836 24044 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.030079 24044 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:22.031576 24562 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.032222 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.033536 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.034384 24658 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:22.020725 24574 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:22.034855 24658 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:22.035727 24658 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:22.036465 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 452) took 1007 ms. Trace:
I20260709 12:16:22.037367 24590 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:22.036914 22750 rpcz_store.cc:276] 0709 12:16:21.029095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:21.691712 (+662617us) service_pool.cc:224] Handling call
0709 12:16:21.697665 (+  5953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:21.698063 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:21.698096 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:21.735637 (+ 37541us) log.cc:844] Serialized 26 byte log entry
0709 12:16:21.823603 (+ 87966us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:21.838268 (+ 14665us) log.cc:844] Serialized 14 byte log entry
0709 12:16:21.839873 (+  1605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:21.839979 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:22.036156 (+196177us) raft_consensus.cc:1685] finished
0709 12:16:22.036179 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:22.036390 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":560,"prepare.queue_time_us":12831,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":28071,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":17377,"spinlock_wait_cycles":1543424,"thread_start_us":43045,"threads_started":1,"wal-append.queue_time_us":158975}
I20260709 12:16:22.039486 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:22.040115 22750 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:22.044035 22746 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:22.045042 24658 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:22.031570 24657 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:22.052376 24636 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:22.055677 24189 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:22.059270 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 477) took 1239 ms. Trace:
I20260709 12:16:22.026818 24668 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:22.059944 23682 rpcz_store.cc:276] 0709 12:16:20.819890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.926065 (+106175us) service_pool.cc:224] Handling call
0709 12:16:22.058979 (+1132914us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54002be8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:22.059175 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544221056}
I20260709 12:16:22.062922 22896 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:21.941520 23982 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:22.079770 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 57068.3us
I20260709 12:16:22.082376 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.088423 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.089375 22893 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:22.047465 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:22.080371 24568 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:22.020485 24584 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:22.095964 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.103000 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.100019 24568 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:22.113637 22750 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:22.113924 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:22.023213 24349 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:16:22.114912 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:22.116353 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.035585 24535 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.121330 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:22.120558 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:22.123781 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:22.124248 23493 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:22.094074 24523 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:16:22.125581 24649 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:22.100780 24590 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:22.126230 24649 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.126456 24590 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:22.127012 24657 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:22.128115 23982 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:22.128500 24590 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:22.128762 23982 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:22.128708 24583 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:22.133123 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:22.134050 24583 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:22.128526 24649 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:22.135324 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:22.137851 24605 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:22.140518 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:22.140956 24649 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:22.141600 24649 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:22.142019 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:22.142774 22749 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:22.147830 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 232) took 2872 ms. Trace:
I20260709 12:16:22.150470 22745 rpcz_store.cc:276] 0709 12:16:19.275528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.374740 (+1099212us) service_pool.cc:224] Handling call
0709 12:16:21.377338 (+1002598us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:21.876679 (+499341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:21.886675 (+  9996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:21.888443 (+  1768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:21.892097 (+  3654us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:21.895211 (+  3114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:21.902146 (+  6935us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:22.147611 (+245465us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54001e5fd0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:22.147753 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145325056}
I20260709 12:16:22.151417 24349 consensus_queue.cc:1243] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:16:22.145813 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:22.152263 24349 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:22.152777 24349 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:22.153465 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 450) took 1215 ms. Trace:
I20260709 12:16:22.153894 22753 rpcz_store.cc:276] 0709 12:16:20.938222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.997733 (+ 59511us) service_pool.cc:224] Handling call
0709 12:16:22.153232 (+1155499us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400406ad4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:22.153395 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244412288}
I20260709 12:16:22.152876 24668 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:22.152936 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 239) took 1041 ms. Trace:
I20260709 12:16:22.119730 22893 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:22.164489 22752 rpcz_store.cc:276] 0709 12:16:21.111558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:21.128252 (+ 16694us) service_pool.cc:224] Handling call
0709 12:16:22.145630 (+1017378us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:16:22.152867 (+  7237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30595968}
I20260709 12:16:22.154423 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.165877 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:22.167030 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.173903 22748 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:22.175882 22749 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:22.178037 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:22.178897 22753 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
W20260709 12:16:22.179531 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:22.181751 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:22.171484 24189 raft_consensus.cc:3055] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:22.186077 22864 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:22.142047 24649 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:22.173424 23982 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:22.192433 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:22.184619 24584 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:22.202517 24582 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:16:22.201881 24584 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.180819 24668 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:22.187613 24189 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:22.153921 24349 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.190501 24673 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:22.194381 24657 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:22.178368 24493 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:22.206514 23982 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.205766 24584 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:22.216209 24349 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:22.215955 24189 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:22.241261 24189 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:22.228453 23982 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:22.224736 24657 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:22.250643 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:22.221411 24639 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:22.259832 24568 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:22.247385 24668 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:22.265937 24676 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.473s	user 0.004s	sys 0.000s
I20260709 12:16:22.266427 24535 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:22.230175 24673 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:22.268390 24493 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:22.247813 24657 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:22.293697 24535 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:22.303575 24535 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.233239 24669 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.246630 24666 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.278184 24639 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:22.288918 24443 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.326977 23656 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:22.296597 24577 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:22.321589 24678 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:22.332770 22749 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:22.311932 24657 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:22.323642 24535 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:22.335251 22897 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:22.350458 24605 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.351104 24605 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:22.353325 24605 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:22.355960 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:22.352938 24662 log.cc:927] Time spent T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.073s	user 0.005s	sys 0.008s
I20260709 12:16:22.358403 22750 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:22.359706 22750 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:16:22.360121 22750 pending_rounds.cc:85] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 1
I20260709 12:16:22.360352 22750 pending_rounds.cc:107] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:16:22.360620 22750 raft_consensus.cc:2889] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:22.338245 24574 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.367802 24577 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:22.376008 24666 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:22.376879 24443 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:22.378050 24639 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:22.379642 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:22.384356 24574 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:22.386528 22744 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:22.387419 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 585) took 1503 ms. Trace:
I20260709 12:16:22.388115 24574 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:22.388759 24574 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:22.372705 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:22.392266 24658 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:22.392351 24574 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:22.330502 24673 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.394309 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:22.403242 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:22.404000 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:22.404883 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:22.380299 24639 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:22.406555 22753 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:16:22.408377 24578 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.409226 24578 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:22.407852 24639 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:22.396242 23982 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:22.398443 24691 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:16:22.336905 24678 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:22.399683 24575 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:22.414978 24678 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:22.418045 22747 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:22.426194 23982 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:22.432245 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.434154 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:22.430444 23695 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:22.435770 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 174) took 2684 ms. Trace:
I20260709 12:16:22.436049 24578 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:22.436221 22820 rpcz_store.cc:276] 0709 12:16:19.751333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.751457 (+   124us) service_pool.cc:224] Handling call
0709 12:16:19.751703 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:20.079782 (+328079us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:16:20.256131 (+176349us) log.cc:844] Serialized 14 byte log entry
0709 12:16:20.697052 (+440921us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b18003f6940. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:16:20.837164 (+140112us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b18003f6940. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287
0709 12:16:20.846895 (+  9731us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:20.846955 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:20.846999 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:22.435548 (+1588549us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54006a09d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:22.435595 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:22.435711 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":255449,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":30025,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":110,"spinlock_wait_cycles":778519808,"thread_start_us":462507,"threads_started":3,"wal-append.queue_time_us":269423,"wal-append.run_cpu_time_us":1426,"wal-append.run_wall_time_us":1061785}
I20260709 12:16:22.444834 24586 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:22.445487 24586 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:22.448379 24625 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:22.449277 24625 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:22.449640 24548 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:22.450311 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:22.450242 24548 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:22.451143 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:22.451499 23679 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:22.451678 24625 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:22.452739 24548 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:22.453246 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:22.452752 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:22.455549 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:22.456122 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:22.456321 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:22.456710 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:22.457166 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:22.457517 22749 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:22.400972 24649 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:22.459475 23695 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:22.459585 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:22.460269 23682 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:22.460657 24649 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:22.456851 23660 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:22.458137 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:22.464854 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:22.465708 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:22.466483 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:22.467126 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:22.467368 24672 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.780s	user 0.004s	sys 0.003s
I20260709 12:16:22.467303 23674 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:22.468014 24579 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:22.401288 24468 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:22.456645 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:22.471966 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:22.472332 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 504) took 1087 ms. Trace:
I20260709 12:16:22.473821 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:22.474167 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:22.474763 22823 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:22.475199 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:22.476033 22827 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:16:22.476748 22826 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 5. Ops: []
I20260709 12:16:22.478375 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:22.479144 22822 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:22.483791 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:22.468804 24579 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:16:22.485069 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:22.485522 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:22.490185 22820 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:22.487413 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:22.494993 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:22.499094 22823 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:22.500937 24639 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:22.502247 24657 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:22.503283 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:22.387781 22744 rpcz_store.cc:276] 0709 12:16:20.884431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.892451 (+  8020us) service_pool.cc:224] Handling call
0709 12:16:22.386041 (+1493590us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:22.386299 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:22.387128 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:22.387359 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6334336}
I20260709 12:16:22.504462 24669 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:22.508771 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:22.510996 23494 leader_election.cc:336] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.794s (SENT)
I20260709 12:16:22.526330 23656 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:22.512625 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 230) took 3268 ms. Trace:
I20260709 12:16:22.509161 23674 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:22.517072 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:22.518229 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:22.519090 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.527854 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:22.539767 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:22.545220 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:22.546072 22747 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:22.513175 24649 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:22.544909 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:22.551375 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.554454 22820 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:22.549480 24574 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:16:22.527612 22751 rpcz_store.cc:276] 0709 12:16:19.243972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.600246 (+356274us) service_pool.cc:224] Handling call
0709 12:16:19.600579 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:21.028329 (+1427750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:21.028364 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:21.039961 (+ 11597us) log.cc:844] Serialized 26 byte log entry
0709 12:16:21.184054 (+144093us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:21.316981 (+132927us) log.cc:844] Serialized 14 byte log entry
0709 12:16:21.330156 (+ 13175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:21.330270 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:22.352387 (+1022117us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b240051d268. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15189c4 00007fadf1516acb 00007fadf16d1dc9 00007fadf16d1a55 00007fadf16d109d 00007fadf430310e 00007fadf431a88c 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221
0709 12:16:22.493802 (+141415us) raft_consensus.cc:1685] finished
0709 12:16:22.512359 (+ 18557us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:22.512537 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1262580,"prepare.queue_time_us":72842,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":1280032,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":55276,"spinlock_wait_cycles":12929920,"thread_start_us":377218,"threads_started":3,"wal-append.queue_time_us":156870}
I20260709 12:16:22.552384 22901 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:22.560778 24574 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:22.561365 24574 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:22.561755 24569 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:16:22.562327 24574 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.563784 24574 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:22.544864 24537 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:22.566114 24537 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:22.566516 24537 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:22.566883 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:22.557466 24411 consensus_queue.cc:1059] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:16:22.568976 24411 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:22.569355 24411 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:22.519140 24447 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:22.561782 22897 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:22.573560 22751 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:22.544734 23982 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:22.583180 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:22.588016 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:22.589215 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:22.590943 22748 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:22.592247 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:22.594707 22823 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:22.592020 22747 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:22.570276 24411 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.597289 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:22.598060 22864 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:22.599062 22895 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:22.600742 23695 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:22.600560 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:22.601719 23656 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:22.601333 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:22.600840 22791 connection.cc:256] RPC call timeout handler was delayed by -1.508072521000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32430000000000003s for a response
I20260709 12:16:22.605860 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:22.598793 24468 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:16:22.610121 24468 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:22.610519 24468 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:22.611415 24468 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:22.612468 22752 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:22.614437 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.615650 23689 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
W20260709 12:16:22.606626 22791 connection.cc:256] RPC call timeout handler was delayed by -1.1870315450000817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 12:16:22.624269 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:22.624410 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:22.625156 23689 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:22.625291 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:22.627151 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:22.602986 24658 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:22.629079 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:22.633970 24647 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:22.472918 22894 rpcz_store.cc:276] 0709 12:16:21.385065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:21.385523 (+   458us) service_pool.cc:224] Handling call
0709 12:16:21.385903 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:21.386417 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:21.386450 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:21.387155 (+   705us) log.cc:844] Serialized 26 byte log entry
0709 12:16:21.477751 (+ 90596us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:21.645494 (+167743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:21.645595 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:22.466493 (+820898us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:22.469588 (+  3095us) raft_consensus.cc:1685] finished
0709 12:16:22.469610 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:22.472246 (+  2636us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"spinlock_wait_cycles":12815744,"thread_start_us":42570,"threads_started":1,"wal-append.queue_time_us":285727}
I20260709 12:16:22.589923 24668 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:16:22.592857 24590 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:16:22.601085 24455 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:16:22.696091 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:22.694207 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.622644 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:22.597581 24659 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 12:16:22.705713 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 83214.6us
I20260709 12:16:22.622750 24592 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:22.614277 24586 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:22.629860 24468 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:22.708112 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:22.709096 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:22.712407 24635 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:16:22.712671 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:22.615054 24349 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 12:16:22.628398 24411 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:22.634712 24658 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:22.726967 22893 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:22.730702 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:22.734520 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.736096 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:22.736733 22893 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:22.740137 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:22.740417 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:22.753062 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:22.764890 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 53687.2us
I20260709 12:16:22.742470 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.711316 24579 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:22.713269 24592 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:22.779098 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:22.778506 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 82960.5us
I20260709 12:16:22.776948 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:22.738934 23679 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:22.728368 23982 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:22.722386 24635 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:22.801213 22893 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
W20260709 12:16:22.790844 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 84581.4us
I20260709 12:16:22.808303 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:22.839679 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:22.818993 22745 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:22.819785 24592 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:22.746186 24658 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:22.823940 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44910.6us
W20260709 12:16:22.835072 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58359.9us
I20260709 12:16:22.808624 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:22.848784 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.846050 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:22.910552 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 64632.8us
I20260709 12:16:22.911711 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:22.835529 24678 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:22.843122 24635 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:22.840467 24583 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.919932 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:22.908795 22894 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:22.788407 24578 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:16:22.851363 24593 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:22.925406 22893 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:22.960940 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:22.851722 24579 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:22.958209 24189 consensus_queue.cc:1059] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 12:16:22.992707 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:22.919621 24614 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:23.018879 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:22.989550 24593 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:22.919800 24647 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:22.873035 24625 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.143s
I20260709 12:16:22.992496 24578 consensus_queue.cc:1243] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:22.923389 24659 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 12:16:22.924371 24594 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:16:22.967469 24537 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:22.959254 24583 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.027973 24579 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:23.055564 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 182818us
W20260709 12:16:23.056380 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 144179us
I20260709 12:16:23.057902 24593 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.058346 24579 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.059533 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:23.060369 22899 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:23.061342 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:23.062270 22899 raft_consensus.cc:2393] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:23.069242 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:23.067377 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.037302 24578 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:16:23.066987 24678 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:23.078933 24714 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:23.079667 24714 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:23.081801 24704 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:16:23.082361 24714 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:23.073787 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:23.069083 24434 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.090070 22751 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:16:23.090587 22751 pending_rounds.cc:85] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 1
I20260709 12:16:23.090898 22751 pending_rounds.cc:107] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:16:23.091187 22751 raft_consensus.cc:2889] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:23.087110 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:23.076761 24663 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:23.073912 24716 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:23.097321 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:23.098011 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:23.103715 22744 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 2.
I20260709 12:16:23.103804 24657 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:23.106380 22864 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.107272 24657 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:23.107638 24657 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:23.107982 24657 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.109587 22899 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:23.114689 23679 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:23.116565 24718 consensus_queue.cc:1059] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:23.117987 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:23.113412 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:23.083518 24678 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:23.094139 24647 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.111233 24455 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.111750 24716 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.096241 24434 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:23.139099 24574 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:23.155977 22824 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:23.169561 22824 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:23.170629 22824 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:23.139294 24594 raft_consensus.cc:3055] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:23.172519 24594 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:23.173557 24594 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.138558 24537 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:23.146281 22748 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:23.175974 24455 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.177580 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1025) took 1288 ms. Trace:
I20260709 12:16:23.178115 22896 rpcz_store.cc:276] 0709 12:16:21.889418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.033282 (+143864us) service_pool.cc:224] Handling call
0709 12:16:23.177391 (+1144109us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b5400848354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:23.177517 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65986944}
I20260709 12:16:23.180009 24716 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:23.152506 24586 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:23.181145 24586 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:23.181269 24434 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:23.164405 22900 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:23.182212 24586 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:23.183704 24586 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:23.154178 24636 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:23.187288 24636 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:23.187471 24455 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:23.188264 24636 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.156636 24590 raft_consensus.cc:3055] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:23.189872 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:23.194099 24583 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:23.195456 24583 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:23.196077 24583 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.197547 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:23.147799 24625 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:23.198668 24625 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:23.198742 22900 raft_consensus.cc:2393] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:23.198942 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:23.199750 24625 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.138262 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:23.176258 22826 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:23.201257 24625 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:23.189996 24590 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:23.199749 22746 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
W20260709 12:16:23.203692 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 203511us
I20260709 12:16:23.203208 24590 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.204998 24590 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:23.207494 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.166095 24678 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:23.211588 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:23.210531 24455 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:23.216382 24455 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.216185 24657 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.216987 24455 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:23.229995 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:23.226586 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:23.234643 22748 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.206863 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:23.243391 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:23.244503 23660 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:23.248651 23682 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:16:23.245761 22824 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:23.251935 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:23.253698 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46986.8us
W20260709 12:16:23.255514 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 137606us
I20260709 12:16:23.256095 23679 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:23.261157 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.255930 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:23.249343 24468 consensus_meta.cc:287] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.003s
W20260709 12:16:23.261488 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 118088us
I20260709 12:16:23.239705 22894 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:23.277872 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.278903 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:23.284042 23682 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:23.243045 24594 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:23.285686 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:23.283582 24573 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:16:23.280517 24611 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:23.292927 24611 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:23.294034 24611 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.258916 24565 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:23.299139 24565 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.299584 24565 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:23.249411 24559 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:23.304033 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:23.307622 23494 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.808s (SENT) [suppressed 6 similar messages]
I20260709 12:16:23.308722 22574 catalog_manager.cc:5697] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:16:23.317056 22899 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:23.280833 23679 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:23.245054 24071 raft_consensus.cc:2764] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:16:23.240350 24658 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:23.204993 24578 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:16:23.310645 22574 catalog_manager.cc:5697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 3 to 6, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 6 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.336540 22745 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:23.316525 24657 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:23.337320 22751 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:23.360977 23679 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:23.362917 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:23.381232 22897 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:23.304041 24559 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.391657 22752 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:23.352517 24411 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:23.396735 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:23.397866 22826 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:23.399968 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:23.353178 24570 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:16:23.401587 23682 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:23.356470 24642 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:16:23.404147 22826 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:16:23.385382 24720 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.384922 24709 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:23.383185 24579 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:23.416932 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:23.397459 24583 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:23.427335 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:23.433296 22745 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:16:23.439344 22820 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:23.441640 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:23.405932 24663 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:23.414647 24709 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:23.449478 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:23.423094 24579 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.451504 23682 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:16:23.464680 23682 pending_rounds.cc:85] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 2
I20260709 12:16:23.465059 23682 pending_rounds.cc:107] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:16:23.465353 23682 raft_consensus.cc:2889] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:23.465751 23682 pending_rounds.cc:107] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:16:23.465979 23682 raft_consensus.cc:2889] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:23.412194 24730 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:23.401660 24411 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:23.446864 24583 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:23.444069 24735 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.449267 24717 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:23.449409 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:23.448956 24716 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:23.468968 24579 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:23.421833 24635 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:23.490173 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 252) took 1403 ms. Trace:
I20260709 12:16:23.429370 24721 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:16:23.498948 22748 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:23.454741 24455 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.505345 22864 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.513674 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 466) took 1066 ms. Trace:
I20260709 12:16:23.514189 22747 rpcz_store.cc:276] 0709 12:16:22.447336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.599804 (+152468us) service_pool.cc:224] Handling call
0709 12:16:23.512860 (+913056us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:23.513105 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:23.513313 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:23.513340 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:23.513389 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:23.513421 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.513481 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:23.513606 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11464064}
I20260709 12:16:23.420778 24720 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.429953 24723 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:16:23.509054 24611 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:23.510560 22574 catalog_manager.cc:5697] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 4 to 6, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 6 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.471920 24730 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:23.480966 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:23.430058 24710 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:16:23.519510 22824 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:23.477730 24387 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.535485 22892 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:23.491273 24714 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.499534 24649 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:23.503405 22753 rpcz_store.cc:276] 0709 12:16:22.087175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.408547 (+321372us) service_pool.cc:224] Handling call
0709 12:16:22.408883 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:22.409196 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:16:22.604866 (+195670us) log.cc:844] Serialized 14 byte log entry
0709 12:16:23.161785 (+556919us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b18003e51e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a
0709 12:16:23.488370 (+326585us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:23.488433 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:23.488477 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.489895 (+  1418us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:23.490092 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":226515,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":33215,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":51,"spinlock_wait_cycles":3470464,"thread_start_us":637396,"threads_started":3,"wal-append.queue_time_us":357151}
I20260709 12:16:23.546180 24714 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.491333 24735 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.551092 24714 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:23.553391 24735 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:23.555857 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:23.556268 24718 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:23.556695 24718 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:23.556752 22753 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:23.557806 24718 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.558368 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.559131 22894 raft_consensus.cc:2368] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5.
I20260709 12:16:23.559453 24714 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:23.559895 24714 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.529697 24729 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:23.560313 24714 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:23.560660 24729 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.537761 24709 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.564139 24559 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:23.565267 24569 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:23.566481 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.566159 24569 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:23.568135 24639 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:16:23.507076 24583 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:23.568616 24569 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:23.569129 24714 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.569483 24583 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.570225 22824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53"
dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:43202
I20260709 12:16:23.571098 22824 raft_consensus.cc:606] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:23.571426 24658 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:23.572083 24714 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:23.556701 24455 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:23.572576 24387 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.571553 22824 raft_consensus.cc:614] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:23.574929 24735 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.575124 24663 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.575670 24735 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.580498 24635 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:23.580637 24265 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:23.542712 24730 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:23.581372 24265 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:23.583400 24565 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.586261 24565 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:23.587746 24719 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.588584 24719 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:23.569314 24569 raft_consensus.cc:2764] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:16:23.590762 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 610) took 1304 ms. Trace:
I20260709 12:16:23.591465 22749 rpcz_store.cc:276] 0709 12:16:22.286190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.479494 (+193304us) service_pool.cc:224] Handling call
0709 12:16:22.479862 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:22.508915 (+ 29053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:22.508951 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:22.508997 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:22.509026 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.590470 (+1081444us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b54004047d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:23.590528 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:23.590692 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66279168}
W20260709 12:16:23.533875 24592 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.662s	user 0.014s	sys 0.001s
I20260709 12:16:23.565402 24720 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:23.597301 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:23.605695 22748 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:23.590955 24735 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:23.608717 24719 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:23.544469 24712 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:23.560036 24411 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:23.616437 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:23.619380 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.625110 22901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:23.625947 22901 raft_consensus.cc:606] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:23.626318 22901 raft_consensus.cc:614] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:23.628443 24728 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.629083 24728 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.622035 22748 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:23.633054 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:23.652233 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 157469us
I20260709 12:16:23.654537 24565 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:23.655292 24565 consensus_queue.cc:1243] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:16:23.655721 24639 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:16:23.655906 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 148373us
I20260709 12:16:23.658221 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:23.661424 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:23.661823 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:23.661453 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:23.663753 22753 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:23.663614 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:23.665172 22748 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:23.632565 24712 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:23.612218 24592 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:23.582665 24265 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.672437 24669 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:23.656980 24387 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:23.656128 24639 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:23.682405 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.675568 24468 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:23.678748 24411 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:23.674651 24729 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:23.686961 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 206050us
I20260709 12:16:23.692929 22748 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:23.687326 22901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:23.695030 22901 raft_consensus.cc:606] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:23.684396 22753 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:23.689713 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:23.693445 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.673916 24579 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.704919 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:23.709429 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:23.680213 24714 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:16:23.714910 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:23.717677 23689 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:23.719323 24502 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:23.720167 24502 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:23.731339 24639 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.732489 24071 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:23.733115 24071 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:23.733351 24639 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:23.734148 24071 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.735222 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:23.735666 24071 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.738508 24571 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:23.721570 24502 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.739013 24571 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:23.739739 24502 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.739990 24571 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.700137 24411 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:23.743252 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46379.7us
I20260709 12:16:23.745126 24559 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:23.699319 24565 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:23.747567 24565 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:23.748005 24565 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:23.690043 24669 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:23.749770 24669 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.751663 24592 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:23.753335 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.754552 23682 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
W20260709 12:16:23.755939 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:23.756618 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:23.757061 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.759801 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:23.741241 24571 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.704286 24265 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:23.759773 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.765448 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.769376 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:23.711159 24729 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:23.771831 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:23.772228 22748 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:16:23.773842 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:23.773849 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:23.774174 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:23.778139 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:23.776223 22752 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
W20260709 12:16:23.780814 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 71510.5us
I20260709 12:16:23.779560 22748 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 2.
I20260709 12:16:23.743371 24411 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:23.761437 24717 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:23.767976 24712 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.769677 24658 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.775188 24728 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:23.780218 24128 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:23.835872 24717 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:23.782799 24742 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:23.794440 22753 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:23.840029 24742 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.791719 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:23.841498 24730 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.839000 24658 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:23.781322 24593 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:23.776558 24663 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:23.847095 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 232) took 1339 ms. Trace:
I20260709 12:16:23.781169 24719 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:16:23.808176 24727 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.332s	user 0.001s	sys 0.002s
W20260709 12:16:23.851459 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 59815.6us
I20260709 12:16:23.867477 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:23.789273 24729 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:23.910662 22751 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:16:23.808553 24649 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:23.859480 24455 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:23.859840 22895 rpcz_store.cc:276] 0709 12:16:22.507761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.509332 (+  1571us) service_pool.cc:224] Handling call
0709 12:16:22.509665 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:22.599439 (+ 89774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.846695 (+1247256us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b54002ff154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:23.847003 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205158144}
W20260709 12:16:23.909407 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.806211 24579 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:23.866537 24719 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.930881 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:23.929092 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 513) took 1334 ms. Trace:
I20260709 12:16:23.932381 22899 rpcz_store.cc:276] 0709 12:16:22.594681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:23.115782 (+521101us) service_pool.cc:224] Handling call
0709 12:16:23.316839 (+201057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:23.317656 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.923318 (+605662us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54004ec0d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:23.929009 (+  5691us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461406080}
I20260709 12:16:23.853392 24467 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:16:23.909562 24617 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 12:16:23.930148 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.873500 24593 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:23.918062 24387 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:23.914682 24728 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:23.919721 24734 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:23.957640 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:23.960353 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:23.935134 24719 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:23.960219 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:23.919005 24502 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:16:23.869851 24663 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:23.958603 24387 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.969437 24593 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:23.972288 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.954707 24668 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.937456 24716 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:16:23.973484 24730 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:23.974187 24729 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:23.975397 24728 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:23.968508 24751 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:16:23.978991 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.983556 24678 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:23.922575 24128 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:16:23.936431 24710 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:23.950958 24649 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:23.990692 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:23.996335 24387 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:23.998534 24663 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:23.964056 24590 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.959131 24721 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:16:24.008111 24742 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:24.003799 24071 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:23.936251 24745 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:16:24.038723 22822 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:24.040854 24728 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:24.007179 24668 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:24.048128 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:24.048833 22827 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:24.049952 24668 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:24.019073 24678 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:24.052794 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:24.053444 22827 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:24.050571 24128 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:24.058248 24658 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:23.994582 24734 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.058190 24565 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.052176 24071 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:24.065619 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.066171 22824 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:24.066803 23689 raft_consensus.cc:2410] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:24.054205 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:24.059023 24742 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:24.056913 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.068928 22750 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:24.083144 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 465) took 1636 ms. Trace:
I20260709 12:16:24.075776 24128 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:24.083993 24387 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.085485 24128 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:24.086016 24387 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:24.075547 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:24.090421 24734 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:24.055570 24710 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:16:24.075724 24717 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:16:24.083218 23982 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:24.091882 23982 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:24.092525 23982 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:24.046329 24590 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:24.058398 24678 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.094022 24678 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:24.076267 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:24.094760 24590 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:24.086584 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:24.076020 22751 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:24.095958 22900 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:24.077025 24571 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:24.083644 22750 rpcz_store.cc:276] 0709 12:16:22.447061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.599692 (+152631us) service_pool.cc:224] Handling call
0709 12:16:24.063009 (+1463317us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:16:24.068754 (+  5745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:24.082863 (+ 14109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:24.083082 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7831808}
I20260709 12:16:24.094197 22899 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:24.074560 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 515) took 1479 ms. Trace:
I20260709 12:16:24.099915 22897 rpcz_store.cc:276] 0709 12:16:22.595404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:23.125157 (+529753us) service_pool.cc:224] Handling call
0709 12:16:23.140932 (+ 15775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:23.381867 (+240935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:24.061685 (+679818us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54006eb754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:24.074496 (+ 12811us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541194624}
I20260709 12:16:24.091929 24710 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:16:24.101465 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 47271.4us
I20260709 12:16:24.107468 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:24.108493 22744 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:16:24.112085 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.092689 24742 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:24.147835 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:24.098762 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.177423 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:24.105998 24710 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:24.182512 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:24.183522 22820 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:24.113649 24590 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:16:24.190742 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 92069.1us
I20260709 12:16:24.194587 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:24.196010 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:24.117002 24734 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:24.198216 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:24.202091 22818 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:24.204564 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:24.205693 22825 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:24.122051 24742 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:24.198711 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:24.209111 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:24.112274 24571 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:24.215098 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.216522 22825 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:24.216320 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:24.205670 24518 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:24.216333 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:24.218043 24518 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.216361 24663 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:24.219322 24663 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.219563 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:24.220461 22900 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:24.220873 24518 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:24.221488 24663 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:24.223981 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:24.228492 24748 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.397s	user 0.004s	sys 0.013s
I20260709 12:16:24.231354 24617 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.232007 24617 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.234258 24617 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:24.234567 24071 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:24.235831 22753 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:16:24.199365 24537 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:24.239552 24746 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:24.239646 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:24.240537 22748 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:24.218137 24717 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:24.245848 24681 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:24.268796 24717 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:24.269098 24681 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:24.269322 24717 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:24.247341 24537 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:24.269801 24571 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:24.270711 24537 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.241964 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:24.189616 24658 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:24.189762 24590 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.254099 24565 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:24.263211 22901 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:24.292964 24518 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:24.293497 24518 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.293964 24518 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:24.205716 24734 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.298262 24734 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:24.265772 24467 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:24.240360 24746 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.286278 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:24.320160 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:24.321146 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.323643 22818 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:24.287137 24658 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.291872 24590 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:24.291031 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:24.264027 24742 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.336531 22753 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:24.337831 22893 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:16:24.338610 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:24.291031 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:24.341835 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.292027 24719 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.361970 24719 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:24.363276 24523 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:24.363027 24724 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:24.364059 24523 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:24.366827 24523 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:24.367974 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:24.368561 24746 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:24.369274 22746 raft_consensus.cc:2368] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6.
I20260709 12:16:24.285670 24710 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:24.372854 24710 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:24.373340 23493 leader_election.cc:400] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6.
I20260709 12:16:24.373925 23493 leader_election.cc:403] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:16:24.376070 24678 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:24.334015 24658 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:24.379652 23982 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.385874 23982 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:24.386917 22746 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
W20260709 12:16:24.387228 24767 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:16:24.383033 22900 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
W20260709 12:16:24.395828 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.412796 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:24.421844 22717 leader_election.cc:400] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5.
I20260709 12:16:24.423146 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:24.412117 24742 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:24.426180 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.428624 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.430680 22900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:24.410002 24518 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.432097 22900 raft_consensus.cc:606] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:24.432358 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:24.433861 22900 raft_consensus.cc:614] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:24.436334 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:24.437456 22822 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:16:24.437845 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:24.438099 22822 pending_rounds.cc:85] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 2
I20260709 12:16:24.438694 22822 pending_rounds.cc:107] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:16:24.439733 22822 raft_consensus.cc:2889] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:16:24.429280 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 351220us
I20260709 12:16:24.442860 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:24.443805 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:24.445744 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:24.411741 24717 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:24.448663 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:24.449409 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 1.1927e+06us
I20260709 12:16:24.462275 22824 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:24.441695 23982 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:24.463476 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:24.432096 24729 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:24.464053 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:24.445318 24746 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:24.469167 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:24.448382 24734 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:24.448799 24719 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:24.461561 24663 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:24.468151 24718 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:24.493723 22744 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:24.496377 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:24.496542 24730 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:16:24.497575 24387 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:24.498077 24387 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:24.498553 22900 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:16:24.498943 22900 pending_rounds.cc:85] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 2
I20260709 12:16:24.499166 22900 pending_rounds.cc:107] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:16:24.499462 22900 raft_consensus.cc:2889] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:24.499059 24387 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.448637 24411 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:16:24.502297 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:24.503046 22748 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:24.449632 24649 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.496392 24518 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:24.504108 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 506) took 1928 ms. Trace:
I20260709 12:16:24.504515 22892 rpcz_store.cc:276] 0709 12:16:22.575878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.576047 (+   169us) service_pool.cc:224] Handling call
0709 12:16:23.182559 (+606512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:23.594453 (+411894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:24.062111 (+467658us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400848354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:24.503887 (+441776us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b5400848350. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:24.504047 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204958336}
I20260709 12:16:24.505138 24649 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:24.505499 22749 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:24.464843 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:24.506613 24636 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:24.508298 24265 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:24.509428 24265 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:24.509756 24265 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:24.510124 24518 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.511601 24071 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:24.513727 24642 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:24.515076 24578 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:24.517321 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:24.469092 24593 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:24.520782 23679 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.523826 23679 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:24.520505 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.523926 22748 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:16:24.525722 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:24.487442 24773 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:16:24.528550 24772 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:16:24.526548 22824 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:24.515434 24578 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:24.530767 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.532727 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:24.533763 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.520341 24729 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:24.510622 24518 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.490432 24719 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:24.477259 24746 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:24.489832 24734 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:24.538837 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:24.544137 24766 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:16:24.471545 24659 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:16:24.534977 23679 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:24.540009 24744 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:24.545137 23982 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:24.576217 23982 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.576766 23982 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:24.550540 24719 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:24.537571 24537 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:16:24.536221 24411 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:24.583127 24411 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:16:24.583793 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.584182 24411 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.534955 24633 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:24.544193 24771 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:16:24.538450 24594 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:24.567458 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:24.552217 24746 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:24.565501 24734 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:24.571501 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 497) took 1295 ms. Trace:
W20260709 12:16:24.567523 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 96080.8us
I20260709 12:16:24.573689 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:24.574533 22901 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:16:24.591418 23982 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:24.534745 24773 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:24.548436 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.600747 23679 rpcz_store.cc:276] 0709 12:16:23.275894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:23.276100 (+   206us) service_pool.cc:224] Handling call
0709 12:16:23.280653 (+  4553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:24.520436 (+1239783us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b54005e2520. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46fd06f 00007fadf4775f60 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62
0709 12:16:24.571247 (+ 50811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:24.571447 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21440384}
I20260709 12:16:24.510636 24265 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.599494 22748 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:16:24.602246 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 53950.6us
I20260709 12:16:24.600143 24729 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:24.604097 24765 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:16:24.606767 24773 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.586215 24717 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:24.575699 24659 consensus_queue.cc:1243] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:16:24.594113 24573 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:16:24.612251 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.586836 24663 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:24.635221 24663 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:24.635313 24579 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.635890 24579 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.637024 24663 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.638216 24579 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:24.616058 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:24.585350 24590 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:24.623859 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:24.644083 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:24.645236 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:24.645895 22751 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:24.626653 22826 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:24.627476 22750 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.3-8.3]
I20260709 12:16:24.647712 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:24.648788 23982 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:24.628167 24719 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:24.629092 24711 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:16:24.629701 24649 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:24.630149 22746 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:24.631023 24518 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:24.568871 24467 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:16:24.595564 24578 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:24.650731 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:24.653512 24730 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:16:24.661298 22864 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:24.671370 22899 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:24.670363 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:24.676436 22901 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:24.685961 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:24.687319 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.654821 24537 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:24.654374 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.691030 23682 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:24.691926 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.617760 24744 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:24.618724 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:24.658274 23982 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:24.693472 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.688719 22752 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:24.689742 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.695088 23689 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:24.695209 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.658275 24559 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:24.696689 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.659854 24071 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:16:24.694449 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 80508.4us
I20260709 12:16:24.722278 23689 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:24.698036 22752 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:24.703157 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.679195 24717 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:24.684676 24636 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:24.725402 23682 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:24.686235 24523 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:24.707212 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:24.701776 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.729476 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.734155 23660 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:24.690845 24537 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:24.699791 24728 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:24.741848 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:24.736369 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.698496 24578 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:24.700033 24718 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:24.749501 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.685093 24716 consensus_queue.cc:1059] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:16:24.705143 24642 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:24.700361 24128 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:24.738924 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:24.738680 23685 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:24.717841 24635 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:24.704101 24714 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:24.746004 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:24.741989 24728 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:24.744481 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:24.743597 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:24.737449 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.775028 23674 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:24.775476 24725 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:24.751052 23689 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:24.730541 24189 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:24.735764 24071 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:24.743562 24537 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:24.755288 24678 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6.
I20260709 12:16:24.775871 24728 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.776161 24725 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:24.763168 24128 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.918485 24434 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:24.921864 24434 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:24.853145 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:16:24.653935 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:24.922642 24434 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:24.925624 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 271672us
I20260709 12:16:24.926134 24434 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:24.861657 22745 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:24.873804 22752 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:16:24.886634 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:24.927565 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:24.927975 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:24.929169 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.746466 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:24.930253 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:24.759456 22899 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:24.933027 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:24.764559 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:24.935606 24128 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:24.895880 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:24.936528 24128 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:24.937186 23674 raft_consensus.cc:2393] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:24.937420 24128 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.938297 23982 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:24.898032 23660 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 2. Current term is 4. Ops: []
W20260709 12:16:24.900279 23494 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.506s (SENT)
I20260709 12:16:24.939401 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:24.940064 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:24.942054 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.938552 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.945214 23674 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:24.947935 24128 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:24.905896 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.957952 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.905923 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:24.897992 22893 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:16:24.908537 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:24.959200 23682 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:24.959885 22898 raft_consensus.cc:2393] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:24.910354 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:24.911953 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.961858 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:24.783044 24071 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:24.788288 24189 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.916224 24411 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:24.968348 24411 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:24.857717 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 628) took 1261 ms. Trace:
I20260709 12:16:24.970934 22747 rpcz_store.cc:276] 0709 12:16:23.596395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:23.596984 (+   589us) service_pool.cc:224] Handling call
0709 12:16:23.597333 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:23.597762 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:23.597796 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:23.598506 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 12:16:24.637235 (+1038729us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b180012f7c0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:16:24.856170 (+218935us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:24.856350 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:24.856564 (+   214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:24.856707 (+   143us) raft_consensus.cc:1685] finished
0709 12:16:24.856753 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:24.857418 (+   665us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7920,"raft.queue_time_us":189,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":9308,"spinlock_wait_cycles":10795264,"thread_start_us":218151,"threads_started":1,"wal-append.queue_time_us":1206985}
I20260709 12:16:24.972522 24128 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:24.939312 23982 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.970602 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:24.976353 23982 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:24.976528 24387 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:24.903223 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:24.951156 23660 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:24.977730 23672 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:24.951920 23674 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.3-8.3]
I20260709 12:16:24.955065 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:24.981267 24468 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:24.739357 24523 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:24.984200 22899 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:24.766058 24658 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:24.987512 24590 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:24.988620 24658 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:24.985605 24523 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:24.990057 24642 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:24.992975 24579 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:24.993669 24579 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:24.781522 24601 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:24.769094 24714 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:24.811378 24728 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:24.904446 23679 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:24.816113 24746 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:24.813174 24719 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:24.977082 23982 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:25.025455 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 77369.6us
I20260709 12:16:24.994199 24579 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.053772 24709 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:25.081799 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 304991us
W20260709 12:16:25.057585 24793 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:16:24.995973 24663 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:24.995891 24724 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:25.058990 24729 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:24.981261 24467 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 12:16:25.089478 24467 consensus_queue.cc:1243] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:16:25.098973 24773 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:16:25.101174 24773 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:25.101799 24773 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:25.102698 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 330467us
I20260709 12:16:25.104471 22820 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:25.105770 24724 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:25.109695 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.116568 23682 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:25.126098 24579 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:25.129410 24579 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.130254 24579 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:25.131007 24579 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:25.133014 24663 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:25.133658 24716 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:16:25.137070 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.137713 24642 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.138507 24642 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:25.140938 24714 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:25.142944 24711 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:25.143422 24642 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:25.136602 22899 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:25.135411 24411 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:25.143848 24711 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:25.135766 24579 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:25.136073 24189 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:25.151836 24800 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:16:25.153530 24773 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:25.156322 24642 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.157116 24642 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:25.158089 24467 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:16:25.159365 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.160169 24725 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:25.161108 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:25.162582 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 51581.4us
I20260709 12:16:25.163107 22899 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:25.163699 22899 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:25.164003 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:25.169059 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.170975 24773 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:25.171700 24579 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:25.175024 22821 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:25.175173 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:25.176061 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.177121 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.178041 22827 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:25.138403 24746 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.179929 22821 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:25.135881 24663 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.180147 22819 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:25.181206 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.181924 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.184628 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.180383 24642 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:25.186661 22822 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:25.178136 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.183106 22820 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:25.188349 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.164950 22899 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:25.189381 22824 raft_consensus.cc:2368] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6.
I20260709 12:16:25.189911 22899 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:16:25.191078 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 86681.1us
I20260709 12:16:25.193924 24798 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:25.166642 24711 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:25.199244 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:25.202989 24711 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.204072 24711 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:25.207228 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 659) took 1249 ms. Trace:
I20260709 12:16:25.207799 22826 rpcz_store.cc:276] 0709 12:16:23.957434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:23.957570 (+   136us) service_pool.cc:224] Handling call
0709 12:16:23.957924 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:24.646754 (+688830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:25.206577 (+559823us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54001257d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:25.206958 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536930048}
I20260709 12:16:25.209281 22895 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:25.218004 24349 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.219805 24711 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.219995 24349 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:25.220878 24663 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:25.221454 24663 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:25.221979 24663 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:25.213553 22827 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:25.213045 23672 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:25.231281 23982 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:25.225322 24734 consensus_meta.cc:287] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.009s
I20260709 12:16:25.240440 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 270) took 1468 ms. Trace:
I20260709 12:16:25.241098 24798 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:25.242000 24798 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:25.243805 24719 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:25.243631 24537 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:25.244415 24719 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:25.232424 23494 leader_election.cc:336] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.808s (SENT)
I20260709 12:16:25.219880 24744 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:16:25.247035 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:25.259229 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.241200 22745 rpcz_store.cc:276] 0709 12:16:23.771990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:23.772123 (+   133us) service_pool.cc:224] Handling call
0709 12:16:24.860858 (+1088735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:24.927145 (+ 66287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:25.240018 (+312873us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400413a50. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:25.240321 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2502492416}
W20260709 12:16:25.261839 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 62715.5us
I20260709 12:16:25.250298 24573 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:25.264523 22899 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 3. (term mismatch)
I20260709 12:16:25.265043 22899 pending_rounds.cc:85] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 2
I20260709 12:16:25.268138 24783 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:25.268675 24783 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:25.260470 24719 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.265254 22899 pending_rounds.cc:107] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 8.3
I20260709 12:16:25.274010 22899 raft_consensus.cc:2889] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:25.261078 24537 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.275449 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.281034 22819 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:25.270088 24783 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:25.287343 24798 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:25.290990 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 81426.8us
I20260709 12:16:25.292068 24617 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.289096 24572 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.292865 24617 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:25.293776 24572 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:25.294495 22747 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:25.295835 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:25.293794 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:25.297144 24783 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:25.297272 22752 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:25.265998 24734 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:25.291765 24798 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.299896 24617 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.300825 24734 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.301882 22826 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:25.289021 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:25.306228 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:25.308473 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.308754 24806 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:25.309042 22822 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:25.310185 24806 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:25.310688 24806 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.311105 24806 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:25.311384 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.312115 22822 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:25.306382 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:25.314520 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.314705 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.315608 22822 raft_consensus.cc:2376] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6. Re-sending same reply.
I20260709 12:16:25.315986 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:25.313562 24734 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.313953 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.317106 22826 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:16:25.317420 22825 raft_consensus.cc:2376] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6. Re-sending same reply.
I20260709 12:16:25.320652 22900 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:16:25.328290 24681 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:25.330264 24681 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:25.330845 22827 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:16:25.331545 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.332253 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 47693.3us
W20260709 12:16:25.332461 24712 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 12:16:25.333043 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.335590 24349 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:25.296114 24572 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:25.341897 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.344365 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.349977 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.352118 22826 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:25.354687 24592 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:25.355041 22827 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.355453 22745 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:25.356042 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.356596 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.356997 22818 raft_consensus.cc:2368] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6.
I20260709 12:16:25.358279 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.359102 22822 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:25.359333 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.359123 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.361733 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.362452 22820 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:25.358340 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.363322 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.363963 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.364530 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.364861 24663 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:25.361754 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:25.360225 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44470.6us
I20260709 12:16:25.365496 22820 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:25.360342 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.368898 22752 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:16:25.373019 24779 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:25.374593 24779 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:25.375217 24779 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:25.375548 24592 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:25.376605 24779 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:25.377142 24592 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:25.379252 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:25.383275 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:25.383855 22748 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:25.384524 24635 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:25.384950 24635 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:25.388789 24265 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.389599 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.374442 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:25.395531 22899 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:25.397843 22826 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:25.398830 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.399041 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.399184 22751 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:25.400347 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.400528 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.401707 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.401906 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.402266 22827 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:25.403563 22822 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:16:25.404837 22824 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:25.378588 24779 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:25.409029 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.409317 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.411530 22825 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:25.386091 24635 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:25.348956 24573 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:16:25.418361 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.420037 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.421020 22819 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:25.419867 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:25.423935 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.424932 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.426533 22827 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:25.427186 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:25.427623 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:25.428025 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:25.428670 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:25.429638 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:25.430044 24573 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:25.430364 23656 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:25.394483 24455 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:25.435236 24573 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.436178 24573 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:25.437273 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:25.424998 24467 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.440634 24467 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:25.440382 22574 catalog_manager.cc:5697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 1 to 4, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 4 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.444247 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:25.445969 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:25.446203 24724 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:25.435307 24455 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:25.448657 24455 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:25.451296 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:25.452664 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:16:25.463267 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 68307.7us
I20260709 12:16:25.462626 24724 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.464874 24724 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:25.413750 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:25.407475 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:25.446069 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:25.475847 23656 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:25.480222 22745 raft_consensus.cc:2410] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:16:25.483954 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:25.484829 22824 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:25.490525 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:25.491133 22894 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:25.495723 22893 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:25.498458 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 275) took 1430 ms. Trace:
I20260709 12:16:25.499215 22749 rpcz_store.cc:276] 0709 12:16:24.068318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.068522 (+   204us) service_pool.cc:224] Handling call
0709 12:16:24.068960 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:24.505946 (+436986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:25.497728 (+991782us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54001e64d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:25.498144 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003448064}
I20260709 12:16:25.500337 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:25.501199 22818 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:25.491211 22898 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:16:25.504947 22899 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:25.516500 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:25.442723 22574 catalog_manager.cc:5697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.520807 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:25.527058 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 100566us
I20260709 12:16:25.533847 23656 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:25.541203 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:25.542892 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:25.538003 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:25.546969 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:25.548046 23679 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:25.549970 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 660) took 1442 ms. Trace:
I20260709 12:16:25.538280 24572 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:16:25.550173 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:25.550884 24572 consensus_queue.cc:1243] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:16:25.551506 23674 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:25.550446 22823 rpcz_store.cc:276] 0709 12:16:24.037194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.037963 (+   769us) service_pool.cc:224] Handling call
0709 12:16:24.038289 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:24.038665 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:24.038686 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:24.052859 (+ 14173us) log.cc:844] Serialized 26 byte log entry
0709 12:16:24.415348 (+362489us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:24.426816 (+ 11468us) log.cc:844] Serialized 14 byte log entry
0709 12:16:24.430884 (+  4068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:24.430980 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:25.415808 (+984828us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b18000bde80. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:16:25.470183 (+ 54375us) raft_consensus.cc:1685] finished
0709 12:16:25.478906 (+  8723us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:25.479131 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11934,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":10252,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":18086,"spinlock_wait_cycles":5585152,"thread_start_us":309609,"threads_started":1,"wal-append.queue_time_us":365534}
I20260709 12:16:25.545186 22748 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.550194 22750 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: []
W20260709 12:16:25.551570 22753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 283) took 1275 ms (client timeout 1585 ms). Trace:
W20260709 12:16:25.560282 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.556697 22753 rpcz_store.cc:269] 0709 12:16:24.276375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.276538 (+   163us) service_pool.cc:224] Handling call
0709 12:16:25.537520 (+1260982us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b54000a8f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:25.551359 (+ 13839us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6907776}
I20260709 12:16:25.563793 23660 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.559279 22899 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:25.539300 24663 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:25.571791 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:25.556538 24467 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:25.578502 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:25.586547 22745 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:25.592232 23494 leader_election.cc:400] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6.
I20260709 12:16:25.592456 24636 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.593232 24636 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:25.595256 24805 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:25.595310 24803 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:25.596006 24805 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:25.598047 24805 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.598238 24635 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:25.599092 23656 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:25.560745 24786 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:16:25.606654 23660 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:25.610189 22897 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:25.604528 22818 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:25.607307 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:25.621896 23672 raft_consensus.cc:2410] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:16:25.563835 24806 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:25.626986 23656 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
W20260709 12:16:25.633456 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.640508 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.651590 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:25.656648 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:25.659438 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:25.656122 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:25.666126 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.669199 22899 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:25.676654 22746 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:25.678715 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:25.678435 22753 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.3-8.3]
I20260709 12:16:25.679412 23660 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:25.609601 24663 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:16:25.610751 24805 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:16:25.620802 24411 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:16:25.687600 24798 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:25.668150 24636 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.706478 23685 raft_consensus.cc:2410] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:16:25.722045 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:25.733529 23660 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:25.734705 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:25.735993 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:25.737568 23660 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:25.744752 23679 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:16:25.744352 23660 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:25.748322 24724 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:25.753398 22574 catalog_manager.cc:5697] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 5, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 5 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.756072 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 636) took 1130 ms. Trace:
I20260709 12:16:25.755576 22574 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 3, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 3 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:16:25.758466 24616 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:25.758201 22574 catalog_manager.cc:5697] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.759703 22790 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:25.761830 24744 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:25.762331 24744 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.764655 23656 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:25.762758 24744 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:25.756465 22750 rpcz_store.cc:276] 0709 12:16:24.625461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.648979 (+ 23518us) service_pool.cc:224] Handling call
0709 12:16:25.549825 (+900846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:25.567431 (+ 17606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:25.755902 (+188471us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b54000a8f50. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:25.756014 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064646912}
I20260709 12:16:25.772697 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:25.779201 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 81978us
W20260709 12:16:25.784220 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 155455us
I20260709 12:16:25.759752 24616 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:16:25.809311 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.809620 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:25.812071 23982 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:25.813900 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:25.815606 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:25.816905 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:25.763178 24265 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:16:25.840144 24265 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:25.840710 24265 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:25.841755 24265 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:25.825282 24728 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:25.833003 24349 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.843752 24349 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:25.844851 22894 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:25.783702 24537 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:25.850811 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 57015.5us
I20260709 12:16:25.853546 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:25.851154 24811 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:16:25.763507 24633 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:16:25.763193 24593 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
W20260709 12:16:25.873915 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.868357 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 203282us
I20260709 12:16:25.873446 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:25.872570 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 55728.7us
I20260709 12:16:25.820293 24616 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:25.826726 24805 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:16:25.893651 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.893134 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:25.897881 22822 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:25.899942 22822 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:25.790480 24617 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.905393 24265 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.868317 24537 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:25.915416 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 190139us
I20260709 12:16:25.902741 24805 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:25.916764 24805 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.917090 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:25.910615 24349 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.909415 24573 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:25.889050 24467 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:25.920624 23689 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:25.924691 24573 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:25.926311 22900 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:25.926960 24573 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:25.918852 23493 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:25.929361 24573 raft_consensus.cc:2764] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:16:25.931845 24806 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:25.933797 24730 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:25.918927 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:25.934834 24593 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:25.935828 24639 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:25.936708 24633 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:25.937620 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:25.986184 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:25.925002 24734 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:25.915958 24537 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:25.944933 24681 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:25.928193 24617 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:25.924495 24565 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:25.825356 24663 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
W20260709 12:16:25.929908 24817 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:16:25.886237 24728 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:25.967612 22821 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 3.
I20260709 12:16:26.002138 23982 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:26.010973 23493 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:16:26.011591 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 74125.5us
I20260709 12:16:25.970077 24593 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:26.005872 24681 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:26.009366 24806 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:26.015324 24573 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:26.047010 24573 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:26.047498 24573 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:26.046586 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:26.048343 22747 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:16:26.042719 22745 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 9 index: 3. (index mismatch)
I20260709 12:16:26.039443 24806 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:26.051241 24806 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:26.051322 24681 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:26.052706 24681 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:26.053673 24825 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:26.054734 24825 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:26.055519 24825 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:26.056483 24825 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:26.044023 22749 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:26.044691 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.057530 24639 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:26.058087 24565 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:26.043030 24616 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:26.021021 24734 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:26.066075 22747 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
W20260709 12:16:26.068921 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.035388 24798 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:26.008657 24633 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.095430 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:26.073577 24825 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:26.050427 24744 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.122680 23656 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:26.128213 24617 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:26.111991 24537 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.117007 24616 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:26.097410 24639 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.154943 23656 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:26.157568 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:26.152168 24734 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:26.159766 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:26.162357 24639 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:26.162801 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:26.163021 24639 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:26.163424 23660 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:26.163560 24639 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:26.165628 24639 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:26.166136 24639 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:26.166471 24639 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:26.167129 24826 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.167984 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.167961 24826 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:26.168491 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:26.131006 24728 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:26.174588 23660 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:26.176404 24828 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.177243 24828 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:26.178670 23660 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:26.179219 23679 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:26.169790 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:26.183499 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.146765 24617 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:26.181862 23674 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
W20260709 12:16:26.191514 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 274498us
W20260709 12:16:26.199327 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.200773 23679 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
W20260709 12:16:26.191208 24635 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.593s	user 0.013s	sys 0.000s
I20260709 12:16:26.149366 24537 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.214775 23695 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:26.187644 24826 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:26.187145 24617 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:26.222536 24639 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:26.226018 23685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 506) took 1332 ms (client timeout 1580 ms). Trace:
I20260709 12:16:26.197039 24349 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.227985 24349 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:26.228704 23659 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:16:26.229058 23659 pending_rounds.cc:85] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 2
I20260709 12:16:26.229274 23659 pending_rounds.cc:107] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:16:26.229506 23659 raft_consensus.cc:2889] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:26.230140 24349 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:26.227246 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.230733 24649 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:26.226555 23685 rpcz_store.cc:269] 0709 12:16:24.893974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.909750 (+ 15776us) service_pool.cc:224] Handling call
0709 12:16:26.225739 (+1315989us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b540073b254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:26.225925 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707966848}
W20260709 12:16:26.302975 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 54497us
I20260709 12:16:26.293651 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 519) took 1325 ms. Trace:
I20260709 12:16:26.303653 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.304071 23659 rpcz_store.cc:276] 0709 12:16:24.909508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.963846 (+ 54338us) service_pool.cc:224] Handling call
0709 12:16:26.228342 (+1264496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.229950 (+  1608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.232357 (+  2407us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540073b250. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:26.234478 (+  2121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2907352960}
I20260709 12:16:26.308601 22751 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:26.181735 24593 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.293136 24572 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
W20260709 12:16:26.362298 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.365355 24803 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:26.366197 24803 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:26.370471 24803 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:26.378945 24537 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:26.332353 24649 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.333417 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.335654 24633 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:26.383299 24455 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.346432 22892 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:26.421033 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:26.405442 22750 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:16:26.418013 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 500460us
I20260709 12:16:26.436105 24803 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:16:26.438155 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.440227 24592 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.441071 24592 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.442623 24349 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:16:26.436975 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 106863us
I20260709 12:16:26.471179 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:26.429716 24826 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:26.477624 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:26.465031 24593 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:26.487221 24724 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:26.435268 24537 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 12:16:26.489305 22821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 204) took 1311 ms (client timeout 1547 ms). Trace:
I20260709 12:16:26.461580 24828 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:26.490057 22821 rpcz_store.cc:269] 0709 12:16:25.177536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.180844 (+  3308us) service_pool.cc:224] Handling call
0709 12:16:26.488945 (+1308101us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b5400123ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:26.489158 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158644608}
I20260709 12:16:26.496294 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.497139 22751 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:26.481475 24649 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:26.431208 24617 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:26.463227 24455 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:26.509478 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 44270.2us
I20260709 12:16:26.516924 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:26.496637 24834 raft_consensus.cc:2764] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:16:26.522347 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:26.490607 24826 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:26.529029 24826 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:26.529697 24826 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:16:26.518764 24805 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.601s	user 0.007s	sys 0.012s
I20260709 12:16:26.536964 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.540694 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:26.504209 24798 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:26.543123 24734 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.521770 24349 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:26.551833 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 376157us
W20260709 12:16:26.570534 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.556813 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:26.533686 24805 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:26.581017 24649 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:26.584829 24805 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:26.544425 24669 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:16:26.562000 24786 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.011s	sys 0.029s
I20260709 12:16:26.580286 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:26.530746 24573 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:26.543556 24730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.009s	sys 0.005s
I20260709 12:16:26.598871 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.601991 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:26.602519 24806 consensus_meta.cc:287] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.007s
W20260709 12:16:26.609128 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.619602 22750 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:16:26.592449 24786 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.011s	sys 0.029s
I20260709 12:16:26.606281 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.576602 24734 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:26.632861 24724 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:16:26.633353 24825 consensus_meta.cc:287] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.001s
I20260709 12:16:26.633677 24724 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.604929 24826 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:16:26.647322 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.625797 24455 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:26.652602 22747 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:16:26.633817 24825 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:26.646963 24805 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:26.649770 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.009s	sys 0.010s
W20260709 12:16:26.623487 24730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.010s	sys 0.005s
I20260709 12:16:26.656482 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:26.656945 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:26.661466 23660 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:26.657557 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:26.662761 23659 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:26.592867 24828 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 12:16:26.659623 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.010s	sys 0.011s
W20260709 12:16:26.663853 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 643800us
I20260709 12:16:26.625481 24806 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:26.653872 22747 pending_rounds.cc:85] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 2
I20260709 12:16:26.647907 24592 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:26.650803 24724 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:26.670305 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.673882 22747 pending_rounds.cc:107] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:16:26.653674 24826 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:16:26.660261 24616 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.510s	user 0.013s	sys 0.000s
I20260709 12:16:26.677057 22745 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:26.714035 24826 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:26.681927 24744 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:26.659452 24455 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:26.683293 24617 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:26.683768 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:26.686951 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:26.736996 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 62530.7us
I20260709 12:16:26.665807 24537 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:26.688977 24806 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:26.675823 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.690398 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:26.666082 24805 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:26.691378 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 359410us
I20260709 12:16:26.666395 24798 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:26.676692 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.700260 24825 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:26.701354 24573 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:26.708382 24734 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:26.659458 24649 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:26.710703 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:26.781869 23689 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:26.674911 22747 raft_consensus.cc:2889] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:26.688380 24559 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:26.739188 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:26.739498 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:26.785084 22819 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:26.784940 24649 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.742726 24592 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:16:26.747637 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:26.786474 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:26.787102 22895 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:26.748160 24805 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:26.749364 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:26.750053 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 77826.8us
I20260709 12:16:26.744648 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:26.756757 24779 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:26.758188 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:26.759210 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:26.764634 23659 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:26.665760 24730 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:26.737282 24455 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:26.788296 24838 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:16:26.795452 23494 leader_election.cc:400] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6.
I20260709 12:16:26.791153 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:26.792367 23674 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:26.743530 24724 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:26.742913 24830 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:26.799685 22751 raft_consensus.cc:2393] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:26.777287 24847 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:16:26.813292 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 233115us
I20260709 12:16:26.819494 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:26.794282 24779 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:26.822264 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.795531 24455 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:26.807142 24559 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.828439 24559 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:26.831665 22822 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.833984 22822 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:26.836169 24719 raft_consensus.cc:3055] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:26.836817 24719 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:16:26.845081 24815 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.755s	user 0.003s	sys 0.008s
I20260709 12:16:26.803576 24830 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:26.847981 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 499) took 1554 ms. Trace:
I20260709 12:16:26.849785 24830 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:26.848416 22744 rpcz_store.cc:276] 0709 12:16:25.293267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.295666 (+  2399us) service_pool.cc:224] Handling call
0709 12:16:25.296117 (+   451us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:25.588661 (+292544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:25.588707 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:25.589417 (+   710us) log.cc:844] Serialized 52 byte log entry
0709 12:16:25.709605 (+120188us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:26.097718 (+388113us) log.cc:844] Serialized 14 byte log entry
0709 12:16:26.114838 (+ 17120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.148704 (+ 33866us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b48000ed258. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf96a8aa1 00007fadf969fb37 00007fadf969f9ca 00007fadf979726f 00007fadf9796f37 00007fadf97ab55c 00007fadf97ab508 00007fadf97ab488 00007fadf97ab443 00007fadf97aa6ec 00007fadf86d4a96
0709 12:16:26.847493 (+698789us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54001e91d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:26.847559 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:26.847612 (+    53us) raft_consensus.cc:1685] finished
0709 12:16:26.847625 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.847803 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33374,"prepare.queue_time_us":16347,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":31007,"raft.run_cpu_time_us":4894,"raft.run_wall_time_us":582374,"spinlock_wait_cycles":498289280,"thread_start_us":458257,"threads_started":2,"wal-append.queue_time_us":465861}
I20260709 12:16:26.850653 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 530) took 1419 ms. Trace:
I20260709 12:16:26.851547 24639 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:26.800951 24724 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:26.853171 24349 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:26.800772 24744 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.844398 24779 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:26.858238 24744 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:26.858850 24779 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:26.860443 24744 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:26.861068 24635 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:26.861217 24843 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.861753 24635 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:26.861894 24843 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:26.853519 24724 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:26.854390 24649 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:26.863919 24635 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:26.864440 24843 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:26.750847 24537 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:26.864733 22576 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 128) took 10029 ms. Trace:
I20260709 12:16:26.866595 24537 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:26.867795 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:26.869055 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:26.869537 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:26.870981 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 75700.5us
I20260709 12:16:26.871577 24265 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.871783 24839 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:26.855860 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 524) took 1363 ms. Trace:
I20260709 12:16:26.873131 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:26.871842 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:26.851040 23682 rpcz_store.cc:276] 0709 12:16:25.431454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.436433 (+  4979us) service_pool.cc:224] Handling call
0709 12:16:25.436930 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:25.437409 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:25.437441 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:25.438123 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 12:16:25.634117 (+195994us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:25.634202 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:25.634319 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:26.844013 (+1209694us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:26.850377 (+  6364us) raft_consensus.cc:1685] finished
0709 12:16:26.850397 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.850591 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15458,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":3908992,"thread_start_us":185425,"threads_started":1,"wal-append.queue_time_us":582448}
I20260709 12:16:26.878904 23982 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:26.879429 23982 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:26.878114 22892 rpcz_store.cc:276] 0709 12:16:25.492596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.492952 (+   356us) service_pool.cc:224] Handling call
0709 12:16:25.493316 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.428086 (+934770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.855596 (+427510us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b540057f154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:26.855764 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961165696}
W20260709 12:16:26.882165 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 57742.9us
W20260709 12:16:26.881266 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 68353.3us
I20260709 12:16:26.807199 24669 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:26.894232 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:26.899430 23685 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:26.894658 23982 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:26.892593 22745 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:26.880872 24734 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:26.919335 24734 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:26.919848 24734 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:26.865118 22576 rpcz_store.cc:276] 0709 12:16:16.835696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:16.836052 (+   356us) service_pool.cc:224] Handling call
0709 12:16:26.864524 (+10028472us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:18.873119 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:19.126689 (+253570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:19.131373 (+  4684us) write_op.cc:435] Acquired schema lock
0709 12:16:19.141718 (+ 10345us) tablet.cc:662] Decoding operations
0709 12:16:19.357747 (+216029us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:19.359830 (+  2083us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:19.378369 (+ 18539us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:16:19.610323 (+231954us) tablet.cc:701] Row locks acquired
0709 12:16:19.612307 (+  1984us) write_op.cc:260] PREPARE: finished
0709 12:16:19.622659 (+ 10352us) write_op.cc:270] Start()
0709 12:16:19.622853 (+   194us) write_op.cc:276] Timestamp: P: 1783599379622583 usec, L: 0
0709 12:16:19.622887 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:16:19.623877 (+   990us) log.cc:844] Serialized 2890 byte log entry
0709 12:16:20.304324 (+680447us) op_driver.cc:464] REPLICATION: finished
0709 12:16:20.535761 (+231437us) write_op.cc:301] APPLY: starting
0709 12:16:20.535863 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:20.536090 (+   227us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:20.536231 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:20.537184 (+   953us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:20.537412 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:16:20.537459 (+    47us) write_op.cc:312] APPLY: finished
0709 12:16:20.537766 (+   307us) log.cc:844] Serialized 58 byte log entry
0709 12:16:20.537988 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:20.538134 (+   146us) write_op.cc:454] Released schema lock
0709 12:16:20.538194 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:20.542444 (+  4250us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:20.542474 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1135269,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":224879,"apply.run_cpu_time_us":2883,"apply.run_wall_time_us":6667,"num_ops":7,"prepare.queue_time_us":267716,"prepare.run_cpu_time_us":16265,"prepare.run_wall_time_us":872110,"raft.queue_time_us":389640,"raft.run_cpu_time_us":8688,"raft.run_wall_time_us":262692,"replication_time_us":640511,"thread_start_us":385141,"threads_started":4,"wal-append.queue_time_us":116390,"wal-append.run_cpu_time_us":38386,"wal-append.run_wall_time_us":1786156}]]}
I20260709 12:16:26.920825 22822 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:26.921648 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 997) took 1049 ms. Trace:
I20260709 12:16:26.883567 24537 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:26.864547 24635 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:26.838014 24719 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:26.905691 24848 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:16:26.907418 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:26.900858 24847 consensus_queue.cc:1059] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:16:26.892210 24633 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:16:26.901341 24593 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:16:26.912604 24559 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:26.915735 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 44002.1us
I20260709 12:16:26.916383 24826 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:26.872207 24265 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.928279 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:26.929557 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:26.928176 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:26.925571 23493 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:26.956257 22820 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:26.930150 24806 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:26.937209 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:26.933458 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:26.972293 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 45561.8us
I20260709 12:16:26.972848 22826 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:26.937970 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:26.974700 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 67352.9us
I20260709 12:16:26.922008 22822 rpcz_store.cc:276] 0709 12:16:25.872265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.872473 (+   208us) service_pool.cc:224] Handling call
0709 12:16:25.889357 (+ 16884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.831073 (+941716us) spinlock_profiling.cc:243] Waited 76.4 ms on lock 0x7b5400069620. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46fd06f 00007fadf4775f60 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62
0709 12:16:26.921321 (+ 90248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.921574 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175654272}
I20260709 12:16:26.944291 23682 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:26.945125 22825 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:26.949081 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.929883 24537 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.933183 24835 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:26.958253 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.943020 24635 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:26.959657 22751 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:27.043744 24663 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:26.955610 24730 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:27.044593 24663 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:27.036859 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 61095.6us
I20260709 12:16:26.960757 22746 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:26.961661 22753 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:26.961841 24633 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:26.962366 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:26.966610 24559 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:26.966820 24649 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:26.943496 24565 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:26.969027 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:26.970824 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:27.055325 22752 raft_consensus.cc:2410] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:16:27.055729 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:27.065034 22827 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 3: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:27.058252 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:27.063441 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:27.010627 24828 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:27.071744 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:26.970966 24669 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:27.082103 22826 raft_consensus.cc:3055] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:27.037441 24537 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:27.084781 22826 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:27.054508 24633 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:27.102985 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 168636us
I20260709 12:16:27.104501 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:27.036818 24806 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:27.126405 22824 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:16:27.129865 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 80727.6us
I20260709 12:16:27.088097 24719 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:27.081943 24850 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:27.072233 24616 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:16:27.099198 24828 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:27.152482 24868 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:27.153225 24868 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:27.156302 24868 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:27.157931 24572 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.158569 24572 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:27.161123 24572 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:27.138906 22826 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:27.095197 24798 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:27.165164 24633 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:27.165997 24823 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.051s	user 0.004s	sys 0.000s
I20260709 12:16:27.165661 24798 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:27.168033 24864 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:16:27.168443 24798 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:27.087196 24565 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:27.169293 24663 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:27.170697 22750 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:27.171362 24565 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:27.089869 24559 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:16:27.129040 24728 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:27.130102 24779 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:16:27.176420 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:27.087368 24649 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:27.178696 22826 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:27.180065 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 211837us
I20260709 12:16:27.186223 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:27.138240 24850 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:27.188308 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 83919us
I20260709 12:16:27.062157 24835 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:27.177322 24633 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:27.220553 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 239920us
W20260709 12:16:27.228228 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:27.227559 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:27.226675 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:27.203191 24850 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:27.184897 24728 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:27.227084 24592 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:27.201772 24663 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:27.363900 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:27.404131 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 208881us
I20260709 12:16:27.433620 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:27.339498 24565 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.210543 24873 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:27.240607 24639 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:16:27.215596 24572 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:27.415879 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:27.416036 24845 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.418175 24265 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:27.418401 24649 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:27.420059 24835 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:27.367255 24828 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:27.439620 22826 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:16:27.447204 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 282616us
I20260709 12:16:27.554492 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:27.436761 24779 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:27.438591 24803 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:27.561630 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 335219us
I20260709 12:16:27.453569 24593 raft_consensus.cc:3055] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:16:27.605149 22790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.047s	sys 0.096s
W20260709 12:16:27.605652 22790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.047s	sys 0.096s
W20260709 12:16:27.606077 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 531756us
I20260709 12:16:27.568812 22900 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:16:27.492110 24734 consensus_meta.cc:287] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.004s
I20260709 12:16:27.569283 24875 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.563907 24616 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.546722 24572 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:27.611666 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:27.659614 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 226068us
W20260709 12:16:27.646081 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:27.645872 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:27.563424 24635 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:27.660770 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:27.568917 24779 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:27.453025 24565 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:27.455072 24663 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:27.598925 24593 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:27.669195 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:27.570325 24803 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:27.732229 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:27.664021 24572 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:27.664361 24798 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.681200 24806 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:27.647253 24734 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:27.733253 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:27.663754 24616 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:27.756534 24883 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:16:27.756871 24869 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:27.757632 24869 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.758067 24869 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:27.759368 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:27.757092 24455 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.875s	user 0.013s	sys 0.000s
W20260709 12:16:27.763278 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:27.766678 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:27.766669 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:27.681919 24779 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:27.763389 22894 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:27.778961 24889 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.779567 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:27.788793 23659 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
W20260709 12:16:27.788887 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 218614us
I20260709 12:16:27.776027 22901 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:27.789770 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:27.778991 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:27.791038 22820 raft_consensus.cc:2410] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:16:27.791350 23695 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:27.779129 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:27.787472 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 351079us
I20260709 12:16:27.786451 22745 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:27.794821 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:27.794008 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:27.804541 22822 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:16:27.805987 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:27.809845 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:27.810894 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:27.814754 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:27.817723 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:27.819250 22827 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:27.819832 23682 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:27.811993 23685 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:27.820905 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:27.740615 24798 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:27.778656 24455 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:27.803773 24537 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.704s	user 0.015s	sys 0.000s
I20260709 12:16:27.787395 24826 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:27.790645 24592 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:27.866216 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:27.867841 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:27.812132 24806 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:27.879765 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:27.880810 23682 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:27.871833 23685 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:27.662061 24875 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:27.822638 24649 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:27.846232 24265 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:27.889819 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:27.895907 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:27.898324 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:27.864641 24639 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:16:27.485558 24873 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:27.902770 24265 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:16:27.910241 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 249564us
I20260709 12:16:27.548538 24845 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:27.823132 24805 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:16:27.808777 24889 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:27.887975 24633 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.661s	user 0.008s	sys 0.008s
W20260709 12:16:27.938725 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 487162us
I20260709 12:16:27.803361 24593 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:27.977195 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 372538us
W20260709 12:16:27.950208 24719 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.813s	user 0.014s	sys 0.002s
I20260709 12:16:27.869246 24537 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:28.001156 24633 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.910241 24872 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:27.904582 24897 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.002544 22823 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:27.915599 24892 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.007320 22826 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:28.000072 23494 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:27.977293 24265 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:28.023504 24663 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.017536 24881 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.090684 24881 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.018110 24798 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:28.019443 24849 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.015s	sys 0.006s
I20260709 12:16:27.919684 24806 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 12:16:28.021041 24901 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:28.021025 24876 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:28.024051 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:16:28.119654 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 310279us
W20260709 12:16:28.032217 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 242226us
I20260709 12:16:28.139353 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:27.899853 24649 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:27.955833 24728 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.022519 24882 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 12:16:28.098207 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 277364us
I20260709 12:16:28.150425 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.150825 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:28.151497 23689 raft_consensus.cc:2410] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:16:28.153203 24663 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:28.066916 24872 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:28.155438 24872 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.082311 24565 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:28.163391 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:28.121942 24849 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.015s	sys 0.007s
I20260709 12:16:28.023262 24592 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:28.165136 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.172705 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.173358 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.128881 24593 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:28.174381 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 217369us
I20260709 12:16:28.180912 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:28.117563 24888 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.176676 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.176842 23659 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:28.177261 23689 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:28.183420 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.077301 24724 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:16:28.167709 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.179625 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.179651 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.070955 24633 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:28.173655 24876 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:16:28.173334 24565 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.196400 24565 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:28.197541 24633 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:28.197782 24876 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:28.198297 24890 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.199116 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.199049 24890 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:28.094702 24803 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:28.200248 23659 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:28.143239 24779 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.184384 22898 raft_consensus.cc:2410] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:16:28.149487 24649 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:28.176908 23656 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:28.185420 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.167651 24798 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:28.145565 24616 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.139596 24891 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:28.189776 24901 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:28.095263 24892 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:28.122743 24805 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.191861 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.189359 22896 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
W20260709 12:16:28.188629 22865 connection.cc:256] RPC call timeout handler was delayed by -1.0140222210000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 12:16:28.075971 24897 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.219182 24669 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.257040 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.213567 24798 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:28.307269 24798 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:28.278249 24805 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:28.307487 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 126643us
I20260709 12:16:28.309484 24805 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.256412 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.310715 22899 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:28.310158 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.198619 24565 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.224231 24779 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:16:28.310111 24906 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:16:28.254398 24901 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:28.304100 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.321137 22896 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:28.224448 24455 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:28.297623 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 118617us
W20260709 12:16:28.317154 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 125538us
I20260709 12:16:28.284116 24891 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:28.304919 24349 raft_consensus.cc:3055] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:28.349488 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.191481 24888 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:28.373775 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.319491 24669 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:28.379328 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 69274.8us
I20260709 12:16:28.380254 24890 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:28.314502 24779 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:28.381000 24907 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:28.381283 24779 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.381479 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.384400 24901 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:28.385138 24901 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:28.386976 24839 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:28.388595 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:28.387470 24839 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:28.391323 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.391747 24839 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.386340 24663 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:28.390437 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.401633 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.403008 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.349455 24898 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:28.409639 22820 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:28.375339 24828 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:28.374388 24349 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:28.413053 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.381721 24907 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:28.403862 24894 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.393s	user 0.000s	sys 0.002s
I20260709 12:16:28.399663 24537 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:28.381031 24669 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.428707 22820 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 5: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:16:28.407714 24879 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:16:28.430483 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.433578 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.434218 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1000) took 1530 ms. Trace:
I20260709 12:16:28.435878 22819 rpcz_store.cc:276] 0709 12:16:26.904243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:26.904424 (+   181us) service_pool.cc:224] Handling call
0709 12:16:26.911254 (+  6830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:26.966242 (+ 54988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:26.968506 (+  2264us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:26.970019 (+  1513us) log.cc:844] Serialized 26 byte log entry
0709 12:16:27.079665 (+109646us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:27.079736 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:28.425313 (+1345577us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b54001243d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:28.425361 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:28.425408 (+    47us) raft_consensus.cc:1685] finished
0709 12:16:28.425421 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:28.434146 (+  8725us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1797,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":297,"spinlock_wait_cycles":125493632,"thread_start_us":86764,"threads_started":1,"wal-append.queue_time_us":72990,"wal-append.run_cpu_time_us":2612,"wal-append.run_wall_time_us":1130341}
I20260709 12:16:28.443321 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:28.445079 22717 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.998s (SENT) [suppressed 11 similar messages]
I20260709 12:16:28.418227 24901 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:28.410866 24898 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:28.408907 24870 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:28.450256 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.374903 24891 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.496953 24891 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.500996 24455 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:28.487293 24875 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:28.444507 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:28.503888 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 59471.1us
W20260709 12:16:28.484195 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 95703.3us
W20260709 12:16:28.468464 24857 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.242s	user 0.011s	sys 0.005s
I20260709 12:16:28.512104 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.439316 24849 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:28.466720 24839 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:28.487200 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:28.485859 24872 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.490681 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:28.450994 24744 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:28.535826 24744 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.537370 24872 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.539036 24744 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:28.449229 24901 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:28.539811 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.518862 24845 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.467489 24898 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:28.541126 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 513) took 1501 ms. Trace:
I20260709 12:16:28.541270 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.521836 24888 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:28.524646 22894 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.710s	user 0.004s	sys 0.007s
I20260709 12:16:28.509322 24904 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:28.543473 24892 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.541671 22744 rpcz_store.cc:276] 0709 12:16:27.039906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:27.052318 (+ 12412us) service_pool.cc:224] Handling call
0709 12:16:27.107426 (+ 55108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:27.449392 (+341966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:27.453565 (+  4173us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:27.569659 (+116094us) log.cc:844] Serialized 26 byte log entry
0709 12:16:27.985030 (+415371us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:27.991255 (+  6225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:28.004376 (+ 13121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:28.540791 (+536415us) raft_consensus.cc:1685] finished
0709 12:16:28.540826 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:28.541045 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7121,"raft.queue_time_us":10413,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":765,"thread_start_us":572112,"threads_started":2,"wal-append.queue_time_us":857207}
I20260709 12:16:28.545706 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.546451 22827 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:28.547042 24265 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.548130 24907 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.550437 24265 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:28.551738 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.553387 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.540009 24873 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:28.554642 24850 consensus_meta.cc:287] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.106s	user 0.010s	sys 0.003s
I20260709 12:16:28.555183 24850 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:28.542040 23659 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:28.525871 24649 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:28.515661 24663 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:28.526759 24616 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:16:28.516032 24909 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.127s	user 0.007s	sys 0.000s
I20260709 12:16:28.529958 24798 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:28.532047 24881 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:28.532233 24869 consensus_meta.cc:287] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.772s	user 0.012s	sys 0.000s
I20260709 12:16:28.427999 24565 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:28.538887 24349 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:28.539986 24901 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:28.562569 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:28.581374 24572 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.838s	user 0.015s	sys 0.000s
I20260709 12:16:28.566325 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.485400 24889 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.514469 24882 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:28.512485 24730 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:28.602557 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.613741 23659 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:28.616303 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.617084 22893 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:16:28.603209 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 112627us
I20260709 12:16:28.513532 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:28.543506 22894 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:28.563603 22897 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:28.610085 23660 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
W20260709 12:16:28.620692 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 107233us
I20260709 12:16:28.602162 24870 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:28.638303 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:28.609622 24616 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.640833 22825 raft_consensus.cc:2393] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 5: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:28.640962 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:28.582480 24663 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:28.611723 24882 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:28.643131 23494 connection.cc:256] RPC call timeout handler was delayed by -1.3069360049998977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
I20260709 12:16:28.606702 24869 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:28.610548 24885 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:28.624714 24639 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:28.645043 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:28.650177 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.644411 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:28.646555 22822 pending_rounds.cc:85] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 2
I20260709 12:16:28.625059 24873 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:28.631896 24893 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.625316 24889 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:28.627038 24892 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.662091 23659 raft_consensus.cc:2410] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:16:28.652176 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.662127 22822 pending_rounds.cc:107] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:16:28.649622 24828 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.645576 24917 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:16:28.647205 24890 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.668191 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.611680 24572 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:28.632218 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1067) took 1062 ms. Trace:
I20260709 12:16:28.703115 22894 rpcz_store.cc:276] 0709 12:16:27.570281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:27.605975 (+ 35694us) service_pool.cc:224] Handling call
0709 12:16:28.626631 (+1020656us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:28.703876 24798 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:28.704274 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.704876 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.675837 22822 raft_consensus.cc:2889] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:28.651831 24882 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:28.672060 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.645943 24565 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:28.654394 24728 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:28.648142 24850 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.666692 24897 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:28.666438 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:28.718629 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 55243.4us
I20260709 12:16:28.705089 22901 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:28.676613 22893 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:28.653712 24616 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:28.671250 24876 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:28.722992 24876 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:28.723620 24876 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.724331 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.724335 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.713259 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:28.713606 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45559.1us
I20260709 12:16:28.674623 24881 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:28.640308 24872 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:16:28.724467 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 60295.2us
I20260709 12:16:28.632288 24730 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:28.725574 22901 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:28.729033 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.730513 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:28.732465 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.653247 24919 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.077s
W20260709 12:16:28.717622 24920 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:16:28.715006 24728 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:28.740007 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:28.685717 24889 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:28.739347 24873 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.749400 24873 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:28.750983 24886 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:28.751559 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.752231 24869 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.679733 24892 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.753748 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.754433 22901 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:28.755343 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.739544 24904 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:16:28.757089 24904 consensus_queue.cc:1243] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:16:28.696135 24828 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.728010 24917 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:28.760391 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:28.737174 22894 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:28.772238 22865 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.698905 24890 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.788785 24890 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.791492 23659 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:28.677904 24893 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.773656 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:28.760396 24728 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:28.776962 24928 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 12:16:28.780081 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:28.781281 24572 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.782620 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.782922 24870 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:28.783524 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:28.783978 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:28.814958 24923 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:16:28.785501 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1069) took 1151 ms. Trace:
I20260709 12:16:28.785669 22900 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:16:28.734032 24850 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.766470 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.794936 24828 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.801932 24892 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.804260 24730 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:28.750535 24898 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:28.809983 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:28.824895 24870 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.812023 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:28.816175 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.757784 24873 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:28.771108 24917 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.833748 23682 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:28.785046 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.813354 24649 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.817629 24871 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:28.804291 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.851243 22897 rpcz_store.cc:276] 0709 12:16:27.633785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:27.633953 (+   168us) service_pool.cc:224] Handling call
0709 12:16:28.785210 (+1151257us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54003593d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:28.785403 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025775488}
I20260709 12:16:28.789907 24617 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:16:28.857193 23982 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:28.869378 22821 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:28.853492 24872 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.901639 24872 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.903617 24649 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:28.904309 24649 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:28.904968 24926 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.136s	user 0.000s	sys 0.002s
I20260709 12:16:28.852872 24850 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:28.906438 24900 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:28.906807 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:28.858027 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 91652.8us
I20260709 12:16:28.811893 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:28.859647 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 49797.4us
I20260709 12:16:28.908231 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:28.908545 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:16:28.863548 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 51619.1us
I20260709 12:16:28.908277 23660 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:28.850063 22894 raft_consensus.cc:606] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:28.857827 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 119627us
I20260709 12:16:28.871938 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.909008 23685 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:28.913287 22821 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
W20260709 12:16:28.873131 24925 log.cc:927] Time spent T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 12:16:28.874131 24927 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:16:28.859561 24719 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:28.875991 24617 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:28.913100 24663 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.943017 24617 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:28.912868 22894 raft_consensus.cc:614] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:28.944077 24617 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:28.945037 24850 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.945452 24617 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:28.947362 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:28.947799 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1063) took 1493 ms. Trace:
I20260709 12:16:28.869609 23982 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:28.948019 24901 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:28.939553 24876 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:28.945124 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:28.951301 24876 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:28.953801 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:28.863915 24839 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:28.959039 24839 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.959540 24839 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:28.867419 24592 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:28.861972 24932 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:28.862612 24870 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:28.884716 24779 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.001s
I20260709 12:16:28.887118 24882 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:28.867697 24917 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:28.891456 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.897058 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:28.820201 24904 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:16:28.843073 24885 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:16:28.999197 24867 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.967s	user 0.000s	sys 0.004s
I20260709 12:16:28.999904 24889 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:28.910640 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:28.911885 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:28.909256 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:28.907554 22750 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
W20260709 12:16:29.001719 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 92527us
W20260709 12:16:28.907612 24929 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:16:28.926702 22897 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:28.932217 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:28.922871 24884 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.934862 24898 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:28.935792 22746 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:28.939365 22753 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:28.922392 24891 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:28.961895 22894 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:29.022505 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:28.950521 23982 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:28.950534 22748 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:16:28.971385 23682 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:28.948226 22892 rpcz_store.cc:276] 0709 12:16:27.454552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:27.454795 (+   243us) service_pool.cc:224] Handling call
0709 12:16:27.492529 (+ 37734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:27.552624 (+ 60095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:27.552674 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:28.499507 (+946833us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b2c001e6a18. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:16:28.500114 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 12:16:28.665593 (+165479us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:28.665640 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:28.665729 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:28.947463 (+281734us) raft_consensus.cc:1685] finished
0709 12:16:28.947487 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:28.947734 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6752,"raft.queue_time_us":249425,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":15058,"spinlock_wait_cycles":17719680,"thread_start_us":164723,"threads_started":1,"wal-append.queue_time_us":241270}
I20260709 12:16:28.981638 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:28.990314 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:28.996984 22824 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:29.003338 22823 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:29.002408 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:29.028877 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:29.011246 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 79138.2us
I20260709 12:16:29.029865 23660 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:29.001564 22749 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:16:29.030539 22791 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:29.081643 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:29.081650 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:29.083035 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:29.083855 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:29.084705 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 54237.6us
I20260709 12:16:29.087126 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.087375 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.089239 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:29.093011 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:29.094754 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:29.101639 23695 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:29.101547 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.103096 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:29.103319 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.104043 23695 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:29.100196 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:29.105309 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:29.106066 23982 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:29.106570 23982 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:29.107213 23982 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:29.012568 24828 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:29.107678 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:28.994742 24779 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:29.133656 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.022586 24891 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.126273 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:29.001605 24897 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 12:16:29.123358 23660 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:29.139294 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.139838 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:29.132302 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.104420 22753 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:29.126078 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:29.139130 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:29.145974 22748 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:29.134069 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:29.147436 22894 raft_consensus.cc:2393] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:29.147876 22823 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:29.115566 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.000412 24798 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:16:29.152262 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:29.155120 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.101281 24889 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:29.133868 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.139592 22824 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:29.023164 24904 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:29.164228 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:29.165050 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.111794 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:29.142061 24898 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:29.141788 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:29.150702 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:29.018992 24744 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:29.157938 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:28.989598 24932 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:29.114138 24900 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:29.174341 23682 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:29.136258 24734 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:29.175079 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:29.175468 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:29.151705 24593 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.959s	user 0.011s	sys 0.004s
I20260709 12:16:29.145671 24891 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:29.167167 24892 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:29.139007 24890 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:29.146230 24882 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:29.176328 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.179654 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.177825 23660 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:29.168118 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:29.183218 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:29.193322 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:29.181510 22746 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:29.173730 24898 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.157163 24826 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:29.200124 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 541) took 1430 ms. Trace:
I20260709 12:16:29.201967 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:29.185132 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 73441.5us
I20260709 12:16:29.202689 23982 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:29.177359 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.163479 24889 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:29.023408 24884 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:29.189738 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:29.166877 24935 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:29.175093 24798 consensus_queue.cc:1243] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:29.194152 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 523) took 1029 ms. Trace:
I20260709 12:16:29.178198 24869 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:16:29.192548 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:29.192224 24890 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:29.201812 24898 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:29.198339 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:29.187381 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.200687 23672 rpcz_store.cc:276] 0709 12:16:27.769776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:27.769972 (+   196us) service_pool.cc:224] Handling call
0709 12:16:27.796783 (+ 26811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:27.824558 (+ 27775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:27.824593 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:27.824721 (+   128us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:27.824773 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:29.199840 (+1375067us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b5400292554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:29.199895 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:29.200059 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63080192}
I20260709 12:16:29.207279 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.209019 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:29.205322 24901 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:29.210731 22747 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:29.210675 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:29.211731 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:29.191424 24892 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.209775 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:29.174130 24904 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:29.265380 22748 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:29.218530 23679 rpcz_store.cc:276] 0709 12:16:28.165140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.425156 (+260016us) service_pool.cc:224] Handling call
0709 12:16:28.440419 (+ 15263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:28.450843 (+ 10424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:28.451136 (+   293us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:28.488678 (+ 37542us) log.cc:844] Serialized 26 byte log entry
0709 12:16:28.678080 (+189402us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:28.703877 (+ 25797us) log.cc:844] Serialized 14 byte log entry
0709 12:16:28.709286 (+  5409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:28.709359 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:28.786324 (+ 76965us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b18000ed5e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1692522 00007fadf16947c1
0709 12:16:28.786923 (+   599us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b18000ed5e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1692522 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:16:29.193944 (+407021us) raft_consensus.cc:1685] finished
0709 12:16:29.193967 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:29.194096 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5299,"prepare.queue_time_us":33272,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":68586,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":3424,"spinlock_wait_cycles":48267776,"thread_start_us":121737,"threads_started":1,"wal-append.queue_time_us":213384}
I20260709 12:16:29.183243 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:29.224673 22790 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:29.293243 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 68651us
I20260709 12:16:29.293990 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.176874 24744 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.200227 24592 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:29.228493 23660 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:29.302969 23660 pending_rounds.cc:85] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 1
I20260709 12:16:29.303260 23660 pending_rounds.cc:107] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:16:29.303478 23660 raft_consensus.cc:2889] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:16:29.209367 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.229027 23685 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:29.230996 24798 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:29.232728 23672 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:29.213999 24889 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:29.235733 23982 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:29.226020 24890 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:29.287593 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 535) took 1140 ms. Trace:
I20260709 12:16:29.288187 22826 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:29.240423 24939 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.192793 24593 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:29.295477 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.308045 22900 rpcz_store.cc:276] 0709 12:16:28.147488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.147658 (+   170us) service_pool.cc:224] Handling call
0709 12:16:28.785368 (+637710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:28.856267 (+ 70899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:29.251418 (+395151us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54003593d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:29.287502 (+ 36084us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1424243968}
I20260709 12:16:29.292362 22897 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:16:29.299467 22823 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:29.235845 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.307334 22826 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:29.309649 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 99965.2us
I20260709 12:16:29.291605 24892 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:29.337141 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 159864us
I20260709 12:16:29.287379 24869 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:29.316835 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.318317 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:29.309965 24942 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.082s	user 0.000s	sys 0.004s
I20260709 12:16:29.319950 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:29.344303 23659 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:29.347628 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:29.296298 24935 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:29.320894 22826 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:29.318837 24805 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:29.322620 24875 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.322875 24593 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:29.324872 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:29.233722 24728 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:29.325651 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 89892.3us
I20260709 12:16:29.317394 24897 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:29.322502 24884 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:29.317641 24943 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.098s	user 0.002s	sys 0.002s
I20260709 12:16:29.368383 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:29.332479 24932 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:29.301597 24882 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:29.301422 24744 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:29.339938 22749 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:29.299528 24919 raft_consensus.cc:2764] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:16:29.311219 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:29.341683 23982 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:29.341030 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:29.442337 23982 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:29.442945 23982 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:29.350308 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:29.308063 24798 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.357296 23659 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:29.361901 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:29.444942 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 83125us
I20260709 12:16:29.319192 22892 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:29.335522 24849 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:29.363327 22826 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:29.369452 22897 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:29.443892 22900 raft_consensus.cc:2376] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5. Re-sending same reply.
W20260709 12:16:29.451993 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 111003us
I20260709 12:16:29.439581 22823 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:29.453205 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:29.447464 22751 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:29.460161 22894 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:29.318961 24939 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:29.468288 22824 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:29.507064 22826 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:29.508265 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1018) took 1092 ms. Trace:
I20260709 12:16:29.508766 22826 rpcz_store.cc:276] 0709 12:16:28.415685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.415978 (+   293us) service_pool.cc:224] Handling call
0709 12:16:28.416393 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:29.246260 (+829867us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b5400069b20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf47811c0 00007fadf4782231 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c
0709 12:16:29.507890 (+261630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:29.508176 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10988288}
I20260709 12:16:29.514551 22826 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:29.437374 24884 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:29.529516 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:29.538926 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:29.544138 22823 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:29.451447 24798 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:29.512408 24559 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.551200 24559 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:29.543064 24839 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.002s
I20260709 12:16:29.552469 24839 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:29.451210 24869 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:29.555362 24869 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:29.558845 22819 raft_consensus.cc:2393] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:29.562464 24843 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:16:29.562685 24945 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 12:16:29.563112 24843 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:29.563750 24839 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:29.466797 24779 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:29.474588 24537 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:29.565233 24537 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:29.566277 24537 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:29.571627 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:29.364429 24875 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:29.537650 24635 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:16:29.475327 24873 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:29.587021 23982 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:29.589561 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 434555us
I20260709 12:16:29.582747 24900 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:29.598276 24900 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.598711 24900 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:29.600411 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.603526 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.604483 22749 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:29.611027 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.633358 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:29.635809 23982 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:29.592643 24873 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:29.595638 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.641616 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.676008 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.564093 24843 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:29.677325 24593 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:29.678646 24843 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:29.678151 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.647238 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:29.678149 22745 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 3. Current term is 4. Ops: []
W20260709 12:16:29.688424 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 230869us
I20260709 12:16:29.647492 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:29.610028 24779 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:29.575567 24884 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:29.646492 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:29.691920 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44539.8us
I20260709 12:16:29.683728 22749 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
W20260709 12:16:29.672830 24886 consensus_meta.cc:287] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.921s	user 0.014s	sys 0.002s
I20260709 12:16:29.674492 24839 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:29.644397 24882 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:29.710408 22745 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:16:29.705240 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 58773us
I20260709 12:16:29.650507 24873 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:29.696879 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:29.693547 24881 consensus_meta.cc:287] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.953s	user 0.018s	sys 0.000s
W20260709 12:16:29.745026 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 48261.7us
I20260709 12:16:29.708209 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:29.695267 24593 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:29.746706 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.692830 24616 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:29.709374 24617 consensus_meta.cc:287] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.763s	user 0.015s	sys 0.001s
I20260709 12:16:29.698968 24932 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.773991 22824 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:29.749854 22749 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:29.753021 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:29.712294 24886 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:29.717481 24870 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.722s	user 0.013s	sys 0.000s
I20260709 12:16:29.787508 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:29.770345 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:29.701141 24779 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:29.705715 24904 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:29.716888 24950 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:29.748991 24881 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:29.775699 24897 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:29.784482 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:29.805621 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 52679.9us
I20260709 12:16:29.758215 24839 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:29.810169 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1023) took 1342 ms. Trace:
I20260709 12:16:29.793968 24849 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:16:29.783869 24592 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:29.803117 24617 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:16:29.832870 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:29.833310 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 63121.9us
I20260709 12:16:29.832456 22818 rpcz_store.cc:276] 0709 12:16:28.468282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.486250 (+ 17968us) service_pool.cc:224] Handling call
0709 12:16:28.488424 (+  2174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:28.537292 (+ 48868us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:16:28.537711 (+   419us) log.cc:844] Serialized 14 byte log entry
0709 12:16:28.601204 (+ 63493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:28.601360 (+   156us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:28.601409 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:29.340801 (+739392us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800225d00. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419
0709 12:16:29.716458 (+375657us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b48004d8158. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf96a8aa1 00007fadf969fb37 00007fadf969f9ca 00007fadf979726f 00007fadf9796f37 00007fadf97ab55c 00007fadf97ab508 00007fadf97ab488 00007fadf97ab443 00007fadf97aa6ec 00007fadf86d4a96
0709 12:16:29.809851 (+ 93393us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b54001266d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:29.809914 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:29.810097 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28022,"prepare.queue_time_us":878,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":211,"raft.run_cpu_time_us":20184,"raft.run_wall_time_us":1155278,"spinlock_wait_cycles":119699840,"thread_start_us":63077,"threads_started":1,"wal-append.queue_time_us":101836,"wal-append.run_cpu_time_us":2763,"wal-append.run_wall_time_us":1183880}
I20260709 12:16:29.753919 24890 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:29.747946 24898 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:29.832312 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:29.844441 22823 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
W20260709 12:16:29.847072 24956 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:16:29.847805 24828 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.711s	user 0.007s	sys 0.004s
W20260709 12:16:29.849292 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:29.853263 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 65834.4us
I20260709 12:16:29.875972 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.828600 24888 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:16:29.876938 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44707.1us
I20260709 12:16:29.831609 24897 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:29.838083 24886 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:29.798966 24932 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:29.806219 24870 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:29.888267 24918 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 1.452s	user 0.031s	sys 0.016s
W20260709 12:16:29.889232 24922 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 1.453s	user 0.000s	sys 0.004s
W20260709 12:16:29.890331 24947 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 12:16:29.849685 24959 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:29.838999 24592 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:29.925187 24592 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:29.925415 24932 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:29.887254 24897 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:29.927946 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.886283 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.865592 24617 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.879338 24839 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:29.908190 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:29.908330 24875 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:29.883643 24828 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:29.911449 24957 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:29.913167 24779 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:29.914264 24917 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.901s	user 0.006s	sys 0.002s
I20260709 12:16:29.828279 24950 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:29.914810 24890 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:29.915041 24881 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.915738 24939 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:29.916496 24898 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:29.916847 24884 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:29.918839 24870 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:29.919691 22899 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:29.924134 24959 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:29.935292 24957 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:29.924350 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45631.6us
I20260709 12:16:29.951203 24959 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:29.951685 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:29.951778 24957 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:29.935395 24593 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:29.954063 24957 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:29.883149 24888 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.957031 24888 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:29.931138 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44985.4us
I20260709 12:16:29.964394 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:29.922566 24892 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.571s	user 0.000s	sys 0.012s
W20260709 12:16:29.922873 24891 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.727s	user 0.000s	sys 0.014s
I20260709 12:16:29.930056 24617 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:29.935696 24932 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:16:29.948815 24924 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.225s	user 0.000s	sys 0.004s
I20260709 12:16:29.948594 24798 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:29.949216 23674 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:29.977639 22901 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:29.987784 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:29.988521 22818 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:29.989094 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:29.989663 23672 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:29.987107 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:29.990981 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:29.991179 23689 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:29.991593 23659 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:29.981911 24593 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:29.998935 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:29.978328 24891 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:30.002941 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:29.979995 24890 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:16:30.004313 23679 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 2.
I20260709 12:16:30.009997 22824 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:29.978878 24779 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:30.011155 23672 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:29.939450 24915 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:30.017040 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:29.992199 24884 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:29.941736 24917 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:30.018009 23685 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:29.994864 24950 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:30.018636 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1022) took 1568 ms. Trace:
I20260709 12:16:30.024334 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:30.026120 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:30.017016 24744 consensus_meta.cc:287] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
I20260709 12:16:30.030329 24744 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:30.020849 24593 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.031919 22826 raft_consensus.cc:2368] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7.
I20260709 12:16:30.030371 24663 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.033111 24744 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:30.032969 24663 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.023221 22820 rpcz_store.cc:276] 0709 12:16:28.450074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.450256 (+   182us) service_pool.cc:224] Handling call
0709 12:16:28.450682 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:28.451382 (+   700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:28.451417 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:28.491158 (+ 39741us) log.cc:844] Serialized 26 byte log entry
0709 12:16:28.614730 (+123572us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:28.614774 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:28.617502 (+  2728us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:29.948150 (+1330648us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:30.011678 (+ 63528us) raft_consensus.cc:1685] finished
0709 12:16:30.011716 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:30.018513 (+  6797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5423,"raft.queue_time_us":106,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3274,"spinlock_wait_cycles":12924800,"thread_start_us":121483,"threads_started":1,"wal-append.queue_time_us":217233}
I20260709 12:16:30.035420 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:30.036085 22820 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:30.036528 24798 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:30.020839 24873 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:30.037704 24663 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:30.039017 24728 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:30.039942 24873 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:30.040913 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:30.045996 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:30.047765 24872 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:30.048926 24839 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:30.049491 24839 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:30.049674 24900 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.012468 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.042415 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:30.054652 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:29.979488 24892 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.019881 24779 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.060424 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.061019 22818 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:30.062021 22750 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:30.021919 24884 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:30.065913 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:30.067106 23659 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:30.069243 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.069816 22823 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:30.050585 24839 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.071545 23682 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
W20260709 12:16:30.076756 24965 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:16:30.077535 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 670) took 1170 ms. Trace:
I20260709 12:16:30.066694 23685 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:30.078178 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1088) took 1039 ms. Trace:
I20260709 12:16:30.078644 22900 rpcz_store.cc:276] 0709 12:16:29.038410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:29.452631 (+414221us) service_pool.cc:224] Handling call
0709 12:16:29.465673 (+ 13042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:29.588327 (+122654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:29.588381 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:29.596627 (+  8246us) log.cc:844] Serialized 26 byte log entry
0709 12:16:29.707408 (+110781us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:29.707454 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:29.707524 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:30.077959 (+370435us) raft_consensus.cc:1685] finished
0709 12:16:30.077980 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:30.078117 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7159,"raft.queue_time_us":100618,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":175910,"threads_started":2,"wal-append.queue_time_us":366724}
I20260709 12:16:30.080281 24839 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:30.077958 22751 rpcz_store.cc:276] 0709 12:16:28.906835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.907288 (+   453us) service_pool.cc:224] Handling call
0709 12:16:28.907662 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:29.466474 (+558812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:30.077300 (+610826us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b54000a9454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:30.077472 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225394944}
I20260709 12:16:30.083060 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.084630 24891 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:30.085021 24892 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:30.075196 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.084630 22823 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:30.066869 24915 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:30.087965 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:30.088011 24915 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.089710 22824 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:30.090646 24915 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:30.093350 24349 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:30.064543 24884 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:30.095566 22818 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:16:30.096118 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 543) took 1860 ms. Trace:
I20260709 12:16:30.096588 22899 rpcz_store.cc:276] 0709 12:16:28.235735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.811038 (+575303us) service_pool.cc:224] Handling call
0709 12:16:28.818228 (+  7190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:29.951003 (+1132775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:30.095876 (+144873us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003101d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:30.096047 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2532503808}
I20260709 12:16:30.099790 24779 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:30.106935 22744 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:30.108493 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 317) took 1128 ms. Trace:
I20260709 12:16:30.109027 22750 rpcz_store.cc:276] 0709 12:16:28.979834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:29.014304 (+ 34470us) service_pool.cc:224] Handling call
0709 12:16:30.108238 (+1093934us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54001e64d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:30.108421 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236056832}
I20260709 12:16:30.090689 24893 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:30.118398 24959 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:30.120627 24917 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:30.121731 24959 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:30.123584 22820 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
W20260709 12:16:30.124356 24889 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.789s	user 0.008s	sys 0.004s
I20260709 12:16:30.062021 24900 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:30.139920 24669 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:30.139511 24897 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.144305 23689 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:30.143890 24669 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:30.151722 24593 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:30.156829 24593 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:30.159097 24593 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:30.159440 24649 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:30.160384 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 552) took 1176 ms. Trace:
I20260709 12:16:30.160846 23660 rpcz_store.cc:276] 0709 12:16:28.984270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:29.302361 (+318091us) service_pool.cc:224] Handling call
0709 12:16:29.302718 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:29.319742 (+ 17024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:29.319770 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:29.320326 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 12:16:29.637161 (+316835us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:29.644323 (+  7162us) log.cc:844] Serialized 14 byte log entry
0709 12:16:30.079816 (+435493us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b1800157a20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287 00007fadf479a208
0709 12:16:30.102578 (+ 22762us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b480003abd8. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf96a8aa1 00007fadf969fb37 00007fadf969f9ca 00007fadf979726f 00007fadf9796f37 00007fadf97ab55c 00007fadf97ab508 00007fadf97ab488 00007fadf97ab443 00007fadf97aa6ec 00007fadf86d4a96
0709 12:16:30.156185 (+ 53607us) log.cc:844] Serialized 14 byte log entry
0709 12:16:30.160012 (+  3827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:30.160101 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:30.160151 (+    50us) raft_consensus.cc:1685] finished
0709 12:16:30.160165 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:30.160318 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29840,"prepare.queue_time_us":7078,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":8672,"raft.queue_time_us":152344,"raft.run_cpu_time_us":11666,"raft.run_wall_time_us":785935,"spinlock_wait_cycles":55026816,"thread_start_us":345902,"threads_started":2,"wal-append.queue_time_us":429811}
I20260709 12:16:30.167655 24669 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:30.169122 24669 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:30.171922 24969 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.172565 24969 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.174577 24897 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:30.174732 24969 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:30.186399 24592 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:30.189646 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 313769us
I20260709 12:16:30.094584 24888 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.191280 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:30.190410 24592 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:30.143142 24889 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:30.198542 24972 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:30.201030 24850 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:16:30.200850 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 249237us
I20260709 12:16:30.192515 24455 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:30.206081 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:30.206709 23660 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:30.207954 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:30.208750 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:30.210819 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.211603 22820 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:30.211854 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.207233 24850 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.213778 24850 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:30.216266 22820 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:30.216790 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.218129 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:30.218744 22896 raft_consensus.cc:2393] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:30.220635 22825 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:30.221125 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:30.211934 24849 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:30.224799 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:30.220723 24897 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:30.236205 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:30.236920 24559 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:30.239930 24849 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:30.241026 24849 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:30.241376 22893 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
W20260709 12:16:30.243077 24936 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.130s	user 0.005s	sys 0.011s
W20260709 12:16:30.243413 22893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 285) took 1711 ms (client timeout 2076 ms). Trace:
I20260709 12:16:30.245076 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 233) took 1610 ms. Trace:
I20260709 12:16:30.245493 24884 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.245577 22822 rpcz_store.cc:276] 0709 12:16:28.634254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.634422 (+   168us) service_pool.cc:224] Handling call
0709 12:16:28.646338 (+ 11916us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:28.721248 (+ 74910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:28.721287 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:28.727818 (+  6531us) log.cc:844] Serialized 52 byte log entry
0709 12:16:28.851565 (+123747us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:28.861890 (+ 10325us) log.cc:844] Serialized 14 byte log entry
0709 12:16:28.862276 (+   386us) log.cc:844] Serialized 14 byte log entry
0709 12:16:28.862919 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:28.862997 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:29.558221 (+695224us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b18000adc20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1692557 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:16:29.931231 (+373010us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b48004d8158. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf96a8aa1 00007fadf969fb37 00007fadf969f9ca 00007fadf979726f 00007fadf9796f37 00007fadf97ab55c 00007fadf97ab508 00007fadf97ab488 00007fadf97ab443 00007fadf97aa6ec 00007fadf86d4a96
0709 12:16:30.222633 (+291402us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:30.244869 (+ 22236us) raft_consensus.cc:1685] finished
0709 12:16:30.244889 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:30.245019 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9219,"prepare.queue_time_us":23236,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":16054,"raft.run_cpu_time_us":2827,"raft.run_wall_time_us":1079351,"spinlock_wait_cycles":57451904,"thread_start_us":94780,"threads_started":1,"wal-append.queue_time_us":242055}
I20260709 12:16:30.254876 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 526) took 1658 ms. Trace:
I20260709 12:16:30.248137 24884 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:30.243856 22893 rpcz_store.cc:269] 0709 12:16:28.532117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.730159 (+198042us) service_pool.cc:224] Handling call
0709 12:16:30.243197 (+1513038us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54002fdd54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:30.243330 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3411531520}
I20260709 12:16:30.255369 23695 rpcz_store.cc:276] 0709 12:16:28.596700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:29.104967 (+508267us) service_pool.cc:224] Handling call
0709 12:16:29.116511 (+ 11544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:29.572647 (+456136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:29.572693 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:29.573300 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 12:16:29.667069 (+ 93769us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:29.751119 (+ 84050us) log.cc:844] Serialized 14 byte log entry
0709 12:16:29.791050 (+ 39931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:30.248284 (+457234us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54001ffed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:30.248327 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:30.248370 (+    43us) raft_consensus.cc:1685] finished
0709 12:16:30.254645 (+  6275us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:30.254816 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42046,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":95947,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":15293,"spinlock_wait_cycles":1047834496,"thread_start_us":157134,"threads_started":3,"wal-append.queue_time_us":413925}
I20260709 12:16:30.261758 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 280) took 1751 ms. Trace:
I20260709 12:16:30.263058 22895 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:30.266460 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.267139 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:30.267822 22748 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:30.267832 23672 raft_consensus.cc:2368] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6.
I20260709 12:16:30.269367 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 705) took 1292 ms. Trace:
I20260709 12:16:30.269729 22819 rpcz_store.cc:276] 0709 12:16:28.976918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:29.196124 (+219206us) service_pool.cc:224] Handling call
0709 12:16:30.269182 (+1073058us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400124dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:30.269317 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745439488}
I20260709 12:16:30.262182 22901 rpcz_store.cc:276] 0709 12:16:28.509863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.773322 (+263459us) service_pool.cc:224] Handling call
0709 12:16:30.261588 (+1488266us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540058e8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:30.261700 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2320864512}
I20260709 12:16:30.273748 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:30.274013 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:30.274453 22752 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:30.275558 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.276710 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.278509 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.279476 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:30.284142 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:30.283919 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:30.285386 22900 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:30.285722 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:30.287815 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:30.290771 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:30.291474 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:30.292073 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 64918.7us
I20260709 12:16:30.292294 23682 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:30.295563 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:30.292358 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:30.296334 23679 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:30.296947 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:30.298046 22822 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 5: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:30.298273 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:30.299075 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:30.300062 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5444065d09a34471bca8963724a74d20"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:30.301616 22894 raft_consensus.cc:606] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:30.301789 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:30.300246 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.245999 24850 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.307571 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:30.300499 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:30.297035 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:30.303241 22745 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:30.308395 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:30.305379 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.309561 22899 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:30.305604 23679 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:16:30.310940 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:30.232015 24897 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:30.306046 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:30.284422 24265 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.314662 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:30.319222 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:30.317844 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.327346 22897 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:30.316318 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:30.284024 24839 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:30.334424 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:30.292078 24900 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:30.323928 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:30.330150 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:30.327433 22821 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:30.325065 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:30.333141 22752 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:30.272444 24886 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:16:30.301131 24559 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:16:30.379184 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 533) took 1641 ms. Trace:
I20260709 12:16:30.336673 23679 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:30.364207 22898 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:16:30.363372 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:30.352106 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:30.395771 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 64693.9us
I20260709 12:16:30.356876 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.387102 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.341360 22893 raft_consensus.cc:2393] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:30.450052 22822 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
W20260709 12:16:30.376580 22892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1077) took 1375 ms (client timeout 1721 ms). Trace:
I20260709 12:16:30.380616 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:30.451184 22892 rpcz_store.cc:269] 0709 12:16:29.001444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:29.094451 (+ 93007us) service_pool.cc:224] Handling call
0709 12:16:30.376344 (+1281893us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54004f1ad4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:30.376497 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513235200}
I20260709 12:16:30.443080 22897 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:30.359191 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.458148 22818 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:30.419943 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 288) took 1787 ms. Trace:
I20260709 12:16:30.462230 22717 leader_election.cc:400] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6.
I20260709 12:16:30.462682 22717 leader_election.cc:403] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:16:30.288781 24593 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:30.449879 22899 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
W20260709 12:16:30.320997 24968 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:16:30.373485 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:30.449460 23674 rpcz_store.cc:276] 0709 12:16:28.737848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:29.211392 (+473544us) service_pool.cc:224] Handling call
0709 12:16:29.227574 (+ 16182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:29.977918 (+750344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:30.378917 (+400999us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b540073b9d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:30.379115 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1653204736}
I20260709 12:16:30.361938 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:30.465515 22894 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:30.466301 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:30.461875 22900 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
W20260709 12:16:30.464448 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 139523us
I20260709 12:16:30.465778 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.467449 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:30.365509 24719 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:30.371814 24875 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:30.325043 24969 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:30.470927 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 97593.2us
I20260709 12:16:30.471681 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:30.471764 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:30.355398 24849 raft_consensus.cc:993] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: : Instructing follower a89a4b420ea9496aab55475fc38bb6f7 to start an election
W20260709 12:16:30.356385 24931 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.633s	user 0.005s	sys 0.002s
I20260709 12:16:30.318848 24982 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:30.472102 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:30.357409 24876 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.467587 22752 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:30.473186 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:30.371994 24779 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:30.329005 24734 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:16:30.475245 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:30.475517 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.476259 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:30.490746 22892 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:30.487605 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:30.492070 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:30.476882 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 153039us
I20260709 12:16:30.477141 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:30.477769 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:30.494724 22749 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:30.333693 24884 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:30.505283 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1024) took 2001 ms. Trace:
W20260709 12:16:30.460911 24880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.931s	user 0.013s	sys 0.022s
W20260709 12:16:30.506260 24880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.985s	user 0.014s	sys 0.022s
I20260709 12:16:30.396747 24872 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:16:30.482963 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:30.509449 22745 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:30.356554 24889 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:30.340162 24900 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.484612 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.320235 24592 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.153s
I20260709 12:16:30.487267 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.336032 24265 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.484382 24972 raft_consensus.cc:1081] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Signalling peer a89a4b420ea9496aab55475fc38bb6f7 to start an election
W20260709 12:16:30.472530 24984 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 12:16:30.324945 24455 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.152s
I20260709 12:16:30.474567 24719 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.324676 24877 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.152s
I20260709 12:16:30.328303 24911 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.153s
I20260709 12:16:30.494422 22896 raft_consensus.cc:2393] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:30.494388 24798 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:30.463760 24805 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6.
I20260709 12:16:30.492990 24730 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:16:30.544257 24892 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:16:30.547334 24877 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:30.547616 24892 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:30.547784 24877 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:30.548030 24892 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:30.491286 24734 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.548074 24265 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:30.548641 24734 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:30.548730 24877 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.489270 24845 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:30.505425 24884 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.549768 24892 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.550446 24884 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:30.550439 24845 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:30.551586 24892 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:30.551791 24845 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.560050 24884 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.474352 24875 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.506065 22827 rpcz_store.cc:276] 0709 12:16:28.503508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.547196 (+ 43688us) service_pool.cc:224] Handling call
0709 12:16:28.547563 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:28.581585 (+ 34022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:28.581637 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:28.606531 (+ 24894us) log.cc:844] Serialized 26 byte log entry
0709 12:16:28.698478 (+ 91947us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:28.698524 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:28.698590 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:30.335335 (+1636745us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:30.504806 (+169471us) raft_consensus.cc:1685] finished
0709 12:16:30.504841 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:30.505190 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36335,"raft.queue_time_us":39392,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":6453,"spinlock_wait_cycles":3608960,"thread_start_us":58339,"threads_started":1,"wal-append.queue_time_us":106191}
I20260709 12:16:30.571174 24875 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:30.480918 24915 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:30.573688 24915 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:30.358529 24897 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:30.511910 22897 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
W20260709 12:16:30.575354 24967 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.619s	user 0.003s	sys 0.001s
I20260709 12:16:30.575875 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.545423 24798 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.576866 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 563) took 1426 ms. Trace:
I20260709 12:16:30.577622 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:30.479777 24635 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:30.419123 24871 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:30.351933 24617 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.356042 24839 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.481093 24559 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:16:30.507437 24957 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.000s
I20260709 12:16:30.577337 23656 rpcz_store.cc:276] 0709 12:16:29.150920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:29.438017 (+287097us) service_pool.cc:224] Handling call
0709 12:16:29.464954 (+ 26937us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:29.540159 (+ 75205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:29.540217 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:29.572050 (+ 31833us) log.cc:844] Serialized 52 byte log entry
0709 12:16:29.807587 (+235537us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:29.807639 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:29.807716 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:30.574683 (+766967us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:30.576569 (+  1886us) raft_consensus.cc:1685] finished
0709 12:16:30.576589 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:30.576806 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25707,"raft.queue_time_us":26577,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":35784,"spinlock_wait_cycles":13019904,"thread_start_us":85914,"threads_started":1,"wal-append.queue_time_us":295522}
I20260709 12:16:30.586038 22894 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:30.523689 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:30.531404 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:30.595537 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.486766 24728 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:30.521291 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:30.508855 24744 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:30.543224 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:30.479594 24948 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:16:30.537540 24719 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:30.561929 24850 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:30.562047 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:30.563025 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:30.630468 22745 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:30.564357 24888 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:30.513314 24900 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:30.545621 24917 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.489130 24876 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.566073 24904 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:30.462477 22895 rpcz_store.cc:276] 0709 12:16:28.632977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.912588 (+279611us) service_pool.cc:224] Handling call
0709 12:16:30.262705 (+1350117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:30.263434 (+   729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:30.419669 (+156235us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540058e8d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:30.419867 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3089187712}
W20260709 12:16:30.582594 24985 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:16:30.582456 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.523095 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:30.589250 24559 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.590024 23682 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:30.539665 24593 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:30.593325 22901 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
W20260709 12:16:30.608747 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 123251us
I20260709 12:16:30.612025 22892 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:30.629678 24897 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:30.591446 24871 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:30.617117 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 95909.7us
W20260709 12:16:30.617799 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 74721.5us
I20260709 12:16:30.631192 24744 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:30.624318 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:30.713148 22753 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:30.631690 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.714362 22745 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:30.591137 24617 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:30.667498 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.667621 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:30.592677 24635 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:30.632761 24957 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:30.633208 24982 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:30.613418 24728 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.677479 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:30.616272 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 97676.7us
I20260709 12:16:30.781589 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.782156 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:30.782335 22822 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:30.682022 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:30.782871 22820 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:30.683038 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:30.783630 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 101664us
I20260709 12:16:30.787417 22822 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:30.636937 24917 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:30.811679 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.812618 22818 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:30.813634 24917 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:30.574668 24915 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.817265 22898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 286) took 2208 ms. Trace:
I20260709 12:16:30.818061 22898 rpcz_store.cc:276] 0709 12:16:28.608677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.892446 (+283769us) service_pool.cc:224] Handling call
0709 12:16:28.892718 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:30.459871 (+1567153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:30.816889 (+357018us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400a83ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:30.817176 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3383608192}
I20260709 12:16:30.820422 24617 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:30.821228 24617 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:30.824174 24617 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:30.702075 24876 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:30.708230 24884 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:30.709864 24839 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:30.636627 24904 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:30.817246 22820 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:30.828449 24904 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:30.830137 24904 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:30.731834 24900 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.832875 24900 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:30.732985 24871 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:30.667158 24559 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:30.833839 24897 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:30.835063 24897 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:30.835641 24897 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:30.836995 24728 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:30.745134 24744 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.676664 24593 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.843024 24593 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:30.762729 24898 raft_consensus.cc:3055] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:30.845554 24898 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:30.845831 24649 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:16:30.846024 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 168664us
I20260709 12:16:30.846536 24898 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:30.847052 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:30.847913 24898 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:30.849473 24876 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:30.852531 24805 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:30.853230 24805 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:30.576833 24798 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:30.856429 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.857194 24719 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.857965 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.787276 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.863585 22826 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:30.683477 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:30.792793 22822 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:30.796909 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:30.798229 24970 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:16:30.798959 24635 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:30.801249 22746 raft_consensus.cc:2410] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:16:30.801641 24990 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 12:16:30.802450 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:30.876652 22750 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:30.790943 24957 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.804505 24734 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.882495 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.805320 24265 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:30.808913 24877 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:30.897569 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:30.899288 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:30.896492 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:30.844944 22749 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:30.864945 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:30.867069 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 183749us
I20260709 12:16:30.900990 23682 raft_consensus.cc:2393] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:30.865355 23679 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:30.901458 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:30.902745 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:30.903373 22746 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:30.868953 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:30.867069 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 70318.3us
W20260709 12:16:30.869735 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:30.905299 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:30.870525 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:30.871057 22753 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:30.906644 22791 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:30.872879 24839 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:30.873991 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:30.875826 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:30.912853 22827 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:30.879102 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:30.913552 22745 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
W20260709 12:16:30.883258 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:30.911586 22753 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:30.893513 22751 raft_consensus.cc:2393] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:30.877727 23660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5444065d09a34471bca8963724a74d20"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:45650
I20260709 12:16:30.897817 23659 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
W20260709 12:16:30.916440 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46005.2us
I20260709 12:16:30.854236 24805 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:30.866547 24982 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:30.908427 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:30.871541 22790 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:30.874541 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:30.878598 24900 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:30.904580 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:30.979435 24900 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:30.979939 24900 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:30.980054 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 75577.7us
I20260709 12:16:30.981454 24455 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:30.918059 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:30.883200 24957 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:30.984983 22745 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:30.987514 22749 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:30.990348 22749 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:16:30.970577 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 54924.3us
I20260709 12:16:30.910141 24949 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:30.992173 22751 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:30.993768 24669 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:30.995412 24719 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:30.995975 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:30.996829 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:30.997097 24669 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:30.997668 24971 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:16:31.000180 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 82197.1us
I20260709 12:16:31.000842 24993 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:31.001078 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:31.001367 24993 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:31.001929 24993 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:31.002575 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:31.002977 24996 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:31.003109 24617 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:30.867312 24875 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:31.004971 24663 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:30.883000 24905 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:31.006448 24905 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:31.006815 24875 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:31.007416 22894 raft_consensus.cc:606] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:30.916589 24888 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:31.007858 22894 raft_consensus.cc:614] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:30.910429 24779 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:31.007608 24905 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:30.911576 24948 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:31.009503 24948 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:31.010468 24734 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:30.916234 24969 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:30.976204 22825 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:31.004583 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:30.917862 24850 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:31.010425 24948 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:31.017076 22827 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:31.019733 22750 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:30.971836 24886 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 12:16:30.974116 22747 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:30.903023 24892 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:31.037757 23660 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:31.039528 23660 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:31.035610 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:31.012147 24939 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:31.050853 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:31.053411 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:31.053433 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:31.047652 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:30.994473 24728 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:31.022003 24805 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:31.062803 22900 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:31.018536 24734 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.048171 24917 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:31.036659 24730 raft_consensus.cc:2764] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 12:16:31.063519 24845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.050s	sys 0.109s
I20260709 12:16:31.085417 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:31.100168 22892 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:31.102089 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:31.104429 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.086683 23689 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:31.087071 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:31.036770 24850 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:30.902827 24265 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:31.098197 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:31.081699 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:31.059192 24873 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.035s	sys 0.061s
I20260709 12:16:31.123303 22895 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:31.123529 23659 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:31.119673 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 248189us
I20260709 12:16:31.074154 23660 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:31.131820 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 223482us
I20260709 12:16:31.132627 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:31.108557 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:31.127600 22748 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:31.088435 24649 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:16:31.138510 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51654.7us
W20260709 12:16:31.149381 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 248294us
W20260709 12:16:31.119868 24845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.051s	sys 0.109s
I20260709 12:16:31.048939 24892 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:31.157315 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:31.129372 24873 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.035s	sys 0.062s
I20260709 12:16:31.081739 24886 consensus_queue.cc:1059] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:16:31.161196 23679 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:31.161115 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:31.171808 22900 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:31.137583 24884 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:31.166877 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:31.120942 24850 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:31.130986 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:31.192065 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 61198.1us
I20260709 12:16:31.193171 22790 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:31.183260 23656 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:31.184231 22898 raft_consensus.cc:2410] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:16:31.131367 24888 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:31.098714 24734 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:31.154338 24949 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:31.156162 24893 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:31.128667 24971 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:16:31.161197 24730 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:31.208058 22747 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
W20260709 12:16:31.224588 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 320279us
I20260709 12:16:31.188864 24884 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.160403 24899 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:16:31.226032 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:31.160166 24877 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:16:31.195780 24845 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:31.284086 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.210539 24893 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:16:31.284700 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 58773us
I20260709 12:16:31.154114 24982 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:31.213670 24730 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:31.234277 24884 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:31.232769 24971 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:31.225981 24870 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 12:16:31.327047 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.283262 24899 consensus_queue.cc:1243] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:31.291963 24889 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:31.292179 24730 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:31.287516 24893 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:31.336804 23659 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:31.302556 24971 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:31.359421 24971 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:31.361019 24971 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:31.363263 24744 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:31.355002 24957 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:31.356581 25005 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:31.283509 24845 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:31.231864 24888 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:31.373871 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 88369.6us
I20260709 12:16:31.370746 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:31.381407 23659 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:31.345640 24877 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:31.391017 24877 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:31.391530 22897 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:31.392521 24877 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:31.393817 24957 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:31.395485 24798 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.004s
I20260709 12:16:31.396145 24798 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:31.291682 24850 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:31.404160 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:31.404417 22896 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:31.404446 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:31.413043 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 531) took 1104 ms. Trace:
I20260709 12:16:31.433566 22748 rpcz_store.cc:276] 0709 12:16:30.308835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:30.459533 (+150698us) service_pool.cc:224] Handling call
0709 12:16:31.412688 (+953155us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400413554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:31.412901 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464311040}
I20260709 12:16:31.425290 23660 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:31.348691 24889 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:31.350692 24635 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:16:31.444197 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 276188us
I20260709 12:16:31.445602 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:31.425251 24593 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.549s	user 0.004s	sys 0.004s
W20260709 12:16:31.446878 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 267830us
W20260709 12:16:31.451565 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.406756 24850 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:31.457973 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:31.436085 24898 consensus_meta.cc:287] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.005s
W20260709 12:16:31.455803 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 280135us
W20260709 12:16:31.460310 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 267237us
I20260709 12:16:31.468673 22790 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:31.398911 24265 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:31.398751 24798 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:31.416771 24728 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:31.463233 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:31.470819 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:31.455771 24904 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:31.507251 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.508036 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:31.455091 24635 raft_consensus.cc:697] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:31.460768 23659 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
W20260709 12:16:31.467041 24559 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.000s
W20260709 12:16:31.519183 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 386617us
I20260709 12:16:31.461673 24892 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:31.517712 24728 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:16:31.513584 24839 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.002s
I20260709 12:16:31.508893 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:16:31.531019 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 60302.8us
I20260709 12:16:31.471155 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 529) took 1177 ms. Trace:
I20260709 12:16:31.453997 24593 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:31.470225 24994 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:31.499969 24898 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:31.542929 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.461874 24900 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:31.468140 24949 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:16:31.516036 24265 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:31.522310 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:31.547701 22752 rpcz_store.cc:276] 0709 12:16:30.294014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:30.861897 (+567883us) service_pool.cc:224] Handling call
0709 12:16:30.862167 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:30.862369 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:31.184146 (+321777us) log.cc:844] Serialized 14 byte log entry
0709 12:16:31.470823 (+286677us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:31.470878 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:31.470929 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:31.470990 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:31.471100 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":351027,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":58,"raft.queue_time_us":366,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":10967,"thread_start_us":558301,"threads_started":2}
I20260709 12:16:31.565968 22895 raft_consensus.cc:2410] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:16:31.524173 24734 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:31.528678 24798 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:31.553709 24996 consensus_meta.cc:287] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 12:16:31.548377 24839 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:31.582762 22717 leader_election.cc:400] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7.
I20260709 12:16:31.583825 22717 leader_election.cc:403] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:16:31.582453 23695 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
W20260709 12:16:31.579952 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 57762.2us
I20260709 12:16:31.521265 24904 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:31.523800 24559 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:31.586439 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:31.591531 22896 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:31.571192 24744 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:31.566288 24875 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:16:31.596853 24897 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:31.599363 24805 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.002s
I20260709 12:16:31.620321 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 688) took 1201 ms. Trace:
I20260709 12:16:31.620982 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:31.583904 24996 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:31.568248 24728 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:16:31.629132 22745 rpcz_store.cc:276] 0709 12:16:30.418868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:30.985802 (+566934us) service_pool.cc:224] Handling call
0709 12:16:31.012165 (+ 26363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:31.012391 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:16:31.303315 (+290924us) log.cc:844] Serialized 14 byte log entry
0709 12:16:31.619890 (+316575us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:31.619962 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:31.620020 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:31.620102 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:31.620246 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":272552,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":103,"raft.queue_time_us":138,"thread_start_us":571901,"threads_started":2}
I20260709 12:16:31.590041 24899 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.570217 24663 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:16:31.570474 24898 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:31.594317 24994 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7.
I20260709 12:16:31.570425 24265 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:31.547732 24889 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:31.581761 24798 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:31.618211 25005 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:31.629056 24744 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:31.644954 24897 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:31.668009 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 204603us
I20260709 12:16:31.641834 24455 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:31.642401 24669 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:31.629130 24939 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:16:31.664727 25002 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:16:31.664311 24649 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:31.649302 25012 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:31.709671 23674 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:31.702718 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:31.710688 23672 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:31.692203 24669 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:31.705857 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 85040us
I20260709 12:16:31.597823 24635 consensus_queue.cc:237] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:31.647210 24899 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:31.679652 24845 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:31.722085 23672 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:31.709780 25012 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.707901 24839 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:31.709791 24455 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:31.707294 24649 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:31.733953 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:31.705677 25008 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:16:31.768440 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:31.769093 23672 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:31.721848 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 204149us
I20260709 12:16:31.792997 24455 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:31.793952 24663 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:31.778230 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:31.795629 23660 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:31.795522 25013 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.796154 25013 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:31.796676 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:31.774667 23674 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:31.798184 25013 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:31.798727 22790 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:31.799705 24265 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:31.799904 25019 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:16:31.800307 24265 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:31.800761 24265 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:31.801560 24265 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:31.776021 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:31.803627 23659 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:31.805981 23659 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:31.808879 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:31.781734 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:31.813506 22752 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:16:31.816576 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 314245us
I20260709 12:16:31.818296 22896 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:31.763475 24839 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:31.820878 23672 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
W20260709 12:16:31.847432 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.906205 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:31.799011 24593 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:31.908247 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:31.770117 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:31.925442 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:31.906525 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 85854.4us
I20260709 12:16:31.761902 25012 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:31.787369 24649 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:31.821056 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:31.765478 25011 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:31.907397 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:31.970249 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:31.845160 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:31.971210 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.806613 24734 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:31.972332 24734 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.972800 24734 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:31.923163 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46530 (request call id 10) took 1395 ms. Trace:
I20260709 12:16:31.764967 24875 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.147s
I20260709 12:16:31.776209 24888 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:31.794596 24663 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:31.939509 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:31.939725 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:31.940413 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:31.975306 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:31.975469 22822 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:31.975960 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:31.976007 22819 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:31.943521 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:31.909252 24845 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.966909 22748 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:31.977068 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:31.908097 24839 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:31.823130 25034 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:31.909375 24900 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:31.819545 24957 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:16:31.978431 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 208386us
I20260709 12:16:31.979764 23672 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:16:31.983181 24888 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:31.985668 25011 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:31.987303 22824 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:31.987783 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:31.990327 22823 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:31.974097 22894 rpcz_store.cc:276] 0709 12:16:30.513749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:30.630401 (+116652us) service_pool.cc:224] Handling call
0709 12:16:31.908555 (+1278154us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400572454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf4779853 00007fadf974760a 00007fadf2ccd7d4 00007fadf2ccd762 00007fadf2ccd691 00007fadf2ccd60c 00007fadf2ccc8c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:31.908670 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529373568}
I20260709 12:16:31.980830 22896 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:31.944406 24893 consensus_meta.cc:287] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.579s	user 0.005s	sys 0.006s
I20260709 12:16:31.798914 24669 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:32.002558 22822 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:31.926394 24904 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:32.004650 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:31.761543 25005 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:31.941191 24559 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:31.943104 24948 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.818253 24949 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.143s
W20260709 12:16:32.026746 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45052.2us
I20260709 12:16:31.986986 24982 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.979202 24971 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.788874 24744 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:32.031098 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:32.038666 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:31.923382 25018 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 12:16:32.039395 23660 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:16:32.032943 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:32.031189 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:32.042948 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:32.019781 24891 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:31.976769 24593 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:16:32.045724 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:32.041390 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:32.061728 22894 raft_consensus.cc:2410] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:16:32.041267 22822 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:32.037225 22896 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:32.062541 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:32.063529 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:32.034919 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:32.048962 24905 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:32.026856 24898 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:32.069517 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:32.070179 23674 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:32.086490 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:32.087785 25006 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:32.089953 25006 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:32.091475 25006 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:32.091964 25006 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:32.093478 25006 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.095263 25006 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:32.097611 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:32.027402 25046 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:31.996178 24845 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.031260 25043 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:32.015877 24893 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:32.083755 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:32.132488 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 48814.7us
I20260709 12:16:32.075681 22819 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:32.045236 25042 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:32.115562 23660 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:32.105038 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:32.060774 24939 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:32.120836 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 191015us
I20260709 12:16:32.042338 25048 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:32.072616 24798 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:32.126016 22894 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:16:32.043581 24982 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.106760 22901 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:32.078495 24969 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:32.039013 24948 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:32.155484 25028 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 12:16:32.156391 25035 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 12:16:32.156471 25020 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:16:32.157204 24948 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:32.139003 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.162883 25053 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.163666 25053 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.167862 24663 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:32.168814 24899 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:32.139590 24898 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:32.140065 25048 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:32.176357 25048 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:32.140699 24915 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:32.180894 24915 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:32.131655 25046 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:32.183991 25046 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.189100 24982 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:32.192595 24893 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:32.125166 25044 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:32.141894 25042 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:32.055086 24891 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:32.105366 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:32.046823 24971 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.209678 23674 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:32.142007 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:32.072225 25038 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:32.144445 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:32.125612 24730 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.002s
I20260709 12:16:31.996518 25034 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.116781 24900 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:32.155117 24969 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:16:32.203388 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:32.217916 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 78545.9us
W20260709 12:16:32.225960 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 75953.5us
I20260709 12:16:32.213374 24900 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:32.251822 23672 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:32.244845 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:32.212447 24891 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:32.150259 24939 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:32.143596 25015 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:16:32.217697 25044 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:32.260985 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:32.243222 24893 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:32.182397 24915 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.278519 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:32.242575 25029 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:32.216439 24730 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:32.271384 24993 consensus_meta.cc:287] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.269s	user 0.017s	sys 0.000s
I20260709 12:16:32.284710 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:32.291687 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:32.254643 24900 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:32.267177 25045 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:32.249678 24728 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:16:32.301568 24730 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:32.303453 24850 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.835s	user 0.012s	sys 0.001s
I20260709 12:16:32.286689 24969 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.285983 24994 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:32.290704 24663 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:16:32.309582 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 337859us
I20260709 12:16:32.329600 25055 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.330639 25044 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:32.331461 24939 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:32.292142 24893 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:32.298115 24805 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:32.340962 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:32.345139 23679 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:32.307905 25047 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:16:32.343834 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 99441.1us
I20260709 12:16:32.294495 24993 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:32.356616 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:32.344187 24884 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.025s	user 0.015s	sys 0.000s
I20260709 12:16:32.363607 22901 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:32.345717 24889 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.354941 25047 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.370460 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:32.342089 25042 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:32.365090 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:32.371371 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 70564.4us
I20260709 12:16:32.348462 24971 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:32.377208 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:32.348193 24850 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:32.344595 25055 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.388674 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:32.377075 24899 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.394284 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:32.370253 24884 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:32.399094 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:32.396382 24850 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:32.381456 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:32.415954 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:32.419359 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:32.495617 23685 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:32.416869 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:32.405557 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:32.401043 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:32.396061 24889 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:32.503142 22749 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:32.498445 22901 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:32.504545 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:32.505108 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 576) took 1363 ms. Trace:
I20260709 12:16:32.430586 24877 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:32.431879 24996 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:16:32.422181 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.433964 22892 raft_consensus.cc:3055] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:32.434116 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:32.439951 25059 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.446333 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:32.450858 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 718) took 1658 ms. Trace:
I20260709 12:16:32.538554 22821 rpcz_store.cc:276] 0709 12:16:30.792446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:30.793015 (+   569us) service_pool.cc:224] Handling call
0709 12:16:30.875280 (+ 82265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:31.158676 (+283396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:31.158720 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:31.158776 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:31.158851 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:32.450472 (+1291621us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54007a1a54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:32.450535 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:32.450739 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649668992}
I20260709 12:16:32.539443 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:32.451910 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:32.541080 22747 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:32.453843 24869 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:32.546362 22819 raft_consensus.cc:2368] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7.
I20260709 12:16:32.465727 24997 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:16:32.468655 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.478403 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 311) took 1074 ms. Trace:
I20260709 12:16:32.548416 22895 rpcz_store.cc:276] 0709 12:16:31.404021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.404224 (+   203us) service_pool.cc:224] Handling call
0709 12:16:32.478022 (+1073798us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002bd254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:32.478299 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305597696}
I20260709 12:16:32.549068 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:32.550242 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:32.550551 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:32.480818 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 580) took 1322 ms. Trace:
I20260709 12:16:32.552173 23695 rpcz_store.cc:276] 0709 12:16:31.158706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.158863 (+   157us) service_pool.cc:224] Handling call
0709 12:16:31.164191 (+  5328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:31.584359 (+420168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:32.480570 (+896211us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400374e54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:32.480748 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961324800}
I20260709 12:16:32.553851 22864 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:32.483009 25011 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:32.388819 25018 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:32.488008 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:32.375568 25047 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:32.495975 22827 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:32.506090 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:32.508510 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:32.503253 24917 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:32.380653 25063 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.135s
W20260709 12:16:32.510591 25061 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.118s	user 0.001s	sys 0.001s
I20260709 12:16:32.510860 25034 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:32.505560 23689 rpcz_store.cc:276] 0709 12:16:31.141853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.142976 (+  1123us) service_pool.cc:224] Handling call
0709 12:16:31.143705 (+   729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:31.198425 (+ 54720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:31.198471 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:31.209600 (+ 11129us) log.cc:844] Serialized 26 byte log entry
0709 12:16:31.572238 (+362638us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:31.572291 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:32.490295 (+918004us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b5400159354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:32.490357 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:32.490427 (+    70us) raft_consensus.cc:1685] finished
0709 12:16:32.490458 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:32.505041 (+ 14583us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125036800,"thread_start_us":282845,"threads_started":1,"wal-append.queue_time_us":887716}
I20260709 12:16:32.388263 24798 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:32.524988 24996 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:32.606989 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:32.530525 22790 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:32.608047 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:32.608731 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 78331.5us
I20260709 12:16:32.608856 24744 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:32.609689 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:32.532338 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.516830 22901 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:32.614230 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:32.615145 22901 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:32.616885 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:32.617678 22746 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:32.525457 22892 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:32.527748 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 147570us
I20260709 12:16:32.618752 22892 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.619647 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:32.421926 22820 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:32.483100 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:32.556279 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:32.621734 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:32.622627 22820 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:32.623838 22820 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:32.388149 25043 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:32.388936 24993 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:32.557848 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:32.628578 22895 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:32.419734 25013 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.556519 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:32.630069 22749 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:32.630287 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:32.417047 25055 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:32.565456 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 565) took 1775 ms. Trace:
I20260709 12:16:32.565970 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:32.551420 23659 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:32.517360 25056 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.640429 22825 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:16:32.640898 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.642359 22895 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:32.642777 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:32.577184 24265 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:16:32.577044 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 89175.9us
I20260709 12:16:32.646289 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:32.514726 24805 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:32.400593 25068 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.183s
I20260709 12:16:32.557020 25042 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:32.579806 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:32.571565 25059 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.581459 24917 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:32.585489 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:32.671784 22894 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:32.591080 25036 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:32.592661 24897 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.900s	user 0.013s	sys 0.000s
I20260709 12:16:32.382131 24649 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.520639 22818 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:32.545313 24969 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:32.546164 24869 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:32.619808 22892 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:32.627753 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:32.687140 22822 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:16:32.687460 22748 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:32.624627 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:32.558677 24997 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:32.638970 22821 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:32.638497 23656 rpcz_store.cc:276] 0709 12:16:30.790184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:30.790953 (+   769us) service_pool.cc:224] Handling call
0709 12:16:30.799325 (+  8372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:31.195632 (+396307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:32.565078 (+1369446us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b540059d3d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:32.565370 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862107904}
I20260709 12:16:32.522145 24900 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.689915 22821 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:32.383168 24839 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.698197 24839 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:32.387327 24893 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.508004 24899 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:32.606912 25063 consensus_queue.cc:1243] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:32.657636 22820 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:32.666466 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:32.668763 22825 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:32.704856 24899 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:32.663316 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:32.641065 24871 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:32.711009 25071 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:32.711323 24871 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:32.711629 25086 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:16:32.711776 25071 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:32.712252 25059 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:32.683957 24996 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:32.713630 24996 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:32.714097 25066 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:16:32.675552 25056 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.717231 24875 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:32.717741 24875 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.718098 24875 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:32.657963 24744 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:32.651149 25055 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.719506 22827 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:32.719664 25055 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:32.705652 24899 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:32.706700 22825 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
W20260709 12:16:32.709731 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46544.1us
I20260709 12:16:32.717865 24869 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.605906 25011 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:16:32.664882 24730 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:32.656631 25042 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.656550 24593 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:32.725544 22746 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:32.576272 25018 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:32.627990 24798 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.741005 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:32.755673 22825 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:32.651562 25013 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:32.741708 25073 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:32.743115 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:32.749257 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:32.749783 22750 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:32.749598 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 313) took 1321 ms. Trace:
W20260709 12:16:32.728850 25048 consensus_meta.cc:287] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.552s	user 0.015s	sys 0.000s
I20260709 12:16:32.742522 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:32.763576 22749 raft_consensus.cc:2410] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:16:32.792706 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 51830.6us
W20260709 12:16:32.794305 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.796029 22748 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 4: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:32.736272 24972 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:32.748754 24839 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.814826 22826 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:32.738140 24969 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:16:32.760140 24970 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:16:32.759264 24900 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:32.637532 25043 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.809449 25071 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:32.817507 22818 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:32.752431 25042 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:32.759073 24869 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:32.753372 24734 consensus_meta.cc:287] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.780s	user 0.008s	sys 0.007s
I20260709 12:16:32.765394 24971 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:32.743650 24899 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:32.752904 24730 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:32.888937 22899 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:16:32.890388 22899 pending_rounds.cc:85] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 2
I20260709 12:16:32.891000 22899 pending_rounds.cc:107] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:16:32.891458 22899 raft_consensus.cc:2889] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:32.895206 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:32.896311 22749 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:32.899047 22898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1098) took 1846 ms (client timeout 2057 ms). Trace:
W20260709 12:16:32.899741 22898 rpcz_store.cc:269] 0709 12:16:31.052670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.052913 (+   243us) service_pool.cc:224] Handling call
0709 12:16:32.887679 (+1834766us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54005a0354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:32.898924 (+ 11245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290282368}
W20260709 12:16:32.879660 24905 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.799s	user 0.008s	sys 0.005s
I20260709 12:16:32.903517 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:32.906767 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:32.913578 23493 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:32.914903 22748 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:32.798837 25048 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.912428 24850 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:32.918586 24915 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:32.918941 25013 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:32.919858 25024 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.898s	user 0.000s	sys 0.002s
I20260709 12:16:32.920497 25081 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:32.919751 24969 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.920955 25081 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.921401 25081 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:32.916742 24917 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:32.919090 25048 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:32.919724 25084 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:32.926354 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 578) took 1783 ms. Trace:
W20260709 12:16:32.899421 24891 consensus_meta.cc:287] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.002s
I20260709 12:16:32.888964 24889 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:32.943981 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:32.923645 24915 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:16:32.945909 25085 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:16:32.946051 24649 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:32.823304 24839 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.730262 25036 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:32.961059 22790 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:32.924396 25038 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.001s
W20260709 12:16:32.915541 25012 consensus_meta.cc:287] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.941s	user 0.011s	sys 0.004s
I20260709 12:16:32.943821 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:32.948375 23682 rpcz_store.cc:276] 0709 12:16:31.142585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.144863 (+  2278us) service_pool.cc:224] Handling call
0709 12:16:31.145251 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:31.174815 (+ 29564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:31.174855 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:31.203569 (+ 28714us) log.cc:844] Serialized 26 byte log entry
0709 12:16:31.544333 (+340764us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b480003abd8. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf96a8aa1 00007fadf969fb37 00007fadf969f9ca 00007fadf979726f 00007fadf9796f37 00007fadf97ab55c 00007fadf97ab508 00007fadf97ab488 00007fadf97ab443 00007fadf97aa6ec 00007fadf86d4a96
0709 12:16:31.552765 (+  8432us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:31.552827 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:31.552915 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:32.919058 (+1366143us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:32.925930 (+  6872us) raft_consensus.cc:1685] finished
0709 12:16:32.925966 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:32.926256 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20751,"raft.queue_time_us":42785,"raft.run_cpu_time_us":2364,"raft.run_wall_time_us":348820,"spinlock_wait_cycles":35337984,"thread_start_us":264726,"threads_started":1,"wal-append.queue_time_us":673816}
I20260709 12:16:32.967413 22752 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 4: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:32.820513 24972 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:32.829197 24997 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:32.969846 25029 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.000s
I20260709 12:16:32.969628 25017 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.969499 24891 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.970165 24899 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:32.913870 24884 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:32.814918 25073 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:32.972484 24915 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:32.937254 25013 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.987435 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:32.893761 24734 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:32.991248 23674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.018s
I20260709 12:16:32.995087 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:33.075973 23674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.000s	sys 0.018s
I20260709 12:16:32.997984 22826 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:32.965076 25048 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.002899 22893 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:32.981253 24730 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:32.971802 24905 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.888146 25054 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:16:33.007452 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 387674us
W20260709 12:16:33.093233 22745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.175s	sys 0.240s
I20260709 12:16:33.066620 22747 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:33.068787 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:33.093873 22745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.175s	sys 0.240s
I20260709 12:16:32.990463 24889 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:32.989842 25038 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:32.988933 25015 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:33.069685 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:33.070317 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:33.087602 24265 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:33.088773 22898 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:16:33.006534 25029 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:33.084317 22749 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:33.017302 24997 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:33.093645 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:33.098623 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:33.116205 22895 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:33.096216 22747 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:33.104935 24265 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:33.113848 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:33.165086 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.012s	sys 0.024s
I20260709 12:16:32.996343 25012 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:33.165635 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.012s	sys 0.024s
I20260709 12:16:33.097683 24889 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:33.172638 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 524722us
I20260709 12:16:33.183341 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:33.158500 24635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.016s	sys 0.019s
I20260709 12:16:33.114879 24730 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.100703 24900 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:33.085340 24884 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.085453 25068 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.073747 25013 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:33.173084 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 79513us
I20260709 12:16:33.117630 22748 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:33.094475 25048 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:33.201651 22823 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:33.097091 24905 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:33.166661 25056 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:33.186442 25006 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.086s	user 0.011s	sys 0.004s
I20260709 12:16:33.208446 22898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:33.236033 22898 raft_consensus.cc:606] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:33.236632 22898 raft_consensus.cc:614] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:33.237984 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:33.118921 25054 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.210579 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:33.185425 24889 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:33.189528 24635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.016s	sys 0.020s
I20260709 12:16:33.074802 25017 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:33.240260 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:33.205770 24798 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:33.256052 22900 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
W20260709 12:16:33.252938 25088 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:16:33.204030 24730 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:33.172637 24915 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:33.243016 25034 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:33.258143 25094 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.247871 25038 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:33.211179 24884 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:33.249851 25054 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:33.387202 22820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.014s	sys 0.059s
W20260709 12:16:33.416455 22820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.014s	sys 0.059s
I20260709 12:16:33.214020 25068 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:33.272703 24798 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:33.403174 23731 heartbeater.cc:646] Failed to heartbeat to 127.17.249.254:41671 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.249.254:41671 timed out after 15.000s (SENT)
I20260709 12:16:33.362946 25018 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:33.394696 25043 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:33.390828 25034 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:33.545519 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:33.600134 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:33.601181 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:33.601729 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:33.602233 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:33.424846 25015 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:33.610140 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:33.616833 22717 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.193s	user 0.073s	sys 0.151s
W20260709 12:16:33.621476 22717 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.197s	user 0.073s	sys 0.151s
W20260709 12:16:33.621873 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 1.20707e+06us
W20260709 12:16:33.621855 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:33.623754 24649 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.625084 24649 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:33.469676 24891 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:33.627782 24649 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:33.634173 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1108) took 1270 ms. Trace:
I20260709 12:16:33.634891 22901 rpcz_store.cc:276] 0709 12:16:32.363295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.615853 (+252558us) service_pool.cc:224] Handling call
0709 12:16:32.616198 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:32.616431 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:32.616456 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:32.617066 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 12:16:32.763615 (+146549us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:32.763652 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:32.763716 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:33.633842 (+870126us) raft_consensus.cc:1685] finished
0709 12:16:33.633875 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:33.634089 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":145366,"threads_started":1,"wal-append.queue_time_us":468727}
I20260709 12:16:33.637324 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:33.640098 22897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 304) took 3157 ms (client timeout 2124 ms). Trace:
I20260709 12:16:33.397298 25029 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.194s
W20260709 12:16:33.640925 22897 rpcz_store.cc:269] 0709 12:16:30.459510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:30.582050 (+122540us) service_pool.cc:224] Handling call
0709 12:16:33.617134 (+3035084us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b540014f5d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:33.617337 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657653504}
W20260709 12:16:33.647058 22865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.008s	sys 0.065s
W20260709 12:16:33.647660 22865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.008s	sys 0.065s
I20260709 12:16:33.545739 24899 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.546415 25038 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:33.601945 25034 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:33.549549 24972 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:33.616645 24734 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:33.618074 24839 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:33.648020 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 987609us
W20260709 12:16:33.628860 24996 consensus_meta.cc:287] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.915s	user 0.004s	sys 0.010s
W20260709 12:16:33.669090 22867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.124s	sys 0.183s
W20260709 12:16:33.666333 23493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.034s	sys 0.039s
W20260709 12:16:33.737540 23493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.035s	sys 0.039s
W20260709 12:16:33.737931 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 642092us
I20260709 12:16:33.599303 25069 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.524s
I20260709 12:16:33.443819 24798 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:33.683764 24877 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.141s	user 0.015s	sys 0.000s
I20260709 12:16:33.408886 25094 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:33.738181 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 731) took 1222 ms. Trace:
I20260709 12:16:33.760924 22827 rpcz_store.cc:276] 0709 12:16:32.515803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.570876 (+ 55073us) service_pool.cc:224] Handling call
0709 12:16:33.737989 (+1167113us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b54001257d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:33.738120 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142649600}
W20260709 12:16:33.729168 25044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.024s	sys 0.031s
I20260709 12:16:33.739609 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:33.685518 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:33.766988 22897 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:33.740808 22751 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:33.747828 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 270) took 1378 ms. Trace:
I20260709 12:16:33.748649 23682 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:16:33.749306 22895 consensus_meta.cc:287] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.001s
I20260709 12:16:33.653815 22898 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:33.669343 25036 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:33.737423 22867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.134s	sys 0.195s
W20260709 12:16:33.735435 24455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.018s	sys 0.081s
I20260709 12:16:33.805986 22895 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:33.684490 24899 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:33.807071 22822 rpcz_store.cc:276] 0709 12:16:32.369718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.370162 (+   444us) service_pool.cc:224] Handling call
0709 12:16:33.738067 (+1367905us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400791154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:33.747743 (+  9676us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717595520}
W20260709 12:16:33.766438 25044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.024s	sys 0.032s
I20260709 12:16:33.822404 22827 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:33.829757 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1051) took 1176 ms. Trace:
I20260709 12:16:33.830231 22827 rpcz_store.cc:276] 0709 12:16:32.653071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.767256 (+1114185us) service_pool.cc:224] Handling call
0709 12:16:33.822174 (+ 54918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.829411 (+  7237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.829696 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:33.825188 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:33.764259 24850 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.641018 25015 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:33.752532 25012 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:33.828531 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:33.817302 24455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.018s	sys 0.082s
I20260709 12:16:33.841064 25017 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:33.843681 24869 consensus_meta.cc:287] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.956s	user 0.014s	sys 0.000s
I20260709 12:16:33.867204 24972 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:33.867748 22894 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:33.844182 24850 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:33.868055 24972 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:33.831820 24877 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.838518 22897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:33.869812 22897 raft_consensus.cc:606] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:33.870282 22897 raft_consensus.cc:614] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:32.765098 22892 rpcz_store.cc:276] 0709 12:16:31.428550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.467273 (+ 38723us) service_pool.cc:224] Handling call
0709 12:16:31.467686 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:32.433789 (+966103us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400229d20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf47811c0 00007fadf4782231 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c
0709 12:16:32.749067 (+315278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:32.749115 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:32.749174 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:32.749219 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:32.749322 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:32.749513 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1547,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":33138,"spinlock_wait_cycles":527444736}
I20260709 12:16:33.768070 24734 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.807921 24905 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:33.809782 25056 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.691926 25038 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:33.762917 24891 consensus_queue.cc:1059] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 9.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:16:33.880213 22892 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:33.877789 22822 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:33.745963 25073 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:33.883670 23685 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:33.836370 25029 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:33.873799 25087 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.582s	user 0.002s	sys 0.000s
W20260709 12:16:33.909581 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.026s	sys 0.091s
W20260709 12:16:33.910177 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.026s	sys 0.091s
I20260709 12:16:33.870900 25048 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:33.912425 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:33.915470 23682 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
W20260709 12:16:33.900538 25083 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.484s	user 0.002s	sys 0.000s
I20260709 12:16:33.920820 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:33.924170 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:33.925258 23679 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:33.924086 22749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.030s	sys 0.052s
W20260709 12:16:33.927649 22749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.030s	sys 0.053s
I20260709 12:16:33.928624 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:33.931226 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:33.932487 23682 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:33.921314 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:33.936892 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:33.937846 23689 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:33.904595 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:33.938846 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:33.910823 24730 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:33.877791 24877 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:33.947732 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:33.879415 24734 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:33.949622 25080 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.332s	user 0.000s	sys 0.002s
I20260709 12:16:33.965519 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:33.967832 23656 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:16:33.970698 22865 connection.cc:256] RPC call timeout handler was delayed by -1.0217154919998848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 12:16:33.971856 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:33.972749 25036 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.973412 25036 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:33.975765 24730 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:33.976306 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:33.979017 24905 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:33.976557 24730 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:33.981487 22892 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:33.889632 25056 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:33.956344 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:33.941336 25018 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:33.997843 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:33.979854 24905 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:34.005267 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:34.006753 22900 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:34.007558 23679 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:34.008347 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:34.008268 23494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.035s	sys 0.090s
I20260709 12:16:33.955760 25043 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:34.010277 23494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.035s	sys 0.090s
W20260709 12:16:34.010707 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 759158us
W20260709 12:16:33.981885 24875 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.263s	user 0.012s	sys 0.004s
W20260709 12:16:33.996644 25083 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:16:34.019356 24730 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:34.011314 25047 consensus_meta.cc:287] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.405s	user 0.012s	sys 0.004s
I20260709 12:16:34.013731 22897 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
W20260709 12:16:33.990818 25081 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.069s	user 0.013s	sys 0.005s
I20260709 12:16:33.995970 24996 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:34.013363 22744 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:34.033215 22892 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:33.932317 25044 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:16:33.918227 25029 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:34.037102 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:34.012806 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:34.049463 24730 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:34.050421 24730 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:34.052879 24730 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:34.053316 22900 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:34.021500 25018 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:16:34.074280 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:34.073993 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 695) took 1629 ms. Trace:
I20260709 12:16:34.075599 22745 rpcz_store.cc:276] 0709 12:16:32.445123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.445285 (+   162us) service_pool.cc:224] Handling call
0709 12:16:32.445720 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:32.446179 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:32.446213 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:32.446858 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 12:16:33.100305 (+653447us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:33.100369 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.100468 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:34.073730 (+973262us) raft_consensus.cc:1685] finished
0709 12:16:34.073752 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:34.073916 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19200,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"thread_start_us":647100,"threads_started":1,"wal-append.queue_time_us":950415}
W20260709 12:16:34.084782 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:34.029062 25097 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:34.082294 22892 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:34.088903 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:34.096474 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 556) took 1874 ms. Trace:
I20260709 12:16:34.100670 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:34.089999 22865 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.770s (SENT) [suppressed 8 similar messages]
I20260709 12:16:34.086408 24869 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:16:34.103168 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:34.104200 22892 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
W20260709 12:16:34.104419 25093 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:16:34.105876 22892 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:34.106420 24905 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:34.111594 25100 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:34.112309 25100 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:34.114720 25100 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:34.074195 24972 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:34.117157 25100 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:34.117399 24734 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:34.117936 25100 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.119028 25015 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:34.016332 24875 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.073086 25039 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:34.120406 25100 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:34.081274 25018 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.040480 24996 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:34.083089 25017 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:16:34.132848 22901 raft_consensus.cc:2368] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
W20260709 12:16:34.141312 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.028s	sys 0.125s
I20260709 12:16:34.090406 25048 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:34.074662 24455 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:34.079949 24798 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:34.097083 23674 rpcz_store.cc:276] 0709 12:16:32.222578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.223996 (+  1418us) service_pool.cc:224] Handling call
0709 12:16:32.224470 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:32.225412 (+   942us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:32.253631 (+ 28219us) log.cc:844] Serialized 14 byte log entry
0709 12:16:32.489033 (+235402us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b1800362260. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:16:33.093277 (+604244us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:33.093854 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 12:16:33.094020 (+   166us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:33.094052 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.094130 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:34.084223 (+990093us) raft_consensus.cc:1685] finished
0709 12:16:34.096198 (+ 11975us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:34.096386 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19908,"prepare.queue_time_us":27991,"raft.queue_time_us":21193,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":24763,"spinlock_wait_cycles":15255168,"thread_start_us":587227,"threads_started":1,"wal-append.queue_time_us":1008524}
W20260709 12:16:34.138607 23495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.022s	sys 0.038s
W20260709 12:16:34.150194 23495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.023s	sys 0.038s
I20260709 12:16:34.078303 25068 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:34.142119 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:34.141867 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.028s	sys 0.125s
W20260709 12:16:34.151408 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:34.128192 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:16:34.151618 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 527990us
I20260709 12:16:34.155354 24734 consensus_queue.cc:1059] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:34.156843 24730 raft_consensus.cc:3055] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:34.157371 24730 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:34.158324 24730 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:34.160380 24730 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:34.144845 22900 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:16:34.145499 22824 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.141s	user 0.010s	sys 0.017s
I20260709 12:16:34.041239 25047 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:34.172914 25047 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:34.173128 22747 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:16:34.132427 24969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.029s	sys 0.116s
I20260709 12:16:34.042135 25081 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:34.174307 24969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.029s	sys 0.116s
I20260709 12:16:34.086753 25014 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
W20260709 12:16:34.175485 22824 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.010s	sys 0.017s
I20260709 12:16:34.176564 22827 raft_consensus.cc:2368] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5.
W20260709 12:16:34.140096 25078 log.cc:927] Time spent T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.304s	user 0.000s	sys 0.002s
I20260709 12:16:34.134619 25101 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:34.138230 25018 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:34.135553 24899 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:34.122803 25091 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:16:34.139130 25036 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:34.147933 24877 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:34.195194 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 67337.6us
I20260709 12:16:34.149847 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:34.192536 25038 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:34.193949 24969 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:34.197077 25101 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:34.150233 25048 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:34.223054 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 266727us
I20260709 12:16:34.209000 25103 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.205089 25015 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:34.230494 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 140471us
I20260709 12:16:34.262252 23674 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:34.223412 25056 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:34.274047 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.275344 23679 raft_consensus.cc:2410] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:16:34.277176 23674 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:34.277331 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:34.270208 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 114031us
I20260709 12:16:34.279385 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.279879 23682 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:34.280369 23660 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:34.260764 24996 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:34.281728 24875 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:34.270716 24889 consensus_meta.cc:287] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.006s	user 0.015s	sys 0.000s
I20260709 12:16:34.281162 25015 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:34.224560 24969 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:34.327800 25104 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:16:34.329185 24969 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:34.302590 25098 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.272s	user 0.000s	sys 0.002s
I20260709 12:16:34.332547 25048 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:34.333508 24997 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.169s	user 0.011s	sys 0.002s
I20260709 12:16:34.257395 25107 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:34.334226 25107 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.306324 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.309451 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.335497 23679 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:34.309720 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1050) took 1698 ms. Trace:
I20260709 12:16:34.336319 22820 rpcz_store.cc:276] 0709 12:16:32.611328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.424331 (+813003us) service_pool.cc:224] Handling call
0709 12:16:34.005951 (+581620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:34.006237 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:16:34.215827 (+209590us) log.cc:844] Serialized 14 byte log entry
0709 12:16:34.309186 (+ 93359us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:34.309271 (+    85us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:34.309347 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.309457 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:34.309638 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":253368,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":41088,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":64,"thread_start_us":284938,"threads_started":3}
I20260709 12:16:34.310815 23660 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:16:34.303737 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.311657 24889 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:34.310563 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:34.316627 25015 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:34.284410 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:34.302268 25029 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:34.342639 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 58313.2us
I20260709 12:16:34.343161 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.344926 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:34.310392 25081 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:34.346447 22744 raft_consensus.cc:2368] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6.
I20260709 12:16:34.347380 24889 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:34.347635 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:34.348397 22744 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:34.349221 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 359) took 1527 ms. Trace:
I20260709 12:16:34.349046 25101 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:34.349674 22747 rpcz_store.cc:276] 0709 12:16:32.821469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.161739 (+340270us) service_pool.cc:224] Handling call
0709 12:16:33.162129 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:34.173893 (+1011764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.348950 (+175057us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000a8f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:34.349154 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324398976}
I20260709 12:16:34.351194 22744 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:34.352079 24996 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:16:34.339694 25034 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.004s
I20260709 12:16:34.352622 25053 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:34.353223 22818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 735) took 1690 ms (client timeout 1858 ms). Trace:
I20260709 12:16:34.353179 25034 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:34.353806 22818 rpcz_store.cc:269] 0709 12:16:32.662507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.686041 (+ 23534us) service_pool.cc:224] Handling call
0709 12:16:34.353056 (+1667015us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b54002e8954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:34.353170 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126224128}
I20260709 12:16:34.357247 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:34.359206 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:34.339556 25042 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.417s	user 0.012s	sys 0.004s
I20260709 12:16:34.359318 24996 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:16:34.365585 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.337443 24875 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:34.367362 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.270262 25103 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.337864 25107 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:34.371150 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.374571 24900 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:34.375728 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:34.385322 22896 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:34.382262 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.390239 22896 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:34.363584 25056 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:34.376531 25106 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:16:34.394264 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 168893us
I20260709 12:16:34.393524 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:34.397185 24996 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:34.397759 25120 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.398365 25120 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.398648 24845 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:34.399711 24871 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.400895 25120 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:34.401046 24871 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:34.379171 24875 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.405349 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:34.406723 24875 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:34.407194 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:34.407670 24875 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:34.408020 24875 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.408181 25053 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:34.408388 24875 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:34.408812 25053 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:34.389580 24900 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:34.412205 25039 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:34.413009 23660 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:34.402994 25114 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:34.415122 25114 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:34.415585 25114 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:34.416097 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:34.416450 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1047) took 2022 ms. Trace:
I20260709 12:16:34.416793 22824 rpcz_store.cc:276] 0709 12:16:32.394351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.457371 (+ 63020us) service_pool.cc:224] Handling call
0709 12:16:32.457861 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:32.930852 (+472991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:32.930906 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:32.944110 (+ 13204us) log.cc:844] Serialized 26 byte log entry
0709 12:16:34.175886 (+1231776us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:34.175929 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.176015 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:34.416229 (+240214us) raft_consensus.cc:1685] finished
0709 12:16:34.416251 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:34.416392 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26861,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":89,"thread_start_us":1643265,"threads_started":2,"wal-append.queue_time_us":1269531}
I20260709 12:16:34.417804 22827 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:16:34.383737 25054 consensus_meta.cc:287] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.952s	user 0.006s	sys 0.006s
I20260709 12:16:34.403252 25056 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.419239 25054 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:34.406617 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:34.420521 23689 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:34.421780 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 354) took 1845 ms. Trace:
I20260709 12:16:34.422518 25120 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.422215 22750 rpcz_store.cc:276] 0709 12:16:32.576789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.577537 (+   748us) service_pool.cc:224] Handling call
0709 12:16:32.577871 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:32.762928 (+185057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.421560 (+1658632us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540043ec54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:34.421727 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394713856}
I20260709 12:16:34.419777 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:34.423501 25120 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:34.418653 22824 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:16:34.427073 25053 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:34.367601 25042 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:34.431665 22819 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1048) took 2037 ms (client timeout 1552 ms). Trace:
W20260709 12:16:34.432403 22819 rpcz_store.cc:269] 0709 12:16:32.394531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.419027 (+ 24496us) service_pool.cc:224] Handling call
0709 12:16:34.431337 (+2012310us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b54000f19d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:34.431553 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115428608}
I20260709 12:16:34.384348 25034 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:34.395293 22896 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.421571 25054 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:34.433050 25042 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:34.434335 24970 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:34.437022 24970 consensus_queue.cc:1243] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:16:34.416031 22820 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:34.444173 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:34.446230 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:34.446569 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:34.449362 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:34.451946 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:34.452932 22819 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:34.454668 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:34.458290 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:34.459224 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:34.459410 23679 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:34.464984 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:34.466142 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:34.447630 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:34.474473 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:34.474910 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.475705 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:34.482102 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:34.482375 24996 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:34.484050 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:34.485280 22819 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:34.486555 22824 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
W20260709 12:16:34.503235 23672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 555) took 2451 ms (client timeout 1508 ms). Trace:
I20260709 12:16:34.501808 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:34.505084 22820 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:34.504065 24889 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:34.506641 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.506201 25054 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:34.507773 25054 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.508018 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:34.484323 25053 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:34.508662 25053 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:34.508147 25054 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:34.509227 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.510314 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.484066 24898 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:34.482599 25018 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.511472 24898 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.511911 24898 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:34.506848 24889 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:34.509025 25053 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:34.513913 23679 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:34.514007 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:34.521553 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:34.522378 22819 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:34.522673 22900 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:34.523768 22819 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:34.514348 22896 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:34.525743 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.491003 23674 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:16:34.503700 23672 rpcz_store.cc:269] 0709 12:16:32.035849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.042667 (+  6818us) service_pool.cc:224] Handling call
0709 12:16:34.486646 (+2443979us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54001ffed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:34.486756 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471775104}
I20260709 12:16:34.532481 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:34.533573 23672 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:34.530396 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:34.514940 23660 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:34.517781 24915 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:34.518383 24889 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:34.519119 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:34.505108 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:34.540007 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:34.447331 24997 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.677680 22900 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:16:34.607798 22896 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:34.618287 23689 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:34.521512 24900 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:34.638288 25055 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:34.486079 24744 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:34.642017 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:34.644169 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:34.644490 25018 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:34.487552 25042 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:16:34.684074 22896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 315) took 2872 ms (client timeout 3306 ms). Trace:
I20260709 12:16:34.673966 25039 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.724885 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:34.707418 22896 rpcz_store.cc:269] 0709 12:16:31.811176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.063232 (+252056us) service_pool.cc:224] Handling call
0709 12:16:34.385167 (+2321935us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b540022b8a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf4782e18 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:34.513928 (+128761us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b540022b8a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f4a1d 00007fadf46db1a4 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf478327c 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591
0709 12:16:34.683974 (+170046us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25455744}
W20260709 12:16:34.727734 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 83638.8us
I20260709 12:16:34.734241 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:34.735957 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:34.736760 22896 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
W20260709 12:16:34.703655 24949 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:16:34.744022 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 726) took 2322 ms. Trace:
I20260709 12:16:34.698649 24744 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:34.719789 25042 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:34.766589 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:34.676743 25054 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.745694 25055 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:34.697832 24997 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:34.772867 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 328436us
I20260709 12:16:34.750540 25103 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:34.812959 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:34.813798 22896 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:34.797886 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:34.746743 25120 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:34.822587 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:34.765566 24744 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:34.766428 25042 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:34.746132 25039 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:34.791838 24893 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.866694 22820 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:16:34.830494 25118 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.452s	user 0.001s	sys 0.001s
I20260709 12:16:34.828181 25100 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:34.871146 24893 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.871721 25053 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.824062 25055 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:34.908234 25054 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:34.910518 24900 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:34.912278 24997 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:34.914870 25122 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:16:34.916067 24617 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:34.916656 24617 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:34.917903 25039 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:34.917732 24617 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.3, Last appended by leader: 3, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:34.920413 24617 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:16:34.923496 25119 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:16:34.894764 24730 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:34.962193 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 132343us
I20260709 12:16:34.967578 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:34.970408 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:34.874962 25107 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.875118 24875 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:34.955660 25054 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:34.927843 25100 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:34.905510 25114 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:34.989617 22818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.022s	sys 0.019s
W20260709 12:16:35.054128 22818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.023s	sys 0.019s
I20260709 12:16:34.991127 22896 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
W20260709 12:16:34.993124 22893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1099) took 3940 ms (client timeout 1844 ms). Trace:
I20260709 12:16:34.991115 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:34.956142 25101 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:34.981356 25032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.009s	sys 0.023s
I20260709 12:16:35.082391 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1101) took 3998 ms. Trace:
I20260709 12:16:34.984906 25053 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:34.987134 25041 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:16:35.017674 25103 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:35.083051 25100 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:35.087358 22746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 554) took 2464 ms (client timeout 2545 ms). Trace:
I20260709 12:16:35.089699 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:34.966439 25039 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.134s
I20260709 12:16:35.057516 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.097427 22899 rpcz_store.cc:276] 0709 12:16:31.062664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.062907 (+   243us) service_pool.cc:224] Handling call
0709 12:16:32.888406 (+1825499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:32.892659 (+  4253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.060488 (+2167829us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54005a0350. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:35.060741 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4108793088}
I20260709 12:16:35.117595 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:35.118422 22899 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:35.082854 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 556) took 2436 ms. Trace:
I20260709 12:16:35.090739 24982 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:34.987684 24900 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:16:35.081527 22893 rpcz_store.cc:269] 0709 12:16:31.053031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.053159 (+   128us) service_pool.cc:224] Handling call
0709 12:16:34.992903 (+3939744us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540057add4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:34.993045 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4281735680}
W20260709 12:16:35.119205 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0146982310000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 12:16:35.118852 22751 rpcz_store.cc:276] 0709 12:16:32.625363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.626979 (+  1616us) service_pool.cc:224] Handling call
0709 12:16:32.627310 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.806465 (+1179155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.061810 (+1255345us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002baa54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:35.062076 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2560074112}
I20260709 12:16:35.121495 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.057917 24997 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:35.113579 25103 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.092080 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:35.109368 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 118381us
W20260709 12:16:35.099027 25032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.010s	sys 0.024s
I20260709 12:16:35.113181 24948 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:34.984269 24730 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:35.121642 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:35.113294 22746 rpcz_store.cc:269] 0709 12:16:32.623091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.623336 (+   245us) service_pool.cc:224] Handling call
0709 12:16:35.087032 (+2463696us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b54001e82d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:35.087229 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217361280}
I20260709 12:16:35.128990 25114 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:35.121320 24982 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:35.135003 24948 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:35.146159 25107 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:35.146294 25114 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.102356 25101 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:35.146629 24948 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:35.169167 25101 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:35.099872 25055 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:35.139752 24669 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:35.130337 25103 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:35.145346 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:35.191253 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45998.6us
I20260709 12:16:35.192067 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:35.054556 25054 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:35.172887 25123 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
I20260709 12:16:35.138412 24730 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:35.131625 24997 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:35.202594 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:35.173189 25091 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:16:35.146692 24982 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:35.165184 25114 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:35.199827 25107 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:35.217803 25107 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:35.218334 25107 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:35.201234 25042 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:35.206264 25039 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:16:35.217121 24997 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:35.201611 25041 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:35.236353 25114 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:35.237238 25125 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:16:35.238296 24898 consensus_meta.cc:287] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.000s
I20260709 12:16:35.320060 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.320214 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.151793 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:35.322376 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:35.147244 22827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.024s	sys 0.030s
W20260709 12:16:35.411222 22827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.025s	sys 0.030s
I20260709 12:16:35.411368 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.412659 22750 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
W20260709 12:16:35.156795 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:35.132375 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:35.420267 22893 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:35.142377 22899 raft_consensus.cc:2376] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6. Re-sending same reply.
I20260709 12:16:35.134199 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.426326 22900 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:35.427985 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.130208 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.132325 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:35.145054 22901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 584) took 1853 ms (client timeout 1717 ms). Trace:
W20260709 12:16:35.330595 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 127907us
I20260709 12:16:35.335562 24617 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.209424 24730 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.244890 24982 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:35.428565 24957 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.428174 24900 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:35.255723 25042 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:35.209123 24893 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:35.230239 25041 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:35.438879 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 286995us
I20260709 12:16:35.439605 25041 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:35.227003 25047 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.441193 25047 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:35.268150 25054 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:35.275619 25107 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:35.443523 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:35.274724 25103 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:35.385929 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.387081 22753 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:35.388500 24898 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:35.407091 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.409224 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:35.424539 24875 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:35.437391 24957 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:35.428997 24949 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.438419 24900 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:35.429844 25039 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:35.361505 25131 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:35.240562 24997 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:35.429793 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.430033 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.453891 24957 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:35.439875 24893 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:35.427800 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:35.460907 22823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1042) took 3074 ms (client timeout 3077 ms). Trace:
I20260709 12:16:35.431799 22896 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:35.461894 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1052) took 2802 ms. Trace:
I20260709 12:16:35.443608 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.463032 25047 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:35.463603 22826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 724) took 3063 ms (client timeout 1770 ms). Trace:
I20260709 12:16:35.464432 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:35.465142 25103 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:35.465461 25135 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.466156 22898 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:35.468676 24898 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:35.469064 22894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 573) took 2400 ms (client timeout 2188 ms). Trace:
I20260709 12:16:35.476835 24997 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:35.477762 24886 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.487881 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.488242 22744 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:35.429150 25063 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:35.479852 24893 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:35.432978 24871 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.031s	user 0.011s	sys 0.007s
W20260709 12:16:35.484860 22894 rpcz_store.cc:269] 0709 12:16:33.067998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.068128 (+   130us) service_pool.cc:224] Handling call
0709 12:16:35.468546 (+2400418us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b54004eb954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:35.468793 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1756804480}
I20260709 12:16:35.479130 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 560) took 1739 ms. Trace:
I20260709 12:16:35.488502 24886 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:35.475842 22826 rpcz_store.cc:269] 0709 12:16:32.399910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.421534 (+ 21624us) service_pool.cc:224] Handling call
0709 12:16:35.463086 (+3041552us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400300f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:35.463346 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565241216}
I20260709 12:16:35.493146 25131 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:35.474741 22823 rpcz_store.cc:269] 0709 12:16:32.386347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.388348 (+  2001us) service_pool.cc:224] Handling call
0709 12:16:35.460317 (+3071969us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54007a2454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:35.460650 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849402752}
I20260709 12:16:35.488987 22898 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:35.499083 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.499601 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:35.500347 22899 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:35.501236 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:35.475399 22822 rpcz_store.cc:276] 0709 12:16:32.659703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.821647 (+1161944us) service_pool.cc:224] Handling call
0709 12:16:33.823750 (+  2103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.880878 (+ 57128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.461063 (+1580185us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b5400125cd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:35.461560 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123739520}
I20260709 12:16:35.505887 24893 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:35.507673 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:35.525576 23689 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:35.530534 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:35.508074 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 44040.8us
I20260709 12:16:35.508389 25063 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:35.508811 25133 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:16:35.509562 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:35.510085 24949 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:35.431638 22901 rpcz_store.cc:269] 0709 12:16:33.291301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.636940 (+345639us) service_pool.cc:224] Handling call
0709 12:16:35.144756 (+1507816us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54000ee2d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:35.144941 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137293184}
I20260709 12:16:35.532575 22819 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:35.507697 22818 raft_consensus.cc:2368] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5.
I20260709 12:16:35.532204 22896 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:35.517053 22892 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:35.517784 25135 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:35.496870 23685 rpcz_store.cc:276] 0709 12:16:33.739180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.739338 (+   158us) service_pool.cc:224] Handling call
0709 12:16:35.478461 (+1739123us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400375d54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:35.478810 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262222080}
I20260709 12:16:35.519045 22752 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:35.520135 22894 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:35.521421 25131 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:35.433703 24730 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:35.530756 25056 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:34.747452 22821 rpcz_store.cc:276] 0709 12:16:32.421996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.691450 (+269454us) service_pool.cc:224] Handling call
0709 12:16:32.739421 (+ 47971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:32.739758 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:16:32.773906 (+ 34148us) log.cc:844] Serialized 14 byte log entry
0709 12:16:34.411573 (+1637667us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b18001d7d00. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:16:34.743556 (+331983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:34.743635 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:34.743701 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.743797 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:34.743943 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24493,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":1965,"spinlock_wait_cycles":48132992,"thread_start_us":331624,"threads_started":1}
I20260709 12:16:35.432757 24617 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:35.555580 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 593) took 1070 ms. Trace:
I20260709 12:16:35.547201 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:35.557169 25135 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:35.496282 24997 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:35.562695 22900 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:35.558660 22747 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:35.644277 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:35.598546 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48883.8us
I20260709 12:16:35.618932 23695 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:35.568483 22894 rpcz_store.cc:276] 0709 12:16:34.483160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.498438 (+1015278us) service_pool.cc:224] Handling call
0709 12:16:35.553593 (+ 55155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.648021 25135 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:35.649537 22894 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:35.650539 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 329) took 1596 ms. Trace:
I20260709 12:16:35.559052 25039 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:35.650949 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:35.651903 22744 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:35.652325 23660 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:16:35.649216 25135 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:35.617192 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:35.561772 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:35.563783 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.559746 25138 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.653883 22899 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:35.559037 24875 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.603053 24870 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.656088 23689 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:35.652148 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:35.558550 24730 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:35.549757 25092 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.788s	user 0.004s	sys 0.015s
I20260709 12:16:35.619752 24850 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:35.671602 24888 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:35.675300 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:35.676553 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 59571.6us
I20260709 12:16:35.678373 25133 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:35.678916 25133 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:35.678959 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:35.652738 25107 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:35.679992 23674 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:35.680197 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:35.674135 24870 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:35.659494 22819 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:35.600383 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:35.679343 25133 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:35.682873 22864 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:35.559456 24891 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:35.564582 24949 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:35.560474 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:35.549583 25063 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:35.661758 22894 rpcz_store.cc:276] 0709 12:16:34.053848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.648446 (+1594598us) service_pool.cc:224] Handling call
0709 12:16:35.649242 (+   796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.650209 (+   967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.650458 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.618844 25094 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:35.688660 22893 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
W20260709 12:16:35.692721 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 156517us
I20260709 12:16:35.696614 22753 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:35.689064 23656 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:16:35.697105 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.738555 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:35.734135 22901 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:35.729449 22896 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
W20260709 12:16:35.705749 22790 connection.cc:256] RPC call timeout handler was delayed by -1.1800118010000915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 12:16:35.705307 24915 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.066s	user 0.012s	sys 0.011s
I20260709 12:16:35.702090 22897 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:35.742570 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:35.695338 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:35.696264 24744 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.835s	user 0.014s	sys 0.014s
I20260709 12:16:35.693928 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:35.703384 24948 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.006s
I20260709 12:16:35.693112 25107 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:35.748922 25107 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.748934 24948 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:35.738967 24888 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:35.752243 22823 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:16:35.751595 24888 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:35.730412 24875 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:35.758082 24948 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:35.760303 22899 raft_consensus.cc:2368] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
I20260709 12:16:35.759667 24744 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:35.729501 25131 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:16:35.763669 23682 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:35.763890 24891 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:35.764798 25136 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:35.765293 25055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.019s	sys 0.011s
W20260709 12:16:35.765895 25055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.019s	sys 0.011s
I20260709 12:16:35.765321 25136 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:35.749788 25107 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:35.767022 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:35.767441 22748 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:35.768666 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:35.761968 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.771279 22899 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:16:35.772524 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 330) took 1694 ms. Trace:
I20260709 12:16:35.772979 22899 rpcz_store.cc:276] 0709 12:16:34.078289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.770111 (+1691822us) service_pool.cc:224] Handling call
0709 12:16:35.770947 (+   836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:35.771813 (+   866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.772462 (+   649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.775032 22899 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:35.775305 23493 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:35.775925 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 332) took 1694 ms. Trace:
I20260709 12:16:35.776706 22899 rpcz_store.cc:276] 0709 12:16:34.081809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.773962 (+1692153us) service_pool.cc:224] Handling call
0709 12:16:35.774468 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.775547 (+  1079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.775828 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.777581 23493 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:35.778723 24948 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:35.779098 24915 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:16:35.776034 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 95995.8us
I20260709 12:16:35.780795 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 333) took 1694 ms. Trace:
I20260709 12:16:35.781406 22899 rpcz_store.cc:276] 0709 12:16:34.086619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.777796 (+1691177us) service_pool.cc:224] Handling call
0709 12:16:35.778285 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.780102 (+  1817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:35.780142 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:35.780198 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:35.780269 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.780343 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:35.780472 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.783658 22899 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:16:35.784281 24617 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:35.784596 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 335) took 1573 ms. Trace:
I20260709 12:16:35.785259 22899 rpcz_store.cc:276] 0709 12:16:34.211007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.782635 (+1571628us) service_pool.cc:224] Handling call
0709 12:16:35.783081 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.784312 (+  1231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.784537 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.791810 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:35.791635 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:35.793381 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:35.793605 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:35.794710 22744 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:35.795359 25131 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:35.795826 25131 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:35.797302 22753 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:35.797115 25131 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:35.799310 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.801055 22894 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:35.801149 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.801724 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1114) took 1394 ms. Trace:
I20260709 12:16:35.802153 22894 rpcz_store.cc:276] 0709 12:16:34.418830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.800471 (+1381641us) service_pool.cc:224] Handling call
0709 12:16:35.800835 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.801501 (+   666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.801670 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.802902 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:35.803807 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 356411us
I20260709 12:16:35.803923 22750 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:35.805367 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.806097 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.743881 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:35.799506 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.817041 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1123) took 1174 ms. Trace:
I20260709 12:16:35.814854 22819 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:35.702672 25135 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:35.818881 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.848594 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:35.806324 22750 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:35.821883 22821 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:35.818358 22818 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:35.820081 22822 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:35.855398 22753 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:35.863318 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1124) took 1102 ms. Trace:
I20260709 12:16:35.864038 22893 rpcz_store.cc:276] 0709 12:16:34.643320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.122898 (+479578us) service_pool.cc:224] Handling call
0709 12:16:35.740578 (+617680us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25344}
I20260709 12:16:35.866696 22893 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:35.823216 22898 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:35.809362 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.867827 23689 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:35.857360 22900 rpcz_store.cc:276] 0709 12:16:34.643068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.429578 (+786510us) service_pool.cc:224] Handling call
0709 12:16:35.816736 (+387158us) spinlock_profiling.cc:243] Waited 88.1 ms on lock 0x7b540057bcd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:35.816962 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202626816}
I20260709 12:16:35.819350 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.798681 25131 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:35.878851 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 101530us
I20260709 12:16:35.820700 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:35.885834 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:35.875473 23674 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:35.889098 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.744191 24997 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:35.662668 25039 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:35.814942 25102 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.696s	user 0.002s	sys 0.016s
I20260709 12:16:35.890312 22898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1115) took 1465 ms. Trace:
I20260709 12:16:35.810511 25013 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:35.811476 25063 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:35.806159 24886 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:35.904202 23656 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:35.903708 22898 rpcz_store.cc:276] 0709 12:16:34.419139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.822465 (+1403326us) service_pool.cc:224] Handling call
0709 12:16:35.822925 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.884372 (+ 61447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.884630 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:35.910729 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:35.911789 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.912832 22746 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:35.913596 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.930661 22751 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:35.914147 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:35.914824 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.919049 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 561) took 3010 ms. Trace:
I20260709 12:16:35.932590 22749 rpcz_store.cc:276] 0709 12:16:32.909011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.213192 (+304181us) service_pool.cc:224] Handling call
0709 12:16:33.247941 (+ 34749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:33.248420 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:33.248472 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:33.249103 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 12:16:33.928567 (+679464us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:33.928633 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.928733 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:35.813769 (+1885036us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:35.918367 (+104598us) raft_consensus.cc:1685] finished
0709 12:16:35.918400 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:35.918765 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5207,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":10136,"spinlock_wait_cycles":9016192,"thread_start_us":679031,"threads_started":1,"wal-append.queue_time_us":868923}
I20260709 12:16:35.939050 22821 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:35.940150 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.940737 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:35.941103 22820 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:35.942463 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.943593 22820 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:35.944846 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.946076 22820 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:16:35.946961 22823 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:35.948086 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.948957 22823 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:35.949819 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.951330 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.953413 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:35.807099 24730 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 12:16:35.955267 22820 raft_consensus.cc:2376] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7. Re-sending same reply.
W20260709 12:16:35.955775 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:35.956429 23682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 601) took 1617 ms (client timeout 2012 ms). Trace:
W20260709 12:16:35.956974 23682 rpcz_store.cc:269] 0709 12:16:34.340318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:34.340476 (+   158us) service_pool.cc:224] Handling call
0709 12:16:35.956104 (+1615628us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54003746d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:35.956325 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3262127360}
I20260709 12:16:35.957196 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:35.959514 22823 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:35.960383 24744 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:35.962255 25039 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:35.958630 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:35.963454 22820 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:35.964396 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:35.965313 22896 raft_consensus.cc:2376] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4. Re-sending same reply.
I20260709 12:16:35.968055 24888 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:35.970458 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.971488 22824 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:35.972879 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.973853 22824 raft_consensus.cc:2410] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:16:35.974270 24870 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:35.920516 24997 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:35.920053 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.884289 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 343) took 1401 ms. Trace:
I20260709 12:16:35.926530 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.906183 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.689049 25138 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:35.985596 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:35.925679 22826 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:35.979812 23493 leader_election.cc:400] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6.
I20260709 12:16:35.980091 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 342) took 1537 ms. Trace:
I20260709 12:16:35.979642 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:35.992923 22822 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:35.986569 22893 rpcz_store.cc:276] 0709 12:16:34.474298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.865728 (+1391430us) service_pool.cc:224] Handling call
0709 12:16:35.866318 (+   590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.874465 (+  8147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.875970 (+  1505us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:36.000422 22896 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:16:36.000526 22823 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:36.001355 23689 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:16:35.999619 23493 leader_election.cc:403] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:16:35.985845 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 312509us
I20260709 12:16:35.986935 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.977761 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.978538 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:35.996093 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.989691 22820 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
W20260709 12:16:35.997538 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45715.6us
W20260709 12:16:35.989831 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:35.974767 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.003458 22744 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:35.984350 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:35.999505 22894 rpcz_store.cc:276] 0709 12:16:34.443042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.869528 (+1426486us) service_pool.cc:224] Handling call
0709 12:16:35.935845 (+ 66317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.979205 (+ 43360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:35.979238 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:35.979282 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:35.979312 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.979841 (+   529us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b54008926d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:35.979888 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:35.980001 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99057408}
I20260709 12:16:35.937173 22900 raft_consensus.cc:2368] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
W20260709 12:16:35.971496 25041 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.005s
I20260709 12:16:36.007658 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:36.005061 22753 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:36.006914 22824 raft_consensus.cc:2376] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6. Re-sending same reply.
I20260709 12:16:36.008745 22819 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:36.003188 22746 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:16:35.977694 24730 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:36.010634 22895 raft_consensus.cc:2368] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
I20260709 12:16:36.016011 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:35.978811 24891 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:36.011000 22898 raft_consensus.cc:2376] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7. Re-sending same reply.
W20260709 12:16:36.019042 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 210498us
I20260709 12:16:36.023804 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:36.024634 22745 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:36.024894 22824 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:36.027562 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.022836 24870 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:35.976856 24884 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:36.029276 22895 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:36.011952 24730 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:36.037467 22896 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:16:35.984318 25107 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:36.039209 22893 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:35.976505 24997 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:36.046726 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:36.011354 25041 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:36.061746 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.014945 25039 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:16:36.063303 23660 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:36.064309 22746 raft_consensus.cc:2393] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:36.069960 23659 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:36.065320 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.063673 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:36.044533 25133 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:36.041875 24891 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6.
I20260709 12:16:36.029289 24870 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:36.075508 22751 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:36.080195 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 327) took 2031 ms. Trace:
W20260709 12:16:36.080914 22897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 339) took 1740 ms (client timeout 1614 ms). Trace:
W20260709 12:16:36.081398 22897 rpcz_store.cc:269] 0709 12:16:34.340837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:34.424470 (+ 83633us) service_pool.cc:224] Handling call
0709 12:16:36.080673 (+1656203us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54006ea854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:36.080832 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2890695936}
I20260709 12:16:36.081971 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:36.080679 22892 rpcz_store.cc:276] 0709 12:16:34.048424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:34.110679 (+ 62255us) service_pool.cc:224] Handling call
0709 12:16:34.124654 (+ 13975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.555009 (+1430355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.077731 (+522722us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000ed154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:36.080105 (+  2374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3197288192}
I20260709 12:16:36.084956 24870 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:36.089234 24875 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:36.091745 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 54832.3us
I20260709 12:16:36.091842 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:36.103403 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.111552 25138 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:36.126235 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 338) took 1902 ms. Trace:
I20260709 12:16:36.132355 22899 rpcz_store.cc:276] 0709 12:16:34.224223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.786454 (+1562231us) service_pool.cc:224] Handling call
0709 12:16:35.788518 (+  2064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:35.788916 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:35.788952 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:35.789768 (+   816us) log.cc:844] Serialized 26 byte log entry
0709 12:16:36.009666 (+219898us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:36.009717 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.009823 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:36.125898 (+116075us) raft_consensus.cc:1685] finished
0709 12:16:36.125925 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.126120 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":219328,"threads_started":1,"wal-append.queue_time_us":309916}
W20260709 12:16:36.105796 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 191083us
I20260709 12:16:36.096451 24870 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:36.065075 24730 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:36.150472 24730 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:36.157104 22751 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:36.154323 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.099288 25041 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:36.104144 24884 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:36.158730 22746 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:36.155478 22822 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
W20260709 12:16:36.164680 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 60110.4us
W20260709 12:16:36.168692 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 93397.1us
I20260709 12:16:36.169147 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:36.173475 22717 leader_election.cc:400] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7.
I20260709 12:16:36.181349 22717 leader_election.cc:403] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:16:36.166460 24870 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:36.185914 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.190376 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.191243 22751 raft_consensus.cc:2410] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:16:36.191311 22819 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:16:36.192476 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.194123 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:36.197013 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.198616 22746 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:16:36.198956 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58728.1us
I20260709 12:16:36.188416 24893 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:36.202716 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:36.193912 25013 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:36.204877 24949 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:36.205554 24949 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:36.204239 22745 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:36.205224 25013 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:36.206053 24893 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:36.206652 24949 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:36.205446 24649 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7.
I20260709 12:16:36.214097 24884 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:36.215273 24870 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:36.216818 23494 leader_election.cc:400] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5.
I20260709 12:16:36.215308 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:36.220182 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.220364 23494 leader_election.cc:403] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:36.220584 22823 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:36.215837 24744 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:16:36.221740 22745 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:36.224548 22746 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:36.225638 25053 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:36.227116 25100 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5.
I20260709 12:16:36.228436 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:36.228922 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:36.230051 25100 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:36.230634 25100 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:36.209187 25039 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:36.224175 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.219648 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:36.231722 25100 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:36.234623 24875 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:36.238325 25013 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:36.238348 25136 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:36.243041 24875 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.244593 24875 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:36.250984 25056 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:36.241072 24893 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:36.268517 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.230527 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:36.246285 25039 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.270117 25056 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:36.272585 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:36.275179 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:36.274966 25056 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:36.246038 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.253891 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:36.269471 22820 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:36.249943 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.267735 22790 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:36.278383 22751 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
W20260709 12:16:36.254855 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 82646.2us
W20260709 12:16:36.219260 25012 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.069s	user 0.031s	sys 0.055s
W20260709 12:16:36.255447 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 120100us
I20260709 12:16:36.278019 22823 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:16:36.220229 25107 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:36.280473 25012 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.260s	user 0.031s	sys 0.056s
I20260709 12:16:36.296265 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:36.292938 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 59811.8us
I20260709 12:16:36.280406 25039 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:36.256093 25133 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:36.301635 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47846us
I20260709 12:16:36.303164 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:36.310178 24904 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:36.313083 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:36.310766 24904 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:36.307807 24884 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:36.323597 24948 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:16:36.327078 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 96707.7us
I20260709 12:16:36.328190 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:36.329248 24886 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:36.330101 24891 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:36.330299 22864 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:36.330813 24891 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:36.331926 24891 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:36.333321 25055 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:36.333828 25055 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.334214 25055 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:36.335793 23689 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:36.315374 25013 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:16:36.337092 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:36.318614 25041 consensus_queue.cc:1059] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:16:36.338480 24617 raft_consensus.cc:3055] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:36.338920 24617 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:36.340039 22790 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:36.339946 24617 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:36.323747 24884 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:36.341107 24617 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:36.341764 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:36.301951 24893 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:16:36.343436 24744 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:36.333556 22864 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:36.313819 25063 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:36.313678 25107 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:36.348516 23660 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:36.317256 24904 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:36.341845 24884 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:36.320124 24850 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:36.357760 25044 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:16:36.368126 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:36.372439 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 69351.7us
I20260709 12:16:36.370496 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:36.353451 24886 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:36.349005 25063 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:36.352752 24888 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:36.353055 25053 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:16:36.391047 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.387413 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:36.393005 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:36.360193 25107 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:36.409516 25100 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:16:36.415104 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56768.8us
I20260709 12:16:36.415892 25012 raft_consensus.cc:2764] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:16:36.405138 25107 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:36.440124 25157 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:16:36.439690 22576 catalog_manager.cc:5697] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 3 to 5, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 5 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:16:36.403434 25053 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:36.441326 25053 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:36.388392 25156 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:16:36.441437 22576 catalog_manager.cc:5697] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.443193 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:36.443679 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:36.398469 24888 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:36.445763 22791 leader_election.cc:400] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
I20260709 12:16:36.445969 24888 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:36.446134 22791 leader_election.cc:403] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:16:36.447367 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:36.448836 24893 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:36.450273 25100 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:36.450734 25100 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:36.386955 24886 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.426725 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:36.435030 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:36.435513 24875 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:36.437937 22574 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57362 (request call id 54) took 18526 ms (client timeout 15000 ms). Trace:
I20260709 12:16:36.428488 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:36.381052 25096 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:36.389582 24870 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:16:36.460965 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 116568us
W20260709 12:16:36.461421 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.398238 25063 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:36.472059 23685 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:36.483676 23659 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:36.486119 22576 catalog_manager.cc:5697] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 3 to 4, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:16:36.463464 24886 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:36.487182 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:36.454819 24893 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:36.488165 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:36.488312 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:36.489163 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 43608.1us
I20260709 12:16:36.490617 23660 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:36.491600 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:36.492612 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:36.494120 25012 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
I20260709 12:16:36.495695 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:36.496665 22894 raft_consensus.cc:2393] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:36.505756 24904 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:36.506140 25055 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:36.464110 25100 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:36.472425 25096 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.510389 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:36.492796 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 122465us
I20260709 12:16:36.507287 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:36.516148 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.517544 23672 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:16:36.530434 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46831.8us
I20260709 12:16:36.531841 25094 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:36.532665 22791 leader_election.cc:400] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
I20260709 12:16:36.533282 22791 leader_election.cc:403] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:36.506810 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:36.513170 22576 catalog_manager.cc:5697] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 1 to 5, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 5 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:16:36.478255 24850 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:36.543579 22899 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:36.508275 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:36.507798 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:36.547276 22892 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:36.545269 22897 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:36.566215 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:36.489187 24915 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:36.572561 22898 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:36.553399 22576 catalog_manager.cc:5697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 3 to 4, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 4 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.557678 22893 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:36.533213 25096 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:16:36.571132 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 116817us
I20260709 12:16:36.532581 25094 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:36.508083 24875 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:36.565500 24900 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:16:36.565208 24897 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:16:36.583021 24888 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:36.583644 25161 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.245s	user 0.000s	sys 0.002s
I20260709 12:16:36.584146 25055 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:36.587075 25012 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:16:36.589258 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.574812 24915 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.550239 25136 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:16:36.579102 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:36.600666 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:36.605708 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:36.610221 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 77737.6us
I20260709 12:16:36.589408 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:36.620240 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 141129us
I20260709 12:16:36.625983 22576 catalog_manager.cc:5697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.620266 24744 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
I20260709 12:16:36.643580 25041 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:36.647606 23660 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: []
W20260709 12:16:36.463672 22574 rpcz_store.cc:269] 0709 12:16:17.911912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.912244 (+   332us) service_pool.cc:224] Handling call
0709 12:16:36.437655 (+18525411us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:27.785254 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:27.973519 (+188265us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:27.996824 (+ 23305us) write_op.cc:435] Acquired schema lock
0709 12:16:28.001716 (+  4892us) tablet.cc:662] Decoding operations
0709 12:16:28.392839 (+391123us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:28.416162 (+ 23323us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:28.423445 (+  7283us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:16:28.519088 (+ 95643us) tablet.cc:701] Row locks acquired
0709 12:16:28.519150 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:16:28.519375 (+   225us) write_op.cc:270] Start()
0709 12:16:28.519572 (+   197us) write_op.cc:276] Timestamp: P: 1783599388519289 usec, L: 0
0709 12:16:28.519614 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:16:28.520517 (+   903us) log.cc:844] Serialized 3281 byte log entry
0709 12:16:30.240303 (+1719786us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf16750ac 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b
0709 12:16:30.577443 (+337140us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:31.395065 (+817622us) op_driver.cc:464] REPLICATION: finished
0709 12:16:31.943010 (+547945us) write_op.cc:301] APPLY: starting
0709 12:16:31.988559 (+ 45549us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:32.071670 (+ 83111us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:32.103807 (+ 32137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:33.163611 (+1059804us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5c0047068c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa971331 00007fadfa971221 00007fadfa96bf6c 00007fadf80cc30b 00007fadf80cbfd3 00007fadf81cae34 00007fadf81b697c 00007fadf81bad61 00007fadf81bad19 00007fadf81baca9 00007fadf81bac71
0709 12:16:33.882606 (+718995us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:33.945716 (+ 63110us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:16:33.955323 (+  9607us) write_op.cc:312] APPLY: finished
0709 12:16:34.079993 (+124670us) log.cc:844] Serialized 64 byte log entry
0709 12:16:34.440238 (+360245us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf16750ac 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b
0709 12:16:35.147727 (+707489us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:35.178736 (+ 31009us) write_op.cc:454] Released schema lock
0709 12:16:35.187257 (+  8521us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:35.206021 (+ 18764us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:35.208579 (+  2558us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4362692,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":528582,"apply.run_cpu_time_us":49444,"apply.run_wall_time_us":3265573,"num_ops":8,"prepare.queue_time_us":556595,"prepare.run_cpu_time_us":43450,"prepare.run_wall_time_us":2773074,"raft.queue_time_us":698485,"raft.run_cpu_time_us":19862,"raft.run_wall_time_us":265845,"replication_time_us":2875288,"spinlock_wait_cycles":86122880,"thread_start_us":3814400,"threads_started":5,"wal-append.queue_time_us":2996492,"wal-append.run_cpu_time_us":25782,"wal-append.run_wall_time_us":2776817}]]}
W20260709 12:16:36.649570 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 117013us
I20260709 12:16:36.620945 24915 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:36.651238 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:36.652733 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:36.653416 23689 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:36.650794 25100 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:36.656224 24888 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:36.659152 25039 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:36.661978 25039 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:36.626248 24617 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:36.663304 24617 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:36.665961 24617 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:36.667081 25055 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:16:36.671271 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 47956.4us
I20260709 12:16:36.672117 25053 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:36.673503 25012 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.675024 24888 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:36.675148 24893 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:36.679805 25094 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:36.671456 24904 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:36.683972 22790 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:36.688717 24897 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:36.689363 24897 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:36.674167 25012 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:36.689849 24897 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:36.691962 25012 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:36.692629 22751 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:36.694344 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:36.695300 22748 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:36.685204 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 133019us
I20260709 12:16:36.700078 22864 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:36.701453 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:36.701758 25055 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:36.650867 22791 leader_election.cc:400] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
I20260709 12:16:36.702502 25055 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:36.703234 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.703877 22751 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:36.703877 25055 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:36.709158 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 119916us
I20260709 12:16:36.710263 23493 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:36.713320 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.715181 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:36.717756 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.718544 22746 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:36.557994 24850 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:36.721971 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:36.732601 23689 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:36.744176 22576 catalog_manager.cc:5697] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 2 to 5, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 5 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.747658 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:36.750026 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 48689.9us
I20260709 12:16:36.750866 22864 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:36.752995 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:36.755106 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:36.756409 22864 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:36.758219 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:36.775560 22748 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:36.767722 22576 catalog_manager.cc:5697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.662184 24886 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:36.780982 22864 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:36.759461 22865 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.770s (SENT)
W20260709 12:16:36.789192 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 152264us
I20260709 12:16:36.795447 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.795866 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.794449 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:36.800547 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 372550us
I20260709 12:16:36.797710 24948 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:36.802772 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.803514 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.803628 22820 raft_consensus.cc:2393] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:16:36.798431 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.774493 25056 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:36.815382 22827 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:16:36.815680 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 105548us
I20260709 12:16:36.818188 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.779273 25107 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.803043 22576 catalog_manager.cc:5697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 5 to 6, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 6 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:16:36.779160 24949 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:36.831151 24904 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:36.831215 25167 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:36.831715 24904 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:36.832185 24904 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:36.832703 24886 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:36.819247 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:36.826329 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.828418 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.830562 22576 catalog_manager.cc:5697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 4 to 5, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 5 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
W20260709 12:16:36.844854 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 194216us
I20260709 12:16:36.791965 25169 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:36.840677 22576 catalog_manager.cc:5697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:16:36.824457 25056 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.823894 25053 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:36.852699 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.864328 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.865509 22820 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:36.868049 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.798430 24870 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:16:36.831279 24949 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:36.870323 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 110921us
I20260709 12:16:36.871168 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:36.875787 22576 catalog_manager.cc:5697] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 4 to 5, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 5 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.877606 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:36.877826 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 96935.6us
I20260709 12:16:36.849535 25133 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.855052 25169 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.863298 25056 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:36.888809 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.889035 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:36.889055 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:36.842844 25107 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:36.894389 22748 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:36.882298 24949 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:36.900345 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:36.908797 22747 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:36.858951 25168 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:36.862479 25096 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:36.930303 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:36.931789 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:36.919886 22576 catalog_manager.cc:5697] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 3 to 4, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 4 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:16:36.937101 22900 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:16:36.887547 25169 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:36.947373 22821 raft_consensus.cc:2376] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9. Re-sending same reply.
I20260709 12:16:36.899663 25138 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:36.900785 24730 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:36.955044 22790 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:36.959236 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 58287.4us
I20260709 12:16:36.959731 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:36.961145 22822 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:36.896970 25133 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:36.972692 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:36.907018 24744 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:16:36.931228 25053 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:16:36.982853 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.982800 22748 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:36.956830 25138 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:36.958628 24730 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:36.990285 22865 leader_election.cc:336] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 2.124s (SENT)
I20260709 12:16:36.999897 22576 catalog_manager.cc:5697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 3 to 4, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 4 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:16:37.000841 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:36.969967 24948 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:36.950402 24897 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:36.951015 25013 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:16:36.996001 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:37.010825 22747 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:36.956352 24891 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:16:37.014947 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:36.996469 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:36.996551 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 110193us
I20260709 12:16:36.997797 25138 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:37.001866 22576 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:37.031002 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:37.009176 22751 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:36.999411 22864 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:37.028406 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:37.029398 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:36.991291 24875 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:37.037606 22899 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:37.012746 25063 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.500s	user 0.013s	sys 0.000s
I20260709 12:16:37.033152 22897 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:37.039014 22900 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:37.040077 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:37.042330 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:37.030267 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:37.047652 22747 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:37.048192 22751 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:36.987454 24888 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:37.049389 22576 catalog_manager.cc:5697] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 2 to 3, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 3 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:37.095979 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.053982 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:37.110952 24850 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:37.114395 25107 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:37.105193 25063 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:37.115737 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:37.115994 22894 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:37.117249 25063 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:37.118889 25096 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:37.039649 24875 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:37.121472 22751 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:37.122083 24875 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:37.125613 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 135376us
I20260709 12:16:37.128052 24850 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:37.126169 24875 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:37.129436 24850 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:37.133905 25177 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:16:37.134011 25063 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:37.134935 25063 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:37.134972 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 81503.4us
I20260709 12:16:37.137880 25133 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:37.138190 25180 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:37.139014 24886 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:16:37.142030 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:37.154593 22824 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 5: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:37.011961 24948 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:37.156455 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 188907us
I20260709 12:16:37.157406 22746 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:37.160548 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:37.140143 24886 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:37.052649 25012 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:37.167304 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:37.010959 24730 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:37.168947 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:37.197265 22746 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:37.198477 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:37.197762 24888 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.167995 22899 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:37.205173 22822 raft_consensus.cc:2376] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6. Re-sending same reply.
I20260709 12:16:37.205480 24888 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:37.205989 22898 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 12:16:37.047967 24870 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:37.207811 22819 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:16:37.208124 22827 raft_consensus.cc:2410] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:16:37.207563 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:37.209144 22823 raft_consensus.cc:2376] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5. Re-sending same reply.
I20260709 12:16:37.105635 24649 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:37.209952 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:37.158138 24915 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.002s
I20260709 12:16:37.164462 24948 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:37.221769 22821 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:37.222259 22826 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:37.208374 22819 pending_rounds.cc:85] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 3
I20260709 12:16:37.163615 25167 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.040009 24891 consensus_queue.cc:1243] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:37.166047 24886 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:37.029098 25182 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.195s
W20260709 12:16:37.240576 22865 leader_election.cc:336] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.858s (SENT)
W20260709 12:16:37.241070 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 244688us
W20260709 12:16:37.275432 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 48567us
I20260709 12:16:37.216679 24870 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:37.200594 25136 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.231485 22819 pending_rounds.cc:107] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:16:37.137415 25063 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:37.305507 22819 raft_consensus.cc:2889] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:37.293975 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:37.010133 25172 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.373s
I20260709 12:16:37.166986 24904 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:37.240898 25012 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:37.257989 24649 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:37.237612 25094 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:16:37.226727 25044 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
W20260709 12:16:37.310629 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 70076.4us
W20260709 12:16:37.317350 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.224851 24915 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:37.349526 25176 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:16:37.351435 24886 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:37.353032 24886 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:37.353932 22745 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:16:37.350445 24915 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:37.339099 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:37.342482 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:37.341950 24649 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:37.344872 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:37.347133 24870 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:37.347879 25044 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:16:37.330133 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 289566us
I20260709 12:16:37.241503 25167 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:37.379940 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:37.396903 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 80657.5us
I20260709 12:16:37.418239 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:37.414261 25133 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:37.423864 25133 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:37.424315 25133 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:37.429430 22900 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:37.431185 25182 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:37.431730 25182 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:37.432157 25182 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:37.432714 24904 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:37.433501 24904 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:37.311544 25136 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:37.431170 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:37.442685 22746 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:16:37.518000 22899 raft_consensus.cc:2410] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:16:37.517457 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:37.523854 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:37.523132 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 53800.3us
I20260709 12:16:37.421240 25107 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:37.528323 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 183509us
W20260709 12:16:37.536369 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 197378us
I20260709 12:16:37.414363 25053 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.118s
I20260709 12:16:37.605455 25173 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:37.609805 24897 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:37.616102 25173 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:37.536444 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 118349us
I20260709 12:16:37.617159 25173 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:37.617910 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:37.618355 25173 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:37.603384 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:37.617173 25053 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:37.533066 24949 consensus_meta.cc:287] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.000s
W20260709 12:16:37.533999 25100 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.878s	user 0.008s	sys 0.005s
W20260709 12:16:37.647317 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.528434 24875 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:37.528615 24891 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:37.666620 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 235549us
I20260709 12:16:37.630295 25172 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:37.678544 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:37.679931 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:37.672717 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:37.691685 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:37.692658 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:37.695672 23659 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:37.692229 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:37.697561 23679 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:37.685799 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:16:37.683363 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 65587.5us
I20260709 12:16:37.697585 23672 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:37.572777 25107 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:37.704555 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:37.706499 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:37.713224 23656 raft_consensus.cc:2376] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5. Re-sending same reply.
I20260709 12:16:37.647248 24904 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:37.717382 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.725139 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:37.725163 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:37.718051 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.726994 23689 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:37.729421 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:37.730060 22823 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:37.722050 25197 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
I20260709 12:16:37.693305 25172 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:37.722494 25190 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.302s	user 0.000s	sys 0.000s
I20260709 12:16:37.683490 24875 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:37.748827 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:37.723879 25193 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.746235 22825 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:16:37.722572 25185 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:16:37.753466 22820 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:37.656630 24949 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:37.745374 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 60825.4us
I20260709 12:16:37.769356 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:37.736579 25039 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:37.570091 25012 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:37.788216 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:37.788434 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:37.789157 23689 raft_consensus.cc:2368] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
W20260709 12:16:37.746695 24888 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.002s
I20260709 12:16:37.724334 25178 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:37.754526 25172 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:37.741210 25100 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:16:37.794891 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.681963 24891 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:37.757650 25138 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.704s	user 0.007s	sys 0.005s
I20260709 12:16:37.795825 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:37.730070 23660 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:37.805728 22899 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:37.794435 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:37.817251 22900 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:37.764811 25154 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:37.818482 22901 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260709 12:16:37.826395 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 406837us
I20260709 12:16:37.790393 25039 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.830466 22823 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:37.741957 24904 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:37.830330 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:37.830750 25041 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.186s	user 0.013s	sys 0.004s
I20260709 12:16:37.837518 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:37.812417 24617 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:37.814640 25100 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:37.851920 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:37.855769 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 60054.5us
W20260709 12:16:37.860039 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 111368us
I20260709 12:16:37.863023 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:37.840893 25208 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:37.839534 25039 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:37.789142 25193 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:37.808193 24888 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:37.865386 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 591) took 1090 ms. Trace:
I20260709 12:16:37.839834 24850 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:37.844264 25041 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:37.860623 25100 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:37.823007 25138 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:37.871299 22749 rpcz_store.cc:276] 0709 12:16:36.769403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.769587 (+   184us) service_pool.cc:224] Handling call
0709 12:16:36.770072 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:36.814603 (+ 44531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.814660 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:36.830380 (+ 15720us) log.cc:844] Serialized 26 byte log entry
0709 12:16:37.216419 (+386039us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:37.216475 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.216559 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:37.721769 (+505210us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:37.853798 (+132029us) raft_consensus.cc:1685] finished
0709 12:16:37.853826 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.859355 (+  5529us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27130,"raft.queue_time_us":27837,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":14698,"spinlock_wait_cycles":526275456,"thread_start_us":368519,"threads_started":1,"wal-append.queue_time_us":473566}
I20260709 12:16:37.882939 22894 pending_rounds.cc:85] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 3
I20260709 12:16:37.863481 25167 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:37.858404 24744 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:37.886686 22823 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:37.888316 22894 pending_rounds.cc:107] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:16:37.892678 22894 raft_consensus.cc:2889] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:37.892943 23660 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:37.868706 25208 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.883499 23689 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:16:37.892967 22791 leader_election.cc:336] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 1.508s (SENT)
I20260709 12:16:37.832660 25178 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:37.903005 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:16:37.903417 25219 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:16:37.947871 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:37.899586 25208 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:37.868917 24875 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:37.901508 24744 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:37.996759 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:37.997536 22749 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:37.976254 25056 consensus_meta.cc:287] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.048s	user 0.004s	sys 0.011s
I20260709 12:16:38.004364 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:37.950371 25216 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:38.015851 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 122887us
I20260709 12:16:38.022372 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:38.023101 22750 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:38.025244 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:38.023128 23689 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:38.027647 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:38.027647 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:38.035462 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.036470 23660 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:16:38.048575 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 176726us
I20260709 12:16:38.094373 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:38.038012 24949 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:38.005133 25056 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:38.098235 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 45903.8us
I20260709 12:16:38.102883 23659 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:16:38.056422 24617 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:38.062284 25053 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:38.106325 23660 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:16:38.099327 25235 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:38.119050 22896 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:16:38.122001 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 94434us
W20260709 12:16:38.105265 25196 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
W20260709 12:16:38.110915 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 322770us
I20260709 12:16:38.137892 22822 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:16:38.099761 25169 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.130s	user 0.013s	sys 0.000s
I20260709 12:16:38.152253 23689 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:38.021965 25216 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:38.157951 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.162150 22895 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:16:38.158505 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:38.162317 23660 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:38.163028 22825 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:38.119141 25212 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:38.175681 24889 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:16:38.176292 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:38.176894 25222 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:16:38.178397 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.183439 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:38.154728 24904 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:38.163579 24949 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:16:38.169375 24870 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:38.165001 25203 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:38.173622 25138 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:38.169778 25193 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:38.216249 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 612) took 1213 ms. Trace:
W20260709 12:16:38.218163 25201 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.226s	user 0.000s	sys 0.002s
I20260709 12:16:38.160465 25169 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:38.212957 25218 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:16:38.251760 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 57556.7us
I20260709 12:16:38.253501 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:38.256790 22900 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:38.214561 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:38.205024 25178 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:38.227890 25220 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:16:38.188181 25212 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:38.275653 24948 consensus_meta.cc:287] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.985s	user 0.010s	sys 0.005s
W20260709 12:16:38.277594 25225 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
I20260709 12:16:38.278302 25212 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:38.231720 25056 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:38.232514 25169 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:38.233675 25173 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.002s
W20260709 12:16:38.216614 25210 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.219s	user 0.000s	sys 0.002s
I20260709 12:16:38.280277 24888 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:38.281589 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 608) took 1328 ms. Trace:
I20260709 12:16:38.211352 25235 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.282809 25235 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:38.285991 25235 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:38.211648 25203 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:38.277709 24948 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:38.235493 25200 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 12:16:38.235693 25211 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.241s	user 0.002s	sys 0.000s
I20260709 12:16:38.289064 25240 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:38.289448 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 358) took 1249 ms. Trace:
I20260709 12:16:38.289783 25240 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:38.177390 25224 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 12:16:38.236231 25205 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.240744 22749 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
W20260709 12:16:38.241940 25133 consensus_meta.cc:287] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.817s	user 0.008s	sys 0.004s
I20260709 12:16:38.219125 25221 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:38.219374 24617 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:38.245752 25242 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:38.235103 25204 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
W20260709 12:16:38.251200 25227 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.144s	user 0.000s	sys 0.002s
I20260709 12:16:38.217432 22892 rpcz_store.cc:276] 0709 12:16:37.003100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.003327 (+   227us) service_pool.cc:224] Handling call
0709 12:16:37.029514 (+ 26187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:37.038522 (+  9008us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:16:37.038555 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:37.136380 (+ 97825us) log.cc:844] Serialized 26 byte log entry
0709 12:16:37.516002 (+379622us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:37.516104 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.516248 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:38.215998 (+699750us) raft_consensus.cc:1685] finished
0709 12:16:38.216017 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.216181 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25344,"thread_start_us":309299,"threads_started":1,"wal-append.queue_time_us":529916}
I20260709 12:16:38.273135 23672 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:38.274982 25216 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:38.287335 25203 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:38.290642 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 765) took 1406 ms. Trace:
I20260709 12:16:38.303838 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 356) took 1291 ms. Trace:
W20260709 12:16:38.249305 24886 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.896s	user 0.013s	sys 0.000s
W20260709 12:16:38.242676 25182 consensus_meta.cc:287] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.810s	user 0.013s	sys 0.000s
I20260709 12:16:38.321442 22745 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:38.323700 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.321951 22896 rpcz_store.cc:276] 0709 12:16:37.012195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.029845 (+ 17650us) service_pool.cc:224] Handling call
0709 12:16:37.125874 (+ 96029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.131980 (+1006106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.303480 (+171500us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54002fe4d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:38.303748 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2283100544}
W20260709 12:16:38.343989 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 126010us
W20260709 12:16:38.331400 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 58518.8us
I20260709 12:16:38.350978 23685 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:38.357758 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:38.290380 25240 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:38.282094 22893 rpcz_store.cc:276] 0709 12:16:36.953175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.953545 (+   370us) service_pool.cc:224] Handling call
0709 12:16:36.969472 (+ 15927us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:36.986240 (+ 16768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.986291 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:37.425135 (+438844us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b2c001e6a18. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:16:37.425812 (+   677us) log.cc:844] Serialized 52 byte log entry
0709 12:16:37.610554 (+184742us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:37.825645 (+215091us) log.cc:844] Serialized 14 byte log entry
0709 12:16:37.828888 (+  3243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.828990 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:38.281142 (+452152us) raft_consensus.cc:1685] finished
0709 12:16:38.281286 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.281504 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6768,"prepare.queue_time_us":264223,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":7111,"raft.run_cpu_time_us":525,"raft.run_wall_time_us":50483,"spinlock_wait_cycles":39761792,"thread_start_us":311926,"threads_started":2,"wal-append.queue_time_us":314483}
I20260709 12:16:38.298769 22899 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:16:38.307979 24870 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:16:38.292615 24730 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.066s	user 0.015s	sys 0.000s
W20260709 12:16:38.307758 25195 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.883s	user 0.003s	sys 0.001s
W20260709 12:16:38.308916 25187 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.676s	user 0.000s	sys 0.002s
W20260709 12:16:38.316572 25192 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.914s	user 0.004s	sys 0.000s
I20260709 12:16:38.355084 25107 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:38.295755 24893 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:38.369787 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 611) took 1390 ms. Trace:
I20260709 12:16:38.295744 24744 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:38.400261 22893 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:16:38.322693 22820 rpcz_store.cc:276] 0709 12:16:36.884585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.884913 (+   328us) service_pool.cc:224] Handling call
0709 12:16:37.742209 (+857296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:37.765688 (+ 23479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.290414 (+524726us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54007a1a50. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:38.290575 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970592000}
I20260709 12:16:38.354664 25242 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:38.354843 25133 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:38.233553 25214 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.255s
I20260709 12:16:38.305822 25239 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.300467 24891 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:38.387753 23689 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:16:38.389835 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.388891 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 596) took 1252 ms. Trace:
I20260709 12:16:38.391362 22896 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:38.352468 24948 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:38.407406 22751 rpcz_store.cc:276] 0709 12:16:37.137012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.159169 (+ 22157us) service_pool.cc:224] Handling call
0709 12:16:37.171481 (+ 12312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:37.172077 (+   596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.172153 (+    76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:37.209654 (+ 37501us) log.cc:844] Serialized 26 byte log entry
0709 12:16:37.611387 (+401733us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:37.611457 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.611582 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:38.388587 (+777005us) raft_consensus.cc:1685] finished
0709 12:16:38.388613 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.388816 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6198,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":21634,"thread_start_us":356551,"threads_started":1,"wal-append.queue_time_us":654388}
W20260709 12:16:38.389950 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 226759us
I20260709 12:16:38.290107 22897 rpcz_store.cc:276] 0709 12:16:37.040486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.116829 (+ 76343us) service_pool.cc:224] Handling call
0709 12:16:37.117182 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:37.166514 (+ 49332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.166547 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:37.224862 (+ 58315us) log.cc:844] Serialized 26 byte log entry
0709 12:16:37.518838 (+293976us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:37.518883 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.518973 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:38.289154 (+770181us) raft_consensus.cc:1685] finished
0709 12:16:38.289177 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.289372 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46948,"raft.queue_time_us":49025,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":37613,"thread_start_us":210682,"threads_started":1,"wal-append.queue_time_us":521826}
W20260709 12:16:38.394198 22790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.006s	sys 0.007s
I20260709 12:16:38.308176 25056 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
W20260709 12:16:38.365433 25172 consensus_meta.cc:287] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.543s	user 0.014s	sys 0.000s
I20260709 12:16:38.395928 22901 rpcz_store.cc:276] 0709 12:16:36.979171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.979484 (+   313us) service_pool.cc:224] Handling call
0709 12:16:36.995351 (+ 15867us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:37.825861 (+830510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.369449 (+543588us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54004b6ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:38.369725 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880886016}
W20260709 12:16:38.416570 22790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.006s	sys 0.007s
I20260709 12:16:38.318212 25039 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:38.371017 25180 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:38.404021 22892 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:38.404449 22899 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:16:38.361503 25221 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:38.418800 23659 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:38.395541 24893 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:38.355804 25205 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:38.428103 22790 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:38.429128 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:38.430503 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:38.415997 25044 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.015s
I20260709 12:16:38.391395 24730 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:38.485271 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55878.5us
I20260709 12:16:38.490731 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:38.491568 22749 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:38.443228 23689 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:38.496790 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:38.497545 24889 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:38.448276 25248 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:38.498170 25218 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:38.499584 25207 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:38.500558 25207 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:38.502490 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:38.503501 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:38.418357 25209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.008s	sys 0.008s
I20260709 12:16:38.449474 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:38.507120 22894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.004s	sys 0.021s
I20260709 12:16:38.507651 23656 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:38.450693 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.451236 25241 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:38.415409 25239 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:38.451785 24886 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:16:38.452401 24870 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:16:38.454273 25100 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.000s
I20260709 12:16:38.456108 25242 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:38.456975 25244 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:38.458029 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.458753 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:38.364559 25182 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:38.463660 24949 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.466005 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:38.466958 22826 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:38.470988 24888 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:16:38.471833 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:38.423676 24649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.022s
I20260709 12:16:38.476012 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 613) took 1460 ms. Trace:
I20260709 12:16:38.496912 22822 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:38.449920 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.550940 23695 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
W20260709 12:16:38.508566 22894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.004s	sys 0.022s
I20260709 12:16:38.456171 25136 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:38.431731 25094 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:38.443198 25044 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.002s	sys 0.015s
I20260709 12:16:38.513126 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:38.514075 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:38.494086 25212 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:16:38.516948 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:38.517326 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:38.518858 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:38.589448 22745 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:38.524300 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:38.525835 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:38.526029 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:38.526400 22818 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:16:38.548475 24649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.001s	sys 0.026s
I20260709 12:16:38.591713 23674 raft_consensus.cc:2376] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4. Re-sending same reply.
I20260709 12:16:38.518860 22749 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:38.533388 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 586) took 1809 ms. Trace:
I20260709 12:16:38.499962 25218 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:16:38.597864 22749 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:38.599423 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:38.600201 22822 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:38.516983 25167 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:16:38.600337 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:38.601492 22823 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
W20260709 12:16:38.511482 25209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.009s	sys 0.009s
I20260709 12:16:38.603513 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:38.604288 23672 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:38.592934 22752 rpcz_store.cc:276] 0709 12:16:36.724286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.724402 (+   116us) service_pool.cc:224] Handling call
0709 12:16:36.779463 (+ 55061us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:36.827929 (+ 48466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.827961 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:36.858356 (+ 30395us) log.cc:844] Serialized 26 byte log entry
0709 12:16:36.984063 (+125707us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:36.984111 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.984193 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:38.308091 (+1323898us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:38.518233 (+210142us) raft_consensus.cc:1685] finished
0709 12:16:38.518261 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.533308 (+ 15047us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40822,"raft.queue_time_us":57153,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6849,"spinlock_wait_cycles":64219008,"thread_start_us":94023,"threads_started":1,"wal-append.queue_time_us":536933}
I20260709 12:16:38.534624 22821 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:16:38.519666 23679 raft_consensus.cc:2376] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5. Re-sending same reply.
I20260709 12:16:38.536453 22824 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:38.609169 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:38.610070 22821 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:16:38.538019 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 72084.1us
I20260709 12:16:38.611685 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.612653 23682 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:38.613919 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:38.545418 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.615272 23685 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:38.534989 22826 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:38.546763 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.532624 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:38.619282 22752 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:16:38.619499 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 86975.2us
I20260709 12:16:38.621434 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:38.548573 22895 rpcz_store.cc:276] 0709 12:16:37.015915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.016228 (+   313us) service_pool.cc:224] Handling call
0709 12:16:37.016670 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.162755 (+1146085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.475614 (+312859us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54005a0854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:38.475927 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618576640}
I20260709 12:16:38.512933 25180 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.558911 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.511518 25207 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:38.424001 25172 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:38.564621 23659 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:16:38.580086 22744 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:38.449354 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:38.585002 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:38.607532 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:38.586207 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:38.590914 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:38.531072 25168 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:16:38.555450 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:38.643708 22747 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:38.663704 22747 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:38.657428 23689 raft_consensus.cc:2410] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:16:38.622457 25136 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:38.640159 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.559715 25248 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:38.659487 22896 raft_consensus.cc:2368] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8.
I20260709 12:16:38.637557 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:38.669714 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:38.657188 22750 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:38.662302 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48511.4us
W20260709 12:16:38.634248 25208 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.645s	user 0.005s	sys 0.007s
W20260709 12:16:38.666903 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 218439us
I20260709 12:16:38.676906 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:38.678052 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:38.670396 23695 raft_consensus.cc:2368] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
I20260709 12:16:38.672178 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:38.679263 22818 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:38.672973 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:38.532804 25100 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:38.583428 24888 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:38.622375 24617 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:38.548126 25235 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:16:38.716383 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.551374 24949 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:38.699441 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:38.625087 25039 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:38.602772 25164 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:38.631286 25205 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:38.632658 25133 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:38.635958 25063 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:38.706758 24900 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:38.667789 24948 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:16:38.714104 23660 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:38.625514 25239 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:38.711014 22747 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:38.776491 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:38.731633 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.736842 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:38.683743 24891 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:16:38.706727 25244 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:38.738103 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:38.624255 24730 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:38.587604 25094 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:38.754473 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.726894 25248 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:38.767208 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:38.706343 25136 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:38.742235 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:38.799629 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 61660.5us
I20260709 12:16:38.732288 24649 raft_consensus.cc:2764] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:16:38.777305 22892 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:38.785353 23689 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:16:38.692116 25252 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:38.793043 23659 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:38.631886 24893 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:38.796031 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.732951 25164 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:38.797109 23656 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:38.799373 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:38.799791 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:38.805883 23674 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:38.800606 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.670764 25180 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:38.809235 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.811615 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:38.812386 25136 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:38.813841 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:38.814913 24617 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:38.816579 25094 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:38.817605 24893 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:38.818394 25240 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:38.820061 24949 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:38.820866 25240 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:38.821722 24888 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:38.752512 25207 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:38.824052 25207 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:38.754590 25241 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.804651 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:38.695751 25208 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:38.796113 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:38.833770 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 366) took 1027 ms. Trace:
I20260709 12:16:38.827056 22751 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:38.827821 23494 leader_election.cc:400] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8.
I20260709 12:16:38.828084 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:38.624586 25221 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:38.826363 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:38.784528 25214 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.837680 23494 leader_election.cc:403] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:16:38.834561 22900 rpcz_store.cc:276] 0709 12:16:37.798604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.347446 (+548842us) service_pool.cc:224] Handling call
0709 12:16:38.348213 (+   767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.362692 (+ 14479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.362736 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:38.371000 (+  8264us) log.cc:844] Serialized 26 byte log entry
0709 12:16:38.578222 (+207222us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:38.578292 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.578382 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:38.825941 (+247559us) raft_consensus.cc:1685] finished
0709 12:16:38.825972 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.826173 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13927,"raft.queue_time_us":16658,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":21689,"thread_start_us":157230,"threads_started":1,"wal-append.queue_time_us":335701}
I20260709 12:16:38.834103 22745 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:38.791806 24904 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:38.797493 25244 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:38.849148 23672 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:38.849403 23674 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
W20260709 12:16:38.849978 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 95042.9us
I20260709 12:16:38.784977 25056 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:16:38.861564 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:38.862329 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:38.863366 23656 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:38.796674 25167 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:16:38.863492 22745 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:38.828758 25252 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:38.864184 22753 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:16:38.861383 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 128171us
W20260709 12:16:38.864835 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.830147 25133 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:38.844298 24617 consensus_queue.cc:1243] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:38.854725 25242 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:38.887869 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:38.856449 25244 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:38.879426 22864 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:38.885840 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:38.919586 22750 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:38.864573 25055 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.896349 24948 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.872066 25252 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:38.870229 25107 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8.
I20260709 12:16:38.929679 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:38.900540 22744 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 11: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:38.923323 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:38.916589 25182 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:38.950408 22824 raft_consensus.cc:2410] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:16:38.855458 25214 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:38.942359 25055 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:38.945839 25236 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:16:38.946403 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.950717 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:38.929366 25229 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.897712 25240 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:16:39.040283 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:39.046847 22750 raft_consensus.cc:2368] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8.
W20260709 12:16:39.035069 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 137791us
I20260709 12:16:38.897253 24850 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:16:38.867173 22893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:39.081279 22893 raft_consensus.cc:606] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:39.081776 22893 raft_consensus.cc:614] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:39.082747 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:39.083666 22744 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:39.084810 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:39.070434 25194 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:39.074055 25055 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:39.075320 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:39.076520 25056 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:39.037572 25236 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:38.929596 25259 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.408s
I20260709 12:16:38.917517 25248 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:38.956949 24948 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:39.398425 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:39.437640 25261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.019s	sys 0.051s
I20260709 12:16:39.437958 25194 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:16:39.440932 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 91056us
I20260709 12:16:39.485730 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:38.926306 25243 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.403s
I20260709 12:16:39.451186 22744 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:16:39.455230 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 61999.8us
I20260709 12:16:39.079968 25180 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:39.034402 25039 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.454210 25236 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:39.465200 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:39.466434 22866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.005s	sys 0.013s
I20260709 12:16:39.034683 25275 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.498s
W20260709 12:16:39.474690 22864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.003s	sys 0.019s
I20260709 12:16:39.372586 24888 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:39.511430 25270 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.573s	user 0.000s	sys 0.000s
I20260709 12:16:39.511139 24888 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:39.463132 25203 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.102s	user 0.016s	sys 0.005s
I20260709 12:16:39.442240 24891 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:39.454728 25056 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:39.501186 22866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.005s	sys 0.013s
I20260709 12:16:39.476099 25096 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:39.530342 25096 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:39.530959 25263 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.677s	user 0.002s	sys 0.000s
I20260709 12:16:39.501138 22750 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:39.491936 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:39.503175 22864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.004s	sys 0.019s
W20260709 12:16:39.532366 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 653056us
W20260709 12:16:39.533923 25260 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.647s	user 0.000s	sys 0.002s
W20260709 12:16:39.536811 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:39.504551 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:39.503186 25208 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:39.508304 24900 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:39.077550 25229 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:39.466714 25261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.019s	sys 0.052s
I20260709 12:16:38.839581 25241 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:39.586081 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 94207.9us
I20260709 12:16:39.589392 22744 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:39.605388 22744 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:39.550899 25213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.027s	sys 0.042s
I20260709 12:16:39.603680 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:39.609736 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:16:39.549691 25251 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:16:39.616963 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 747) took 1125 ms. Trace:
I20260709 12:16:39.514683 25039 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:39.621263 22749 rpcz_store.cc:276] 0709 12:16:38.491101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.598920 (+107819us) service_pool.cc:224] Handling call
0709 12:16:38.599294 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.610066 (+ 10772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.610106 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:38.610707 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:16:38.809190 (+198483us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:38.809296 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.809454 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:39.616606 (+807152us) raft_consensus.cc:1685] finished
0709 12:16:39.616638 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:39.616872 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9881,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":197841,"threads_started":1,"wal-append.queue_time_us":768596}
I20260709 12:16:39.626366 22749 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:39.558916 22826 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:39.623449 25265 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:16:39.580696 24891 consensus_queue.cc:1243] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:39.560359 25180 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:39.607821 25213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.027s	sys 0.043s
I20260709 12:16:39.559289 24900 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:39.532642 25203 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:39.560745 25243 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:39.607080 25107 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:39.646914 22826 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:39.649088 22744 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:16:39.658156 22818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.023s	sys 0.061s
W20260709 12:16:39.687623 22818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.024s	sys 0.061s
I20260709 12:16:39.690944 22744 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:39.671804 22750 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:39.551597 25096 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:39.686422 25107 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:39.704159 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 171075us
W20260709 12:16:39.700281 23493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.002s	sys 0.009s
I20260709 12:16:39.701071 25232 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:39.676060 24891 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:16:39.711817 23493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.002s	sys 0.010s
I20260709 12:16:39.695005 25284 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:39.718092 22744 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:39.712720 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 103061us
I20260709 12:16:39.666769 25180 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:39.699393 25214 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:39.714195 22820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.017s	sys 0.014s
I20260709 12:16:39.703593 25275 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:39.689493 25243 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:39.706121 25107 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:39.717363 22895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5444065d09a34471bca8963724a74d20"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:39.677608 25056 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:39.620508 25194 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:39.724675 22820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.017s	sys 0.015s
I20260709 12:16:39.713953 25232 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:39.717891 24891 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:39.729722 22744 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:39.729818 25272 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:16:39.730363 25283 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:39.731637 25203 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:39.731804 25229 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:39.723903 25284 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:39.714164 24948 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:39.737533 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 221633us
I20260709 12:16:39.744237 22826 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:16:39.723991 25096 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:39.751583 22746 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:16:39.755194 25241 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:39.755515 25039 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:39.861328 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:39.748685 24891 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:39.756819 25173 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:39.760212 25287 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:39.735769 25275 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:39.764178 24893 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.946s	user 0.009s	sys 0.005s
I20260709 12:16:39.746649 25232 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:39.743103 24888 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:39.765352 24850 raft_consensus.cc:3055] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:39.716056 25280 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:16:39.835299 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 304) took 2152 ms. Trace:
I20260709 12:16:39.805866 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 365) took 2040 ms. Trace:
W20260709 12:16:39.812405 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:39.813102 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 784) took 1194 ms. Trace:
I20260709 12:16:39.806679 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:39.789471 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:39.806648 22901 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:16:39.834324 24897 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:16:39.808825 25107 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:39.810098 25180 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:39.808825 25284 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:39.853185 25218 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.859154 24900 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:39.864876 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 153604us
I20260709 12:16:39.889780 25289 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:16:39.944773 22864 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:39.949273 22750 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:16:39.776408 25207 consensus_meta.cc:287] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.951s	user 0.009s	sys 0.006s
W20260709 12:16:39.950739 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:39.903509 22894 rpcz_store.cc:276] 0709 12:16:37.765546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.863811 (+ 98265us) service_pool.cc:224] Handling call
0709 12:16:37.879433 (+ 15622us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:37.903232 (+ 23799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.903277 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:37.904112 (+   835us) log.cc:844] Serialized 52 byte log entry
0709 12:16:38.553320 (+649208us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:38.698273 (+144953us) log.cc:844] Serialized 14 byte log entry
0709 12:16:38.733632 (+ 35359us) log.cc:844] Serialized 14 byte log entry
0709 12:16:38.785480 (+ 51848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.785561 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:39.772255 (+986694us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b180008f680. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:16:39.805537 (+ 33282us) raft_consensus.cc:1685] finished
0709 12:16:39.805574 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:39.805771 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80246,"prepare.queue_time_us":47360,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":102,"raft.queue_time_us":129641,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":211,"spinlock_wait_cycles":66321536,"thread_start_us":765517,"threads_started":2,"wal-append.queue_time_us":705563}
I20260709 12:16:39.880224 22744 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:16:39.811941 24870 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.770721 25100 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:39.805702 25291 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:39.902060 22826 rpcz_store.cc:276] 0709 12:16:37.663712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.664106 (+   394us) service_pool.cc:224] Handling call
0709 12:16:37.664518 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.466829 (+802311us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b540082b2a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf47811c0 00007fadf4782231 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c
0709 12:16:39.540677 (+1073848us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b4c0039ca80. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf2a4ba20 00007fadf2a5ca29 00007fadf2a22644 00007fadf2a49f2d 00007fadf2a49b93 00007fadf477a18b 00007fadf477acb5 00007fadf4775f30 00007fadf47777de 00007fadf4781b49 00007fadf4782416
0709 12:16:39.815438 (+274761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:39.815705 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294233344}
I20260709 12:16:39.873171 25221 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:16:39.906474 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:39.970188 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:39.923115 22895 raft_consensus.cc:606] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:39.971341 22895 raft_consensus.cc:614] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:39.869400 25173 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:39.905229 25214 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.953397 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 395) took 1178 ms. Trace:
I20260709 12:16:39.954625 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:39.903239 22818 rpcz_store.cc:276] 0709 12:16:38.618427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.693666 (+ 75239us) service_pool.cc:224] Handling call
0709 12:16:38.723162 (+ 29496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.748652 (+ 25490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.748711 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:38.749276 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:16:39.688137 (+938861us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:39.688201 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:39.688297 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:39.812745 (+124448us) raft_consensus.cc:1685] finished
0709 12:16:39.812794 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:39.813023 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33710,"raft.queue_time_us":25221,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":30491,"thread_start_us":857404,"threads_started":1,"wal-append.queue_time_us":943440}
I20260709 12:16:39.896600 24850 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:39.878134 25287 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:39.973209 22827 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:39.979120 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:40.014008 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:40.233546 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:39.972841 22744 rpcz_store.cc:276] 0709 12:16:38.775304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.613107 (+837803us) service_pool.cc:224] Handling call
0709 12:16:39.613452 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:39.953012 (+339560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:39.953321 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:40.228204 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:40.236205 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:40.237218 22744 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:40.229099 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:40.238685 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:40.244602 22744 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 9 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 12:16:40.232622 22826 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:40.238456 22750 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:39.962721 25284 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:40.304539 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:39.972043 25180 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:40.358952 22901 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:16:40.350942 25168 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.361631 25168 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:40.337783 25194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.010s	sys 0.015s
I20260709 12:16:40.261768 25287 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:39.963855 25218 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:40.376758 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.062s	sys 0.087s
W20260709 12:16:40.377370 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.062s	sys 0.087s
W20260709 12:16:40.377704 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 505676us
W20260709 12:16:40.341516 25278 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.009s	sys 0.006s
I20260709 12:16:39.967085 24870 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:40.227492 25214 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:40.376060 25194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.010s	sys 0.015s
I20260709 12:16:40.370003 25039 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.423146 22893 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:40.392436 25056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.007s	sys 0.015s
I20260709 12:16:40.414422 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:40.418056 22896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.089s	sys 0.139s
W20260709 12:16:40.385322 22820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.007s	sys 0.026s
I20260709 12:16:39.984609 25291 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:40.411768 22824 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.003s	sys 0.022s
W20260709 12:16:40.433144 22824 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.003s	sys 0.022s
W20260709 12:16:40.383176 25278 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.010s	sys 0.006s
W20260709 12:16:40.429008 22896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.089s	sys 0.140s
W20260709 12:16:40.428910 22820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.007s	sys 0.026s
I20260709 12:16:40.365000 25180 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:40.428254 25056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.007s	sys 0.016s
I20260709 12:16:40.422705 25243 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:40.451830 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:40.463088 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:40.462850 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:40.470711 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:40.472832 25289 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:40.486505 22893 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:40.433282 25039 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:40.440990 25207 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:16:40.414381 25173 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:40.488368 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:40.475775 25243 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:40.474751 25168 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:40.475904 25056 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:40.490146 25289 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:40.490031 25275 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:40.428916 24850 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:40.515470 25248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.012s	sys 0.009s
I20260709 12:16:40.532965 23695 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:40.533648 23695 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:40.518246 25107 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:40.518501 22825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.002s	sys 0.020s
W20260709 12:16:40.544200 22825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.002s	sys 0.020s
I20260709 12:16:40.544727 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:40.545626 22744 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:40.531311 25248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.013s	sys 0.009s
I20260709 12:16:40.428447 25213 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:16:40.526302 25306 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:40.446754 25298 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:16:40.529945 24900 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:40.535197 25275 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.617463 25248 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:40.695741 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 244006us
W20260709 12:16:40.705976 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 217694us
I20260709 12:16:40.706530 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:40.706975 23685 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 9 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 12:16:40.679984 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 590) took 2469 ms. Trace:
I20260709 12:16:40.546905 25221 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:40.620656 25218 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:40.600387 25296 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:16:40.231180 25228 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.134s
I20260709 12:16:40.539065 25173 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:40.541715 25216 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:40.699911 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 399) took 1843 ms. Trace:
I20260709 12:16:40.711525 22744 raft_consensus.cc:2410] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:16:40.626718 25096 consensus_meta.cc:287] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.763s	user 0.003s	sys 0.006s
I20260709 12:16:40.544286 24948 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:40.708590 23660 rpcz_store.cc:276] 0709 12:16:38.210744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.213327 (+  2583us) service_pool.cc:224] Handling call
0709 12:16:38.213728 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.768884 (+555156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.679529 (+1910645us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b540073cb54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:40.679853 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116663168}
W20260709 12:16:40.763726 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:40.627578 25303 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:16:40.639752 25299 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:16:40.524113 25056 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:40.529660 25243 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:40.648945 25308 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:16:40.628023 25295 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:16:40.671686 25305 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:16:40.620033 25236 consensus_meta.cc:287] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.080s	user 0.011s	sys 0.000s
I20260709 12:16:40.670717 25298 consensus_queue.cc:1243] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:40.770013 22749 rpcz_store.cc:276] 0709 12:16:38.856204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.627250 (+771046us) service_pool.cc:224] Handling call
0709 12:16:39.635966 (+  8716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:39.652021 (+ 16055us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:39.972454 (+320433us) log.cc:844] Serialized 14 byte log entry
0709 12:16:40.697474 (+725020us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18000056e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a
0709 12:16:40.699392 (+  1918us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:40.699470 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:40.699539 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.699638 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:40.699829 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":774544,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"spinlock_wait_cycles":2393856,"thread_start_us":775158,"threads_started":2,"wal-append.queue_time_us":626800}
I20260709 12:16:40.687911 25317 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.672170 24897 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.672873 24617 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:40.780714 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:40.756752 25039 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:40.783591 23674 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:40.708057 24870 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:40.831840 23682 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
W20260709 12:16:40.828007 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:40.882606 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:40.787403 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:40.709908 25306 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:40.763515 25248 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:40.788462 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:40.758105 25275 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:40.860343 25311 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:16:40.704535 25289 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:40.786451 24948 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:40.776369 25218 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:40.868242 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:40.872443 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:40.894037 23672 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:16:40.872650 23494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.012s
I20260709 12:16:40.870030 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:40.894515 23494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.005s	sys 0.013s
I20260709 12:16:40.875330 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:40.775607 25312 raft_consensus.cc:2764] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:16:40.895700 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:40.896450 22749 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:40.879004 24617 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:40.875880 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 382) took 1001 ms. Trace:
I20260709 12:16:40.880049 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 324) took 1010 ms. Trace:
I20260709 12:16:40.884789 24897 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:40.901940 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:40.884217 23679 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:40.870990 25169 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:40.911202 25169 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:40.913021 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 372) took 2314 ms. Trace:
I20260709 12:16:40.915093 23672 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:16:40.873728 22717 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.509s (SENT) [suppressed 33 similar messages]
W20260709 12:16:40.872507 25313 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:16:40.888245 23656 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:40.914458 22900 rpcz_store.cc:276] 0709 12:16:38.598581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.844746 (+246165us) service_pool.cc:224] Handling call
0709 12:16:38.845146 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:39.628973 (+783827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:39.629022 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:39.646080 (+ 17058us) log.cc:844] Serialized 26 byte log entry
0709 12:16:39.944020 (+297940us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:39.944071 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.677062 (+732991us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54004eb954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:40.677137 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:40.901954 (+224817us) raft_consensus.cc:1685] finished
0709 12:16:40.901981 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:40.912946 (+ 10965us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95371,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":3504,"spinlock_wait_cycles":1801443712,"thread_start_us":246777,"threads_started":1,"wal-append.queue_time_us":661579}
I20260709 12:16:40.914255 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 321) took 1059 ms. Trace:
W20260709 12:16:40.884187 24889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.010s	sys 0.007s
W20260709 12:16:40.895021 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 528622us
I20260709 12:16:40.898329 22894 rpcz_store.cc:276] 0709 12:16:39.874604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:40.343989 (+469385us) service_pool.cc:224] Handling call
0709 12:16:40.374917 (+ 30928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:40.375166 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:16:40.395435 (+ 20269us) log.cc:844] Serialized 14 byte log entry
0709 12:16:40.871601 (+476166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:40.871686 (+    85us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:40.875618 (+  3932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.875691 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:40.875823 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6018,"prepare.queue_time_us":36138,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":161,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":4562,"thread_start_us":453375,"threads_started":1}
W20260709 12:16:40.880229 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 173789us
I20260709 12:16:40.902215 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 629) took 1196 ms. Trace:
I20260709 12:16:40.898537 22824 rpcz_store.cc:276] 0709 12:16:39.869952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.870200 (+   248us) service_pool.cc:224] Handling call
0709 12:16:39.892869 (+ 22669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:39.893153 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:16:40.438725 (+545572us) log.cc:844] Serialized 14 byte log entry
0709 12:16:40.879690 (+440965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:40.879755 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:40.879801 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.879866 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:40.879993 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5108,"prepare.queue_time_us":552407,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":7409,"thread_start_us":975403,"threads_started":2}
I20260709 12:16:40.906816 25213 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:40.775888 24900 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.933308 22899 rpcz_store.cc:276] 0709 12:16:39.706523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.706967 (+   444us) service_pool.cc:224] Handling call
0709 12:16:39.707431 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:39.713676 (+  6245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:39.713711 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:39.718175 (+  4464us) log.cc:844] Serialized 26 byte log entry
0709 12:16:40.257913 (+539738us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:40.257971 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.258066 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:40.902006 (+643940us) raft_consensus.cc:1685] finished
0709 12:16:40.902025 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:40.902146 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22369,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":255383,"threads_started":1,"wal-append.queue_time_us":739509}
I20260709 12:16:40.877725 25236 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:40.912235 24948 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:40.927455 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:40.917428 22820 rpcz_store.cc:276] 0709 12:16:39.854715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.858461 (+  3746us) service_pool.cc:224] Handling call
0709 12:16:39.859034 (+   573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:39.859522 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:39.859562 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:39.860302 (+   740us) log.cc:844] Serialized 26 byte log entry
0709 12:16:40.434955 (+574653us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:40.435015 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.435113 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:40.914038 (+478925us) raft_consensus.cc:1685] finished
0709 12:16:40.914059 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:40.914194 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1843,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"thread_start_us":574093,"threads_started":1,"wal-append.queue_time_us":661304}
I20260709 12:16:40.881101 25317 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:40.912273 25169 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:40.941697 24897 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:40.943305 24617 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:40.943892 24891 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.053s	user 0.008s	sys 0.004s
I20260709 12:16:40.949258 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:40.912966 25321 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:16:40.951869 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 78180.1us
I20260709 12:16:40.952255 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:40.956560 22749 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:40.932415 25289 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:40.962458 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:40.962491 22745 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:40.967129 22894 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:16:40.967888 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:40.971596 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:40.972564 23656 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:40.957787 24891 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:40.966090 24617 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:40.958149 25321 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:40.975615 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:40.977635 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:41.002271 22750 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:41.004099 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:41.005332 25207 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:41.006167 25207 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:40.951071 24900 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:40.954190 25218 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:16:40.975363 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:40.955416 24889 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 12:16:40.979362 25314 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:16:40.986063 25252 consensus_meta.cc:287] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.948s	user 0.007s	sys 0.007s
I20260709 12:16:41.018422 22749 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:40.979116 25169 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:40.978389 25330 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.985327 25248 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:40.983196 25324 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:41.028796 25324 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:41.031107 25287 consensus_meta.cc:287] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.643s	user 0.006s	sys 0.014s
I20260709 12:16:41.031433 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 628) took 2525 ms. Trace:
I20260709 12:16:41.031702 25287 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:41.033247 23685 raft_consensus.cc:2393] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:41.032187 22897 rpcz_store.cc:276] 0709 12:16:38.505641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.515131 (+  9490us) service_pool.cc:224] Handling call
0709 12:16:38.537425 (+ 22294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:38.560539 (+ 23114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.560580 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:38.584819 (+ 24239us) log.cc:844] Serialized 52 byte log entry
0709 12:16:38.758101 (+173282us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:38.826656 (+ 68555us) log.cc:844] Serialized 14 byte log entry
0709 12:16:38.826941 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.827011 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:41.005479 (+2178468us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b180001de00. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:16:41.030906 (+ 25427us) raft_consensus.cc:1685] finished
0709 12:16:41.031052 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:41.031296 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131277,"prepare.queue_time_us":82423,"raft.queue_time_us":18384,"raft.run_cpu_time_us":6411,"raft.run_wall_time_us":31209,"spinlock_wait_cycles":38705920,"thread_start_us":157296,"threads_started":1,"wal-append.queue_time_us":254157}
I20260709 12:16:40.983703 25242 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:41.036893 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:41.037370 25242 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:41.039134 25218 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:41.026170 25330 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:41.041988 25330 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:41.038486 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:41.043522 25324 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:41.045478 24891 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:41.049125 25287 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:41.051137 22750 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:16:41.022372 25252 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:41.052156 25214 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:41.052313 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.053205 24889 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:41.054306 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:41.021494 25232 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.115s	user 0.008s	sys 0.005s
I20260709 12:16:41.069875 25317 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:41.061887 25056 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:41.072338 25236 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:41.083956 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:41.072707 25291 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:41.075219 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:41.076167 25252 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:41.092582 22748 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:16:41.076561 25281 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.444s	user 0.008s	sys 0.006s
I20260709 12:16:41.016116 25228 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:16:41.081007 25275 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:41.081431 25235 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.081441 22750 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:41.080049 25232 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:41.076261 25306 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:41.079478 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:41.278931 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.285490 25324 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:41.072360 24900 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:41.067286 24889 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:41.065464 25243 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:41.308434 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:41.287786 25291 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.316026 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:41.311509 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:41.318161 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.318506 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:41.294253 25214 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:16:41.087055 25205 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.577s	user 0.001s	sys 0.015s
I20260709 12:16:41.372712 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:41.374110 22748 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:41.374708 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:41.375633 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:41.376482 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:41.392740 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.393239 22900 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:41.392772 22899 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:41.376761 22749 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 3: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:16:41.380045 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:41.386626 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.389077 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 610) took 2850 ms. Trace:
I20260709 12:16:41.417650 22751 rpcz_store.cc:276] 0709 12:16:38.539154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.628673 (+ 89519us) service_pool.cc:224] Handling call
0709 12:16:38.629037 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.836458 (+207421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:41.388856 (+2552398us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400406fd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:41.389023 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454986112}
W20260709 12:16:41.394263 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 310403us
I20260709 12:16:41.419709 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:41.314917 24889 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:41.310845 25324 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:41.451798 25324 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:41.463204 22899 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
W20260709 12:16:41.487285 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.488368 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:41.375119 25173 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:41.496881 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:41.499027 25218 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.499799 22749 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:41.499753 25218 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:41.501199 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:41.502358 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:41.503342 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 83754.1us
I20260709 12:16:41.504464 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:41.506003 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:41.507206 25335 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:41.510771 25332 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:41.511102 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:41.512004 25332 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.512300 22827 raft_consensus.cc:2410] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:16:41.512769 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:41.513690 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:41.514076 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:41.514349 22825 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
W20260709 12:16:41.392517 25205 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.883s	user 0.001s	sys 0.015s
I20260709 12:16:41.511855 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:41.515391 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:41.516674 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:41.512620 25332 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:41.514825 22818 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:41.503413 22748 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:41.531482 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:41.532950 22791 leader_election.cc:400] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8.
I20260709 12:16:41.533322 22748 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:41.497771 22751 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:41.536273 22749 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
W20260709 12:16:41.537364 22893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 377) took 1744 ms (client timeout 1750 ms). Trace:
I20260709 12:16:41.540280 25232 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:41.540742 24617 consensus_meta.cc:287] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.000s
I20260709 12:16:41.544287 25322 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:41.544708 25322 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:41.545626 25322 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:41.314145 25235 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:41.545908 25242 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.001s
W20260709 12:16:41.537781 22893 rpcz_store.cc:269] 0709 12:16:39.792539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.806368 (+ 13829us) service_pool.cc:224] Handling call
0709 12:16:41.537211 (+1730843us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54005a0354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:41.537309 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1194581248}
I20260709 12:16:41.548301 25235 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:41.549119 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46530 (request call id 14) took 1836 ms. Trace:
I20260709 12:16:41.549561 22895 rpcz_store.cc:276] 0709 12:16:39.712806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.717199 (+  4393us) service_pool.cc:224] Handling call
0709 12:16:41.548892 (+1831693us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540015a254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf4779853 00007fadf974760a 00007fadf2ccd7d4 00007fadf2ccd762 00007fadf2ccd691 00007fadf2ccd60c 00007fadf2ccc8c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:41.549022 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428177792}
I20260709 12:16:41.550209 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 786) took 2691 ms. Trace:
I20260709 12:16:41.511005 25154 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:16:41.560508 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 70836.9us
I20260709 12:16:41.562129 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:41.559387 22826 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:41.550751 22821 rpcz_store.cc:276] 0709 12:16:38.858339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.858486 (+   147us) service_pool.cc:224] Handling call
0709 12:16:38.858740 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.898183 (+ 39443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.898212 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:38.929454 (+ 31242us) log.cc:844] Serialized 26 byte log entry
0709 12:16:39.453082 (+523628us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:39.453149 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:39.453251 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:41.075933 (+1622682us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:41.523209 (+447276us) raft_consensus.cc:1685] finished
0709 12:16:41.523240 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:41.550132 (+ 26892us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130235,"raft.queue_time_us":24292,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":19724,"spinlock_wait_cycles":13600640,"thread_start_us":412032,"threads_started":1,"wal-append.queue_time_us":593386}
I20260709 12:16:41.565811 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:16:41.546416 25207 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
W20260709 12:16:41.552261 25244 consensus_meta.cc:287] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 2.624s	user 0.007s	sys 0.009s
I20260709 12:16:41.375005 25291 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:41.547443 25322 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:41.568832 25218 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:41.567149 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:41.589839 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:41.591123 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.551016 25173 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:41.551577 25332 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:41.552124 25339 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:41.572563 25228 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:41.571066 25223 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:16:41.580253 25289 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.001s
I20260709 12:16:41.613343 22744 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:41.548295 25242 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:41.575666 25207 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:41.602197 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:41.593300 25339 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.607267 24617 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.615146 25164 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:41.620294 25291 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:41.593232 25100 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:41.631045 22744 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:41.638121 24617 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:41.639341 25164 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:41.612372 25228 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:41.640017 24850 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:41.625500 25173 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:41.577870 25244 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:41.642745 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:41.648012 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45941.6us
I20260709 12:16:41.649647 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:41.629590 25339 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:41.670735 22748 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
W20260709 12:16:41.672431 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.679673 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:41.647015 25207 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:41.647091 25100 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:41.658275 25223 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:41.688205 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:41.689632 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:41.697454 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:41.700974 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.700577 22752 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:41.695050 25207 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:41.706831 25242 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:41.695508 25218 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:41.698732 25332 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:16:41.693775 25228 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:41.728868 24617 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:41.729172 25340 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:16:41.711213 25207 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:41.713498 25223 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:16:41.753057 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 600) took 3756 ms. Trace:
I20260709 12:16:41.753551 22753 rpcz_store.cc:276] 0709 12:16:37.996656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.999171 (+  2515us) service_pool.cc:224] Handling call
0709 12:16:38.019689 (+ 20518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.871857 (+852168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:41.752732 (+2880875us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b54006798d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:41.752984 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1941564288}
I20260709 12:16:41.740938 25244 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:41.735600 25214 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:41.745994 25172 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:41.772019 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 62150.9us
I20260709 12:16:41.774250 25207 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:41.791038 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 212446us
W20260709 12:16:41.793735 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 187703us
W20260709 12:16:41.795644 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.735991 25100 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:41.802537 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 201508us
I20260709 12:16:41.820119 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:41.821977 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:41.825843 25287 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:41.829424 25287 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.829882 25287 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:41.830176 25214 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:41.826122 24617 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:16:41.840183 22747 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:41.827279 25316 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:16:41.814400 25335 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:41.814062 25218 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.807786 25241 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 12:16:41.857038 22865 connection.cc:256] RPC call timeout handler was delayed by -2.0127815660000579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:16:41.866950 22865 connection.cc:256] RPC call timeout handler was delayed by -1.7526815660000921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 12:16:41.867327 22865 connection.cc:256] RPC call timeout handler was delayed by -1.3935815659999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
I20260709 12:16:41.867920 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:41.856997 22747 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:41.869324 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 605) took 3367 ms. Trace:
I20260709 12:16:41.869863 22747 rpcz_store.cc:276] 0709 12:16:38.501728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.615697 (+113969us) service_pool.cc:224] Handling call
0709 12:16:38.616044 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.643582 (+ 27538us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b54001773a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf47811c0 00007fadf4782231 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c
0709 12:16:41.826687 (+3183105us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b58006170d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46db0aa 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4
0709 12:16:41.868946 (+ 42259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:41.869257 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4017986176}
I20260709 12:16:41.876971 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:41.857393 25235 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:41.879536 25169 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:16:41.876266 25254 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:16:41.852360 25154 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:16:41.886889 25235 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.867944 25218 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:41.901935 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:41.903795 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:41.904616 22826 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:41.909235 22819 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:41.893546 24850 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:41.883198 25335 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:16:41.892851 25304 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.927536 22818 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:16:41.928079 22818 pending_rounds.cc:85] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 4
I20260709 12:16:41.928344 22818 pending_rounds.cc:107] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:16:41.928603 22818 raft_consensus.cc:2889] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:41.881623 25063 consensus_queue.cc:1059] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
W20260709 12:16:41.919682 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.934538 22821 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:16:41.935089 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 106327us
I20260709 12:16:41.938066 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:41.909523 25235 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:41.942215 22824 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:16:41.945775 22826 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
W20260709 12:16:41.949854 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 53015.8us
I20260709 12:16:41.952534 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:41.953236 22823 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:41.954180 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:41.954699 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:41.955358 22900 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:41.949259 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:41.954909 22899 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:41.952363 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:41.926554 25214 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.951015 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:41.959090 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:41.970688 22820 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:41.972235 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:41.975149 22894 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:41.968896 22818 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:16:41.974439 22892 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:41.973102 22896 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:16:41.980883 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:41.981917 22823 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:41.984073 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:41.984849 22824 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:41.985877 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:41.986475 22897 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:41.987171 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:41.989172 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:41.989964 22895 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:41.915776 24949 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:16:41.998749 22900 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:42.004159 22899 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:42.005503 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:42.008041 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:42.006667 22818 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:41.933880 25344 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:16:41.975914 25154 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:16:42.009970 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 123359us
I20260709 12:16:42.010270 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:42.014834 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.019404 22822 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:42.022174 22827 raft_consensus.cc:2410] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:16:42.023772 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:41.999225 25207 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:42.005573 25173 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.969334 24889 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:41.938387 25304 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:42.035822 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:42.038452 22818 raft_consensus.cc:2410] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:16:42.043592 25180 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:42.045454 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.045565 25339 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:42.038519 25173 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:42.054332 25339 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:42.044461 25180 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:16:42.054673 25173 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:42.060918 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:42.062615 22818 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:42.061057 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:42.020056 25154 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:42.071581 25358 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:16:42.072009 25321 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:42.073576 25321 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:42.075258 25136 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.076094 25218 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:42.077307 25205 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.077946 25205 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:42.079248 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:42.080255 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:42.081142 23672 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:42.081287 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:42.080269 25205 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:42.085427 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.087505 25355 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.088253 25355 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:42.091845 25353 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:16:42.047142 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:42.095770 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:41.982796 25214 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:42.098050 23660 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
W20260709 12:16:42.099391 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.075995 25136 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:42.103230 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:42.103227 25063 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.033325 25207 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.117517 23656 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:16:42.118073 23656 pending_rounds.cc:85] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 3
I20260709 12:16:42.118391 23656 pending_rounds.cc:107] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:16:42.118664 23656 raft_consensus.cc:2889] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:42.066865 22820 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:42.121951 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:42.032555 25279 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 2.481s	user 0.002s	sys 0.032s
I20260709 12:16:42.100611 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.010247 25362 consensus_queue.cc:1059] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:16:42.128290 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:42.130369 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:42.132229 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:42.135556 22823 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:16:42.138156 22897 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:16:42.138649 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.143438 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.149559 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:42.150079 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:42.151070 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.129145 22821 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:16:42.125737 25207 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:42.154570 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.154732 25205 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:42.155575 25293 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:42.157842 25369 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.158409 25369 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:42.157472 23493 leader_election.cc:400] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8.
I20260709 12:16:42.160733 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.117789 25154 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:42.163301 23493 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:42.140278 25350 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:16:42.111868 25063 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:42.178923 25205 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:16:42.168360 25298 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:42.182421 25369 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:42.188958 25322 consensus_meta.cc:287] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.606s	user 0.014s	sys 0.000s
I20260709 12:16:42.190771 25214 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:42.165112 25293 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:42.160414 25172 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:42.186561 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:16:42.186559 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.182349 25364 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:16:42.134008 25355 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:42.200541 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:42.230844 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.232549 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:42.233145 22751 raft_consensus.cc:2376] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6. Re-sending same reply.
I20260709 12:16:42.233222 22748 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:42.234382 22751 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:42.236361 25293 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:42.236975 25293 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:42.238989 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:42.239957 22748 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:42.216996 25172 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:42.242640 22749 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:42.220088 25369 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.244738 25293 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:42.247040 25063 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:42.248454 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:42.254989 24889 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:42.227023 25322 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:42.256472 25207 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:42.257042 25228 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:42.258448 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:42.258924 25235 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:42.260766 25287 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:42.267541 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:42.278990 22750 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:42.268087 22748 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:42.220062 25298 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:16:42.269994 22752 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 3.
I20260709 12:16:42.275641 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:42.281863 22749 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:42.263433 25172 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:42.284284 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:42.277547 22717 connection.cc:256] RPC call timeout handler was delayed by -3.8926939870000297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2738s for a response
W20260709 12:16:42.270638 25164 consensus_meta.cc:287] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.007s
W20260709 12:16:42.285902 22717 connection.cc:256] RPC call timeout handler was delayed by -3.6361939869998423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3023s for a response
W20260709 12:16:42.310739 22717 connection.cc:256] RPC call timeout handler was delayed by -3.3589939869998489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3331s for a response
W20260709 12:16:42.311466 22717 connection.cc:256] RPC call timeout handler was delayed by -2.9967415529999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 12:16:42.311903 22717 connection.cc:256] RPC call timeout handler was delayed by -2.9499415529999169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 12:16:42.312338 22717 connection.cc:256] RPC call timeout handler was delayed by -2.8932415529998252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 12:16:42.313277 22717 connection.cc:256] RPC call timeout handler was delayed by -2.8662415529997816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:16:42.313768 22717 connection.cc:256] RPC call timeout handler was delayed by -2.7789415529998678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 12:16:42.314581 22717 connection.cc:256] RPC call timeout handler was delayed by -2.7780415529998663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 12:16:42.269474 25322 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.315981 22818 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:42.319032 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:42.315292 22717 connection.cc:256] RPC call timeout handler was delayed by -2.7177415529999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 12:16:42.339892 22717 connection.cc:256] RPC call timeout handler was delayed by -1.995941552999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2757s for a response
I20260709 12:16:42.343825 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 389) took 3578 ms. Trace:
W20260709 12:16:42.348084 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.348915 22898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 376) took 2557 ms. Trace:
I20260709 12:16:42.350175 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 643) took 1581 ms. Trace:
I20260709 12:16:42.350512 23685 rpcz_store.cc:276] 0709 12:16:40.769314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:40.780346 (+ 11032us) service_pool.cc:224] Handling call
0709 12:16:42.350027 (+1569681us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54002904d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:42.350133 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352591104}
I20260709 12:16:42.271171 25355 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:16:42.344416 22746 rpcz_store.cc:276] 0709 12:16:38.765246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.550281 (+785035us) service_pool.cc:224] Handling call
0709 12:16:39.550673 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:39.820293 (+269620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:42.343468 (+2523175us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54000a8f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:42.343752 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461156736}
I20260709 12:16:42.356585 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:42.360040 22750 raft_consensus.cc:2410] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:16:42.360239 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:42.360410 22744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 412) took 1724 ms (client timeout 1899 ms). Trace:
W20260709 12:16:42.361083 22744 rpcz_store.cc:269] 0709 12:16:40.616220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:40.901638 (+285418us) service_pool.cc:224] Handling call
0709 12:16:42.340315 (+1438677us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54000a8054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:42.340479 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630343040}
I20260709 12:16:42.363157 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:42.363178 22753 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:42.364008 22895 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:42.367272 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:42.268573 25369 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:42.368666 22745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 391) took 3597 ms (client timeout 2744 ms). Trace:
I20260709 12:16:42.359457 22897 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:16:42.369217 22745 rpcz_store.cc:269] 0709 12:16:38.765878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.867105 (+101227us) service_pool.cc:224] Handling call
0709 12:16:42.362614 (+3495509us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b5400412b54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:42.362826 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4686691072}
I20260709 12:16:42.329069 25322 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:42.361114 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 382575us
I20260709 12:16:42.374164 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.349251 22898 rpcz_store.cc:276] 0709 12:16:39.792096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.805787 (+ 13691us) service_pool.cc:224] Handling call
0709 12:16:39.806175 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:39.972056 (+165881us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:16:40.299088 (+327032us) log.cc:844] Serialized 14 byte log entry
0709 12:16:40.701047 (+401959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:40.701132 (+    85us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:40.701192 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:42.348742 (+1647550us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540015a254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:42.348774 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:42.348872 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":326873,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":5742,"raft.queue_time_us":119746,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":61252,"spinlock_wait_cycles":380911488,"thread_start_us":379551,"threads_started":2,"wal-append.queue_time_us":531640,"wal-append.run_cpu_time_us":2595,"wal-append.run_wall_time_us":1188859}
I20260709 12:16:42.339583 25335 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:42.368993 22900 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:42.378762 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:42.381107 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:42.328609 25214 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:16:42.363173 25063 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:42.367610 25365 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:42.327525 25218 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 12:16:42.387851 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.388616 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:42.389503 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:42.383597 25276 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:42.338275 25362 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:16:42.392232 22899 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:42.393340 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:42.390893 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 360636us
I20260709 12:16:42.395249 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:42.413084 22897 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:42.413213 22892 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:42.396723 22893 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:42.397279 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:42.398291 22896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:42.416265 22896 raft_consensus.cc:606] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.416780 22896 raft_consensus.cc:614] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:42.370968 25136 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:42.402325 22898 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:16:42.379803 25335 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.395299 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:42.392810 25063 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.427735 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:42.401841 25228 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:42.437862 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:42.429011 25332 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:16:42.487092 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 49506.4us
I20260709 12:16:42.426915 25335 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:42.427608 25339 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:42.489889 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:42.441768 25063 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:42.410742 25365 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:42.478072 25276 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:42.443624 25228 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:16:42.512216 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:42.486554 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 269241us
I20260709 12:16:42.520484 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:42.522143 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:42.528584 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:42.530009 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:42.533320 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 215481us
I20260709 12:16:42.489441 25332 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:42.523138 22896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
W20260709 12:16:42.536191 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.522560 23493 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:42.536355 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 178381us
I20260709 12:16:42.537479 25136 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:42.546222 22896 raft_consensus.cc:606] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.546904 22896 raft_consensus.cc:614] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:42.517807 25100 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:42.504187 25291 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:42.549647 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:42.526975 25203 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:42.537945 25107 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:16:42.592100 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.504470 25284 consensus_queue.cc:1059] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:16:42.630190 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:42.540278 25382 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:42.501574 25373 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 12:16:42.638093 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 88570.8us
I20260709 12:16:42.551957 25194 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:42.635169 22750 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:42.636984 22819 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:42.534440 25316 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 12:16:42.566294 25287 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:42.568598 25203 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:42.541383 25378 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.122s
I20260709 12:16:42.667925 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:42.673377 22819 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:42.634585 25107 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.638221 25254 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:16:42.675825 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 143802us
I20260709 12:16:42.634225 25385 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:42.626477 25291 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:42.676558 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 146637us
W20260709 12:16:42.688650 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 145585us
I20260709 12:16:42.637269 25100 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:42.647109 25194 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.659406 25382 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:42.703688 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:42.671186 25203 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:42.683720 25107 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:42.727985 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.642611 25207 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:42.661314 24617 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:16:42.733521 22750 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:42.735533 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:42.712718 25382 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.672642 25309 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:16:42.712419 25194 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:42.708137 25369 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:42.753100 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:42.645124 25228 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:42.766029 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:42.755545 22750 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:42.768914 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:42.740769 25287 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:16:42.760783 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.763171 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:42.764204 25297 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:42.782178 22751 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:42.749704 25207 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.789278 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:42.782260 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:42.793536 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.794911 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:42.794070 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.796097 22751 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:42.796922 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:42.800369 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.765175 25316 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:42.754441 25382 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:42.717319 25332 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:42.779893 25254 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:16:42.832013 23493 connection.cc:256] RPC call timeout handler was delayed by -1.4866540909999912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27440000000000003s for a response
I20260709 12:16:42.825706 23695 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:42.788511 25378 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:16:42.837932 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45541.3us
W20260709 12:16:42.816089 25380 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:16:42.809262 25369 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:42.857311 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:42.860822 22865 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:42.857684 23672 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:42.857843 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:42.864494 23685 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:42.818233 25402 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.866973 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:42.825680 25136 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:42.873989 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:42.871950 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:42.839923 24949 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:42.827896 25365 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:42.873834 23682 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:42.849400 25228 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:42.869360 23685 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:42.866477 25369 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:42.879191 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 90021.8us
W20260709 12:16:42.881058 25376 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 12:16:42.881735 25386 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:16:42.897375 23660 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:42.885095 25136 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:42.870492 25400 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.887874 24850 raft_consensus.cc:3055] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:42.851290 25287 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:16:42.891315 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 91063.4us
I20260709 12:16:42.855189 25332 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:42.809703 25207 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:42.898815 22747 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:16:42.883278 25291 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:42.901984 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:42.902280 22751 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:42.871271 25254 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:42.890918 25375 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.242s	user 0.001s	sys 0.001s
I20260709 12:16:42.923561 25405 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:42.910565 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:42.911398 24850 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:42.911669 25395 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:16:42.911825 25287 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:42.814936 25100 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:42.890873 25316 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:42.945516 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:42.918864 22747 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:42.898877 25369 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:42.875849 25276 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:16:42.932036 25309 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:42.953080 25405 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:42.953596 25405 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.953965 25405 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:42.954022 22894 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:16:42.938493 25164 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:42.956416 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:42.957228 22825 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:42.948725 25316 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.959642 25316 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:42.964129 25394 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:16:42.964689 25207 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:42.966149 25381 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
W20260709 12:16:42.937672 25321 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.864s	user 0.012s	sys 0.006s
W20260709 12:16:42.923575 25379 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.278s	user 0.001s	sys 0.001s
I20260709 12:16:42.903358 25214 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:42.986126 25214 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.986647 25214 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:42.927714 25365 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:42.933701 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:42.903265 25416 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:42.874882 25402 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:42.983757 22747 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:42.994987 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:42.999768 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 66188.7us
I20260709 12:16:43.004364 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:42.929325 25254 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:43.029734 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:42.918411 25400 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:43.015223 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.014580 25063 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:43.040161 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.025408 25194 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:43.025928 25287 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:43.005863 24850 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:43.046316 23685 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:43.036831 25416 raft_consensus.cc:2764] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:16:43.007756 25365 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:43.050385 25402 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:43.051669 25365 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:43.052439 25400 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:43.052924 23682 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:16:43.054136 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.050590 25287 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:43.055698 25254 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:42.973348 25362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.008s	sys 0.001s
W20260709 12:16:43.059605 25362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.008s	sys 0.001s
I20260709 12:16:43.059988 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.036304 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.061471 23656 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:43.037885 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.043929 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:43.062480 23672 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:43.062999 25416 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:43.049408 24850 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:43.067303 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:43.067438 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:43.002276 22747 raft_consensus.cc:3055] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:43.070045 22747 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:43.074472 23689 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:16:43.043040 25172 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.709s	user 0.012s	sys 0.002s
I20260709 12:16:43.035391 25309 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:43.077880 22747 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.003093 25393 consensus_queue.cc:1059] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:16:43.082434 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:43.091012 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:43.091778 22894 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:43.092398 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.094709 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:43.095376 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:43.096390 22893 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:43.099452 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:43.101882 22747 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:43.046219 25321 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:16:43.082706 25154 consensus_meta.cc:287] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.896s	user 0.010s	sys 0.006s
I20260709 12:16:43.044700 25420 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:43.103818 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 788) took 1110 ms. Trace:
I20260709 12:16:43.121421 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:43.084106 25396 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.003s
I20260709 12:16:43.109091 22825 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:16:43.088343 25415 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.125705 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:43.119268 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:43.122291 22892 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 2.
I20260709 12:16:43.121912 22824 rpcz_store.cc:276] 0709 12:16:41.993132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:41.993305 (+   173us) service_pool.cc:224] Handling call
0709 12:16:42.013143 (+ 19838us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:42.020185 (+  7042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:42.020230 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:42.035270 (+ 15040us) log.cc:844] Serialized 52 byte log entry
0709 12:16:42.432346 (+397076us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:42.680205 (+247859us) log.cc:844] Serialized 14 byte log entry
0709 12:16:42.680514 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:42.680652 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:43.103551 (+422899us) raft_consensus.cc:1685] finished
0709 12:16:43.103577 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:43.103750 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13882,"prepare.queue_time_us":347899,"prepare.run_cpu_time_us":6457,"prepare.run_wall_time_us":9943,"raft.queue_time_us":177019,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":22069,"thread_start_us":456512,"threads_started":2,"wal-append.queue_time_us":437760}
I20260709 12:16:43.124701 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.133044 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:43.135408 22822 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:43.132014 22898 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:43.133006 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:43.078976 25362 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:16:43.143893 22897 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:43.079314 25254 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:16:43.103010 25410 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:43.082029 25401 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:16:43.130375 25427 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:43.150575 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.154376 22822 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:43.087623 25172 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:43.107044 25417 consensus_queue.cc:1175] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" responder_term: 4 status { last_received { term: 4 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:16:43.165179 25304 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:43.167305 22749 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:16:43.125228 25154 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.174937 23674 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:43.185501 23660 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:16:43.191169 25203 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:43.186731 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:43.188845 25335 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.684s	user 0.013s	sys 0.000s
I20260709 12:16:43.186172 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.178807 25410 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:43.212955 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
W20260709 12:16:43.188867 25403 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 12:16:43.182004 25194 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:43.194263 22864 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:43.133172 25164 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:43.138090 25415 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.235953 25203 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:43.236152 25410 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:43.217876 25335 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.240231 25154 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:43.187796 25063 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:43.246057 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 330) took 1344 ms. Trace:
I20260709 12:16:43.165038 25405 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:43.169471 25377 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:43.250492 25207 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.168344 25361 raft_consensus.cc:3055] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:16:43.173571 25388 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.393s	user 0.000s	sys 0.002s
I20260709 12:16:43.251288 25207 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.184427 23672 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:43.252512 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 797) took 1255 ms. Trace:
I20260709 12:16:43.253361 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.253687 25207 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:43.157991 25321 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:16:43.204254 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:43.205219 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:43.255477 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 51320.2us
I20260709 12:16:43.256464 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:43.257717 25169 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:43.207674 23656 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 3.
I20260709 12:16:43.211177 23685 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
W20260709 12:16:43.178246 25383 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.547s	user 0.001s	sys 0.000s
I20260709 12:16:43.261029 25298 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:43.261328 25392 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:43.261600 25298 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:43.261979 25392 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.250725 25405 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:43.225525 23674 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:43.227001 22819 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:43.230243 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.170527 25369 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:43.246587 22821 rpcz_store.cc:276] 0709 12:16:41.901390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:41.901561 (+   171us) service_pool.cc:224] Handling call
0709 12:16:43.245818 (+1344257us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b54002e8954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:43.245959 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72708352}
I20260709 12:16:43.158279 23682 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:43.213707 22894 raft_consensus.cc:606] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:43.271404 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 621) took 1822 ms. Trace:
I20260709 12:16:43.283432 25392 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:43.252923 22820 rpcz_store.cc:276] 0709 12:16:41.997126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.162171 (+165045us) service_pool.cc:224] Handling call
0709 12:16:42.183654 (+ 21483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:42.184254 (+   600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:42.184299 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:42.215264 (+ 30965us) log.cc:844] Serialized 26 byte log entry
0709 12:16:42.527549 (+312285us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:42.527586 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:42.527645 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:43.172901 (+645256us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:43.252185 (+ 79284us) raft_consensus.cc:1685] finished
0709 12:16:43.252207 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:43.252450 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":230,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":2852,"spinlock_wait_cycles":5696384,"thread_start_us":278124,"threads_started":1,"wal-append.queue_time_us":488747}
I20260709 12:16:43.258145 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:43.156287 25416 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:43.216960 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:43.326077 22752 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:16:43.264573 25344 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:16:43.263824 25107 consensus_meta.cc:287] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.002s
I20260709 12:16:43.250926 22826 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:16:43.331341 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 207783us
W20260709 12:16:43.278740 25406 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
W20260709 12:16:43.279420 25322 consensus_meta.cc:287] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.895s	user 0.013s	sys 0.002s
I20260709 12:16:43.281672 22747 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:43.271054 25382 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.236073 25415 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:43.283388 25172 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:43.348976 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.284042 25223 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:43.251302 25361 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:43.287633 25384 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.522s	user 0.002s	sys 0.000s
I20260709 12:16:43.206504 25365 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:16:43.209733 25291 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:16:43.378957 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 342) took 1366 ms. Trace:
I20260709 12:16:43.371217 25416 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:43.379110 25241 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:43.379905 25241 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:43.380581 25291 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:43.251039 25377 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:43.381065 25241 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:43.382368 25241 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:43.381070 25291 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:43.266911 25390 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:43.291947 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.296190 22898 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:43.303982 22900 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:43.305512 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:43.269783 22897 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:43.406421 22899 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:43.317238 23689 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:43.232975 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:43.263507 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 618) took 1169 ms. Trace:
I20260709 12:16:43.322677 22753 rpcz_store.cc:276] 0709 12:16:41.449118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:41.761011 (+311893us) service_pool.cc:224] Handling call
0709 12:16:42.362957 (+601946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:42.371566 (+  8609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:43.271110 (+899544us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400412b50. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:43.271315 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361750400}
W20260709 12:16:43.327734 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 69693.5us
W20260709 12:16:43.407759 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 174912us
I20260709 12:16:43.258589 25169 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:43.334686 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:43.334856 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:43.341667 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.319034 25335 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:43.231415 25316 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:43.327667 25344 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:43.422967 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:43.262600 25298 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:43.402503 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.409124 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:43.409739 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.381896 25377 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:43.336848 25107 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:43.407555 23659 rpcz_store.cc:276] 0709 12:16:42.094501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.095429 (+   928us) service_pool.cc:224] Handling call
0709 12:16:42.119048 (+ 23619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:42.141704 (+ 22656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:42.141753 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:42.161608 (+ 19855us) log.cc:844] Serialized 26 byte log entry
0709 12:16:42.392512 (+230904us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:42.418928 (+ 26416us) log.cc:844] Serialized 14 byte log entry
0709 12:16:42.426069 (+  7141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:42.426192 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:43.177440 (+751248us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:43.263051 (+ 85611us) raft_consensus.cc:1685] finished
0709 12:16:43.263188 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:43.263374 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12983,"prepare.queue_time_us":25986,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":4071,"raft.queue_time_us":85375,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":49248,"spinlock_wait_cycles":17319168,"thread_start_us":176813,"threads_started":1,"wal-append.queue_time_us":329480}
I20260709 12:16:43.379383 22823 rpcz_store.cc:276] 0709 12:16:42.012549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.173680 (+161131us) service_pool.cc:224] Handling call
0709 12:16:42.203409 (+ 29729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:42.217897 (+ 14488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:42.217959 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:42.218698 (+   739us) log.cc:844] Serialized 26 byte log entry
0709 12:16:42.627281 (+408583us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:42.627323 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:42.627419 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:43.286761 (+659342us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:43.378585 (+ 91824us) raft_consensus.cc:1685] finished
0709 12:16:43.378611 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:43.378890 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7268,"raft.queue_time_us":202,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6248,"spinlock_wait_cycles":5483776,"thread_start_us":408125,"threads_started":1,"wal-append.queue_time_us":482431}
I20260709 12:16:43.355221 25223 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:43.425860 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 91134.1us
I20260709 12:16:43.437716 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:43.438335 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:43.441146 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:43.352303 25392 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:16:43.431514 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.447722 23682 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:43.443472 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.448895 23689 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 3.
I20260709 12:16:43.412815 25366 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:43.453720 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:43.454398 22897 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:43.443689 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.403040 25390 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:43.457710 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.441862 22899 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:43.413463 25276 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:43.419652 25063 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:43.350613 25322 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:43.422483 25254 consensus_queue.cc:1243] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:43.442409 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:43.459197 23672 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:16:43.435202 25309 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.458230 25298 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:43.488358 22900 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:43.435747 25415 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:43.482998 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:43.484180 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.445631 25335 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:43.461220 23682 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:43.457758 25377 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:43.492863 23689 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:16:43.411640 25291 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:43.489850 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:43.495160 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.450951 25214 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:43.499100 22897 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:43.460706 25405 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:16:43.499286 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:43.502089 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.504980 23682 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:43.502489 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.502976 25164 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:43.536808 25164 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:43.537297 25164 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:43.538547 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.491554 25434 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:43.510177 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:43.489283 25435 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:16:43.513769 25416 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:43.554241 25435 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:43.494426 25254 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 12:16:43.554633 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.558688 25435 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:43.559896 25435 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:43.561708 25435 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:43.463415 25361 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.564970 25361 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:43.569977 23695 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:43.498798 25415 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:43.524147 25107 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:43.511093 25291 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:43.526918 25214 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:43.528708 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 777) took 1285 ms. Trace:
I20260709 12:16:43.604609 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:43.531435 25369 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:43.535833 25304 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:43.548202 22752 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:43.551734 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:43.489589 25154 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:16:43.499326 25390 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:43.496618 25335 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:43.553781 25430 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:43.572274 25322 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:43.619385 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 67740.6us
I20260709 12:16:43.573529 25382 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:43.579571 25316 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:43.496649 25344 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.581202 25235 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:43.582293 22818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 801) took 1583 ms (client timeout 1887 ms). Trace:
W20260709 12:16:43.642233 22818 rpcz_store.cc:269] 0709 12:16:41.998419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.121590 (+123171us) service_pool.cc:224] Handling call
0709 12:16:43.582054 (+1460464us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54005d9654. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:43.582205 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442974080}
I20260709 12:16:43.517273 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:43.583854 25172 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:43.588725 25434 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.594236 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:43.598928 22900 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:43.603339 22751 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:43.603861 22897 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:43.608835 22899 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:43.649425 22751 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:43.605050 22750 rpcz_store.cc:276] 0709 12:16:42.243089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.813130 (+570041us) service_pool.cc:224] Handling call
0709 12:16:42.827990 (+ 14860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:42.867395 (+ 39405us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:42.893094 (+ 25699us) log.cc:844] Serialized 14 byte log entry
0709 12:16:43.027613 (+134519us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b18003ae9a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:16:43.429201 (+401588us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:43.429258 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:43.429309 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:43.528383 (+ 99074us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b5400405bd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:43.528441 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:43.528627 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13773,"prepare.queue_time_us":25036,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":24492,"raft.run_wall_time_us":7223,"spinlock_wait_cycles":141316608,"thread_start_us":383353,"threads_started":1,"wal-append.queue_time_us":558090}
I20260709 12:16:43.650334 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:43.610689 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:43.650866 22897 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:16:43.612100 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:43.651351 22897 pending_rounds.cc:85] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 3
I20260709 12:16:43.651690 22897 pending_rounds.cc:107] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:16:43.614115 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:43.651968 22897 raft_consensus.cc:2889] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:43.616956 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:43.654109 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:43.491061 25309 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:43.621222 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:43.621840 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:43.659178 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:43.654709 22751 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.637475 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:43.661134 22752 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:43.608139 25304 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:43.644435 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 793) took 1647 ms. Trace:
I20260709 12:16:43.663084 22826 rpcz_store.cc:276] 0709 12:16:41.995823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.161160 (+165337us) service_pool.cc:224] Handling call
0709 12:16:43.250594 (+1089434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:43.331532 (+ 80938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:43.642596 (+311064us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002e8950. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:43.642762 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2486942976}
I20260709 12:16:43.665380 22751 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:43.666478 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:43.667398 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:43.667131 25304 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.668671 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:43.668998 25287 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:43.669430 22753 raft_consensus.cc:2368] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8.
I20260709 12:16:43.669682 25287 consensus_queue.cc:1243] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:16:43.670303 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:43.671608 23656 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:43.634657 25440 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:43.645543 23660 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 5: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:43.607990 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:43.607931 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:43.675921 22747 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:43.676450 22747 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:43.677110 22745 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:43.677352 22747 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:43.655144 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:43.655061 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.679827 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:43.681339 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:43.682564 22901 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:43.683075 22747 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:43.637283 25430 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:43.686132 22900 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:43.687095 22748 raft_consensus.cc:2410] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:16:43.679440 22749 raft_consensus.cc:2376] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7. Re-sending same reply.
I20260709 12:16:43.688691 22753 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:43.691838 25402 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:43.692653 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:43.693543 25309 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:43.694223 25309 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:43.676106 25107 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:43.695122 25107 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.692502 25415 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.695196 25154 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:43.697217 22818 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:16:43.698544 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:43.695551 25107 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:43.703142 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:43.704845 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:43.705977 22821 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:43.706223 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.705268 22826 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:43.658456 25434 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.657500 25344 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:43.676762 25382 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:43.725639 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:43.726346 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:43.728816 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:43.728998 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:43.729192 22893 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:16:43.731997 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.761879 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 803) took 1218 ms. Trace:
W20260709 12:16:43.773682 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 47232.8us
I20260709 12:16:43.774294 22820 raft_consensus.cc:2368] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8.
I20260709 12:16:43.694694 25309 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:43.784650 22751 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:16:43.796525 22751 pending_rounds.cc:85] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 3
I20260709 12:16:43.801369 22751 pending_rounds.cc:107] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:16:43.801613 22821 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:43.801780 22751 raft_consensus.cc:2889] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:43.728219 25154 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:43.786489 25322 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:43.817435 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.795449 25414 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:16:43.827519 23695 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:16:43.828186 23695 pending_rounds.cc:85] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 3
I20260709 12:16:43.828465 23695 pending_rounds.cc:107] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:16:43.828763 23695 raft_consensus.cc:2889] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:16:43.829923 25224 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:16:43.830402 25315 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.830681 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 638) took 5043 ms. Trace:
I20260709 12:16:43.831068 25315 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:43.831132 23695 rpcz_store.cc:276] 0709 12:16:38.787318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.834568 (+ 47250us) service_pool.cc:224] Handling call
0709 12:16:38.865187 (+ 30619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:40.532820 (+1667633us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54005e3e20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf47811c0 00007fadf4782231 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c
0709 12:16:42.192084 (+1659264us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54005e3e20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46fd06f 00007fadf4775f60 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62
0709 12:16:42.825171 (+633087us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b54005e3e20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46fc520 00007fadf4775f70 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62
0709 12:16:43.569326 (+744155us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b58001f1fd0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46db0aa 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4
0709 12:16:43.829665 (+260339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:43.830579 (+   914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2397217920}
I20260709 12:16:43.843793 25430 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:43.849718 25335 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:43.854022 25309 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:43.867776 25154 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:43.872958 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.882946 25322 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:43.885836 25322 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:43.903689 22901 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:43.787667 24948 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:16:43.912815 25164 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:43.914124 22823 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:16:43.918923 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:43.919850 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.922569 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 629) took 1044 ms. Trace:
I20260709 12:16:43.924477 23674 rpcz_store.cc:276] 0709 12:16:42.871542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.871693 (+   151us) service_pool.cc:224] Handling call
0709 12:16:43.915955 (+1044262us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54007080d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:43.916141 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688509696}
W20260709 12:16:43.945571 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 170794us
W20260709 12:16:43.942749 25431 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.452s	user 0.004s	sys 0.003s
W20260709 12:16:43.983697 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 362548us
W20260709 12:16:43.988713 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.990347 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:44.018705 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:44.029789 25382 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:44.034046 25382 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:44.039551 25164 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:44.043733 25442 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:16:43.987008 25440 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:44.087301 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.046582 25107 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:44.124866 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:44.125880 22750 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:44.103556 25361 consensus_meta.cc:287] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.004s
W20260709 12:16:44.108734 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.083607 25434 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:44.080955 25402 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:44.135149 25164 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.128218 25435 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:16:44.122112 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.135766 25355 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:44.139806 25435 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:44.139834 25164 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:44.146672 25291 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.003s
I20260709 12:16:44.177086 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:44.178220 22752 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:44.151055 25434 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:44.146338 25361 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:44.156916 25435 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:44.147178 25446 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:16:44.157810 25309 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:43.762604 22827 rpcz_store.cc:276] 0709 12:16:42.543252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.543426 (+   174us) service_pool.cc:224] Handling call
0709 12:16:42.543811 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:42.544035 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:16:43.532014 (+987979us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b180032fb60. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf81773c7 00007fadf47899a7 00007fadf47990bf
0709 12:16:43.532278 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 12:16:43.761146 (+228868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:43.761240 (+    94us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:43.761318 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:43.761562 (+   244us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:43.761783 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3551,"prepare.queue_time_us":314516,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":1719,"raft.queue_time_us":139,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":13111,"spinlock_wait_cycles":10172288,"thread_start_us":461980,"threads_started":2}
I20260709 12:16:44.161864 25322 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.140681 25440 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:44.147724 25355 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:44.198503 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:44.162856 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:44.192847 25309 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.187986 25434 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:44.190713 25361 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:44.208678 25415 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:44.220197 25404 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:44.224082 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:44.225183 22750 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:44.210525 25309 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:44.188463 25223 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:44.184381 25402 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:44.222937 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.231860 25223 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:44.251055 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.215832 25154 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:16:44.253583 25228 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:44.254532 25228 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:44.254892 25228 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:44.255744 25228 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:44.256943 25228 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:44.259919 25164 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:44.236099 25449 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:16:44.238519 25355 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:44.240257 25434 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:44.240505 25361 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:44.197557 25322 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:44.266974 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:44.267696 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44011.9us
I20260709 12:16:44.268571 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:44.268834 25322 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:44.244486 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 662) took 1059 ms. Trace:
I20260709 12:16:44.268934 25415 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:44.246917 25107 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:44.249585 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.243167 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:44.269735 25164 raft_consensus.cc:2764] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:16:44.276450 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.276912 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:44.278585 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.279393 22818 raft_consensus.cc:2376] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7. Re-sending same reply.
I20260709 12:16:44.280449 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.273525 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.270401 25415 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:44.281279 22824 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 4: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:44.281400 22821 raft_consensus.cc:2368] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5.
I20260709 12:16:44.281508 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.269486 23689 rpcz_store.cc:276] 0709 12:16:43.185188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:43.506382 (+321194us) service_pool.cc:224] Handling call
0709 12:16:43.587659 (+ 81277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:43.588133 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:43.588172 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:43.898892 (+310720us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b2c00058028. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:16:43.899535 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:16:44.166838 (+267303us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:44.166878 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:44.166954 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:44.244110 (+ 77156us) raft_consensus.cc:1685] finished
0709 12:16:44.244139 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:44.244405 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":278,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":33544960,"thread_start_us":235420,"threads_started":1,"wal-append.queue_time_us":294015}
W20260709 12:16:44.271499 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 246342us
I20260709 12:16:44.282985 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:44.284236 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:44.286504 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:44.286883 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:44.288105 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:44.289772 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:44.289964 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:44.291013 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:44.288856 25434 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:44.293231 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.293737 24948 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:44.295542 25309 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:44.295938 25453 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:16:44.296721 25430 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:44.297147 25430 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:44.297533 25430 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:44.297827 25309 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:44.292011 23494 leader_election.cc:400] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8.
I20260709 12:16:44.291857 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:44.299558 23494 leader_election.cc:403] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:16:44.294607 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:44.300488 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:44.300825 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:44.305121 22826 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:16:44.309772 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:44.310832 22752 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:44.310976 25453 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:44.311671 25453 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:44.311867 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:44.312722 25453 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:44.293205 25400 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:16:44.313217 22752 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:44.291524 25454 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:16:44.303084 24948 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8.
I20260709 12:16:44.315605 25454 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:44.315142 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:44.326473 22752 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:16:44.316133 25454 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:44.303606 25309 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:44.292968 25417 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:44.322655 25466 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.280606 25107 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:44.340919 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.347493 22826 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:44.348589 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.324764 25435 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:44.324863 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.325450 22825 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:16:44.341691 22827 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:44.345185 23689 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:44.361713 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:44.363435 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.365455 22826 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:44.368870 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:44.369706 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.371007 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:44.372911 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:44.374212 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:44.374955 23685 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:16:44.365097 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:44.376910 22751 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:44.377503 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:44.369726 22819 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:44.377682 22752 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:44.379928 23656 raft_consensus.cc:2410] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:16:44.379730 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:44.369844 22827 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:44.381494 22827 pending_rounds.cc:85] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 2
I20260709 12:16:44.381807 22827 pending_rounds.cc:107] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:16:44.382033 22827 raft_consensus.cc:2889] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:44.388577 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:44.388949 22822 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:44.389424 22901 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:44.390928 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:44.391644 23659 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:44.392848 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:44.392966 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:44.395052 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:44.395815 22752 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:44.396162 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:44.396905 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:44.383020 25164 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:44.379206 25223 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.400660 25463 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.406229 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:44.411167 22752 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:44.409771 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:44.412434 22897 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:44.414738 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:44.395146 25417 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:44.400009 25154 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:44.360077 25466 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:44.426584 25436 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.929s	user 0.001s	sys 0.007s
I20260709 12:16:44.409071 25434 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:44.401568 25457 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:44.415040 25164 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:44.401090 25309 consensus_queue.cc:1059] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:16:44.413780 25223 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:44.433941 25402 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:44.437252 25402 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:44.428310 22791 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:44.439275 22819 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:44.425120 25154 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:44.441610 25154 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:44.439445 25441 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.733s	user 0.004s	sys 0.000s
I20260709 12:16:44.439630 25402 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:44.443764 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 619) took 2348 ms. Trace:
I20260709 12:16:44.444150 23679 rpcz_store.cc:276] 0709 12:16:42.094901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.095021 (+   120us) service_pool.cc:224] Handling call
0709 12:16:42.095361 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:42.095684 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:42.095711 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:42.102543 (+  6832us) log.cc:844] Serialized 26 byte log entry
0709 12:16:43.465928 (+1363385us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b180006ac00. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:16:43.506582 (+ 40654us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:43.764131 (+257549us) log.cc:844] Serialized 14 byte log entry
0709 12:16:44.013554 (+249423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:44.013663 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:44.438763 (+425100us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:44.443557 (+  4794us) raft_consensus.cc:1685] finished
0709 12:16:44.443577 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:44.443710 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39374,"prepare.queue_time_us":508598,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":50222,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":89000,"spinlock_wait_cycles":34453120,"thread_start_us":480459,"threads_started":3,"wal-append.queue_time_us":1538064}
I20260709 12:16:44.440608 25344 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:44.447757 25466 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:44.447712 25344 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:44.427361 25460 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:44.429651 25434 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:44.461889 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.416221 25463 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:44.399027 25454 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:44.464104 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:44.427660 25417 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:44.469385 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:44.470393 22747 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:16:44.471858 25173 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:44.472328 25173 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.472652 25173 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:44.438709 25223 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:44.475200 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:44.476164 22897 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:44.476828 25417 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:44.434155 25457 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:44.479120 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:44.479687 22752 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:44.480717 25457 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:44.481297 25400 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.481808 25400 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:44.482753 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:44.483677 22751 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:44.483870 25400 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:44.490417 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:44.484747 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:44.485352 25416 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:16:44.485561 25344 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:44.507359 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:44.508170 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:44.487586 25315 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:44.488080 25463 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:44.489288 25169 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:44.518554 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:44.462844 25434 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:16:44.489735 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 1.06683e+06us
I20260709 12:16:44.490759 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:44.498451 23659 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
W20260709 12:16:44.498649 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:44.530372 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 115697us
I20260709 12:16:44.499856 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:44.501992 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:44.502154 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:44.503029 22752 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:44.458317 25404 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:44.509749 23695 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:44.513123 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:44.536435 22898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 649) took 1096 ms. Trace:
I20260709 12:16:44.540004 23672 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:44.513834 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:44.514659 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:44.537185 22898 rpcz_store.cc:276] 0709 12:16:43.440110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:43.440262 (+   152us) service_pool.cc:224] Handling call
0709 12:16:43.440631 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:43.440890 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:16:43.448125 (+  7235us) log.cc:844] Serialized 14 byte log entry
0709 12:16:44.535938 (+1087813us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:44.536039 (+   101us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:44.536109 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:44.536209 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:44.536361 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":950179,"prepare.queue_time_us":8519,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"thread_start_us":144011,"threads_started":1,"wal-append.queue_time_us":340640}
I20260709 12:16:44.542465 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:44.515043 22751 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:44.467015 25309 consensus_queue.cc:1243] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:44.508250 25435 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:44.522075 22747 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:44.546164 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:44.544255 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 405) took 1279 ms. Trace:
I20260709 12:16:44.509128 25321 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:44.536376 25404 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.547254 22751 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:44.547529 22896 rpcz_store.cc:276] 0709 12:16:43.265127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:43.267443 (+  2316us) service_pool.cc:224] Handling call
0709 12:16:43.267900 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:43.268137 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:43.268474 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 12:16:43.432338 (+163864us) log.cc:844] Serialized 14 byte log entry
0709 12:16:44.390560 (+958222us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:44.487373 (+ 96813us) spinlock_profiling.cc:243] Waited 9.81 ms on lock 0x7b18003d57c0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf1694a40 00007fadf168f4e4 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287 00007fadf479a208
0709 12:16:44.543532 (+ 56159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:44.543610 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:44.543660 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:44.543740 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:44.544191 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1051152,"prepare.queue_time_us":205,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":1072949,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":4688,"spinlock_wait_cycles":53376768,"thread_start_us":199390,"threads_started":2,"wal-append.queue_time_us":194909}
I20260709 12:16:44.552959 23493 leader_election.cc:400] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8.
I20260709 12:16:44.545667 25400 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:44.556777 23493 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:44.531931 25427 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:44.528756 25063 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:44.567348 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.489778 25164 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:44.577391 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46153.4us
I20260709 12:16:44.578912 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:44.579695 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:44.560130 25309 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:44.559296 25391 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:44.554689 25107 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:44.559417 25404 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:44.584271 22717 leader_election.cc:400] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5.
I20260709 12:16:44.559793 25284 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:44.589479 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 1.18037e+06us
I20260709 12:16:44.590773 22717 leader_election.cc:403] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:44.577009 25321 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:44.585669 25400 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:16:44.595079 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.599547 25241 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.599999 25154 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:44.577240 25371 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:44.608685 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:44.585485 25391 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.612923 22895 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:16:44.631665 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 58760.6us
I20260709 12:16:44.633436 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:44.611243 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.629384 22897 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
W20260709 12:16:44.629477 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 80569.6us
I20260709 12:16:44.635303 22897 pending_rounds.cc:85] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 4
I20260709 12:16:44.635640 22897 pending_rounds.cc:107] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:16:44.635999 22897 raft_consensus.cc:2889] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:44.576026 25430 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:44.620787 25400 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:44.663596 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:44.629882 25463 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5.
W20260709 12:16:44.708544 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.627365 25483 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:16:44.755065 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 91560.5us
W20260709 12:16:44.756426 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 150976us
I20260709 12:16:44.639670 25391 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:44.756913 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 408) took 1490 ms. Trace:
I20260709 12:16:44.642416 25063 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:44.759585 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:44.760242 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:44.768116 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:44.620833 25321 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:44.702309 25468 log.cc:927] Time spent T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:16:44.628408 25241 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:44.676514 25435 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:44.661545 25400 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:44.771874 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:44.813642 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:44.784687 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.764329 22892 rpcz_store.cc:276] 0709 12:16:43.266244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:43.301459 (+ 35215us) service_pool.cc:224] Handling call
0709 12:16:43.301951 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:43.302279 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:16:43.315778 (+ 13499us) log.cc:844] Serialized 14 byte log entry
0709 12:16:44.537590 (+1221812us) log.cc:844] Serialized 14 byte log entry
0709 12:16:44.756531 (+218941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:44.756582 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:44.756628 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:44.756697 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:44.756835 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1239374,"prepare.queue_time_us":15696,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":98,"raft.queue_time_us":1196775,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":8625,"spinlock_wait_cycles":1743232,"thread_start_us":246083,"threads_started":3,"wal-append.queue_time_us":392964,"wal-append.run_cpu_time_us":1575,"wal-append.run_wall_time_us":1042703}
I20260709 12:16:44.843346 25463 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:16:44.844254 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:44.844547 25321 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:44.843669 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:44.839725 23672 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:16:44.758311 25480 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:44.758472 25482 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:44.761941 25483 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:44.619997 25284 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:44.848137 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 76348.1us
I20260709 12:16:44.782516 25457 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:44.845486 25434 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:44.798225 25280 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:44.831606 25417 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:44.839234 25460 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.832808 25377 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:44.869160 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:44.853842 25291 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:44.870471 25457 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:44.875331 25483 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:44.878991 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 248200us
W20260709 12:16:44.879743 25487 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:16:44.859293 25480 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:44.875411 25365 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:16:44.883716 25480 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:44.875545 25417 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:44.760495 25484 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:16:44.872771 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:44.876165 25235 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:44.885695 25169 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:16:44.912330 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.916393 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:44.907114 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 267054us
I20260709 12:16:44.917447 25484 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:44.917960 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.918926 25434 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:44.919179 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:44.919736 22752 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:44.876302 25485 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.917014 25173 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:44.906798 25478 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.349s	user 0.001s	sys 0.001s
I20260709 12:16:44.914316 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.929253 22824 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:44.914601 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:44.930591 22823 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:16:44.921584 22865 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:44.919423 25154 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:44.957788 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:44.991231 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 69726.3us
W20260709 12:16:44.991312 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 72193.1us
I20260709 12:16:44.992614 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:44.994194 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:44.906838 25235 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:44.904953 25377 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:44.917937 25484 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:16:44.997228 25492 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:16:44.877544 25457 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:44.996421 25291 raft_consensus.cc:2764] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:16:45.004438 25235 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.001693 24949 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:16:45.020469 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:45.014351 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.885470 25417 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.010677 25484 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:44.886705 25460 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.009656 25382 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:45.024698 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:45.004585 25499 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:16:45.011897 25498 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:45.031679 25382 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:45.034374 25440 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:45.034901 25321 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:45.011538 25169 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:16:45.036027 25377 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:45.072795 25377 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:45.073190 25377 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:44.990899 25485 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:45.073395 25309 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:45.029966 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:45.027911 25496 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.076341 25496 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:45.078233 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:45.058833 25173 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:45.028365 25430 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:45.067005 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:45.069090 25460 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:45.075428 25390 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:45.080006 22751 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:45.081351 22751 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:45.081703 25366 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:45.082129 25366 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:45.078603 25496 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:45.082674 22751 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:45.084697 22751 raft_consensus.cc:3055] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:45.022878 25164 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:45.085001 25107 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.086443 22751 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:45.093173 22751 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:45.085255 25424 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.746s	user 0.017s	sys 0.005s
I20260709 12:16:45.095408 22751 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:45.095422 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 101333us
W20260709 12:16:45.085762 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 55927.1us
I20260709 12:16:45.099654 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.100531 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.098765 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:45.105648 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:45.105885 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:45.109491 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.110344 23685 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:16:45.087180 25460 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:45.114372 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.117862 22896 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:45.118090 22900 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:16:45.116626 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:45.118821 23685 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:45.088263 25382 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:45.119416 22753 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:45.132203 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:45.118963 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:45.133493 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 141350us
I20260709 12:16:45.133846 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:45.137034 22826 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:16:45.088173 25136 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:16:45.134976 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:45.138572 22901 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:45.139585 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:45.139823 22901 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:45.140218 23679 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:45.139914 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:45.142930 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:45.139237 25430 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.111658 25173 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.145831 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:45.150133 22823 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:45.112301 25501 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:45.097504 25107 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:45.140869 22901 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:45.152053 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 636) took 2611 ms. Trace:
I20260709 12:16:45.148332 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:45.154183 22746 rpcz_store.cc:276] 0709 12:16:42.541128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.965807 (+424679us) service_pool.cc:224] Handling call
0709 12:16:42.966259 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:42.966677 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:42.966710 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:42.967332 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 12:16:43.034495 (+ 67163us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:43.034542 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:43.034775 (+   233us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:45.015849 (+1981074us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:45.146817 (+130968us) raft_consensus.cc:1685] finished
0709 12:16:45.146840 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:45.151959 (+  5119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1757,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8093,"spinlock_wait_cycles":381084032,"thread_start_us":48301,"threads_started":1,"wal-append.queue_time_us":321772}
I20260709 12:16:45.133868 25382 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:45.136068 25460 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:45.160497 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:45.098852 25164 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:45.153944 22901 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:45.161705 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:45.157514 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:45.162537 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:45.162775 22824 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:45.163417 22821 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:45.164767 23672 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:16:45.165755 23689 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:16:45.169598 22822 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 10. Ops: []
I20260709 12:16:45.170780 22823 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:45.171833 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:45.172314 22751 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:45.172942 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.173920 22751 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:45.153793 25254 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:45.176975 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:45.177881 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:45.178287 22865 connection.cc:256] RPC call timeout handler was delayed by -1.6230891229999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 12:16:45.179839 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.180733 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.183058 23660 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:16:45.183368 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.184212 22899 raft_consensus.cc:2410] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:16:45.184264 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.184944 23695 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:45.175480 25446 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:45.186100 25446 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.186484 25446 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:45.192888 25063 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.193481 25063 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.195890 25063 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:45.192162 22901 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:16:45.196560 22901 pending_rounds.cc:85] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 4
I20260709 12:16:45.196805 22901 pending_rounds.cc:107] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:16:45.197059 22901 raft_consensus.cc:2889] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:45.150665 25154 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:45.202301 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.203022 22901 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:45.203711 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.184818 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:45.183650 25460 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:45.209291 22899 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:45.214197 25498 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:45.095919 25366 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:45.215049 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.154844 25173 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:45.217124 25164 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:45.219180 25173 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:45.218709 25446 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:45.220782 25404 consensus_meta.cc:287] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.001s
I20260709 12:16:45.221477 25404 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.182420 25457 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:45.225461 25400 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:45.227402 25457 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:45.227952 25457 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:45.152222 25501 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.164333 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:45.229635 22826 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:16:45.230177 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 65930.9us
I20260709 12:16:45.231070 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:45.229031 22827 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:45.235219 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:45.237020 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 152384us
I20260709 12:16:45.245476 25366 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:45.234690 25501 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:45.249204 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.250463 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.251535 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.252235 22899 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:16:45.255035 25304 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:45.167536 25507 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 12:16:45.160890 25382 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:45.228987 25154 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.259202 25154 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:45.260561 25382 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:45.153146 25430 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:45.264876 25430 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:45.237112 25254 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:45.269662 22892 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:45.271880 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.278357 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.279260 23682 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:16:45.279623 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:45.280126 22745 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:16:45.278366 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:45.277509 23679 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:45.237502 25369 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:45.283021 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:45.285924 22823 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:45.285416 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:45.251452 25485 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:45.286882 22892 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:16:45.288921 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.289064 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.277107 24875 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:45.289343 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:45.295398 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:45.303930 22892 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:45.302557 22823 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:45.283599 25254 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:45.281442 25484 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:45.292805 25430 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:45.312645 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:45.307474 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:45.317003 22818 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:45.324697 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:45.306128 25497 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.309798 25309 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:45.290288 25369 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.327059 25430 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.347704 25430 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:45.348256 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 422) took 1736 ms. Trace:
I20260709 12:16:45.348747 22749 rpcz_store.cc:276] 0709 12:16:43.612632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:43.703059 (+ 90427us) service_pool.cc:224] Handling call
0709 12:16:43.725760 (+ 22701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:44.884248 (+1158488us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b180008b0c0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf4777060 00007fadf4777bfb 00007fadf478264b
0709 12:16:44.884396 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:44.884424 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:44.884472 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:44.884507 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:45.348013 (+463506us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54004042d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:45.348064 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:45.348193 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60754,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":22480,"spinlock_wait_cycles":519301120,"thread_start_us":97779,"threads_started":1}
I20260709 12:16:45.327024 22745 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:45.350592 25107 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:45.314271 25446 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:45.353477 25494 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.553s	user 0.000s	sys 0.007s
I20260709 12:16:45.336972 22899 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:45.354972 25485 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:45.356586 22899 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:45.356621 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:45.358822 25365 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:16:45.358963 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 656) took 1561 ms. Trace:
I20260709 12:16:45.359534 25365 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:45.360212 25365 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.361029 25365 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:45.359485 22893 rpcz_store.cc:276] 0709 12:16:43.797807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:43.797984 (+   177us) service_pool.cc:224] Handling call
0709 12:16:43.817509 (+ 19525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:44.601626 (+784117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:44.601661 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:44.602188 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:16:45.264457 (+662269us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b18001ec5e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1
0709 12:16:45.264613 (+   156us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:45.264648 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:45.264752 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:45.352764 (+ 88012us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:45.358719 (+  5955us) raft_consensus.cc:1685] finished
0709 12:16:45.358741 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:45.358906 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":856766,"raft.queue_time_us":786497,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":8521,"spinlock_wait_cycles":24330880,"thread_start_us":23329,"threads_started":1,"wal-append.queue_time_us":60200}
I20260709 12:16:45.341866 23685 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:16:45.363842 25400 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:45.364805 25514 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:45.365026 25391 consensus_meta.cc:287] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.000s
I20260709 12:16:45.365391 25514 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:45.343173 25480 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:16:45.343840 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.368117 25480 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:45.369119 25480 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.370749 25514 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:45.333186 25482 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:45.371726 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 420) took 1760 ms. Trace:
I20260709 12:16:45.372448 25369 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:45.345321 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1085) took 1072 ms. Trace:
I20260709 12:16:45.344667 25254 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.374181 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:45.372309 22744 rpcz_store.cc:276] 0709 12:16:43.611041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:43.611262 (+   221us) service_pool.cc:224] Handling call
0709 12:16:43.611582 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:44.081772 (+470190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:44.081827 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:44.123089 (+ 41262us) log.cc:844] Serialized 26 byte log entry
0709 12:16:44.282511 (+159422us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:44.439555 (+157044us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:44.601099 (+161544us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b180023b1e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf81773c7 00007fadf47899a7 00007fadf47990bf
0709 12:16:44.601282 (+   183us) log.cc:844] Serialized 14 byte log entry
0709 12:16:44.605533 (+  4251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:45.371394 (+765861us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b5400414454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:45.371445 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:45.371499 (+    54us) raft_consensus.cc:1685] finished
0709 12:16:45.371510 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:45.371664 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13166,"prepare.queue_time_us":133641,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":1214,"raft.queue_time_us":148697,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":13560,"spinlock_wait_cycles":426136448,"thread_start_us":499656,"threads_started":3,"wal-append.queue_time_us":256974}
I20260709 12:16:45.375044 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.375682 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:45.373539 25482 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:45.376677 25482 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:45.377142 25309 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:45.377871 25484 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:45.378163 25309 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:45.378630 25235 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:45.374188 25440 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:45.365392 25391 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:45.373929 22825 rpcz_store.cc:276] 0709 12:16:44.272474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.273143 (+   669us) service_pool.cc:224] Handling call
0709 12:16:45.345071 (+1071928us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b540022ef54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:45.345249 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69837696}
I20260709 12:16:45.385680 24875 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:45.404732 24875 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:45.404749 25391 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:45.406267 25491 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.502s	user 0.002s	sys 0.000s
I20260709 12:16:45.336589 25497 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:45.408859 25497 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:45.390250 25470 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.965s	user 0.008s	sys 0.011s
I20260709 12:16:45.391204 22746 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
W20260709 12:16:45.410655 22894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 655) took 1731 ms (client timeout 1991 ms). Trace:
W20260709 12:16:45.411146 22894 rpcz_store.cc:269] 0709 12:16:43.679272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:43.679520 (+   248us) service_pool.cc:224] Handling call
0709 12:16:45.410416 (+1730896us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54004ed754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:45.410584 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3409522944}
I20260709 12:16:45.391036 25235 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:45.415091 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 655) took 1068 ms. Trace:
I20260709 12:16:45.414307 25501 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:45.415581 22747 rpcz_store.cc:276] 0709 12:16:44.346261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.546552 (+200291us) service_pool.cc:224] Handling call
0709 12:16:44.546969 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:44.555243 (+  8274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:44.555309 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:44.555912 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 12:16:44.639797 (+ 83885us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:44.639838 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:44.639914 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:45.405607 (+765693us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:45.414712 (+  9105us) raft_consensus.cc:1685] finished
0709 12:16:45.414738 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:45.415015 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25713,"raft.queue_time_us":7984,"raft.run_cpu_time_us":3643,"raft.run_wall_time_us":23199,"spinlock_wait_cycles":5696896,"thread_start_us":57045,"threads_started":1,"wal-append.queue_time_us":258229}
I20260709 12:16:45.418828 22900 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:45.391037 22901 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:45.392601 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:45.394322 25507 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:16:45.395852 25466 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:16:45.425242 23685 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:45.425551 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:45.427281 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:45.429543 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:45.429950 23685 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:16:45.430387 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:45.423154 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:45.431775 22752 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:45.383937 25484 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:45.401729 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:45.403301 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:45.471482 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 68259.5us
I20260709 12:16:45.403932 25498 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:45.420529 22898 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:45.432857 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:45.476861 22744 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:45.433187 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:45.447656 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:45.447975 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:45.484848 23682 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:45.448606 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.454967 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:45.459035 23674 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:16:45.486313 23689 raft_consensus.cc:2368] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4.
I20260709 12:16:45.486430 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:45.472484 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:45.460444 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:45.463341 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:45.502748 22901 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
W20260709 12:16:45.508637 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47533.2us
I20260709 12:16:45.415143 25241 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:45.421948 25507 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:45.484829 25235 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:45.514758 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:45.510897 23679 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:16:45.468560 24949 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:45.479004 25276 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:45.485575 25497 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:16:45.526654 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 288754us
I20260709 12:16:45.543159 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:45.538218 22898 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:16:45.510651 25427 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:16:45.545492 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 168926us
W20260709 12:16:45.547971 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.515149 25180 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:45.515369 25063 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:45.478636 25366 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:16:45.478363 25485 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:16:45.469044 25154 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.418901 25457 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.550329 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:45.528113 25507 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:45.527987 25235 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.514130 25391 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:16:45.582340 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:45.577494 22748 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:16:45.583751 22748 pending_rounds.cc:85] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 3
I20260709 12:16:45.584126 22748 pending_rounds.cc:107] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:16:45.584369 22748 raft_consensus.cc:2889] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:45.542848 25497 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.579655 25501 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:45.544795 25369 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:16:45.573762 25344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.015s	sys 0.020s
I20260709 12:16:45.559824 25180 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:45.633539 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.582100 25427 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:45.548635 25224 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:16:45.572326 25508 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:16:45.585323 25463 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.565296 25446 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:45.565619 25280 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:16:45.590121 25497 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:45.587020 25304 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:45.598152 25180 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:45.659097 25479 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.069s	user 0.003s	sys 0.006s
I20260709 12:16:45.664472 25377 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:45.666575 25427 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:45.670743 25454 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:45.594249 25344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.016s	sys 0.020s
I20260709 12:16:45.587965 25235 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:45.678402 25457 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:45.682793 25284 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:45.689425 25404 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:45.595003 25369 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.579852 25430 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:45.703088 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:45.810566 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 228111us
W20260709 12:16:45.827116 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 288663us
W20260709 12:16:45.881058 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 293462us
I20260709 12:16:45.885435 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:45.886384 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.824220 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:45.811834 22747 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:45.899735 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:45.694514 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.900889 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:45.901928 23674 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:45.823172 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:45.880074 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.822011 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:45.903748 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:45.844448 22752 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:45.692148 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.905000 23659 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:45.852171 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1093) took 1569 ms. Trace:
I20260709 12:16:45.697752 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.906536 22818 rpcz_store.cc:276] 0709 12:16:44.282264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.282707 (+   443us) service_pool.cc:224] Handling call
0709 12:16:45.851471 (+1568764us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b5400125cd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:45.851785 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2258033408}
I20260709 12:16:45.908977 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:45.832401 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.892619 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:45.827906 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 641) took 1711 ms. Trace:
I20260709 12:16:45.911725 22900 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:45.828794 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.911499 22748 rpcz_store.cc:276] 0709 12:16:44.115882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.118970 (+  3088us) service_pool.cc:224] Handling call
0709 12:16:44.119470 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:45.584960 (+1465490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:45.826985 (+242025us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54001e91d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:45.827580 (+   595us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3352147200}
I20260709 12:16:45.820752 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:45.904356 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.910562 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.916046 23660 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:45.906414 23679 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 10: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:16:45.916975 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.917616 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:45.825940 22749 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:45.916289 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:45.867238 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:45.923718 23674 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:45.925976 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:45.914553 22573 catalog_manager.cc:5697] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 2 to 4, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 4 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:45.675242 24617 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.981014 25280 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.981810 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:45.982128 25280 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.983711 25136 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.984694 25136 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:45.985466 25280 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:45.986994 25284 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:45.987694 25284 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:45.990300 25430 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:45.891868 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 188768us
I20260709 12:16:45.698828 24875 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.593287 25107 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 12:16:45.716806 23689 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:45.717692 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:45.718569 25365 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:45.940901 25169 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:45.930663 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:45.941000 23660 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:16:45.731665 25377 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:45.981245 25304 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:45.686955 24850 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:45.589802 24949 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 12:16:46.032893 23659 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:16:46.035349 22898 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:46.036479 24875 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:45.980614 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 81790.3us
I20260709 12:16:45.981909 24617 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:45.949301 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:45.990015 25434 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:16:45.999666 25304 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.019032 23695 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:16:46.019204 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.022245 25241 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:45.998945 25169 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:46.056771 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 126296us
W20260709 12:16:45.759258 25526 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:16:45.767122 25507 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.058887 25344 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:46.059098 25457 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:46.059844 25344 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.060146 25457 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:46.063163 25365 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:46.065711 25440 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:46.050063 25304 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:45.717089 25463 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:46.078895 22749 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:45.721972 25446 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:46.050355 25241 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:46.081296 25446 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:46.026309 25284 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:46.043370 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:46.047008 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:46.019906 25382 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:16:46.053808 24850 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:46.054106 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:45.751658 25369 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:46.055653 23493 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:46.056036 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 107016us
I20260709 12:16:46.057380 25335 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:16:46.113301 25335 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:46.019042 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 467607us
I20260709 12:16:45.654146 25315 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 12:16:46.109313 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51028.7us
I20260709 12:16:46.111150 22818 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:45.993328 25280 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 12:16:46.057821 25169 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:46.125970 23674 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
W20260709 12:16:46.136384 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:46.139714 25482 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.762s	user 0.006s	sys 0.012s
I20260709 12:16:46.140066 25136 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:46.140901 25205 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:46.141094 25063 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:46.141670 25063 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:46.081676 25241 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.142964 25063 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.143662 25335 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.144747 25241 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:46.146190 24850 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.147300 25280 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:46.147571 25344 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:46.147850 24850 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:46.148761 25169 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:46.150341 22865 leader_election.cc:400] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4.
I20260709 12:16:46.150722 22865 leader_election.cc:403] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:16:46.144845 25063 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:46.110399 25515 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:16:46.057492 25447 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:46.055668 24617 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:46.184052 25180 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.194547 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:46.169239 22900 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
W20260709 12:16:46.206676 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46347.6us
I20260709 12:16:46.148800 25463 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:46.147866 25280 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:46.205745 25136 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:46.225665 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:46.232718 25154 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:46.178161 25482 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.234944 22749 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:46.235980 25482 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:46.240535 25365 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:46.243692 25488 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:46.245105 25164 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:46.240685 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 85158.2us
I20260709 12:16:46.246949 25366 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:46.247850 25415 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:46.248620 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 205101us
I20260709 12:16:46.248898 25154 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:16:46.249593 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 125759us
I20260709 12:16:46.307835 25463 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:46.308722 25463 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:46.311050 25366 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.312022 25457 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:46.312209 25205 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:16:46.312861 25457 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:46.313939 25164 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:46.216666 25284 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 3. Current term is 4.
I20260709 12:16:46.263913 25447 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:46.267731 22576 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43984 (request call id 156) took 16945 ms (client timeout 15000 ms). Trace:
I20260709 12:16:46.269372 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:46.269548 22573 catalog_manager.cc:5697] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 5 to 6, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 6 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:16:46.270553 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:46.247009 22747 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:46.273180 22745 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:16:46.275878 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 220476us
W20260709 12:16:46.276765 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.278741 25180 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:46.279469 25280 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:46.303440 25415 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:46.306034 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:46.251679 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:46.268440 25369 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.358882 22753 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:46.359287 22573 catalog_manager.cc:5697] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.360312 25447 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:46.360456 25369 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:46.361403 22573 catalog_manager.cc:5697] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 4 to 7, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 7 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.367522 25488 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.371268 25515 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:46.372355 25169 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:46.356289 22864 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:46.373029 25169 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.374150 25241 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:46.375186 24875 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:46.374636 25241 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.376137 25241 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:46.377117 25377 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:46.377763 25377 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:46.378969 23682 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.840s	user 0.012s	sys 0.008s
I20260709 12:16:46.379479 25316 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:46.324718 25365 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.380518 25316 consensus_queue.cc:1243] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:16:46.381210 24949 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:46.381645 24949 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:46.382403 25365 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:46.383284 25457 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:46.383430 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:46.384358 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:46.385020 22748 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:46.385753 25309 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:46.384763 24949 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:46.387146 25304 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.358924 25446 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:16:46.406659 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:46.407900 23672 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:46.407956 22892 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:46.379480 23682 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:46.390348 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:46.391007 25482 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:46.394927 25507 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:46.396215 25280 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:46.328204 22576 rpcz_store.cc:269] 0709 12:16:29.322029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:29.338094 (+ 16065us) service_pool.cc:224] Handling call
0709 12:16:30.810330 (+1472236us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54007bb454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e9090 00007fadf4787f3a 00007fadfa53de9c 00007fadfa63c04e 00007fadf8afd2a4 00007fadf8afd232 00007fadf8afd161 00007fadf8afd0dc 00007fadf8afc392 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:46.267383 (+15457053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:38.178675 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:38.234627 (+ 55952us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:38.234691 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:16:38.234709 (+    18us) tablet.cc:662] Decoding operations
0709 12:16:38.236415 (+  1706us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:38.236530 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:38.236564 (+    34us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:16:38.238301 (+  1737us) tablet.cc:701] Row locks acquired
0709 12:16:38.238365 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:16:38.238587 (+   222us) write_op.cc:270] Start()
0709 12:16:38.238768 (+   181us) write_op.cc:276] Timestamp: P: 1783599398238484 usec, L: 0
0709 12:16:38.271486 (+ 32718us) op_driver.cc:348] REPLICATION: starting
0709 12:16:38.272503 (+  1017us) log.cc:844] Serialized 6405 byte log entry
0709 12:16:39.713880 (+1441377us) op_driver.cc:464] REPLICATION: finished
0709 12:16:40.519118 (+805238us) write_op.cc:301] APPLY: starting
0709 12:16:40.527846 (+  8728us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:40.661715 (+133869us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:40.661910 (+   195us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:40.664526 (+  2616us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:40.665057 (+   531us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:16:40.665147 (+    90us) write_op.cc:312] APPLY: finished
0709 12:16:40.665762 (+   615us) log.cc:844] Serialized 112 byte log entry
0709 12:16:40.898825 (+233063us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:40.906363 (+  7538us) write_op.cc:454] Released schema lock
0709 12:16:40.906485 (+   122us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:40.910080 (+  3595us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:40.910116 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":135741,"reported_tablets":33,"spinlock_wait_cycles":2179687168,"child_traces":[["op",{"apply.queue_time_us":752931,"apply.run_cpu_time_us":24097,"apply.run_wall_time_us":419627,"num_ops":16,"prepare.queue_time_us":354063,"prepare.run_cpu_time_us":26895,"prepare.run_wall_time_us":397670,"raft.queue_time_us":818262,"raft.run_cpu_time_us":20716,"raft.run_wall_time_us":765786,"replication_time_us":1424980,"thread_start_us":1893458,"threads_started":5,"wal-append.queue_time_us":802487,"wal-append.run_cpu_time_us":77190,"wal-append.run_wall_time_us":2892452}]]}
I20260709 12:16:46.385120 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:46.397918 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:46.398638 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:46.399787 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.399578 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:46.321110 25154 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:16:46.333329 25430 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.483943 25430 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.485051 23674 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:46.465889 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.400243 25169 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:46.314682 25205 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:16:46.400935 22746 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:46.402915 25415 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:46.374570 25497 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.003s
I20260709 12:16:46.316720 25164 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:46.414659 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:46.417256 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:46.421978 22901 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:46.416730 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:46.406431 22573 catalog_manager.cc:5697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 2 to 3, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 3 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.415191 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:46.425956 22864 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:46.370561 25488 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:46.407090 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:46.408389 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:46.366510 25235 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.415701 24949 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:46.471603 25454 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.005s
I20260709 12:16:46.411957 25309 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:46.478048 25457 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:46.479818 25366 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:46.487497 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.408397 25463 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:46.491072 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 156475us
I20260709 12:16:46.493100 22752 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:46.494695 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:46.409021 25382 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:46.496744 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 680) took 1039 ms. Trace:
W20260709 12:16:46.501904 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:46.505168 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 79318.2us
I20260709 12:16:46.404594 25377 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:46.471997 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:46.537739 22749 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:46.471117 25304 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:46.508378 22898 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:46.514760 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:46.538878 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.533526 23682 rpcz_store.cc:276] 0709 12:16:45.447283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:45.447470 (+   187us) service_pool.cc:224] Handling call
0709 12:16:46.431122 (+983652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:46.517149 25169 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:16:46.544466 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 238676us
I20260709 12:16:46.513993 25309 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:46.546361 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 146921us
I20260709 12:16:46.501132 25482 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.543762 22791 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:46.535182 25427 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:46.551679 22748 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:46.553519 25434 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:46.554095 25548 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.554747 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:46.535796 25382 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:46.556227 22897 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:16:46.556420 24850 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:46.509119 25497 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.536031 25515 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:46.554260 25434 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:46.541973 25169 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:46.565214 25414 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:46.565536 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 148941us
I20260709 12:16:46.566846 23493 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:46.565958 25414 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.555099 25548 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.547498 25457 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:46.547530 25366 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:16:46.568823 25169 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:46.562016 25515 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:46.581396 22573 catalog_manager.cc:5697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 3 to 5, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 5 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:16:46.599774 23656 raft_consensus.cc:2410] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:16:46.598551 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:46.600811 22900 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:46.598894 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:46.583074 25164 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:46.590057 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:46.578665 25427 raft_consensus.cc:697] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:46.600534 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:46.572147 25453 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:16:46.569506 24850 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.591835 25488 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:46.644155 22901 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:16:46.645107 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.639420 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:46.616987 25430 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:46.650022 25390 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.652734 25390 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:46.655519 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 88851.9us
I20260709 12:16:46.587957 25402 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:46.626241 25515 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:46.642642 22899 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:16:46.636781 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:46.557091 25382 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.630036 25482 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:46.679270 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.597797 25548 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:46.640255 22894 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:46.649657 23682 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:46.657392 22900 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:46.665207 23659 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:46.665834 25434 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.667634 23695 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:46.667713 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:46.668635 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:46.669051 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:46.669600 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:46.671752 25552 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:16:46.690114 23493 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:46.690132 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:46.692340 25180 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:46.693310 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:46.694150 23679 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:46.695892 23689 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:46.670502 25497 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:46.698596 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:46.643668 25164 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:46.648558 25488 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:46.655187 25366 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:46.708946 22898 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:46.695326 25390 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:46.684645 23674 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:46.659881 25365 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:16:46.706110 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.674047 25414 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:46.715598 23660 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:46.710175 22573 catalog_manager.cc:5697] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 4 to 6, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 6 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:46.697381 25402 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:46.721711 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:46.723388 25548 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:46.735363 22827 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:16:46.724740 23493 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:46.677836 25241 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:46.727275 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 137380us
I20260709 12:16:46.699970 25430 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.703063 25454 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:46.743944 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 170479us
I20260709 12:16:46.744705 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:46.746402 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:46.747188 23672 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:46.747738 25447 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.726744 25518 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:16:46.751313 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:46.716462 25382 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:46.713506 25365 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:46.756151 22748 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 8: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:46.748211 25366 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:46.743783 25304 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.769825 22790 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:46.771927 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:46.766070 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:46.753340 25235 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:46.777961 25366 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.761466 25453 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:16:46.783084 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 58400.3us
I20260709 12:16:46.672547 25427 consensus_queue.cc:237] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:46.785382 24850 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:46.792084 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:46.792650 25454 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:46.794090 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:46.794360 22820 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:16:46.737694 25180 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:46.795557 25457 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:46.785064 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:46.796737 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 639) took 2327 ms (client timeout 2037 ms). Trace:
W20260709 12:16:46.797183 23656 rpcz_store.cc:269] 0709 12:16:44.469617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.469728 (+   111us) service_pool.cc:224] Handling call
0709 12:16:46.796416 (+2326688us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400281754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:46.796603 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4756307328}
I20260709 12:16:46.799067 23493 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:46.806738 22827 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:46.807053 23672 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:46.798708 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:46.764680 25402 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:46.764971 25463 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.820952 23656 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:46.822569 23682 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
W20260709 12:16:46.828301 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.751971 25164 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:46.829588 23494 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:46.801990 24949 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:46.824661 25457 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:46.730060 25309 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:46.826054 25390 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:46.843080 25463 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:46.844561 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 74906.1us
I20260709 12:16:46.820240 25454 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:46.767005 25430 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:46.806126 25304 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:46.765333 25488 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:46.841320 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:46.844648 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:46.838761 25453 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:46.852936 23689 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:16:46.785130 25447 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:46.879814 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:46.841359 25315 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:46.828393 25482 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:16:46.884862 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:46.865195 25390 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.844388 25523 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.129s
I20260709 12:16:46.905246 22823 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:46.904232 23695 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:46.905539 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:46.907150 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:46.891669 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:46.915146 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:46.915931 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 117028us
I20260709 12:16:46.852010 25457 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:46.934290 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 55880.2us
I20260709 12:16:46.936580 22865 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:46.939275 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:46.904866 24850 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.910817 25390 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:46.912364 25488 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:46.943265 22898 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:16:46.911624 22791 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 1.549s (SENT) [suppressed 16 similar messages]
I20260709 12:16:46.875979 24949 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:46.920099 25523 consensus_queue.cc:1243] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:16:46.948351 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:46.951658 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.930933 25454 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:46.933642 25309 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:46.955746 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:46.941289 25280 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:46.952453 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:46.864837 25365 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:46.965096 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 61018us
W20260709 12:16:46.969434 25560 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:16:46.952908 25235 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:46.946252 25169 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:46.959539 25454 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:46.953598 25377 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:16:46.974397 25241 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:47.003896 25463 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:46.949991 24850 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:47.002182 25447 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:46.957775 25453 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:16:46.975416 25280 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:46.991690 25454 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:47.012884 25446 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.032377 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:47.053508 23672 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:16:47.054366 23689 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:47.058350 22901 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:16:47.059935 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:47.066457 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 94770us
I20260709 12:16:47.020442 25515 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:47.075811 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.085770 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:47.078310 22752 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.003s
I20260709 12:16:47.069671 22899 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:47.091046 25169 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:47.091060 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:47.090173 22752 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:47.095321 25515 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:47.096011 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:47.098608 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.101505 22899 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:47.096170 25205 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:47.102439 25205 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:47.103201 22899 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:47.103924 25205 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:47.112789 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:47.086468 25430 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:47.051309 25446 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:47.152104 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:47.201521 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:47.113131 22753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.010s	sys 0.040s
I20260709 12:16:47.094607 25304 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:47.209537 22825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.007s	sys 0.031s
W20260709 12:16:47.209226 22753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.010s	sys 0.040s
I20260709 12:16:47.096087 25280 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:47.237962 23682 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:47.248272 22901 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:16:47.254879 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.218425 25063 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:16:47.264837 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.222841 25457 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:47.239941 25205 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:47.272993 22901 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:47.244051 25154 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.287221 22901 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [4.3-7.5]
I20260709 12:16:47.291759 22893 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:16:47.292577 22896 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.016s	sys 0.019s
W20260709 12:16:47.293174 22896 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.016s	sys 0.019s
I20260709 12:16:47.294308 22899 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:47.295562 22895 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:47.296849 22895 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:47.295708 22896 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:16:47.298184 22895 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:16:47.298554 22895 pending_rounds.cc:85] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 3
I20260709 12:16:47.312922 25365 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:47.315104 25063 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:47.290556 25344 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.319491 22892 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
W20260709 12:16:47.319743 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.321274 25390 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:47.325353 25446 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:47.284785 24850 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:47.326691 24949 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:47.329888 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 45569.7us
W20260709 12:16:47.376750 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 465142us
I20260709 12:16:47.331192 22895 pending_rounds.cc:107] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:16:47.377517 22895 raft_consensus.cc:2889] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:47.341305 25169 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.284268 25154 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:47.335785 25382 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.000s
W20260709 12:16:47.355285 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 514068us
I20260709 12:16:47.293118 22893 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:47.385855 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:47.354980 25063 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:47.394482 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:47.399734 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:47.410461 22748 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:47.415429 22746 pending_rounds.cc:85] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 3
I20260709 12:16:47.415865 22746 pending_rounds.cc:107] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:16:47.416097 22746 raft_consensus.cc:2889] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:47.392849 25446 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:16:47.375304 25344 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:47.396608 25169 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:47.428349 25344 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:47.432009 25154 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:47.432535 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:47.434171 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:47.408507 25414 consensus_queue.cc:1059] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:16:47.435675 25414 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:47.436075 25414 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.435747 25536 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:47.436537 25414 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:47.438259 25536 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:47.438725 25536 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.439196 25536 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:47.439851 25453 raft_consensus.cc:3055] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:47.440132 25518 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:47.440405 25453 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:47.440872 25518 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:47.441804 25453 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:47.442166 25518 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:47.443692 22752 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:16:47.443706 25518 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:47.448549 25309 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:47.449069 25309 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:47.449478 25309 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:47.432051 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:47.456676 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:47.458941 22573 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.022s	sys 0.054s
W20260709 12:16:47.459383 22573 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.022s	sys 0.054s
I20260709 12:16:47.468194 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:47.430552 25169 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:47.473361 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:47.474047 22750 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:16:47.475152 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.476444 22750 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:47.478613 22750 pending_rounds.cc:85] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 3
I20260709 12:16:47.474076 22747 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:47.480892 22750 pending_rounds.cc:107] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:16:47.483086 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:47.487808 22752 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:47.483734 22750 raft_consensus.cc:2889] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:47.470160 24850 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.493878 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:47.479604 24949 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:16:47.504066 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.502924 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:47.510222 23682 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:16:47.510882 23682 pending_rounds.cc:85] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 4
I20260709 12:16:47.511189 23682 pending_rounds.cc:107] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:16:47.511468 23682 raft_consensus.cc:2889] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:47.485641 25453 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:47.463547 25154 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:16:47.550665 24949 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:47.552234 24949 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:47.518429 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:47.498229 25402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.016s	sys 0.049s
I20260709 12:16:47.520623 25390 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:47.522054 22897 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:47.504681 25457 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:47.527379 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:47.532560 22744 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:47.533627 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 811) took 1149 ms. Trace:
W20260709 12:16:47.537492 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 43768.7us
I20260709 12:16:47.538381 25463 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:47.544698 25427 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:47.466612 25454 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:47.589357 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:47.601343 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:47.576665 25402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.016s	sys 0.049s
I20260709 12:16:47.554282 25154 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:16:47.582834 22753 rpcz_store.cc:276] 0709 12:16:46.384057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:46.384225 (+   168us) service_pool.cc:224] Handling call
0709 12:16:46.384590 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:46.504700 (+120110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:46.504747 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:46.545525 (+ 40778us) log.cc:844] Serialized 26 byte log entry
0709 12:16:47.224206 (+678681us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:47.224269 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:47.337418 (+113149us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400413a54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:47.337497 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:47.533157 (+195660us) raft_consensus.cc:1685] finished
0709 12:16:47.533184 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:47.533531 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12324,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":19163,"spinlock_wait_cycles":234877312,"thread_start_us":637849,"threads_started":1,"wal-append.queue_time_us":917188}
I20260709 12:16:47.629819 22752 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:47.599712 25457 raft_consensus.cc:697] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:47.662210 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 50878.8us
I20260709 12:16:47.671216 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:47.672937 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 820) took 1621 ms. Trace:
I20260709 12:16:47.666718 22864 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:47.671520 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:47.676290 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.672628 22744 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:47.682101 23685 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:47.686111 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:47.686527 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:47.687635 23656 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:47.690037 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:47.615940 25205 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:47.514878 24850 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:47.695380 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 467372us
I20260709 12:16:47.697324 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:47.709419 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:47.710469 23689 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:47.664506 25446 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:47.715394 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:47.664319 25463 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:47.736047 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:47.737052 22752 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:47.684800 25284 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:47.766604 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:47.699395 25580 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:47.747540 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.620719 25579 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 12:16:47.657999 25457 consensus_queue.cc:237] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:47.775770 23682 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:16:47.679296 25377 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:16:47.708712 25180 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:47.786751 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.738318 25366 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:47.673436 22825 rpcz_store.cc:276] 0709 12:16:46.040365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:46.042574 (+  2209us) service_pool.cc:224] Handling call
0709 12:16:46.042997 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:46.043424 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:16:46.490282 (+446858us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b18001445e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:16:46.512171 (+ 21889us) log.cc:844] Serialized 14 byte log entry
0709 12:16:47.658972 (+1146801us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:47.659039 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:47.659100 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:47.661121 (+  2021us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:47.661282 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71121,"prepare.queue_time_us":198530,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":52941,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6134,"spinlock_wait_cycles":91516160,"thread_start_us":1316412,"threads_started":3,"wal-append.queue_time_us":843724}
I20260709 12:16:47.682554 25430 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
W20260709 12:16:47.797055 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 361098us
I20260709 12:16:47.793076 22752 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:47.772393 25304 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:47.815411 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 426898us
I20260709 12:16:47.728418 25434 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:47.818722 22901 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:47.794067 25284 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:47.729209 25205 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:47.814527 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 380) took 1027 ms. Trace:
I20260709 12:16:47.720995 25402 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:16:47.802431 25366 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:47.832176 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.822098 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:47.817123 25588 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:47.820837 25497 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:47.858353 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:47.862700 23685 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:16:47.866025 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:47.866806 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:47.802251 25180 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:47.865810 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:47.832850 25304 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:47.835197 22819 rpcz_store.cc:276] 0709 12:16:46.787075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:46.816539 (+ 29464us) service_pool.cc:224] Handling call
0709 12:16:46.838481 (+ 21942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:46.853653 (+ 15172us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:46.911052 (+ 57399us) log.cc:844] Serialized 14 byte log entry
0709 12:16:47.804672 (+893620us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:47.804732 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:47.814203 (+  9471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:47.814294 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:47.814447 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37830,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":51,"raft.queue_time_us":34054,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":16314,"spinlock_wait_cycles":3225216,"thread_start_us":843485,"threads_started":2,"wal-append.queue_time_us":766473}
I20260709 12:16:47.870872 25579 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:47.871035 25180 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:47.871435 25304 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:47.871519 25579 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:47.871877 25586 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:47.873018 25581 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.193s
I20260709 12:16:47.873369 25463 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:47.873855 25586 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:47.874233 25579 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:47.874336 25586 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.874807 25586 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:47.841598 25309 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:47.876863 25582 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:16:47.877622 25309 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:47.799434 25580 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:47.879101 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:47.879757 25344 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:47.880100 25580 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:47.880235 25344 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:47.880750 25344 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:47.848582 25366 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:47.884440 25164 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:47.885078 25164 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:47.877550 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1176) took 1037 ms. Trace:
I20260709 12:16:47.887789 23656 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:47.872088 25304 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:47.867825 25488 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:47.887734 22901 rpcz_store.cc:276] 0709 12:16:46.840512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.288368 (+447856us) service_pool.cc:224] Handling call
0709 12:16:47.288750 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:47.826425 (+537675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:47.877246 (+ 50821us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b540005fd54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:47.877476 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217996544}
I20260709 12:16:47.895337 23689 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:16:47.838330 25280 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:47.895066 25585 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:16:47.865083 25434 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:47.932385 25180 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.933077 25180 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:47.933635 25284 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:47.956920 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:47.957577 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.964377 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:47.934463 25434 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:47.894482 25063 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:47.851130 25588 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:47.965224 22900 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:47.927336 25488 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:47.991671 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:47.987924 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.985067 25304 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:47.935247 25280 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:47.997632 22894 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:47.886132 25164 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:47.936345 25390 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 12:16:48.032716 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 368834us
I20260709 12:16:47.993157 25454 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:48.037438 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:48.003785 25304 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:48.010635 24850 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:48.097394 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:48.103204 22747 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.014s
I20260709 12:16:48.104244 22747 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
W20260709 12:16:48.106307 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 267159us
I20260709 12:16:48.045574 25180 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:48.120713 25488 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:48.182889 25588 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:48.244241 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:48.291613 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:48.274854 25594 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.270s	user 0.009s	sys 0.002s
I20260709 12:16:48.275876 25548 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:48.277129 25536 consensus_meta.cc:287] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.837s	user 0.006s	sys 0.011s
I20260709 12:16:48.277731 25454 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:48.108491 24850 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:48.016300 25593 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.123s
I20260709 12:16:48.278395 25063 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:48.279258 25592 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:48.279386 25180 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.281430 25590 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:16:48.282209 22793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.000s	sys 0.012s
W20260709 12:16:48.330282 22793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.000s	sys 0.013s
W20260709 12:16:48.283406 25414 consensus_meta.cc:287] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.846s	user 0.012s	sys 0.007s
I20260709 12:16:48.283293 25434 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.282828 25304 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.284015 25280 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:48.284237 25205 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:48.284920 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:48.285966 25169 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:48.087870 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:48.281762 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:48.311806 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:48.313966 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:48.313786 24850 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:48.313620 25536 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:48.317271 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:48.285056 25586 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:48.332093 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:48.279942 25377 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:48.324244 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 286934us
I20260709 12:16:48.365715 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:48.381800 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 100118us
I20260709 12:16:48.105659 25446 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:48.316370 24949 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:48.334103 25180 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:48.383194 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 295552us
I20260709 12:16:48.416515 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:48.384197 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:16:48.419104 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:48.419539 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:48.372364 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:48.334975 25590 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:48.414052 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 102604us
I20260709 12:16:48.417812 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:48.350220 25488 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:48.391448 25434 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:48.439260 25518 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.994s	user 0.009s	sys 0.011s
I20260709 12:16:48.439713 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:48.443581 25446 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:48.445284 25430 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:48.445755 25590 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:48.446185 24949 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:48.398658 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:48.483822 22895 raft_consensus.cc:2410] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:16:48.343616 25063 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:48.485287 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:48.415977 25205 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:48.448477 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:48.376067 25390 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:48.502547 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 54159.3us
I20260709 12:16:48.391968 25588 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:48.392252 25581 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:48.312338 25548 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:48.447589 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:48.486861 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:48.500211 22825 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:48.345134 25414 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:48.381493 25169 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:48.511708 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:48.430047 25235 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:48.504168 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:48.528661 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 450) took 1117 ms. Trace:
I20260709 12:16:48.383849 25304 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:48.542763 22826 raft_consensus.cc:2368] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9.
I20260709 12:16:48.560125 23672 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:16:48.546515 22827 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:16:48.563138 22747 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
W20260709 12:16:48.563474 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 123972us
I20260709 12:16:48.556277 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:48.564162 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:48.564977 22896 raft_consensus.cc:2410] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:16:48.566531 22901 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:48.333595 25592 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:48.541463 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:48.417749 25377 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:48.501883 25205 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.552328 22825 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:16:48.553898 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 181607us
I20260709 12:16:48.510176 25515 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:48.517081 25430 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:48.556932 22818 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:16:48.471966 25604 consensus_queue.cc:1059] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:16:48.570601 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:48.555552 22745 rpcz_store.cc:276] 0709 12:16:47.410995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.411331 (+   336us) service_pool.cc:224] Handling call
0709 12:16:47.437971 (+ 26640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:47.438397 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:47.438436 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:47.439064 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 12:16:47.779007 (+339943us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:47.779055 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:47.779127 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:48.528438 (+749311us) raft_consensus.cc:1685] finished
0709 12:16:48.528461 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:48.528587 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14703,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":339515,"threads_started":1,"wal-append.queue_time_us":530089}
I20260709 12:16:48.509356 25063 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:48.605425 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:48.526998 25454 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:16:48.599822 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:48.530632 25382 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:16:48.527419 25390 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:48.628152 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 180468us
I20260709 12:16:48.638547 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:48.639446 22824 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:48.640285 25169 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:48.640482 25497 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:48.641095 25497 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:48.641219 25454 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.641894 25454 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:48.648258 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:48.648941 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:48.605628 25205 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:48.648731 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:48.606046 25523 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:48.661746 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:48.663265 22819 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:48.663334 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:48.663836 23689 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:16:48.664145 22747 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:48.673764 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:48.675413 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:48.569453 25235 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:48.667502 25610 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 12:16:48.692602 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:48.692979 25616 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:16:48.694695 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:48.697477 25592 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:48.697798 22824 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:48.698437 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:48.700987 25434 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:48.653414 25453 consensus_meta.cc:287] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.104s	user 0.013s	sys 0.005s
W20260709 12:16:48.654352 25365 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.286s	user 0.010s	sys 0.010s
W20260709 12:16:48.649681 25366 consensus_meta.cc:287] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.012s
I20260709 12:16:48.652829 25518 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:48.673640 25581 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:16:48.703018 25619 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:48.653040 25154 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:48.703576 22901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5085cb71870c4e7782244635c250487e"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:48.780452 22752 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:48.780526 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:48.781342 22818 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:48.782836 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:48.783694 23689 raft_consensus.cc:2376] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10. Re-sending same reply.
I20260709 12:16:48.622815 25280 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 12:16:48.662031 25344 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.781s	user 0.015s	sys 0.000s
I20260709 12:16:48.705718 25180 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:48.706874 25586 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:48.692756 25608 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.144s
I20260709 12:16:48.674647 23695 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:48.676263 23685 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
W20260709 12:16:48.719602 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 120321us
I20260709 12:16:48.724022 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:48.612107 25615 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:48.726461 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:48.813844 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:48.814574 22747 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:48.733647 23656 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:16:48.751031 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 96041.3us
I20260709 12:16:48.643186 25593 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:48.755316 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:48.815646 23674 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:16:48.756088 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:48.702055 25598 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.424s	user 0.001s	sys 0.001s
I20260709 12:16:48.774578 25604 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.733176 25523 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:48.795961 22744 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:16:48.762499 24850 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:48.814719 23660 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:16:48.786669 25619 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.780359 25154 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:48.830451 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:48.833844 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:48.854108 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 170064us
I20260709 12:16:48.776402 25434 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:16:48.860899 22818 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:16:48.862426 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:48.813788 25615 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:48.775386 25366 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:48.786023 25518 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:48.890529 22898 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:16:48.908027 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:48.808918 25344 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:48.832917 25619 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:48.909541 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:48.920846 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:48.874971 25586 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:48.854084 24850 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.882795 25581 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:48.882521 25390 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:48.952190 22897 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:48.952514 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:48.887207 25548 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:48.886556 24949 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:48.825186 25604 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:48.948432 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:48.892300 25615 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:48.923048 25284 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:48.915371 25536 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:48.953521 22825 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:48.824836 25593 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:48.931216 25169 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:16:48.981499 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:48.934981 25622 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:16:48.984025 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.005s	sys 0.009s
I20260709 12:16:48.970837 25390 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:49.007570 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.008139 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:49.010160 25612 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:48.991825 25621 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.214s	user 0.000s	sys 0.002s
I20260709 12:16:48.978793 25154 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:48.982805 25284 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:49.052106 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:49.053054 25584 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.257s	user 0.005s	sys 0.001s
I20260709 12:16:49.053305 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.015693 25169 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.954659 24850 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:49.055197 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:49.055500 25597 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.770s	user 0.002s	sys 0.000s
I20260709 12:16:48.997838 25523 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:48.983085 25548 consensus_queue.cc:1059] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:16:49.060696 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 669) took 1354 ms. Trace:
I20260709 12:16:49.029965 22819 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:16:48.948277 25581 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:49.021607 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.006s	sys 0.009s
I20260709 12:16:49.098140 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 456) took 1625 ms. Trace:
I20260709 12:16:49.128661 25284 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:49.144160 23672 rpcz_store.cc:276] 0709 12:16:47.706307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.706648 (+   341us) service_pool.cc:224] Handling call
0709 12:16:47.731614 (+ 24966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:48.560737 (+829123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:49.060379 (+499642us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54000325d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:49.060596 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904627968}
I20260709 12:16:49.153023 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 452) took 1692 ms. Trace:
W20260709 12:16:49.128832 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 263147us
I20260709 12:16:49.125363 22827 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:49.130287 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 695) took 1294 ms. Trace:
I20260709 12:16:49.156198 23682 rpcz_store.cc:276] 0709 12:16:47.836212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.836464 (+   252us) service_pool.cc:224] Handling call
0709 12:16:47.859402 (+ 22938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:47.887099 (+ 27697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:47.887129 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:47.946676 (+ 59547us) log.cc:844] Serialized 26 byte log entry
0709 12:16:48.293159 (+346483us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:48.293304 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:48.293481 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:49.129983 (+836502us) raft_consensus.cc:1685] finished
0709 12:16:49.130009 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:49.130206 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15469,"raft.queue_time_us":39527,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":10823,"thread_start_us":280982,"threads_started":1,"wal-append.queue_time_us":999436}
I20260709 12:16:49.053859 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.158380 22825 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:49.054507 25377 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:49.134279 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 209628us
I20260709 12:16:49.089270 25579 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:49.052134 25402 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:16:48.982216 25280 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 12:16:49.017906 25622 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:49.138160 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:49.101413 24949 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.146032 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:49.146608 22744 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:16:49.148100 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 696732us
I20260709 12:16:49.050876 25630 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:49.144145 25154 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:49.124297 25612 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:49.153565 22751 rpcz_store.cc:276] 0709 12:16:47.461098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.461533 (+   435us) service_pool.cc:224] Handling call
0709 12:16:47.481781 (+ 20248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:47.482056 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:47.482092 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:47.519972 (+ 37880us) log.cc:844] Serialized 26 byte log entry
0709 12:16:47.857877 (+337905us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:47.857925 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:47.858022 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:49.054866 (+1196844us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:49.149290 (+ 94424us) raft_consensus.cc:1685] finished
0709 12:16:49.149312 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:49.152943 (+  3631us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43056384,"thread_start_us":337388,"threads_started":1,"wal-append.queue_time_us":510187}
I20260709 12:16:49.147662 22750 rpcz_store.cc:276] 0709 12:16:47.472314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.478077 (+  5763us) service_pool.cc:224] Handling call
0709 12:16:47.478407 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:47.538462 (+ 60055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:47.538499 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:47.539647 (+  1148us) log.cc:844] Serialized 52 byte log entry
0709 12:16:47.937765 (+398118us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:48.245591 (+307826us) log.cc:844] Serialized 14 byte log entry
0709 12:16:48.276872 (+ 31281us) log.cc:844] Serialized 14 byte log entry
0709 12:16:48.277356 (+   484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:48.277481 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:48.701303 (+423822us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:49.097818 (+396515us) raft_consensus.cc:1685] finished
0709 12:16:49.097852 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:49.098039 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75799,"prepare.queue_time_us":414450,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":32950,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":306,"spinlock_wait_cycles":31208320,"thread_start_us":638025,"threads_started":2,"wal-append.queue_time_us":579356}
I20260709 12:16:49.139487 25169 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:49.206368 22823 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:49.209842 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:49.163086 25463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.007s	sys 0.018s
I20260709 12:16:49.216528 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.217171 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:49.203855 25598 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:16:49.161237 25579 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:49.164821 25377 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:49.207504 25603 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:16:49.251852 25463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.007s	sys 0.019s
I20260709 12:16:49.287853 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.221033 25608 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 12:16:49.263881 25488 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.803s	user 0.013s	sys 0.004s
I20260709 12:16:49.328020 22864 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:49.329149 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 112070us
I20260709 12:16:49.223743 25623 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:16:49.296218 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 85172.5us
I20260709 12:16:49.217231 24949 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:49.333515 22820 raft_consensus.cc:2410] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:16:49.288847 22827 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:49.283460 25344 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:49.352512 25613 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.398s	user 0.001s	sys 0.001s
I20260709 12:16:49.282449 25603 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:49.355075 25595 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.075s	user 0.003s	sys 0.000s
I20260709 12:16:49.284791 25518 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:49.294193 25611 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:49.336269 25430 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:49.550702 22821 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
W20260709 12:16:49.408058 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:49.472851 25652 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.459008 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:49.422881 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:49.409516 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 59031.1us
I20260709 12:16:49.291666 25377 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:49.377828 22717 connection.cc:256] RPC call timeout handler was delayed by -1.3231387529999665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 12:16:49.382302 25280 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:49.335743 25623 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:16:49.409638 25591 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.004s	sys 0.010s
W20260709 12:16:49.492993 25642 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.307s	user 0.000s	sys 0.002s
W20260709 12:16:49.588541 25596 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 12:16:49.571611 25647 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.380559 25619 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:49.591162 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 448) took 2198 ms. Trace:
I20260709 12:16:49.593257 25619 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:49.591764 22746 rpcz_store.cc:276] 0709 12:16:47.392783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.400037 (+  7254us) service_pool.cc:224] Handling call
0709 12:16:47.415222 (+ 15185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:47.416707 (+  1485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:47.416740 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:47.417214 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:16:47.918180 (+500966us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:48.317076 (+398896us) log.cc:844] Serialized 14 byte log entry
0709 12:16:48.317394 (+   318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:48.317500 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:49.590809 (+1273309us) raft_consensus.cc:1685] finished
0709 12:16:49.590842 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:49.591052 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8100,"prepare.queue_time_us":395914,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":6487,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":12736,"thread_start_us":773948,"threads_started":2,"wal-append.queue_time_us":1675923}
W20260709 12:16:49.493392 25643 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 12:16:49.493777 25626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.008s	sys 0.014s
W20260709 12:16:49.595448 25626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.008s	sys 0.015s
I20260709 12:16:49.596212 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 447) took 2206 ms. Trace:
I20260709 12:16:49.498417 25063 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:49.504732 25304 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:49.504894 25589 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.337s	user 0.001s	sys 0.001s
I20260709 12:16:49.526428 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 459) took 1004 ms. Trace:
W20260709 12:16:49.535172 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 207258us
I20260709 12:16:49.492472 25659 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.609115 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:49.614568 22893 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:49.466141 25402 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:49.544937 22898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1179) took 2695 ms (client timeout 2066 ms). Trace:
I20260709 12:16:49.409164 25579 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:49.609622 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:49.551265 22823 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:49.329325 25548 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:49.621441 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:49.621731 25579 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:49.622067 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:49.622713 22823 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:49.622855 25654 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:16:49.624197 25657 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:16:49.621448 25402 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:49.596752 22749 rpcz_store.cc:276] 0709 12:16:47.389313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.389799 (+   486us) service_pool.cc:224] Handling call
0709 12:16:47.452097 (+ 62298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:47.452630 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:47.452658 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:47.453226 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:16:47.795189 (+341963us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:48.086043 (+290854us) log.cc:844] Serialized 14 byte log entry
0709 12:16:48.093363 (+  7320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:48.094555 (+  1192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:49.332920 (+1238365us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:49.595772 (+262852us) raft_consensus.cc:1685] finished
0709 12:16:49.595934 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:49.596132 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":515945,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":16710,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":19747,"spinlock_wait_cycles":60008320,"thread_start_us":620211,"threads_started":2,"wal-append.queue_time_us":825829}
I20260709 12:16:49.625342 25639 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.626403 25402 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:49.626302 25610 consensus_queue.cc:1175] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2c3a0d56045540b7802937559599f09c" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.5-7.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:16:49.564026 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.366326 25414 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:49.568161 22790 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:49.570969 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.550756 25390 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.587129 25604 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:49.634723 25390 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:49.635581 25646 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 12:16:49.622028 25548 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:49.638053 25390 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:49.539007 25593 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:49.598161 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 822) took 1311 ms. Trace:
W20260709 12:16:49.639524 25651 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:16:49.602363 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:49.640161 25205 consensus_meta.cc:287] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.966s	user 0.009s	sys 0.006s
I20260709 12:16:49.640676 22827 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
W20260709 12:16:49.642217 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 74202.8us
I20260709 12:16:49.548861 25603 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:49.540470 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1108) took 1091 ms. Trace:
W20260709 12:16:49.615151 22898 rpcz_store.cc:269] 0709 12:16:46.841494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.020094 (+178600us) service_pool.cc:224] Handling call
0709 12:16:49.507013 (+2486919us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54006ea854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:49.537031 (+ 30018us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4004272512}
I20260709 12:16:49.653332 22819 rpcz_store.cc:276] 0709 12:16:48.449004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.449136 (+   132us) service_pool.cc:224] Handling call
0709 12:16:49.530482 (+1081346us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002e8454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:49.540406 (+  9924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406833024}
W20260709 12:16:49.584022 25591 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.004s	sys 0.018s
I20260709 12:16:49.558682 24850 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:49.221416 25581 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:49.587175 25629 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 12:16:49.573571 25518 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.577732 25658 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.670501 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:49.491531 25605 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.435s
I20260709 12:16:49.621327 25633 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.679239 25633 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:49.606058 25640 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:49.627964 22821 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 9: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:49.572669 25430 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:49.621341 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:49.628481 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:49.566423 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0765387530000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 12:16:49.631620 22823 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
W20260709 12:16:49.688184 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0054387529999076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
I20260709 12:16:49.688261 22894 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:49.578640 25427 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:16:49.573246 25652 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:49.609853 22895 rpcz_store.cc:276] 0709 12:16:48.522462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.530328 (+  7866us) service_pool.cc:224] Handling call
0709 12:16:48.555859 (+ 25531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:48.776007 (+220148us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:48.868047 (+ 92040us) log.cc:844] Serialized 14 byte log entry
0709 12:16:49.206925 (+338878us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:49.206983 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:49.207032 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:49.526087 (+319055us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54005a0354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:49.526161 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:49.526354 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":136437,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":123667,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":18569,"spinlock_wait_cycles":505737600,"thread_start_us":424913,"threads_started":2,"wal-append.queue_time_us":536794}
I20260709 12:16:49.648026 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:49.585021 25623 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:49.590312 25647 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:49.607622 25280 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:49.608285 25454 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:49.661408 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.638480 25548 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:49.639526 25645 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 12:16:49.688755 25488 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:49.737815 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 82790.2us
I20260709 12:16:49.671551 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.335315 25606 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.433s
I20260709 12:16:49.609920 25453 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:16:49.677934 25605 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:49.761940 25605 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:49.762982 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:49.763374 25605 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:49.764487 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:49.765048 25605 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:49.652798 25593 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.765728 25593 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:49.766021 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:49.766731 25365 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.767350 25365 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:49.337476 25634 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.440s
I20260709 12:16:49.682413 25633 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:49.609397 25235 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:49.624238 25628 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:16:49.639699 22753 rpcz_store.cc:276] 0709 12:16:48.286625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.286820 (+   195us) service_pool.cc:224] Handling call
0709 12:16:48.287162 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:48.545579 (+258417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:48.545614 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:48.550411 (+  4797us) log.cc:844] Serialized 26 byte log entry
0709 12:16:48.806628 (+256217us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:48.806756 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:49.518026 (+711270us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54004051d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:49.540205 (+ 22179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:49.597746 (+ 57541us) raft_consensus.cc:1685] finished
0709 12:16:49.597776 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:49.598078 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29584,"raft.queue_time_us":309312,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":17192,"spinlock_wait_cycles":524832384,"thread_start_us":203003,"threads_started":1,"wal-append.queue_time_us":307787}
W20260709 12:16:49.700852 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 159831us
I20260709 12:16:49.625903 25639 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:49.770287 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:49.623565 25659 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:49.334188 25622 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:49.728824 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 80936.2us
I20260709 12:16:49.700462 25612 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:49.704974 22827 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:49.729295 22894 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [4.3-7.5]
I20260709 12:16:49.564455 25611 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:49.730028 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:49.731799 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 458) took 2034 ms. Trace:
I20260709 12:16:49.618703 22899 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:49.687561 25640 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:49.692044 25581 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:49.760530 25588 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.241s	user 0.009s	sys 0.006s
I20260709 12:16:49.759974 25463 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 12:16:49.761565 25497 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.120s	user 0.013s	sys 0.005s
I20260709 12:16:49.760140 25647 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:49.764931 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:49.652022 25205 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:49.783547 22748 rpcz_store.cc:276] 0709 12:16:47.697764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.719535 (+ 21771us) service_pool.cc:224] Handling call
0709 12:16:47.770890 (+ 51355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:48.089624 (+318734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:48.089681 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:48.274161 (+184480us) log.cc:844] Serialized 26 byte log entry
0709 12:16:48.503473 (+229312us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:48.503509 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:48.504279 (+   770us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:49.731428 (+1227149us) raft_consensus.cc:1685] finished
0709 12:16:49.731462 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:49.731709 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35263,"raft.queue_time_us":99199,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":479373,"threads_started":2,"wal-append.queue_time_us":900124}
I20260709 12:16:49.697227 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.768299 25593 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:49.684754 25518 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:49.788594 22717 leader_election.cc:400] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9.
I20260709 12:16:49.790892 22819 raft_consensus.cc:2376] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5. Re-sending same reply.
I20260709 12:16:49.795359 22898 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:49.827068 22717 leader_election.cc:403] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:16:49.797005 22824 raft_consensus.cc:2410] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:16:49.769500 25634 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:49.734127 25655 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:16:49.830031 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58389.3us
I20260709 12:16:49.772581 24949 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:49.834101 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.835194 22821 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:49.769486 25365 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:49.838641 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:49.786861 25619 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:49.843568 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:49.684340 25658 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:49.849812 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:49.852828 22821 raft_consensus.cc:2376] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8. Re-sending same reply.
I20260709 12:16:49.850492 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:49.855304 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:49.857285 25662 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:49.857985 25662 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:49.859222 25662 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:49.817160 25622 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:49.867887 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.868470 22821 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:49.869288 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.869870 22821 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:16:49.789961 25608 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:16:49.870741 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.869529 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:49.832067 25634 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:49.836382 25588 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.876212 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:49.876755 22821 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:49.815879 25497 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:49.879691 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:49.882555 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:49.880116 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:49.880291 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:49.846581 25667 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:49.752923 25280 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:49.881479 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:49.883662 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:49.848489 25655 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:49.883718 22749 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:49.862093 24949 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:49.753630 25430 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:49.889403 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:49.883723 25154 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.004s
I20260709 12:16:49.898200 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:49.901265 25659 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:49.903438 25611 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:49.904471 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:49.905450 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:49.905722 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:49.906090 23689 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:16:49.906380 23682 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:49.897205 25640 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:49.907397 25515 raft_consensus.cc:3055] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:49.907847 25515 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:49.907995 25640 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:49.908727 25518 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:49.909727 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1114) took 1409 ms. Trace:
I20260709 12:16:49.910149 22820 rpcz_store.cc:276] 0709 12:16:48.500798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.500965 (+   167us) service_pool.cc:224] Handling call
0709 12:16:49.909483 (+1408518us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54001266d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:49.909657 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1648482560}
I20260709 12:16:49.911481 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.911381 25655 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:49.912744 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:49.912993 25586 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.965s	user 0.012s	sys 0.000s
I20260709 12:16:49.913587 25586 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:49.902964 25634 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:49.917307 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:49.898851 22827 raft_consensus.cc:2376] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6. Re-sending same reply.
I20260709 12:16:49.914448 22818 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:16:49.879273 25365 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:49.913944 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.921427 22822 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
W20260709 12:16:49.922716 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 183148us
I20260709 12:16:49.885459 25523 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.924717 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:49.927279 23656 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:16:49.930001 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:49.923939 22749 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:16:49.891474 25235 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:49.908779 25515 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:49.938048 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:49.941574 23672 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:49.936537 25434 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:49.943548 25235 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:49.944007 25235 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:49.945130 25658 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:49.949695 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:49.893606 24949 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:49.949333 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:49.923810 25630 consensus_meta.cc:287] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.003s
I20260709 12:16:49.957446 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:49.884481 25588 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:49.968704 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44029.2us
W20260709 12:16:49.918372 25536 consensus_queue.cc:1175] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" responder_term: 7 status { last_received { term: 7 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 7 index: 4 } }
I20260709 12:16:49.929116 25365 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:49.976925 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:49.975016 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:49.895337 25612 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:16:49.981717 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:49.982906 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.949869 25586 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:49.986510 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 695) took 2020 ms. Trace:
I20260709 12:16:49.983688 22827 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 4.
I20260709 12:16:49.966213 24949 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:49.997407 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:49.994844 22897 rpcz_store.cc:276] 0709 12:16:47.958401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.958687 (+   286us) service_pool.cc:224] Handling call
0709 12:16:47.998032 (+ 39345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:48.956620 (+958588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:49.978358 (+1021738us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54002fe754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:49.978636 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177513856}
I20260709 12:16:49.970441 25630 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:50.004705 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:49.984804 25659 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:49.985149 25365 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:50.022379 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.023078 25659 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:50.024096 25579 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.024195 25659 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:50.024766 25579 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:50.027143 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:50.027326 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:50.010102 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 76040.7us
I20260709 12:16:50.028090 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.029467 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:50.029646 25652 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:50.030479 25579 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:50.030957 25674 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.031484 25674 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:50.031126 25579 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:16:50.032922 25434 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:49.988160 24850 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:49.990968 25658 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:50.035043 25658 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.035401 25658 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:16:50.039060 25624 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 1.339s	user 0.004s	sys 0.002s
I20260709 12:16:50.040477 24850 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:50.040993 24850 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:49.986176 25634 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:50.040488 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 698) took 2068 ms. Trace:
I20260709 12:16:50.043375 22892 rpcz_store.cc:276] 0709 12:16:47.972502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.972675 (+   173us) service_pool.cc:224] Handling call
0709 12:16:47.973076 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:47.996172 (+ 23096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:47.996218 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:48.021788 (+ 25570us) log.cc:844] Serialized 26 byte log entry
0709 12:16:48.302155 (+280367us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:48.302196 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:48.302284 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:50.038536 (+1736252us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b2400348188. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15189c4 00007fadf1516acb 00007fadf16d1dc9 00007fadf16d1a55 00007fadf16d109d 00007fadf430310e 00007fadf431a88c 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221
0709 12:16:50.040171 (+  1635us) raft_consensus.cc:1685] finished
0709 12:16:50.040193 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:50.040428 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":137674,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":11003,"spinlock_wait_cycles":36942208,"thread_start_us":202154,"threads_started":1,"wal-append.queue_time_us":625585}
I20260709 12:16:50.030632 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:50.046751 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:49.948442 25523 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:50.049201 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:50.055379 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.056293 22825 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:16:50.057314 25497 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:50.057495 25169 consensus_meta.cc:287] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.798s	user 0.006s	sys 0.005s
I20260709 12:16:50.047809 22827 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:50.062850 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 831) took 1008 ms. Trace:
I20260709 12:16:50.063149 22827 rpcz_store.cc:276] 0709 12:16:49.054239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.003176 (+948937us) service_pool.cc:224] Handling call
0709 12:16:50.062756 (+ 59580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:50.061498 22745 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:50.066059 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:50.048578 25590 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.516s	user 0.011s	sys 0.005s
I20260709 12:16:50.071223 25590 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:50.072320 25623 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:50.073503 25590 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:50.076406 25623 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:50.079238 22826 raft_consensus.cc:2368] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7.
I20260709 12:16:50.080220 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:50.084879 22897 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:50.085608 25235 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:50.081265 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:50.092634 22818 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:50.081544 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:50.084017 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:50.087257 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:50.089715 25366 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.090999 23682 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:50.090801 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:50.080685 25615 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.081s	user 0.013s	sys 0.000s
I20260709 12:16:50.100286 25615 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:50.100865 25523 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:50.102171 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:50.102887 23695 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:50.095795 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:50.090047 25588 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:50.104773 22901 raft_consensus.cc:606] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:50.108155 22901 raft_consensus.cc:614] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:50.060297 25674 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.101406 25430 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:50.105370 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:50.064112 25579 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:50.116400 25623 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:50.116873 25623 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.117267 25623 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:50.118989 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:50.107079 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 217734us
I20260709 12:16:50.104979 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:50.119969 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:50.120042 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.120484 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:50.120785 22823 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:50.110033 22745 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:16:50.112700 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:50.116235 22894 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:50.121871 22745 pending_rounds.cc:85] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 4
I20260709 12:16:50.122200 22745 pending_rounds.cc:107] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:16:50.122473 22745 raft_consensus.cc:2889] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:50.123594 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:50.125144 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:50.107095 25581 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:16:50.109671 25284 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.953s	user 0.010s	sys 0.002s
I20260709 12:16:50.128232 25632 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:50.129156 25683 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.129745 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.129588 25605 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.130340 25588 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:16:50.137338 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:50.127599 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:50.069022 25169 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:50.135118 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:50.146178 22827 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 10: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:50.109418 25610 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:50.141054 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.148239 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:50.115118 25430 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:50.125643 25579 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:50.156108 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.133203 25674 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:50.162849 25674 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:50.163523 25674 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:50.164022 25615 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:50.094082 25603 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:50.145800 25683 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:50.170706 25683 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.148986 25434 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:50.161473 25235 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.159169 25463 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:50.133453 25581 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:50.170135 25365 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:50.230436 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:50.234942 22827 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:50.239882 22896 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:50.147083 25488 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:50.174881 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:50.200917 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:50.174113 25430 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:50.247030 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 71680.9us
I20260709 12:16:50.156351 25497 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:50.195417 24850 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:50.249233 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:50.233786 25581 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:50.149897 25446 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 12:16:50.138473 25284 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:50.291671 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:50.254913 25463 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:50.260242 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:50.261852 25365 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.197100 25603 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.264478 25627 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:50.264894 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:50.280509 25457 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:50.281956 22745 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:16:50.323737 22745 pending_rounds.cc:85] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 4
I20260709 12:16:50.324120 22745 pending_rounds.cc:107] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:16:50.300536 22820 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:50.324359 22752 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:50.324426 22745 raft_consensus.cc:2889] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:50.285892 25497 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.307518 25634 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:50.308949 22748 raft_consensus.cc:2410] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 12:16:50.313606 25377 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:50.315807 22746 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:50.293725 25463 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:50.317513 22823 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:50.310720 24850 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:50.334657 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 69843.4us
I20260709 12:16:50.336599 23695 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:16:50.337924 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:50.354756 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:50.339468 25673 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.506s	user 0.005s	sys 0.000s
W20260709 12:16:50.341188 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 250263us
I20260709 12:16:50.357478 22820 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:50.342240 22827 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:50.302167 25667 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9.
I20260709 12:16:50.353211 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 826) took 1300 ms. Trace:
W20260709 12:16:50.332079 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.303341 25627 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:50.360781 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.342417 25497 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:50.360317 22823 rpcz_store.cc:276] 0709 12:16:49.052841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.301002 (+1248161us) service_pool.cc:224] Handling call
0709 12:16:50.317330 (+ 16328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:50.352907 (+ 35577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:50.353149 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:50.363515 23660 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:16:50.323508 25457 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:50.348086 25365 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:50.366281 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 825) took 1313 ms. Trace:
I20260709 12:16:50.371773 25365 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:50.371847 22818 rpcz_store.cc:276] 0709 12:16:49.052546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.107323 (+1054777us) service_pool.cc:224] Handling call
0709 12:16:50.366214 (+258891us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:50.372380 25365 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:50.372609 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 835) took 1230 ms. Trace:
I20260709 12:16:50.373167 22825 rpcz_store.cc:276] 0709 12:16:49.141932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:49.204047 (+ 62115us) service_pool.cc:224] Handling call
0709 12:16:50.372446 (+1168399us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54001261d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:50.372552 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837274880}
I20260709 12:16:50.376529 25658 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:50.377308 25205 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.379611 25169 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.381343 25284 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:50.382300 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:50.382529 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:50.383569 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:50.371209 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:50.383880 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:50.368801 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 828) took 1306 ms. Trace:
I20260709 12:16:50.369513 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:50.370677 24949 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:50.371096 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.356235 25463 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:50.385083 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.395262 22898 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:50.348804 25602 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:50.403458 22824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1123) took 1541 ms (client timeout 1595 ms). Trace:
W20260709 12:16:50.422636 22824 rpcz_store.cc:269] 0709 12:16:48.861925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.862154 (+   229us) service_pool.cc:224] Handling call
0709 12:16:50.403159 (+1541005us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54005519d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:50.403374 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2146393984}
I20260709 12:16:50.392827 22820 rpcz_store.cc:276] 0709 12:16:49.053450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.356811 (+1303361us) service_pool.cc:224] Handling call
0709 12:16:50.357228 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:50.359466 (+  2238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:50.359718 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:50.397511 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.398458 23656 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:50.424647 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.398572 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.368456 25579 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:50.397858 25649 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:50.403841 22897 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:16:50.401996 25650 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.931s	user 0.004s	sys 0.000s
I20260709 12:16:50.439234 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:50.440126 22899 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:50.422667 25602 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:50.438568 25649 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:50.444345 25581 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:50.444736 25602 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.446631 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.389400 25377 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.446297 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.452898 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.462634 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.463510 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:50.465451 22752 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:50.449121 25658 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:50.469801 22899 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:50.469863 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:50.463841 22751 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:50.400130 25662 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:50.475257 23494 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.449431 25665 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.471520 25377 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:50.481814 25662 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:50.444921 25649 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:50.491285 22898 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:16:50.462639 25619 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:50.421669 25627 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:50.528136 22827 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:50.462639 25284 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:50.469425 25602 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:50.482470 25205 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:50.486061 25603 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:50.423151 25457 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:50.596261 25457 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:50.555331 22744 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:50.599877 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.601133 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.493654 25665 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:50.602258 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:50.603256 25665 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.572409 22894 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:50.604698 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.605639 25180 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:50.606096 25659 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:50.607139 25180 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:50.607599 25659 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:50.607673 25180 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:50.609129 25180 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:50.611439 25180 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:50.611850 25610 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:50.612323 25610 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:50.613107 25610 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:50.614061 25659 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:50.583986 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.615877 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.617313 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:50.584774 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:50.617728 22826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1118) took 2047 ms (client timeout 1828 ms). Trace:
I20260709 12:16:50.490849 24949 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:50.618556 22826 rpcz_store.cc:269] 0709 12:16:48.570111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.570272 (+   161us) service_pool.cc:224] Handling call
0709 12:16:50.617346 (+2047074us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54006a09d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:50.617609 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3390985088}
I20260709 12:16:50.587941 25365 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:50.623497 25515 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:50.625401 25365 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:50.628634 25689 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:16:50.630793 25627 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:50.631889 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 73666.9us
W20260709 12:16:50.632275 22822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 823) took 1580 ms (client timeout 1957 ms). Trace:
W20260709 12:16:50.632917 22822 rpcz_store.cc:269] 0709 12:16:49.051817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:49.052818 (+  1001us) service_pool.cc:224] Handling call
0709 12:16:50.631979 (+1579161us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54006cb454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:50.632178 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817299200}
I20260709 12:16:50.635403 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:50.640259 25588 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:50.640718 25588 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.641083 25588 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:50.643033 22746 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:50.618832 25603 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:50.644079 25603 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:50.644837 25687 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.340s	user 0.002s	sys 0.001s
I20260709 12:16:50.645431 25639 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:50.583173 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.646652 22752 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
W20260709 12:16:50.647648 25690 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 12:16:50.647853 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:50.648947 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.649478 22752 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:16:50.557050 25619 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.600899 25674 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:50.650290 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.651556 22753 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:50.651850 25674 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.655576 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 845) took 1005 ms. Trace:
I20260709 12:16:50.655709 25605 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:50.656136 25605 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:50.656051 22827 rpcz_store.cc:276] 0709 12:16:49.649691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.358735 (+709044us) service_pool.cc:224] Handling call
0709 12:16:50.489815 (+131080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:50.553764 (+ 63949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:50.655394 (+101630us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54005d9150. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:50.655514 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300519296}
I20260709 12:16:50.657039 25605 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:50.667717 22898 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:50.668115 22900 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:50.650367 25619 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:50.673709 25602 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.674340 25602 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:50.678741 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46530 (request call id 18) took 1982 ms. Trace:
I20260709 12:16:50.679209 22901 rpcz_store.cc:276] 0709 12:16:48.696556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.703374 (+  6818us) service_pool.cc:224] Handling call
0709 12:16:50.678537 (+1975163us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540014f5d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf4779853 00007fadf974760a 00007fadf2ccd7d4 00007fadf2ccd762 00007fadf2ccd691 00007fadf2ccd60c 00007fadf2ccc8c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:50.678641 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3045055360}
I20260709 12:16:50.689477 25665 consensus_queue.cc:1059] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:50.690732 25635 raft_consensus.cc:3055] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:50.691107 25635 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:50.692220 22746 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:50.691943 25635 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:50.693413 22746 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:16:50.565740 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 197445us
I20260709 12:16:50.618850 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:50.695051 22750 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:50.588016 25623 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:50.697486 25623 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:50.617908 22751 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:16:50.620903 22864 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:50.699033 22895 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 12:16:50.699141 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 78327.3us
I20260709 12:16:50.621904 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:50.700421 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:50.701300 24850 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:50.701645 24850 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:50.702135 24850 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:50.701678 22747 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:16:50.609543 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.682610 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:50.703349 25635 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:50.708662 25623 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:16:50.711305 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 358209us
I20260709 12:16:50.712133 22748 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:50.589986 25497 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:50.735743 22894 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:50.729869 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:50.730082 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 94762.2us
I20260709 12:16:50.614302 25610 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:50.729471 22865 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.736953 22747 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:50.739223 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.740046 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:50.740684 22896 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:16:50.746234 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.559105 25662 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:16:50.746917 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.747397 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:50.749477 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:50.780750 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:50.776155 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:50.763854 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.759832 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:50.775831 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.789711 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:50.789139 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:50.732689 22749 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
W20260709 12:16:50.797637 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 48211.7us
I20260709 12:16:50.809487 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:50.740057 22752 raft_consensus.cc:2410] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:16:50.782292 23682 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:50.780321 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:50.816708 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56977.3us
I20260709 12:16:50.817873 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:16:50.828191 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.783152 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:50.833884 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:50.835474 23659 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:50.819846 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:50.745184 25665 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:16:50.773370 25647 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.871876 25377 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.871611 25647 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:50.873834 25647 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:50.875818 25665 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:16:50.751129 25660 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:50.877779 25660 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:50.879019 25581 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:50.879590 25602 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:50.879954 25660 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:50.880162 25602 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.880496 25660 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:50.880863 25660 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:50.880646 25602 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:50.881726 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5444065d09a34471bca8963724a74d20"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:50.882313 22894 raft_consensus.cc:606] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:50.882620 22894 raft_consensus.cc:614] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:50.710853 25623 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:50.839148 25592 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:50.883661 25592 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.838129 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:50.867177 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:50.885560 23674 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:50.838727 22747 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:50.870172 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:50.889725 23685 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:50.773689 25365 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:50.751048 25659 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:16:50.892223 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 109188us
W20260709 12:16:50.894202 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 56158.4us
I20260709 12:16:50.895270 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:50.751392 25683 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:50.906373 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 72001.2us
I20260709 12:16:50.906929 25683 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:50.908607 25344 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:50.909166 25683 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:50.838511 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:50.909251 25344 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:50.910135 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 71715.8us
I20260709 12:16:50.911042 22897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:50.910746 25344 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:50.911383 22864 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.911718 22897 raft_consensus.cc:606] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.883965 25648 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:50.912199 25377 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:50.912640 25377 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:50.912405 25648 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:50.913049 25377 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:50.792379 25605 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:50.913803 25648 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:50.915076 24949 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:50.806351 25693 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:50.809336 25366 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:50.900645 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.901209 22895 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:16:50.898917 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:50.909245 23695 pending_rounds.cc:85] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 4
I20260709 12:16:50.788923 25434 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:50.566560 25284 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:50.915603 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 91859.1us
I20260709 12:16:50.891858 25592 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:50.953279 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:50.916412 25608 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:50.921855 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:50.962663 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:50.926558 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.929011 23660 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:16:50.932340 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.925040 22896 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:16:50.937350 22752 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:50.937342 23695 pending_rounds.cc:107] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:16:50.965662 23695 raft_consensus.cc:2889] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:50.751245 25639 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.149s
I20260709 12:16:50.935837 22744 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:50.945938 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.967563 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:50.968062 22749 raft_consensus.cc:2410] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:16:50.941543 25434 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.948797 25284 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:50.948572 25660 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:50.988004 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:50.950747 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:50.886387 25602 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:50.954480 22751 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:50.907320 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:50.897408 25365 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.954766 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:50.955271 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:50.959969 22826 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:50.962316 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:50.995733 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:50.968875 22821 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:50.997273 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:50.973802 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:50.975112 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:50.942890 25683 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:51.007606 22896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a35aee871f0b41e48335c0260a873076"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:50.939517 25366 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:50.983829 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:50.995831 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 88615.1us
I20260709 12:16:50.998756 22822 raft_consensus.cc:2410] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:16:50.971148 25430 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.684s	user 0.008s	sys 0.003s
I20260709 12:16:50.961069 25608 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:51.006666 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:51.063033 23674 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:51.008293 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:50.980047 25463 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.000s
I20260709 12:16:51.006428 25365 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:51.064108 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 89085.6us
I20260709 12:16:51.007376 25683 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:51.021219 25366 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:51.069764 25683 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:51.021896 25660 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:51.024187 25427 raft_consensus.cc:3055] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:50.980525 25457 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:50.980835 25434 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:51.013764 25612 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:51.035089 25602 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:50.988046 25593 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:16:50.987517 25674 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:51.040310 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.039819 25581 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:16:51.040565 23659 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:51.043617 25658 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:16:51.044571 22572 catalog_manager.cc:5697] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.046814 25497 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:50.966814 25169 raft_consensus.cc:2764] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:16:51.053442 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:51.055676 22820 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:51.123184 22821 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:51.102990 25612 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:51.057960 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:51.126626 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:51.059074 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:51.039150 22573 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 129) took 14728 ms (client timeout 15000 ms). Trace:
I20260709 12:16:50.968432 23656 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:51.061398 22819 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:16:51.020530 22751 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:16:51.128464 22751 pending_rounds.cc:85] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 4
I20260709 12:16:51.128821 22751 pending_rounds.cc:107] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:16:51.129308 22751 raft_consensus.cc:2889] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:51.062284 23685 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:16:50.974575 25632 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:16:50.944888 25662 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:51.084854 23674 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:16:51.087198 23689 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:51.011561 25180 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:51.067195 25430 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:51.089044 22750 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:16:51.066911 25608 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:51.103968 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:51.088785 25427 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:51.151542 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 677) took 1220 ms. Trace:
I20260709 12:16:51.130681 25593 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:16:51.120003 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:51.154367 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:51.157670 22819 raft_consensus.cc:2410] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:16:51.157730 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:51.124128 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:51.056643 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:51.127820 22825 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:51.103746 25602 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:51.159868 25602 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:16:51.127693 22573 rpcz_store.cc:269] 0709 12:16:36.310440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.311052 (+   612us) service_pool.cc:224] Handling call
0709 12:16:51.039005 (+14727953us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:47.779127 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:48.005595 (+226468us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:48.005664 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:16:48.005689 (+    25us) tablet.cc:662] Decoding operations
0709 12:16:48.006868 (+  1179us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:48.006976 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:48.007012 (+    36us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:16:48.007956 (+   944us) tablet.cc:701] Row locks acquired
0709 12:16:48.008017 (+    61us) write_op.cc:260] PREPARE: finished
0709 12:16:48.008253 (+   236us) write_op.cc:270] Start()
0709 12:16:48.008477 (+   224us) write_op.cc:276] Timestamp: P: 1783599408008173 usec, L: 0
0709 12:16:48.008524 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 12:16:48.009483 (+   959us) log.cc:844] Serialized 2890 byte log entry
0709 12:16:49.618138 (+1608655us) op_driver.cc:464] REPLICATION: finished
0709 12:16:50.102662 (+484524us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b1800218560. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:16:50.102909 (+   247us) write_op.cc:301] APPLY: starting
0709 12:16:50.103022 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:50.103270 (+   248us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:50.103308 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:50.116801 (+ 13493us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:50.117166 (+   365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:16:50.117248 (+    82us) write_op.cc:312] APPLY: finished
0709 12:16:50.117612 (+   364us) log.cc:844] Serialized 58 byte log entry
0709 12:16:50.117827 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:50.117967 (+   140us) write_op.cc:454] Released schema lock
0709 12:16:50.118042 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:50.118533 (+   491us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:50.118561 (+    28us) write_op.cc:454] Released schema lock
0709 12:16:50.422640 (+304079us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x7b1800218560. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1692557 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
Metrics: {"mutex_wait_us":294404,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":130960,"apply.run_cpu_time_us":3573,"apply.run_wall_time_us":15618,"num_ops":7,"prepare.queue_time_us":938662,"prepare.run_cpu_time_us":26163,"prepare.run_wall_time_us":648906,"raft.queue_time_us":789770,"raft.run_cpu_time_us":60367,"raft.run_wall_time_us":203173,"replication_time_us":1546854,"spinlock_wait_cycles":28396800,"thread_start_us":1967472,"threads_started":4,"wal-append.queue_time_us":685050,"wal-append.run_cpu_time_us":26818,"wal-append.run_wall_time_us":2439320}]]}
I20260709 12:16:51.134294 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:51.140249 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:51.164475 25169 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:51.165097 25169 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:51.165957 25169 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:51.166728 22751 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:51.148447 25639 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:16:51.156302 25593 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:51.168241 25593 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:51.169420 25593 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:51.076798 25463 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:51.175684 22749 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:51.130038 22572 catalog_manager.cc:5697] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 4 to 5, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 5 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.177172 25463 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:51.180323 22572 catalog_manager.cc:5697] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 4, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.152096 23689 rpcz_store.cc:276] 0709 12:16:49.926864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:49.937252 (+ 10388us) service_pool.cc:224] Handling call
0709 12:16:51.146258 (+1209006us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400088c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:51.146441 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2544010496}
I20260709 12:16:51.155282 22896 raft_consensus.cc:606] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:51.195757 22896 raft_consensus.cc:614] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:51.131827 25612 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:51.182130 25581 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.185940 22749 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:51.191979 25662 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:51.193887 25430 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:51.194379 22746 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:51.229954 25608 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:51.232276 25366 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:51.234448 25366 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:51.236125 24850 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 12:16:51.236575 24850 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:51.239996 22572 catalog_manager.cc:5697] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 3 to 4, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:51.244462 25623 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:16:51.247231 25619 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.001s
I20260709 12:16:51.247706 25619 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:51.249763 25619 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:51.250867 25635 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.003s
I20260709 12:16:51.251487 25635 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:51.251816 25635 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:51.252594 25635 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:51.257125 25608 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:51.259099 25581 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:51.261384 25581 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:51.196105 22899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.013s	sys 0.027s
I20260709 12:16:51.115175 22752 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
W20260709 12:16:51.274173 22899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.014s	sys 0.028s
W20260709 12:16:51.153198 25627 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 12:16:51.209661 23656 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:16:51.186018 25602 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:51.214478 25180 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:51.216466 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:51.217633 22827 raft_consensus.cc:3055] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:51.288993 22818 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:51.289225 22827 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:51.220397 25674 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:51.219848 25427 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:51.205549 22748 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:51.274231 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:51.174367 25377 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:51.293666 22896 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:16:51.294126 22900 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:51.290148 22827 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:51.280534 25434 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:51.196568 25304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.029s	sys 0.014s
I20260709 12:16:51.284686 22894 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:51.298677 22827 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:51.284759 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:51.286767 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.288126 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:51.293541 22749 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:16:51.238520 24850 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:51.290616 25603 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
I20260709 12:16:51.279309 23682 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:51.300768 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:51.306911 22897 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:51.290835 25457 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:51.222581 25683 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:51.315265 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.331169 22744 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 4. Current term is 6. Ops: []
I20260709 12:16:51.334964 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:51.298964 25304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.029s	sys 0.014s
W20260709 12:16:51.308775 25588 consensus_meta.cc:287] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.002s
I20260709 12:16:51.353744 25588 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:51.314266 25603 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:51.354709 25602 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:51.356658 25603 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:51.357172 25377 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:51.358078 22823 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:51.309868 25365 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:51.360550 25601 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:51.360877 25588 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:51.361212 25365 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:51.307416 25674 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:51.362112 25674 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:51.367043 22897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:16:51.357923 25683 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:51.367995 22897 raft_consensus.cc:606] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:51.368425 22897 raft_consensus.cc:614] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:51.378273 22900 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
W20260709 12:16:51.339879 25454 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.021s	sys 0.032s
I20260709 12:16:51.380030 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:51.390509 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:51.397744 22827 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:51.397455 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:16:51.406484 25454 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.022s	sys 0.032s
I20260709 12:16:51.402962 25674 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:51.463163 25612 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:51.433377 25434 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:51.465194 22820 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:51.439764 25592 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:51.483156 22745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.010s	sys 0.061s
W20260709 12:16:51.483826 22745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.010s	sys 0.062s
W20260709 12:16:51.486836 23494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.009s	sys 0.017s
W20260709 12:16:51.487277 23494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.009s	sys 0.017s
W20260709 12:16:51.487553 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 680516us
I20260709 12:16:51.492156 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:51.487836 25390 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.015s	sys 0.022s
I20260709 12:16:51.495435 22898 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:51.493111 22894 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
W20260709 12:16:51.499102 23498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.016s	sys 0.024s
I20260709 12:16:51.497179 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:51.500128 23498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.017s	sys 0.024s
W20260709 12:16:51.501272 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.501056 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:51.502107 22750 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:51.502869 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:51.503719 22897 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
W20260709 12:16:51.498304 25390 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.016s	sys 0.022s
W20260709 12:16:51.509254 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.511448 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:51.512499 22896 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
W20260709 12:16:51.489205 22753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.017s	sys 0.012s
W20260709 12:16:51.522132 22753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.017s	sys 0.012s
I20260709 12:16:51.527006 25434 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.527906 25434 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:51.521437 25205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.021s	sys 0.018s
W20260709 12:16:51.559677 23679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.006s	sys 0.018s
W20260709 12:16:51.647768 23679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.007s	sys 0.023s
W20260709 12:16:51.603701 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.008s	sys 0.018s
W20260709 12:16:51.649080 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.010s	sys 0.018s
I20260709 12:16:51.644553 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 841) took 1053 ms. Trace:
W20260709 12:16:51.631506 23695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.012s	sys 0.007s
W20260709 12:16:51.603231 22901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.017s	sys 0.018s
I20260709 12:16:51.501798 25365 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:16:51.538095 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:51.650437 22901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.022s	sys 0.019s
I20260709 12:16:51.651662 22749 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:51.650017 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 654337us
W20260709 12:16:51.649866 23695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.012s	sys 0.008s
I20260709 12:16:51.646708 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 471) took 1250 ms. Trace:
I20260709 12:16:51.653184 22745 rpcz_store.cc:276] 0709 12:16:50.396001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.396133 (+   132us) service_pool.cc:224] Handling call
0709 12:16:50.401920 (+  5787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:50.445611 (+ 43691us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:50.471841 (+ 26230us) log.cc:844] Serialized 14 byte log entry
0709 12:16:50.629035 (+157194us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b180043d1a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:16:51.484408 (+855373us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:51.484480 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:51.484537 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:51.646434 (+161897us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b54004042d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:51.646487 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:51.646634 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26026,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":1250,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":1861,"spinlock_wait_cycles":110934144,"thread_start_us":855020,"threads_started":1}
I20260709 12:16:51.646564 25579 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:16:51.662936 22824 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.011s	sys 0.014s
W20260709 12:16:51.663522 22824 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.011s	sys 0.014s
W20260709 12:16:51.671707 22790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.009s	sys 0.017s
W20260709 12:16:51.672874 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.674396 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:51.675422 22894 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:51.676352 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:16:51.677795 22790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.009s	sys 0.017s
I20260709 12:16:51.678499 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:51.649703 22753 rpcz_store.cc:276] 0709 12:16:50.591169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.653896 (+ 62727us) service_pool.cc:224] Handling call
0709 12:16:50.656769 (+  2873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:50.657084 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:50.658196 (+  1112us) log.cc:844] Serialized 14 byte log entry
0709 12:16:51.644172 (+985976us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:51.644221 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:51.644273 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:51.644371 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:51.644501 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121466,"prepare.queue_time_us":458,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":124971,"thread_start_us":864004,"threads_started":1}
W20260709 12:16:51.653716 25205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.021s	sys 0.021s
W20260709 12:16:51.680965 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 664569us
I20260709 12:16:51.643425 25674 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:51.687595 22822 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.009s	sys 0.015s
W20260709 12:16:51.687834 22793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.010s	sys 0.017s
I20260709 12:16:51.695006 23672 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:51.690900 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:51.695384 22822 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.009s	sys 0.015s
W20260709 12:16:51.695461 22793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.010s	sys 0.018s
W20260709 12:16:51.699600 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.703698 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:51.704521 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:51.644176 25683 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:51.655403 24949 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:16:51.709796 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:51.711768 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.712280 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:51.713778 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:51.714112 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:51.717552 23674 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:51.719756 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:51.724592 23689 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:16:51.736843 25698 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 12:16:51.741127 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:51.747205 22865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.001s	sys 0.034s
W20260709 12:16:51.748169 22865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.001s	sys 0.034s
W20260709 12:16:51.749073 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 645171us
I20260709 12:16:51.753455 22749 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:51.710335 25627 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:51.759662 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:51.767760 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:51.770519 22746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.005s	sys 0.013s
I20260709 12:16:51.768070 23674 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:51.774741 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:51.775740 25304 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:51.767350 25660 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.678s	user 0.019s	sys 0.007s
I20260709 12:16:51.709973 25674 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:51.770447 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:51.719363 25683 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:51.847352 22751 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.022s	sys 0.026s
W20260709 12:16:51.804912 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:51.943158 22751 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.025s	sys 0.029s
W20260709 12:16:51.797317 23493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.003s	sys 0.036s
I20260709 12:16:51.928223 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:51.944936 22895 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.003s	sys 0.016s
I20260709 12:16:51.945369 23689 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:51.945461 22895 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.004s	sys 0.016s
W20260709 12:16:51.777040 22746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.005s	sys 0.014s
I20260709 12:16:51.883706 22747 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
W20260709 12:16:51.947214 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.005s	sys 0.013s
W20260709 12:16:51.947353 23493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.005s	sys 0.042s
I20260709 12:16:51.777745 23659 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:16:51.778602 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:16:51.949746 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 179416us
W20260709 12:16:51.951819 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.005s	sys 0.013s
I20260709 12:16:51.945174 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:51.952073 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 1.05456e+06us
W20260709 12:16:51.953948 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 614577us
W20260709 12:16:51.957309 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.957679 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:51.946350 25463 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.005s	sys 0.013s
W20260709 12:16:51.882517 25708 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:16:51.786525 25344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.008s	sys 0.034s
I20260709 12:16:51.974892 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:51.777102 25377 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:16:51.779065 25612 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:51.790263 25515 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.005s	sys 0.019s
I20260709 12:16:51.780906 25180 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:51.882910 25714 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:51.983183 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 267477us
I20260709 12:16:51.871017 25434 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:51.862082 25711 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:51.986289 23682 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:51.976030 25603 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:16:51.994112 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:52.051668 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 57654.1us
I20260709 12:16:51.972662 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:51.847754 25366 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:52.001732 23660 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:51.881040 25704 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:51.875490 25693 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:52.004514 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.876078 25497 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 12:16:51.782935 25592 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:51.955351 25632 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:51.991372 25344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.012s	sys 0.042s
I20260709 12:16:51.849092 25605 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.153s
W20260709 12:16:51.979441 25463 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.006s	sys 0.014s
I20260709 12:16:51.967212 25718 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:51.782317 25205 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.227s
I20260709 12:16:52.007072 25703 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:51.955260 25446 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:16:52.066227 25700 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:51.981187 25713 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:51.966130 25304 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:52.044782 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:52.099606 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 54898.4us
I20260709 12:16:51.974387 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:52.048544 25711 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:51.980890 25602 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:16:52.007200 25719 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:52.109767 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:52.112290 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.112968 22823 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:52.116638 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.117467 22820 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:52.118995 22821 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:16:52.027244 25515 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.006s	sys 0.020s
I20260709 12:16:52.080953 25180 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:16:52.077350 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:52.123878 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.124302 22753 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:16:52.047719 25377 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:52.124702 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.062520 25706 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:52.096729 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1201) took 1200 ms. Trace:
I20260709 12:16:52.130738 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.045291 25714 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:52.108529 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:52.050211 25169 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.024s	sys 0.016s
I20260709 12:16:52.061647 23682 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:52.121093 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.070705 25366 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:52.123692 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 149416us
I20260709 12:16:52.109380 25205 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:52.150547 22745 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:52.151191 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:52.131129 22901 rpcz_store.cc:276] 0709 12:16:50.896711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.898220 (+  1509us) service_pool.cc:224] Handling call
0709 12:16:50.903730 (+  5510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:50.904162 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:50.904194 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:50.904820 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 12:16:51.651770 (+746950us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:51.651821 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:51.651912 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:52.096455 (+444543us) raft_consensus.cc:1685] finished
0709 12:16:52.096502 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:52.096660 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1525,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":746467,"threads_started":1,"wal-append.queue_time_us":767119}
I20260709 12:16:52.124769 22753 pending_rounds.cc:85] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 3
W20260709 12:16:52.097282 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44686.9us
I20260709 12:16:52.074620 25665 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:16:52.128087 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:16:52.083835 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 305849us
I20260709 12:16:52.161780 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:52.114987 25710 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.222s	user 0.001s	sys 0.001s
I20260709 12:16:52.130507 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.130862 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.076361 23689 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:52.144012 22822 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:16:52.152254 22820 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:52.152730 22753 pending_rounds.cc:107] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:16:52.165649 22753 raft_consensus.cc:2889] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:52.125515 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.130951 25377 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:16:52.153954 25722 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.212s	user 0.001s	sys 0.001s
I20260709 12:16:52.153875 25735 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:16:52.143162 25612 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:52.132588 25706 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.156466 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.159595 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.169090 22823 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:52.169426 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:52.125488 25712 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:52.179030 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.180051 22822 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:52.085186 25632 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:52.079018 25693 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:52.146341 25169 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.025s	sys 0.021s
I20260709 12:16:52.103075 25603 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:16:52.128978 25719 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:52.180902 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 205827us
I20260709 12:16:52.170658 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:52.182232 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.182709 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.072840 25704 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:52.179857 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.184547 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:52.174607 25593 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.002s	user 0.015s	sys 0.006s
I20260709 12:16:52.188023 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:52.187559 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.173851 25377 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:52.178753 25706 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:52.172834 25605 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:52.195986 22818 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:16:52.198915 22819 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 9: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:52.143432 25497 consensus_queue.cc:1059] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:16:52.111864 25700 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:52.199383 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:52.210960 22745 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:52.191458 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:52.211055 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 721) took 1466 ms. Trace:
I20260709 12:16:52.150593 25725 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:16:52.212142 22823 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:16:52.197666 25634 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:16:52.216678 25674 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:52.216516 25180 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:52.193269 25683 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:52.197994 25612 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:16:52.217655 25728 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:16:52.189253 25739 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:52.218323 25709 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:16:52.218243 25704 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:52.190864 25169 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:52.176043 25434 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:16:52.223990 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:16:52.325186 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 101255us
I20260709 12:16:52.191983 25735 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:52.222765 23695 rpcz_store.cc:276] 0709 12:16:50.744437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.744577 (+   140us) service_pool.cc:224] Handling call
0709 12:16:50.750615 (+  6038us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:50.972789 (+222174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:50.972823 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:50.973377 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:16:51.653212 (+679835us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:51.653267 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:51.793891 (+140624us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54003746d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:51.793965 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:52.198878 (+404913us) raft_consensus.cc:1685] finished
0709 12:16:52.198897 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:52.210976 (+ 12079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364215680,"thread_start_us":665462,"threads_started":1,"wal-append.queue_time_us":887557}
I20260709 12:16:52.228392 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.181092 25703 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:16:52.210094 25446 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:52.229776 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 849) took 1302 ms. Trace:
I20260709 12:16:52.209183 25579 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:52.213624 25602 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:16:52.225838 25726 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.211s	user 0.000s	sys 0.002s
I20260709 12:16:52.232870 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.331082 22746 rpcz_store.cc:276] 0709 12:16:50.927708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.223189 (+295481us) service_pool.cc:224] Handling call
0709 12:16:51.223545 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:51.223963 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:51.223997 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:51.224534 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:16:51.947535 (+723001us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:51.947600 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:51.947706 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:52.229504 (+281798us) raft_consensus.cc:1685] finished
0709 12:16:52.229527 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:52.229706 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15349,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":722541,"threads_started":1,"wal-append.queue_time_us":685703}
I20260709 12:16:52.233085 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.220520 25605 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:16:52.267233 25731 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:16:52.268044 25736 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:16:52.268465 25739 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:52.272578 25280 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.014s	sys 0.010s
I20260709 12:16:52.274017 25454 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:16:52.277840 25730 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:16:52.277495 22822 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:16:52.227044 25660 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:16:52.301039 22791 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 1.525s (SENT) [suppressed 22 similar messages]
I20260709 12:16:52.323556 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:52.224820 25390 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 12:16:52.323859 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 143571us
I20260709 12:16:52.324200 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 713) took 1050 ms. Trace:
I20260709 12:16:52.236086 25674 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:52.332824 22894 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:52.341917 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 850) took 1406 ms. Trace:
W20260709 12:16:52.323873 25746 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 12:16:52.336429 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:52.370426 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.336781 25602 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:52.339550 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.376210 22901 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:52.334824 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.351039 22897 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:52.343427 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 395) took 1391 ms. Trace:
I20260709 12:16:52.387400 22824 rpcz_store.cc:276] 0709 12:16:50.951992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.954886 (+  2894us) service_pool.cc:224] Handling call
0709 12:16:50.982157 (+ 27271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:51.664025 (+681868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:51.664071 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:51.710249 (+ 46178us) log.cc:844] Serialized 26 byte log entry
0709 12:16:51.991739 (+281490us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:51.991789 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:51.991869 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:52.343164 (+351295us) raft_consensus.cc:1685] finished
0709 12:16:52.343191 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:52.343354 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17700,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":140,"thread_start_us":911358,"threads_started":2,"wal-append.queue_time_us":410783}
I20260709 12:16:52.338582 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.381008 22900 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:52.342648 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 716) took 1055 ms. Trace:
I20260709 12:16:52.391456 22825 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:16:52.377669 22752 rpcz_store.cc:276] 0709 12:16:50.935633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.307837 (+372204us) service_pool.cc:224] Handling call
0709 12:16:51.345472 (+ 37635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:51.345920 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:51.345961 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:51.380340 (+ 34379us) log.cc:844] Serialized 26 byte log entry
0709 12:16:51.848943 (+468603us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:51.849012 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:51.849126 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:52.341631 (+492505us) raft_consensus.cc:1685] finished
0709 12:16:52.341659 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:52.341846 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7455,"thread_start_us":421506,"threads_started":1,"wal-append.queue_time_us":543075}
I20260709 12:16:52.384429 22896 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:16:52.347970 25280 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.014s	sys 0.010s
I20260709 12:16:52.378645 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:52.335052 25579 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:52.369457 25497 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.377903 22895 rpcz_store.cc:276] 0709 12:16:51.272767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.280540 (+  7773us) service_pool.cc:224] Handling call
0709 12:16:51.280933 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:51.281175 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:51.956782 (+675607us) log.cc:844] Serialized 14 byte log entry
0709 12:16:52.322553 (+365771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:52.322683 (+   130us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:52.322828 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:52.323014 (+   186us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:52.323395 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":645314,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":63841,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":87055104,"thread_start_us":1029856,"threads_started":3,"wal-append.queue_time_us":308664}
W20260709 12:16:52.341154 25727 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:16:52.396180 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:52.333935 25515 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:52.339772 25605 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:52.390225 22899 rpcz_store.cc:276] 0709 12:16:51.286812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.286969 (+   157us) service_pool.cc:224] Handling call
0709 12:16:51.287349 (+   380us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:16:51.310605 (+ 23256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:51.310637 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:16:51.525506 (+214869us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b1800133900. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a
0709 12:16:51.562395 (+ 36889us) log.cc:844] Serialized 78 byte log entry
0709 12:16:51.976913 (+414518us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:52.007002 (+ 30089us) log.cc:844] Serialized 14 byte log entry
0709 12:16:52.007366 (+   364us) log.cc:844] Serialized 14 byte log entry
0709 12:16:52.108059 (+100693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:52.108142 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:52.342404 (+234262us) raft_consensus.cc:1685] finished
0709 12:16:52.342422 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:52.342588 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":115534,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":113,"raft.queue_time_us":251104,"raft.run_cpu_time_us":574,"raft.run_wall_time_us":59916,"spinlock_wait_cycles":9062912,"thread_start_us":388073,"threads_started":2,"wal-append.queue_time_us":518645}
I20260709 12:16:52.337674 25749 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:16:52.348094 25719 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:52.403427 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 77358.3us
I20260709 12:16:52.405002 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.405143 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.405388 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:52.407069 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.369870 25660 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:52.338795 25740 raft_consensus.cc:2764] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:16:52.411464 25602 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:52.397218 25729 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:16:52.415688 25714 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:52.426258 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:52.404771 25674 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:52.416558 25693 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:52.420363 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:52.420867 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:52.422114 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 194293us
I20260709 12:16:52.348390 25446 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:52.439033 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:52.440057 23695 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:52.433645 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:52.441795 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:52.442502 22749 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:16:52.444962 22824 pending_rounds.cc:85] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 3
I20260709 12:16:52.445370 22824 pending_rounds.cc:107] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:16:52.445768 22824 raft_consensus.cc:2889] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:52.446192 23685 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:52.403644 25743 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:16:52.454237 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:52.447820 22819 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:52.419750 25748 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:52.410490 25515 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:16:52.423636 25627 consensus_meta.cc:287] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.642s	user 0.015s	sys 0.000s
W20260709 12:16:52.454704 22865 connection.cc:256] RPC call timeout handler was delayed by -1.5046751560000757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 12:16:52.457305 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:52.467038 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:52.468083 23689 raft_consensus.cc:2368] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7.
I20260709 12:16:52.470721 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.423413 25712 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:52.473284 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:52.474618 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:52.485973 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 184960us
W20260709 12:16:52.470602 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 245189us
I20260709 12:16:52.497269 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:52.498653 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:52.409094 25497 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:52.394325 25612 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:52.499902 22791 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 1.542s (SENT)
I20260709 12:16:52.500993 23685 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:52.446465 25366 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:52.452217 25693 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:52.508055 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:52.448194 25751 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:16:52.504662 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:52.468953 25627 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:52.511729 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:52.510417 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:52.514947 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:52.515563 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:52.514438 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.441133 25434 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:16:52.525701 22819 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 10: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:52.526582 22822 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:52.562179 22827 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:16:52.562726 23685 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
W20260709 12:16:52.569164 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 61284.9us
I20260709 12:16:52.570470 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:52.512676 25703 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:52.574695 23685 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:52.576892 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:52.579514 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:52.569005 25744 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:52.582692 25497 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:52.583047 25759 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:16:52.583900 25732 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:16:52.584013 25304 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:52.572695 25761 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:52.585273 25683 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:52.586196 23695 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
W20260709 12:16:52.590123 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:52.590623 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:52.591162 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:52.591032 22822 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:52.592736 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.594141 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.503060 25463 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:16:52.597730 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.598419 22819 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:52.601517 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:52.570573 25366 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:16:52.604759 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 105363us
I20260709 12:16:52.524956 25754 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:16:52.609112 22791 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 1.669s (SENT)
I20260709 12:16:52.572412 25748 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:52.585743 25683 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:52.612027 23685 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:52.619020 22819 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:16:52.568158 25751 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:52.574287 25627 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:52.643112 25627 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:52.643832 25366 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:52.644928 25366 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:52.645519 25627 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:52.646066 25169 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:52.623461 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.647023 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:52.647384 22825 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
W20260709 12:16:52.648933 23660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 727) took 1823 ms (client timeout 2017 ms). Trace:
I20260709 12:16:52.649158 22825 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:16:52.649499 25706 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:52.651754 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 696) took 1890 ms. Trace:
I20260709 12:16:52.652352 22747 rpcz_store.cc:276] 0709 12:16:50.760926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.993767 (+232841us) service_pool.cc:224] Handling call
0709 12:16:51.031430 (+ 37663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:51.949146 (+917716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:52.651417 (+702271us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b5400406ad4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:52.651667 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959422720}
I20260709 12:16:52.653764 22820 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:52.655092 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 722) took 1910 ms. Trace:
W20260709 12:16:52.655818 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:52.656503 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:52.635811 25760 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:16:52.649188 25755 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:16:52.657915 25748 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:52.635702 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:52.629153 25648 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:52.575018 25515 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:52.463636 25735 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:52.638734 25712 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:52.639508 25753 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:16:52.639336 25759 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:52.673187 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:52.674044 22746 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:52.674506 25734 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:52.674934 25734 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:52.675026 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:52.675815 25734 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:52.640378 25754 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:52.677089 25734 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:52.642079 25751 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:52.637427 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:16:52.636884 22791 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 1.677s (SENT)
I20260709 12:16:52.661369 22819 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:16:52.663880 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:52.649511 23660 rpcz_store.cc:269] 0709 12:16:50.825269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.974110 (+148841us) service_pool.cc:224] Handling call
0709 12:16:52.648673 (+1674563us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54003552d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:52.648853 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050976128}
I20260709 12:16:52.684058 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:52.573861 25674 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:16:52.693593 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:52.694474 23660 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:52.655494 23679 rpcz_store.cc:276] 0709 12:16:50.744712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.744841 (+   129us) service_pool.cc:224] Handling call
0709 12:16:50.779993 (+ 35152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:50.883679 (+103686us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:51.648493 (+764814us) log.cc:844] Serialized 14 byte log entry
0709 12:16:52.008929 (+360436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:52.008992 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:52.009041 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:52.654853 (+645812us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400024254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:52.654895 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:52.655032 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1160,"prepare.queue_time_us":819293,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":41,"raft.queue_time_us":2159,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":15940,"spinlock_wait_cycles":237922688,"thread_start_us":1123122,"threads_started":2,"wal-append.queue_time_us":453536}
I20260709 12:16:52.667392 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:52.666402 25344 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:52.671010 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:52.704768 22748 raft_consensus.cc:2393] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:52.671250 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:52.671370 25515 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:52.671568 22750 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:52.706612 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:52.667580 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:52.610726 25739 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:52.570307 25660 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:52.669914 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:16:52.710820 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 73960.8us
W20260709 12:16:52.726250 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 269029us
W20260709 12:16:52.730129 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 280408us
I20260709 12:16:52.730842 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:52.732257 23679 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:16:52.734398 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 132964us
I20260709 12:16:52.738984 25693 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:52.739558 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:52.747184 23660 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:16:52.726660 25434 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:52.718137 25446 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:52.711072 25761 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:52.756135 23660 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 8. Ops: []
I20260709 12:16:52.697818 25714 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:16:52.754585 23494 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:52.718540 25639 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.758452 23660 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:52.760269 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.735100 25280 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.771919 23660 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:16:52.769972 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:52.774000 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:52.768196 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:52.770816 25770 consensus_queue.cc:1059] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:16:52.777628 22744 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:52.677366 25754 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:52.739893 25693 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:52.792867 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 125306us
I20260709 12:16:52.763058 25768 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.793478 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:52.770270 25759 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:52.712801 25344 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:52.766023 25769 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:52.711411 25683 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:52.762192 25434 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:52.816464 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:52.792580 25454 raft_consensus.cc:3055] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:52.818552 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:52.797389 25634 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.811656 25769 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.778453 25280 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:16:52.827152 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 53268us
I20260709 12:16:52.795396 25647 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:52.773658 25760 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:16:52.779158 25639 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:52.799116 25719 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.821733 25771 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:52.840826 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:52.840265 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:52.843218 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:52.855190 22899 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:52.844206 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:52.813182 25706 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:52.802220 25773 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.852550 22900 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:52.826390 25774 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:52.853948 22896 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:16:52.835577 25769 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:52.849581 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:52.856066 23494 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:52.867250 25766 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:16:52.827921 25454 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:52.864918 25693 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:52.865231 25344 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:52.865906 25775 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:16:52.826493 25453 consensus_queue.cc:1175] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2c3a0d56045540b7802937559599f09c" responder_term: 10 status { last_received { term: 9 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:16:52.857658 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:52.869091 22893 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:16:52.861433 25759 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:52.847929 25744 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:52.901939 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:52.920121 22898 raft_consensus.cc:2393] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:52.905738 23494 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:52.867483 25457 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:52.910655 25377 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.007s
I20260709 12:16:52.913931 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:52.916923 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:52.918692 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:52.809935 25768 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:52.836982 25634 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:52.920730 22896 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:52.921485 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.927771 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:52.891016 25647 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:52.854862 25771 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.932068 22899 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:52.931716 22894 raft_consensus.cc:2410] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:16:52.955055 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 49448.8us
I20260709 12:16:52.967398 23494 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:52.868490 25774 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:52.958520 22898 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:52.928614 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:52.970304 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:52.929755 25759 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:52.859237 25719 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:52.930545 25744 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:16:52.978425 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 49927.5us
I20260709 12:16:52.979458 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:52.919220 25169 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:16:52.963835 25749 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:16:52.925203 25706 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:16:52.963435 25205 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:16:52.967984 25770 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:52.969544 25771 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:52.970762 25602 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:52.973659 25658 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:52.982861 25744 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:52.954422 25377 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:52.982127 25748 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:52.997045 22865 leader_election.cc:336] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.740s (SENT)
I20260709 12:16:52.998222 22819 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:16:53.022378 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:52.972500 25774 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:52.977401 25759 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:52.985688 25665 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.982147 25588 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:52.985335 25446 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:52.985383 25693 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:53.027231 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:52.873103 25773 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:52.989862 25454 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:53.006695 25579 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.005s
I20260709 12:16:53.007851 25734 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:53.010386 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:52.981772 25751 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.022969 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:53.023690 22744 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:52.959689 25457 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:52.987850 25714 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:16:52.990051 25649 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:16:53.041471 22819 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:53.042546 25772 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 12:16:53.043073 25788 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:16:53.043586 25280 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:53.044811 25719 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:53.047051 25344 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:53.049000 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:53.047503 25751 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:53.029597 25693 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:16:53.126739 22865 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.981s (SENT)
W20260709 12:16:53.201375 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 74712.1us
I20260709 12:16:53.152439 25768 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:53.025962 25761 consensus_queue.cc:1059] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
W20260709 12:16:53.222278 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 173382us
I20260709 12:16:53.062736 25734 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:53.031704 25588 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:53.030454 25665 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:53.028039 25748 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:53.066483 25434 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:53.043135 25446 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.160s
W20260709 12:16:53.303592 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:53.186700 25344 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:53.041184 25579 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:53.210407 25693 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:53.313661 22824 pending_rounds.cc:85] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 5
W20260709 12:16:53.280786 25703 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.685s	user 0.011s	sys 0.002s
I20260709 12:16:53.275496 25719 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:53.281893 25627 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:16:53.354418 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:53.229463 25768 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:53.231205 25639 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:53.354974 22824 pending_rounds.cc:107] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:16:53.393306 22824 raft_consensus.cc:2889] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:16:53.397217 25782 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 12:16:53.399564 25796 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
W20260709 12:16:53.403600 22867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.057s	sys 0.114s
W20260709 12:16:53.404129 22867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.057s	sys 0.114s
I20260709 12:16:53.366293 25703 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:53.301982 25714 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
W20260709 12:16:53.386875 25746 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:16:53.388780 22819 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:53.427789 22899 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:53.366938 25719 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:53.432907 22898 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:53.436453 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:53.443336 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.376081 25761 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:16:53.442714 25205 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.448853 22892 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 10: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:53.431792 25169 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.469429 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:53.472764 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:53.402065 25768 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:53.474879 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:53.476351 22752 raft_consensus.cc:2410] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:16:53.461999 25427 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:53.485549 22749 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:53.486874 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:53.490039 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.015s
W20260709 12:16:53.490517 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.011s	sys 0.015s
W20260709 12:16:53.490890 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 504425us
I20260709 12:16:53.492113 22753 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:53.493214 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:53.495970 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:53.496927 22750 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:53.447798 25706 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:16:53.461120 25647 consensus_queue.cc:1059] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:16:53.499614 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:53.503955 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:53.482220 25739 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:53.474964 25169 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:53.496582 25714 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:53.500366 25605 consensus_meta.cc:287] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.074s	user 0.008s	sys 0.007s
I20260709 12:16:53.536725 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.419441 25344 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:53.503444 25280 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:16:53.504842 25781 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.325s	user 0.001s	sys 0.001s
I20260709 12:16:53.544512 23685 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:53.499470 25649 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:53.481053 25205 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:53.533516 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:53.531597 25647 consensus_queue.cc:1243] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:16:53.502440 25457 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:53.505147 24949 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:16:53.529502 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:53.541659 22894 raft_consensus.cc:2410] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:16:53.528291 25377 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:53.572280 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:53.576109 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:53.577597 25803 consensus_queue.cc:1059] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:16:53.547616 25649 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.576886 25801 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:16:53.490572 25719 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:53.582502 22752 raft_consensus.cc:2410] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:16:53.532953 25735 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:16:53.542819 25714 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:53.573880 25344 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:53.542037 25605 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:53.568372 25751 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:53.582108 25588 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:53.615239 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 110956us
I20260709 12:16:53.581444 25760 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:53.583549 25783 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:53.580478 25773 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:53.576097 25787 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:53.634639 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.584843 25778 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:53.637491 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.587555 25739 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:16:53.587662 25649 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:53.635442 22899 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:53.635831 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:53.618108 25803 consensus_queue.cc:1243] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:16:53.612347 25748 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:53.587766 25665 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:53.587430 25280 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:16:53.627370 25760 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:53.631799 25719 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:53.647792 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:53.648344 22898 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:53.654381 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:53.655757 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:53.660948 25605 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:53.663283 25799 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 12:16:53.673326 25515 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.962s	user 0.009s	sys 0.005s
W20260709 12:16:53.674345 25805 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:16:53.637596 25783 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:53.685045 25635 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:53.687276 25745 raft_consensus.cc:3055] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:53.687776 25745 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:53.688836 25745 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:53.690389 25745 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:16:53.698045 25648 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.030s	user 0.014s	sys 0.000s
W20260709 12:16:53.701575 25769 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.805s	user 0.006s	sys 0.006s
I20260709 12:16:53.680253 25810 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:53.702651 25205 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:53.677575 25773 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:53.704509 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:53.682538 25806 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.144s	user 0.002s	sys 0.000s
I20260709 12:16:53.705667 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:53.705531 25783 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:53.705667 25801 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.721670 23659 raft_consensus.cc:2410] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:16:53.723501 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:16:53.757476 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:53.757200 22819 raft_consensus.cc:2376] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10. Re-sending same reply.
W20260709 12:16:53.711717 25774 consensus_meta.cc:287] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.005s
I20260709 12:16:53.762324 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:53.720098 25810 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.763271 22819 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 4.
I20260709 12:16:53.721218 25768 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:53.764457 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 262828us
I20260709 12:16:53.722494 25773 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:53.670522 25760 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:53.762583 25744 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.737s	user 0.006s	sys 0.006s
W20260709 12:16:53.760385 25759 consensus_meta.cc:287] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.729s	user 0.007s	sys 0.006s
I20260709 12:16:53.781026 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:53.771471 25743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.201s	user 0.020s	sys 0.010s
I20260709 12:16:53.787654 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:53.766495 25810 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:53.787060 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 131412us
I20260709 12:16:53.769894 25205 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.790382 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:53.791455 22752 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:53.775748 25773 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:53.789121 25743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.020s	sys 0.011s
I20260709 12:16:53.720772 25769 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:53.798425 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:53.775887 25774 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:53.793031 25205 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:53.794266 25760 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:53.784593 25744 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:53.820297 25205 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:53.807809 25771 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.804s	user 0.013s	sys 0.000s
I20260709 12:16:53.764299 25801 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:53.813359 25700 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:53.813920 22752 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:53.813226 22744 raft_consensus.cc:2410] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:16:53.828715 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:53.831490 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:53.842595 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.842854 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.843679 22894 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:16:53.843819 23695 raft_consensus.cc:2368] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9.
W20260709 12:16:53.841872 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 43512.8us
I20260709 12:16:53.786612 25693 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:53.846732 22894 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:16:53.837883 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:53.847609 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:53.848690 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:53.796227 25743 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:53.850118 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:53.850118 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:53.820912 25632 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:53.820766 25744 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:53.857875 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.849440 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.786841 25759 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:53.814160 25818 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:53.852254 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:53.860016 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:53.860805 22893 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:53.861886 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.862550 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.863193 25700 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:53.880435 22896 raft_consensus.cc:2393] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:53.852880 25588 consensus_queue.cc:1059] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:16:53.853531 25205 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:53.878114 23695 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 5: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:53.843401 25719 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:53.866283 25714 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:53.884783 22752 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:53.835546 25649 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:53.887787 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.854584 25515 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:53.898718 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.901400 22900 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:53.876178 25280 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:53.903674 23656 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:16:53.888980 22717 leader_election.cc:336] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.828s (SENT)
I20260709 12:16:53.891359 25743 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:53.893450 25774 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:53.893911 25588 consensus_queue.cc:1243] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:16:53.895866 25693 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:53.895990 25769 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:53.840657 25771 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:53.890336 22894 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:53.907044 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:53.906810 23679 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:53.906427 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:53.901473 25635 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:53.923781 23695 raft_consensus.cc:2410] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:16:53.905174 25648 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.905937 25515 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:53.927984 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:53.928898 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:53.889410 25700 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:53.908215 25280 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:53.932889 25280 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:53.933248 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:53.934281 22818 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:53.934947 25497 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.935410 25497 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:53.929009 25648 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:53.920038 25665 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.909165 25714 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:16:53.946568 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:53.948660 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:53.932889 25700 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:53.960220 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:53.961242 22894 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:53.972657 25759 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:53.975065 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:53.982497 25771 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:53.983641 25648 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:53.983642 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:53.985896 25801 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:53.945351 25665 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:53.964622 25700 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:53.964157 25649 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:53.993609 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:53.989516 25169 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:53.996027 25593 raft_consensus.cc:3055] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:53.996446 25593 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:53.997362 25593 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:53.998735 25593 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:53.991916 25826 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:54.001816 25826 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.002290 25826 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:54.004594 25742 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.729s	user 0.002s	sys 0.004s
I20260709 12:16:54.006104 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 846) took 3089 ms. Trace:
I20260709 12:16:54.009397 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:54.010191 22894 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:16:54.006527 22751 rpcz_store.cc:276] 0709 12:16:50.916646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.167639 (+250993us) service_pool.cc:224] Handling call
0709 12:16:51.167951 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:51.945004 (+777053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:51.945042 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:51.945574 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 12:16:52.122731 (+177157us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:52.122950 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:52.126983 (+  4033us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:54.003924 (+1876941us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:54.005825 (+  1901us) raft_consensus.cc:1685] finished
0709 12:16:54.005845 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:54.006046 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24737,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"spinlock_wait_cycles":13300480,"thread_start_us":891661,"threads_started":2,"wal-append.queue_time_us":267206}
I20260709 12:16:54.015235 23695 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:54.021908 22900 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:54.010401 22896 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:16:54.030107 25719 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:54.031029 25700 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.042647 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:54.044581 22900 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:54.004851 25665 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:54.048341 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.049654 23695 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:54.031638 25700 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.046182 22896 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:16:53.991632 25515 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.067480 25683 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:16:54.078588 23659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 678) took 1628 ms (client timeout 1677 ms). Trace:
W20260709 12:16:54.079128 23659 rpcz_store.cc:269] 0709 12:16:52.449871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.450018 (+   147us) service_pool.cc:224] Handling call
0709 12:16:54.078302 (+1628284us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540059d8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:54.078507 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2802981248}
I20260709 12:16:54.080430 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:54.080883 23682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 683) took 2403 ms (client timeout 2055 ms). Trace:
I20260709 12:16:54.081012 23689 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:54.081692 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.086417 22751 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
W20260709 12:16:54.088057 25738 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 1.868s	user 0.004s	sys 0.017s
I20260709 12:16:54.089129 25427 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:54.091032 25605 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.091799 25605 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.095746 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 688) took 2387 ms. Trace:
I20260709 12:16:54.096895 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 693) took 2183 ms. Trace:
I20260709 12:16:54.074005 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 423) took 1089 ms. Trace:
W20260709 12:16:54.081310 23682 rpcz_store.cc:269] 0709 12:16:51.677964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.678149 (+   185us) service_pool.cc:224] Handling call
0709 12:16:54.080666 (+2402517us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54003755d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:54.080794 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705851648}
I20260709 12:16:54.098855 22824 rpcz_store.cc:276] 0709 12:16:52.984137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.028471 (+ 44334us) service_pool.cc:224] Handling call
0709 12:16:53.048720 (+ 20249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:53.394410 (+345690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:53.394467 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:53.410449 (+ 15982us) log.cc:844] Serialized 26 byte log entry
0709 12:16:53.510683 (+100234us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:53.644776 (+134093us) log.cc:844] Serialized 14 byte log entry
0709 12:16:53.646140 (+  1364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:54.072044 (+425904us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b180028bbe0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419
0709 12:16:54.073569 (+  1525us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54005519d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:54.073626 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:54.073682 (+    56us) raft_consensus.cc:1685] finished
0709 12:16:54.073694 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:54.073922 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":146435,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":239,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":2431,"spinlock_wait_cycles":611606016,"thread_start_us":152691,"threads_started":2,"wal-append.queue_time_us":152212}
I20260709 12:16:54.103220 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.104660 23659 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:16:54.096305 23672 rpcz_store.cc:276] 0709 12:16:51.708627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.715880 (+  7253us) service_pool.cc:224] Handling call
0709 12:16:51.745047 (+ 29167us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:51.745601 (+   554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:51.745654 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:51.746407 (+   753us) log.cc:844] Serialized 26 byte log entry
0709 12:16:52.026625 (+280218us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:52.026678 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:52.026760 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:54.087372 (+2060612us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:54.095172 (+  7800us) raft_consensus.cc:1685] finished
0709 12:16:54.095200 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:54.095618 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21616,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":12566,"spinlock_wait_cycles":5974400,"thread_start_us":236835,"threads_started":1,"wal-append.queue_time_us":403786}
I20260709 12:16:54.110001 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.111021 23682 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 11: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:54.097563 23674 rpcz_store.cc:276] 0709 12:16:51.913330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.951372 (+ 38042us) service_pool.cc:224] Handling call
0709 12:16:51.979154 (+ 27782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:52.219106 (+239952us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:16:52.219466 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 12:16:52.384603 (+165137us) log.cc:844] Serialized 14 byte log entry
0709 12:16:52.399830 (+ 15227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:52.399881 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:52.399920 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:53.792992 (+1393072us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b18001bdde0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1
0709 12:16:54.095966 (+302974us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b18001bdde0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419
0709 12:16:54.096575 (+   609us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400706f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:54.096629 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:54.096813 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2924,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1733,"raft.queue_time_us":15892,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":20478,"spinlock_wait_cycles":589519104,"thread_start_us":163621,"threads_started":1,"wal-append.queue_time_us":255848,"wal-append.run_cpu_time_us":3195,"wal-append.run_wall_time_us":1208934}
I20260709 12:16:54.113945 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.117018 23682 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:16:54.050819 25773 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.120142 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.120759 22824 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:54.121527 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:54.121855 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:54.123265 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:54.124171 22824 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:54.126214 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.127049 23659 raft_consensus.cc:2410] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:16:54.127367 25770 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.127833 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:54.109555 25603 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:54.129160 22895 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:16:54.140568 22824 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
W20260709 12:16:54.141530 25829 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:16:54.142010 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:54.142498 25700 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:54.142767 22824 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:54.128290 25830 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:54.153395 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:54.154368 22895 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:54.132452 25770 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.134341 25603 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.149873 25830 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:54.161993 22824 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:16:54.165572 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.166965 25830 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:54.167378 22824 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:16:54.177625 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.179224 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.176972 25674 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:54.161159 25758 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:54.180663 25758 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:54.181509 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 684) took 2500 ms (client timeout 2187 ms). Trace:
W20260709 12:16:54.182933 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.180697 25674 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:54.185812 25741 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 1.906s	user 0.012s	sys 0.001s
I20260709 12:16:54.187804 25674 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:54.182049 23656 rpcz_store.cc:269] 0709 12:16:51.681325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.681490 (+   165us) service_pool.cc:224] Handling call
0709 12:16:54.181294 (+2499804us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b540073a5d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:54.181425 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4969905920}
I20260709 12:16:54.189224 22824 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:16:54.181933 25758 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.190915 25758 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:54.192425 25760 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.193125 25760 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:54.194072 22823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 861) took 2035 ms (client timeout 1740 ms). Trace:
W20260709 12:16:54.194536 22823 rpcz_store.cc:269] 0709 12:16:52.158717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.179604 (+ 20887us) service_pool.cc:224] Handling call
0709 12:16:54.193866 (+2014262us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b54001261d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:54.193990 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30980992}
I20260709 12:16:54.190920 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.196038 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.197829 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.193133 25818 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:54.200014 22820 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:54.201284 25639 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:54.201713 25639 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:54.202461 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:54.203317 22892 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:54.203305 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:54.204342 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:54.202461 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.205426 22824 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:16:54.206255 25700 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:54.206321 25770 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:54.207095 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 705) took 2079 ms. Trace:
I20260709 12:16:54.207672 25639 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.208141 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.208345 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:54.209534 25619 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:54.209921 25619 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.210312 25619 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:54.211472 25434 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:54.198545 22823 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:54.207527 22745 rpcz_store.cc:276] 0709 12:16:52.127634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.229169 (+101535us) service_pool.cc:224] Handling call
0709 12:16:52.265804 (+ 36635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:52.499023 (+233219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:52.499060 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:52.499112 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:52.499154 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:54.206859 (+1707705us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001e7dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:54.206904 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:54.207038 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480477440}
I20260709 12:16:54.213447 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:54.214672 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:54.157552 25605 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:54.215433 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:54.216629 22892 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:54.196106 25760 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:54.220577 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.221453 23682 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:54.221704 23656 raft_consensus.cc:2368] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11.
I20260709 12:16:54.223496 25771 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.223840 25665 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:54.223723 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.224666 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.225385 23682 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:54.226573 23682 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:54.152060 25810 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:54.228291 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:54.231401 23682 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:16:54.233932 23682 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:16:54.229010 25771 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.210075 25711 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:54.253054 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.248189 23656 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:54.238188 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.240602 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.235999 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:54.259866 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:54.260872 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:54.261466 22824 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:54.261940 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:54.236923 25759 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:54.263027 25769 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:54.263402 25759 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.263845 25769 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:54.264010 25745 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:54.264557 25745 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.264935 25745 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:54.265034 25769 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.266072 25648 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:54.266685 25648 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:54.267149 25497 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:54.249792 25771 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:54.268477 25771 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:54.213459 25700 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:54.268949 25771 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.269073 25700 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:54.269347 25771 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:54.241601 25579 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:54.257028 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:54.236460 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.273021 23674 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:54.274041 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.275421 23674 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:54.236289 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.276641 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.277091 23682 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:16:54.277729 22822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 863) took 2118 ms (client timeout 2156 ms). Trace:
I20260709 12:16:54.268517 25454 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:54.278455 22822 rpcz_store.cc:269] 0709 12:16:52.159395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.392772 (+233377us) service_pool.cc:224] Handling call
0709 12:16:54.277505 (+1884733us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001257d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:54.277661 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243697920}
I20260709 12:16:54.279925 25603 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:54.277935 22825 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:16:54.275981 22824 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:16:54.284613 25635 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.285113 25635 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:54.286923 25639 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:54.247036 25789 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:54.288494 25789 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:54.267802 25648 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:54.215739 25434 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:16:54.289875 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.290705 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:54.295174 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:16:54.298493 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 159462us
I20260709 12:16:54.234771 25828 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:54.319118 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:54.304453 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:54.305366 22892 raft_consensus.cc:2410] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:16:54.310861 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:54.323705 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:54.311168 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:54.324719 22896 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:16:54.311461 25434 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:54.311096 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.325731 25434 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:54.312289 25619 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:54.326886 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.327270 25789 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:54.328580 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.329615 23672 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:54.240322 25773 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:54.325706 23682 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
W20260709 12:16:54.334874 25674 consensus_queue.cc:1175] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2c3a0d56045540b7802937559599f09c" responder_term: 8 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.4-7.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:16:54.335470 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.336210 23682 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:16:54.337303 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.337353 25779 consensus_queue.cc:1059] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:54.338511 25783 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:54.263856 25759 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:54.340884 25280 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:54.341285 25280 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:54.299316 25704 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.343143 25704 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.344125 25366 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:54.344516 25717 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:54.344630 25366 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:54.345026 25717 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.345453 25717 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:54.347389 25794 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:54.348505 25794 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:54.304867 22901 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:54.348870 25794 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:54.349968 25794 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:54.351723 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 47320.9us
I20260709 12:16:54.378532 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:54.379294 23695 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:54.380791 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:54.382144 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:54.382478 25711 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:16:54.382931 25446 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:54.383100 25711 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:54.383495 25446 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.384140 25446 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:54.384291 25711 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:54.353472 25674 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:16:54.354313 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.243319 25810 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:54.352978 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 690) took 1712 ms. Trace:
I20260709 12:16:54.388098 23689 rpcz_store.cc:276] 0709 12:16:52.640667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.741445 (+100778us) service_pool.cc:224] Handling call
0709 12:16:54.080834 (+1339389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:54.081974 (+  1140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:54.352729 (+270755us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003755d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:54.352907 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3022037888}
I20260709 12:16:54.388607 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:54.389179 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1137) took 2274 ms. Trace:
I20260709 12:16:54.389657 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.389586 22827 rpcz_store.cc:276] 0709 12:16:52.114458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.115259 (+   801us) service_pool.cc:224] Handling call
0709 12:16:52.115535 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:52.563201 (+447666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:54.388863 (+1825662us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b5400301454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:54.389086 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999264640}
I20260709 12:16:54.390540 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:54.391479 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.391708 25674 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:54.392289 25674 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.392516 25798 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:54.392819 25674 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:54.330587 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.395215 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.395869 23672 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:16:54.396942 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.398089 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.324952 23659 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:16:54.328605 25789 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:54.405746 25304 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.406914 25818 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.407401 25818 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:54.337971 23682 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:54.408164 25463 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:54.408690 25463 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:54.409642 25818 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:54.410189 25818 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.392365 23689 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:16:54.410635 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:54.412124 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.413105 25457 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:54.413318 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.413560 25457 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:54.407721 25719 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.414386 25457 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.414861 25719 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.414252 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:54.410630 25818 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.450367 25798 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:54.451399 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.452078 23679 raft_consensus.cc:2376] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8. Re-sending same reply.
I20260709 12:16:54.453019 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.453576 23679 raft_consensus.cc:2376] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6. Re-sending same reply.
I20260709 12:16:54.454376 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.410717 25463 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:54.418493 25649 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:54.419303 23682 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:16:54.414405 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.411158 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.434185 25674 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.439110 25718 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:54.406373 25304 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.445029 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.415832 25457 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:16:54.455598 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.417554 25719 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:54.461174 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:54.499949 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:54.498940 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 61363.1us
I20260709 12:16:54.533946 22827 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
W20260709 12:16:54.534647 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 74513.6us
I20260709 12:16:54.473119 22744 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:54.536079 22751 raft_consensus.cc:2410] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:16:54.465560 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 87095.6us
I20260709 12:16:54.538516 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:54.311373 25828 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:54.490020 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 166371us
I20260709 12:16:54.545288 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:54.548508 22753 raft_consensus.cc:2410] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:16:54.538237 23679 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:16:54.549036 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:54.552956 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:54.559952 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.560708 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:54.561931 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:54.561844 25366 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.563804 25366 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:54.533565 25718 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:54.354652 25830 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.565340 22750 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:54.502497 25770 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:54.566720 25770 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:16:54.550746 25828 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:54.567873 25770 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:54.572489 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:54.493381 25779 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:54.579165 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:54.546864 25794 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:54.579386 25719 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:54.586994 22749 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:54.594621 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:54.595960 22749 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 5: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:54.574713 22827 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:54.575336 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:54.494772 25801 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:16:54.462344 25818 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:54.562942 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:54.599857 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.583745 22753 raft_consensus.cc:2368] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8.
I20260709 12:16:54.574131 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:54.303692 25826 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.577013 25463 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:54.610934 25818 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:54.612462 25826 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:54.613606 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:54.616015 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:54.609450 25830 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:54.617992 25830 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:54.610085 25674 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:54.342152 25280 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:54.575642 25205 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:54.602763 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:54.566571 25718 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.619150 25280 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:54.619160 25205 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.620038 25205 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:54.619972 25718 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:54.622225 25830 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:54.626449 22751 raft_consensus.cc:2393] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 8: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:54.623466 25830 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.630347 25649 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:54.631568 25634 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:54.638806 25619 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:54.640815 22752 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:16:54.640820 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:16:54.637683 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:54.639433 25205 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.645642 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:54.688299 22898 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:16:54.592816 25779 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:54.650564 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:54.692145 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:54.697986 22900 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:54.700132 25649 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:54.700265 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:54.703516 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:54.707213 22894 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:54.708226 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:16:54.706069 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:54.704341 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:16:54.696944 22752 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:54.648866 25826 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:54.687645 25634 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:54.589710 25740 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:16:54.649463 22827 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:54.692325 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:54.704680 25454 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.746170 22894 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:16:54.719345 25674 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:54.719555 25649 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:54.726203 25750 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:54.726051 25592 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:54.747939 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:54.744547 22900 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:16:54.767304 22864 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:54.770635 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:16:54.771912 22900 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:16:54.778033 22827 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:16:54.754182 25515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.031s	sys 0.052s
I20260709 12:16:54.745522 25453 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.725934 25818 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:16:54.785130 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.748100 25826 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:54.751971 25674 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.751569 25634 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:54.753240 25798 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.770105 25434 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.754858 25750 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:16:54.805871 25304 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:54.771035 25745 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:54.795166 25515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.031s	sys 0.053s
I20260709 12:16:54.817888 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:54.835165 23672 raft_consensus.cc:2376] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7. Re-sending same reply.
I20260709 12:16:54.765945 25592 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:54.819782 22791 leader_election.cc:400] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9.
I20260709 12:16:54.836612 22791 leader_election.cc:403] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:54.755419 25635 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:54.838155 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:54.820267 22864 leader_election.cc:400] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8.
I20260709 12:16:54.839167 22864 leader_election.cc:403] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:16:54.790947 25639 consensus_meta.cc:287] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.503s	user 0.004s	sys 0.008s
I20260709 12:16:54.751250 25619 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:16:54.769850 25366 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:54.751855 25454 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:54.796070 25801 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:54.819591 25674 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:54.843233 23672 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:54.846066 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:54.797669 25453 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.823064 25743 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:16:54.851163 25700 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.004s
I20260709 12:16:54.847141 25712 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9.
W20260709 12:16:54.880966 22747 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.014s	sys 0.025s
W20260709 12:16:54.901435 22747 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.014s	sys 0.025s
I20260709 12:16:54.856454 25734 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:54.882890 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:54.838619 25665 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.000s
I20260709 12:16:54.829500 25798 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:54.829782 25434 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.856215 25740 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8.
I20260709 12:16:54.858850 25180 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:16:54.876751 25759 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
W20260709 12:16:54.892410 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46430us
W20260709 12:16:54.877414 25683 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.809s	user 0.008s	sys 0.005s
I20260709 12:16:54.895191 23672 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:54.819281 25779 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:54.927158 22791 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:54.929193 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:54.894030 25761 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:54.939829 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:54.944679 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.951536 23660 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:16:54.914146 25205 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:54.954591 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1153) took 2522 ms. Trace:
I20260709 12:16:54.958352 22825 rpcz_store.cc:276] 0709 12:16:52.432587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.650148 (+217561us) service_pool.cc:224] Handling call
0709 12:16:54.277650 (+1627502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:54.281096 (+  3446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:54.954348 (+673252us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54001257d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:54.954523 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3742004608}
I20260709 12:16:54.956210 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:54.959949 22825 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:16:54.889765 25826 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.932246 25743 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:54.924616 25665 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:54.931506 25639 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:54.916795 25700 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.881227 25750 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:54.891026 25634 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:54.959250 25712 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:16:54.993263 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.959177 25789 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:54.953996 25602 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.932636 25759 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:54.971195 25725 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:54.964696 25769 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.893497 25592 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:54.991341 23682 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 12:16:55.001971 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.011811 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:55.013669 22748 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
W20260709 12:16:54.978298 25840 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:16:54.979159 25743 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:54.987883 25454 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:54.977329 25761 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:16:55.024745 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:55.027072 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:55.000316 25725 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.002911 25639 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.038345 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:55.003532 25602 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:55.054909 22745 raft_consensus.cc:2393] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:55.019275 25773 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:55.056097 25743 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:55.058073 25743 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:55.058738 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:55.061462 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:55.065016 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:55.067603 25453 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:55.067556 22745 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:55.071376 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:55.075691 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:55.080417 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:55.082625 22745 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:16:55.085753 25828 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 12:16:55.016067 25769 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:55.087981 22745 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:16:55.088980 25769 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:55.089910 25742 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:16:55.090703 22818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1150) took 2874 ms (client timeout 1968 ms). Trace:
W20260709 12:16:55.091218 22818 rpcz_store.cc:269] 0709 12:16:52.220446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.334472 (+114026us) service_pool.cc:224] Handling call
0709 12:16:55.090490 (+2756018us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400551ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:55.090606 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3558044416}
W20260709 12:16:55.091892 25719 consensus_meta.cc:287] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.505s	user 0.002s	sys 0.009s
I20260709 12:16:55.092381 25719 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:55.092849 22745 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
W20260709 12:16:55.093019 22821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1144) took 2973 ms (client timeout 1828 ms). Trace:
I20260709 12:16:55.095105 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 729) took 1233 ms. Trace:
W20260709 12:16:55.094587 22821 rpcz_store.cc:269] 0709 12:16:52.119333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.130445 (+ 11112us) service_pool.cc:224] Handling call
0709 12:16:55.092802 (+2962357us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54006a09d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:55.092936 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4532798720}
I20260709 12:16:55.095507 22893 rpcz_store.cc:276] 0709 12:16:53.861346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.879687 (+ 18341us) service_pool.cc:224] Handling call
0709 12:16:53.879905 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:54.537754 (+657849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:54.537788 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:54.537835 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:54.537867 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:55.094877 (+557010us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540014f5d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:55.094921 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:55.095050 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55507,"raft.queue_time_us":46167,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":9245,"spinlock_wait_cycles":1342435584}
I20260709 12:16:55.100802 25700 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:55.024004 25745 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:55.036646 25725 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:55.098418 25759 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:55.109647 22744 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:16:55.099628 25823 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.658s	user 0.003s	sys 0.000s
W20260709 12:16:55.097016 25446 consensus_meta.cc:287] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.000s
I20260709 12:16:55.032500 25635 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:55.107831 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 147246us
I20260709 12:16:55.031404 25592 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:55.099287 25798 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:55.117432 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.111250 22744 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:55.086334 25828 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:55.115658 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:55.082355 25674 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:55.101971 25639 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:55.126641 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:16:55.118237 25771 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.848s	user 0.009s	sys 0.005s
I20260709 12:16:55.123412 25789 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:16:55.123322 25457 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.006s
I20260709 12:16:55.136780 22749 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:55.139509 22752 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: []
W20260709 12:16:55.139882 25717 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.794s	user 0.013s	sys 0.001s
I20260709 12:16:55.140360 25717 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:55.142289 25734 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:55.116408 25808 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:55.143728 22753 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:16:55.114229 25446 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:55.148885 25789 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:55.149395 25789 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:55.149768 25789 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:55.150332 25828 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:55.135990 25718 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
I20260709 12:16:55.151186 25848 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:55.151902 25853 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.151801 25848 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:55.152487 25853 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:55.154105 25848 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:55.150573 25446 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:55.143193 25434 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:16:55.164465 25280 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 12:16:55.159452 25734 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.170248 25734 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:55.164546 25794 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.571s	user 0.012s	sys 0.001s
I20260709 12:16:55.169087 25639 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:55.165658 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:16:55.174259 25734 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:55.174430 25718 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:55.174940 25718 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.175305 25718 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:55.178885 23656 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:55.180261 23656 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:55.181483 23656 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:16:55.182438 23656 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
W20260709 12:16:55.165585 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:55.187023 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.187500 25725 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:16:55.190003 25839 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.288s	user 0.000s	sys 0.002s
I20260709 12:16:55.190323 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:55.192531 25761 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:16:55.193022 25761 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.193389 25761 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:55.194118 22901 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:16:55.156363 25853 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:55.195614 25592 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:55.196285 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 885) took 1702 ms. Trace:
I20260709 12:16:55.196497 25592 consensus_queue.cc:1243] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:16:55.197249 25592 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:55.197758 25592 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:55.196843 22819 rpcz_store.cc:276] 0709 12:16:53.493785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.765810 (+272025us) service_pool.cc:224] Handling call
0709 12:16:53.766162 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:53.773918 (+  7756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:53.773973 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:53.787371 (+ 13398us) log.cc:844] Serialized 26 byte log entry
0709 12:16:53.839478 (+ 52107us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:53.839840 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 12:16:53.840883 (+  1043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:53.840981 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:54.441309 (+600328us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b180032b8a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:16:55.099031 (+657722us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:16:55.196034 (+ 97003us) raft_consensus.cc:1685] finished
0709 12:16:55.196062 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:55.196211 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":606,"prepare.queue_time_us":890,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1565,"raft.queue_time_us":1769,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":14034,"spinlock_wait_cycles":145022592,"thread_start_us":23848,"threads_started":1,"wal-append.queue_time_us":65109}
I20260709 12:16:55.199600 23656 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:55.156955 25717 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:55.202695 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:55.204190 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:55.202844 22745 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:55.208644 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:55.208957 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:55.209841 25683 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:55.210492 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:55.213181 25789 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:55.216318 25649 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:55.220526 22818 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 5.
I20260709 12:16:55.221436 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 711) took 1733 ms. Trace:
I20260709 12:16:55.137501 25771 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:55.222986 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:55.231750 23659 raft_consensus.cc:2368] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9.
I20260709 12:16:55.232396 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:55.232769 25801 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:16:55.233269 22821 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:55.233523 25801 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:16:55.233958 25771 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:55.234879 22747 rpcz_store.cc:276] 0709 12:16:53.487906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.488033 (+   127us) service_pool.cc:224] Handling call
0709 12:16:53.488377 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:53.488767 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:53.586091 (+ 97324us) log.cc:844] Serialized 14 byte log entry
0709 12:16:54.356301 (+770210us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b1800343c00. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a
0709 12:16:54.901881 (+545580us) log.cc:844] Serialized 14 byte log entry
0709 12:16:55.113117 (+211236us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:55.115566 (+  2449us) log.cc:844] Serialized 26 byte log entry
0709 12:16:55.115738 (+   172us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:55.115787 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:55.115909 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:55.221122 (+105213us) raft_consensus.cc:1685] finished
0709 12:16:55.221161 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:55.221356 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3113,"prepare.queue_time_us":712069,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":1719,"raft.queue_time_us":21903,"raft.run_cpu_time_us":438,"raft.run_wall_time_us":100090,"spinlock_wait_cycles":27737344,"thread_start_us":929434,"threads_started":4,"wal-append.queue_time_us":348784,"wal-append.run_cpu_time_us":1743,"wal-append.run_wall_time_us":1069961}
I20260709 12:16:55.223114 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:55.239379 22819 raft_consensus.cc:2368] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12.
I20260709 12:16:55.226385 25761 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:55.224635 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:55.249411 25674 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:55.223891 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:55.250383 22818 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:55.255046 25712 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:55.267689 25801 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:55.302199 25801 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:55.463661 25861 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:16:57.072139 22607 debug-util.cc:398] Leaking SignalData structure 0x7b080029b120 after lost signal to thread 18407
W20260709 12:16:57.073295 22607 debug-util.cc:398] Leaking SignalData structure 0x7b0800124c40 after lost signal to thread 18410
W20260709 12:16:59.115597 25836 log.cc:927] Time spent T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 4.322s	user 0.023s	sys 0.033s
I20260709 12:16:55.269456 25602 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:59.347026 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 713) took 5856 ms. Trace:
I20260709 12:16:59.347851 22746 rpcz_store.cc:276] 0709 12:16:53.490104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.632777 (+142673us) service_pool.cc:224] Handling call
0709 12:16:53.633069 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:53.633409 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:53.633436 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:53.633883 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:16:53.785615 (+151732us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:53.785699 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:53.785819 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:55.328079 (+1542260us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b54004284a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f4dbe 00007fadf46ff930 00007fadf46ff8d8 00007fadf46ff858 00007fadf46ff813 00007fadf46fea9c 00007fadfa5ea2f6 00007fadfa5e4aa8 00007fadf473b7cb 00007fadf473e2c0
0709 12:16:59.345698 (+4017619us) raft_consensus.cc:1685] finished
0709 12:16:59.345816 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:59.346623 (+   807us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3753,"raft.queue_time_us":1864,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4640,"spinlock_wait_cycles":7654656,"thread_start_us":133119,"threads_started":1,"wal-append.queue_time_us":142261}
W20260709 12:16:59.380722 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.233s	user 0.019s	sys 0.067s
W20260709 12:16:59.381572 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.234s	user 0.019s	sys 0.067s
W20260709 12:16:59.382977 25835 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 4.424s	user 0.019s	sys 0.022s
I20260709 12:16:59.387230 25864 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.388685 25864 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:59.393242 25864 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:59.394115 25864 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.395802 25864 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:59.394546 25865 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:59.398237 25865 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:59.399500 25864 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:59.401458 25864 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.402438 25864 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:59.405474 25864 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:59.419046 25864 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:59.412707 25866 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:16:59.413573 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 499) took 4597 ms. Trace:
I20260709 12:16:59.426491 22745 rpcz_store.cc:276] 0709 12:16:54.815860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.098137 (+282277us) service_pool.cc:224] Handling call
0709 12:16:55.202596 (+104459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:55.206402 (+  3806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.412984 (+4206582us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54004042d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:59.413316 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239154432}
I20260709 12:16:59.427636 25866 raft_consensus.cc:3055] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:59.428256 25866 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:59.432454 25750 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:59.410936 25865 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:59.444581 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:16:59.453543 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:59.458002 23682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 746) took 5097 ms (client timeout 3089 ms). Trace:
W20260709 12:16:59.458552 23682 rpcz_store.cc:269] 0709 12:16:54.360545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.548043 (+187498us) service_pool.cc:224] Handling call
0709 12:16:59.457279 (+4909236us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400706f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:59.457619 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960678656}
I20260709 12:16:59.461603 25725 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:59.463145 25725 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:59.464721 25602 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.465919 25602 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:59.469393 25602 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:59.472265 22744 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:16:59.477260 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 512) took 4645 ms. Trace:
I20260709 12:16:59.477823 22744 rpcz_store.cc:276] 0709 12:16:54.832110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.160634 (+328524us) service_pool.cc:224] Handling call
0709 12:16:59.471216 (+4310582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:59.476892 (+  5676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.477194 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:59.473182 25602 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:16:59.479574 25602 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:59.482322 25602 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:59.465914 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:59.483620 25864 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:59.486989 25864 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:16:59.488252 25865 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:59.488704 25865 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:16:59.490252 25865 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:59.492547 25865 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:59.502619 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:59.551362 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:59.554347 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:59.557442 25865 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:59.584075 25865 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.584968 25865 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:59.599148 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.601621 25871 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:16:59.602671 25871 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:59.601969 23656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.400s	user 0.021s	sys 0.054s
I20260709 12:16:59.603855 25865 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:59.604555 23656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.402s	user 0.023s	sys 0.055s
I20260709 12:16:59.606487 25635 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:59.607546 25635 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:59.610771 25660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.781s	user 0.037s	sys 0.030s
I20260709 12:16:59.611097 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 751) took 5070 ms. Trace:
W20260709 12:16:59.611301 25660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.782s	user 0.038s	sys 0.030s
I20260709 12:16:59.611524 23656 rpcz_store.cc:276] 0709 12:16:54.541004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.200809 (+659805us) service_pool.cc:224] Handling call
0709 12:16:55.201188 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:55.201480 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:16:55.201857 (+   377us) log.cc:844] Serialized 14 byte log entry
0709 12:16:59.605847 (+4403990us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:59.605984 (+   137us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:59.606159 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.609299 (+  3140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:59.610950 (+  1651us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":193,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":3109,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":569,"thread_start_us":4403291,"threads_started":1,"wal-append.queue_time_us":249932,"wal-append.run_cpu_time_us":1430,"wal-append.run_wall_time_us":1001471}
I20260709 12:16:59.615127 25865 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.617241 25865 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:59.621832 25865 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:59.622560 25871 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:59.622910 25865 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:59.624207 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 70219.4us
W20260709 12:16:59.624354 23695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 734) took 5403 ms (client timeout 1510 ms). Trace:
W20260709 12:16:59.625407 23695 rpcz_store.cc:269] 0709 12:16:54.221062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.222718 (+  1656us) service_pool.cc:224] Handling call
0709 12:16:59.623772 (+5401054us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b54002904d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:59.624112 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194642688}
W20260709 12:16:59.631942 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:59.634372 25612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 5.238s	user 0.029s	sys 0.033s
W20260709 12:16:59.635888 25612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 5.239s	user 0.030s	sys 0.033s
I20260709 12:16:59.636503 25871 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:59.624231 25865 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:59.637640 25871 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:59.639259 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:16:59.639807 25865 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:59.640479 25865 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:59.641206 25871 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:59.641494 25718 consensus_meta.cc:287] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 4.466s	user 0.045s	sys 0.012s
I20260709 12:16:59.642660 25718 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:59.650909 25718 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:59.658944 22791 connection.cc:256] RPC call timeout handler was delayed by -4.3917804699999579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 12:16:59.659617 22818 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 4.408s	user 0.030s	sys 0.034s
I20260709 12:16:59.660281 22818 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:59.661180 25639 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:16:59.662302 22818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 896) took 4440 ms (client timeout 2017 ms). Trace:
W20260709 12:16:59.663014 22818 rpcz_store.cc:269] 0709 12:16:55.221721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.223645 (+  1924us) service_pool.cc:224] Handling call
0709 12:16:59.662120 (+4438475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:59.670392 25865 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.671259 25865 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:59.673923 25865 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:59.674546 25865 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:59.675396 25865 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:59.678033 25865 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:59.678655 25865 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.679416 25865 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:59.681416 25704 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:59.689469 25867 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:16:59.694803 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:59.695910 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:59.694878 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:59.698925 25718 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.699856 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 892) took 5204 ms. Trace:
I20260709 12:16:59.699782 25718 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:59.700299 22827 rpcz_store.cc:276] 0709 12:16:54.495055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.780023 (+284968us) service_pool.cc:224] Handling call
0709 12:16:54.781386 (+  1363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:54.781810 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:54.781838 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:54.783160 (+  1322us) log.cc:844] Serialized 26 byte log entry
0709 12:16:59.658341 (+4875181us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b180020a0a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:16:59.687925 (+ 29584us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:16:59.688427 (+   502us) log.cc:844] Serialized 14 byte log entry
0709 12:16:59.689077 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.690472 (+  1395us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:59.699154 (+  8682us) raft_consensus.cc:1685] finished
0709 12:16:59.699311 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:59.699555 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":210,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":63,"raft.queue_time_us":226,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":5872,"spinlock_wait_cycles":11954944,"thread_start_us":28964,"threads_started":1,"wal-append.queue_time_us":4907747}
I20260709 12:16:59.702486 25718 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:59.682281 25612 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:59.684453 22790 connection.cc:256] RPC call timeout handler was delayed by -2.4831889930001125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
I20260709 12:16:59.686112 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 864) took 5217 ms. Trace:
I20260709 12:16:59.715296 25612 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:59.718076 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 883) took 7128 ms. Trace:
I20260709 12:16:59.718353 25612 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:59.707333 25704 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:59.711998 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.723542 25704 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:59.724216 25826 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.725091 25826 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:59.727185 25463 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.727698 25704 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:59.728425 22818 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:59.728055 25463 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:59.729471 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:59.730221 22827 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:59.731362 25826 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:59.718588 22820 rpcz_store.cc:276] 0709 12:16:52.589516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.654748 (+ 65232us) service_pool.cc:224] Handling call
0709 12:16:54.199877 (+1545129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:54.308713 (+108836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:54.308738 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:54.308783 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:16:54.308810 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:54.308867 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:59.717633 (+5408766us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001261d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:59.717865 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"spinlock_wait_cycles":3537122560}
I20260709 12:16:59.681658 25865 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:59.715059 22750 rpcz_store.cc:276] 0709 12:16:54.468653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.468857 (+   204us) service_pool.cc:224] Handling call
0709 12:16:54.469430 (+   573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:54.565788 (+ 96358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.685335 (+5119547us) spinlock_profiling.cc:243] Waited 95.7 ms on lock 0x7b54006798d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:59.685825 (+   490us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220017408}
I20260709 12:16:59.735563 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:59.737200 22820 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:16:59.736711 25750 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.739902 25463 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:59.739907 25750 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:59.742901 25750 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:59.740033 25826 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.743739 25826 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:16:59.745851 22748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 862) took 5277 ms (client timeout 2710 ms). Trace:
I20260709 12:16:59.746173 25826 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:59.747476 25463 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:59.749571 22822 consensus_meta.cc:287] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 4.507s	user 0.021s	sys 0.037s
I20260709 12:16:59.750109 22822 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:16:59.750480 25750 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.751264 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.751086 25750 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:59.752041 22745 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:59.753101 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.753796 22746 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:59.754122 22749 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:16:59.755398 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.753357 25750 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:59.756668 25750 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.757452 25750 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:59.759187 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.759810 25750 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:59.760535 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.771132 22790 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:59.772394 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:59.773573 25871 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:59.773774 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:59.774121 25871 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.761317 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.774596 25871 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:59.775250 22744 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:59.776204 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.777307 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.777943 22744 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:59.748238 25463 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:59.781869 25463 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:59.782807 25463 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.783481 25463 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:59.784605 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:59.784994 22750 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:59.785502 22747 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:59.785965 25463 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:59.761966 25826 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:59.787142 25826 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:59.789520 22745 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:59.789824 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.790656 22750 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
W20260709 12:16:59.764649 22822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 899) took 4528 ms (client timeout 2140 ms). Trace:
I20260709 12:16:59.792822 25826 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:16:59.793131 22822 rpcz_store.cc:269] 0709 12:16:55.222666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.224379 (+  1713us) service_pool.cc:224] Handling call
0709 12:16:59.750718 (+4526339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:59.794327 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:16:59.764082 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:16:59.794955 22822 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:59.796124 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.796953 22749 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:16:59.798070 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:16:59.767618 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.760075 22746 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:16:59.800731 25773 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:16:59.801465 25773 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:59.801853 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.802608 22746 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:16:59.802978 25602 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:16:59.803135 25660 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.803752 25602 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:59.804286 22746 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:59.803915 25660 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:59.806342 25602 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:16:59.768991 22826 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:59.767652 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 437) took 5206 ms. Trace:
I20260709 12:16:59.763877 25761 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:59.746387 22748 rpcz_store.cc:269] 0709 12:16:54.467981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.468133 (+   152us) service_pool.cc:224] Handling call
0709 12:16:59.745294 (+5277161us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54000a9454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:59.745546 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090548480}
I20260709 12:16:59.799364 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.811620 22745 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
W20260709 12:16:59.789533 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.828467 25453 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.822515 25718 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.829433 25453 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:59.829704 25718 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:16:59.831013 25634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.647s	user 0.023s	sys 0.032s
W20260709 12:16:59.831631 25634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.663s	user 0.023s	sys 0.032s
I20260709 12:16:59.832199 25718 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:59.834322 25453 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:16:59.837049 23493 connection.cc:256] RPC call timeout handler was delayed by -3.5554978750001283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 12:16:59.837477 22819 raft_consensus.cc:2410] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:16:59.837642 23493 connection.cc:256] RPC call timeout handler was delayed by -3.5050978750000468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 12:16:59.838117 23493 connection.cc:256] RPC call timeout handler was delayed by -3.40969787500012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 12:16:59.838411 25683 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.839145 25683 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:59.841643 25683 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:59.842228 25683 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.843755 22823 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:59.845286 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:59.778767 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.846771 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:59.838454 23493 connection.cc:256] RPC call timeout handler was delayed by -3.3961978750000981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 12:16:59.848829 23493 connection.cc:256] RPC call timeout handler was delayed by -3.2971978750001654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260709 12:16:59.847592 22822 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
W20260709 12:16:59.849262 23493 connection.cc:256] RPC call timeout handler was delayed by -3.1999671870000839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 12:16:59.849677 23493 connection.cc:256] RPC call timeout handler was delayed by -3.1342978750001294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 12:16:59.849929 23493 connection.cc:256] RPC call timeout handler was delayed by -3.1261978750001163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 12:16:59.850518 23493 connection.cc:256] RPC call timeout handler was delayed by -3.1180978750001032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 12:16:59.850953 23493 connection.cc:256] RPC call timeout handler was delayed by -2.2135978750000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30390000000000006s for a response
I20260709 12:16:59.826321 22825 rpcz_store.cc:276] 0709 12:16:54.560990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.960784 (+399794us) service_pool.cc:224] Handling call
0709 12:16:54.961033 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:55.021321 (+ 60288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:55.021368 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:55.021430 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:55.021478 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.767021 (+4745543us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b54005519d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:16:59.767090 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:59.767471 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137680256}
I20260709 12:16:59.852849 22748 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:59.851733 22747 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:59.806572 25660 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:16:59.809652 22791 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 1.590s (SENT)
I20260709 12:16:59.854257 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:16:59.852859 25712 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:16:59.857767 22751 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:16:59.859510 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:59.859516 22749 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:16:59.860996 23659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 750) took 5320 ms (client timeout 2017 ms). Trace:
W20260709 12:16:59.861639 23659 rpcz_store.cc:269] 0709 12:16:54.540147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.573730 (+ 33583us) service_pool.cc:224] Handling call
0709 12:16:59.860506 (+5286776us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54003552d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:59.860742 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451140864}
I20260709 12:16:59.862488 25712 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:59.862978 25712 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.863351 25712 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:59.865378 25761 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:16:59.867098 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:59.867388 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.868307 25304 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.868498 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:59.868854 25304 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:59.871526 25304 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:59.869184 22825 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 5.
I20260709 12:16:59.881568 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:59.878085 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:16:59.876153 22827 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:16:59.871497 25871 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:16:59.891208 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:16:59.892971 25639 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:59.895177 25639 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.895560 25639 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:59.892621 25773 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:16:59.898150 25773 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:16:59.850384 25683 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:59.901955 25789 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:59.906888 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:16:59.916167 23685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 689) took 7275 ms (client timeout 1900 ms). Trace:
I20260709 12:16:59.917614 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:59.918286 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:59.918629 23695 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:16:59.919044 23689 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:16:59.918467 23656 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:59.923483 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:59.892434 22744 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
I20260709 12:16:59.927237 22823 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
W20260709 12:16:59.884359 25801 consensus_meta.cc:287] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 4.551s	user 0.012s	sys 0.046s
W20260709 12:16:59.916821 23685 rpcz_store.cc:269] 0709 12:16:52.640246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.656213 (+ 15967us) service_pool.cc:224] Handling call
0709 12:16:59.915699 (+7259486us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54001ffed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:16:59.915932 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807393536}
W20260709 12:16:59.932118 25693 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 5.452s	user 0.012s	sys 0.055s
W20260709 12:16:59.932542 25693 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 5.534s	user 0.013s	sys 0.055s
I20260709 12:16:59.902925 25683 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:16:59.936988 23674 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:16:59.926534 25634 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.942618 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:16:59.948336 25634 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:16:59.952656 25635 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:59.956745 25871 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:16:59.959322 22825 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:16:59.962123 22820 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:16:59.975476 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:16:59.976842 23679 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 5.
W20260709 12:16:59.978561 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 168983us
I20260709 12:16:59.983929 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:59.987376 25683 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:59.988298 25683 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:16:59.991173 25830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 5.174s	user 0.045s	sys 0.047s
W20260709 12:16:59.991623 25830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 5.245s	user 0.045s	sys 0.047s
I20260709 12:16:59.989856 25683 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:16:59.993731 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:16:59.996558 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 60345.7us
I20260709 12:16:59.995046 23679 raft_consensus.cc:2368] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:16:59.986572 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:16:59.994719 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:16:59.996636 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:00.003293 22790 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:00.006026 23659 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:59.997650 25871 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:00.008371 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:00.009581 22820 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:00.011785 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:00.022027 22819 raft_consensus.cc:2410] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:00.023200 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:00.010052 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:00.018342 25871 raft_consensus.cc:697] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:00.021762 25712 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.009189 23685 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:17:00.023418 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:00.051461 22822 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:00.051657 23659 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:00.052014 22819 raft_consensus.cc:2410] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:00.052147 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:00.052804 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:00.053169 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:00.053488 23659 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:00.016387 25639 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.008898 25660 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:00.030114 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:00.030179 25871 consensus_queue.cc:237] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:00.032920 25770 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:00.057909 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 50752.4us
I20260709 12:17:00.058302 25770 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:00.014974 22821 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 4.775s	user 0.018s	sys 0.041s
I20260709 12:17:00.030126 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:00.015304 23660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 699) took 6186 ms (client timeout 1590 ms). Trace:
I20260709 12:17:00.059644 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:00.036170 23493 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:00.009203 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:00.060534 22746 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:00.036720 22753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 874) took 5411 ms (client timeout 3089 ms). Trace:
I20260709 12:17:00.061936 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:00.059049 25770 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:00.053964 22819 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:00.023898 22745 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:00.055893 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:00.009733 25725 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:00.044332 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:00.068576 22824 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:00.069007 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:00.063616 22753 rpcz_store.cc:269] 0709 12:16:54.602275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.602403 (+   128us) service_pool.cc:224] Handling call
0709 12:17:00.013037 (+5410634us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54001e64d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:00.013348 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204957952}
I20260709 12:17:00.073356 25771 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:00.068624 22821 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
W20260709 12:17:00.074250 22821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 900) took 4848 ms (client timeout 2948 ms). Trace:
I20260709 12:17:00.074458 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 427) took 6760 ms. Trace:
I20260709 12:17:00.056859 25660 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.075124 25660 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:00.074875 22826 rpcz_store.cc:276] 0709 12:16:53.314532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.452750 (+138218us) service_pool.cc:224] Handling call
0709 12:16:53.467839 (+ 15089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:59.851491 (+6383652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:00.074188 (+222697us) spinlock_profiling.cc:243] Waited 6.3 s on lock 0x7b54005528d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:00.074411 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14480908160}
W20260709 12:17:00.060067 23660 rpcz_store.cc:269] 0709 12:16:53.828612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.831062 (+  2450us) service_pool.cc:224] Handling call
0709 12:17:00.014821 (+6183759us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400080554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:00.015034 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2505642880}
I20260709 12:17:00.079089 25789 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:00.080574 25770 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:00.081611 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:00.079174 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 724) took 5349 ms. Trace:
W20260709 12:17:00.074601 22821 rpcz_store.cc:269] 0709 12:16:55.225362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.232070 (+  6708us) service_pool.cc:224] Handling call
0709 12:17:00.074159 (+4842089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:00.071295 25725 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.098692 25725 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:00.100519 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 714) took 5476 ms. Trace:
I20260709 12:17:00.101123 23674 rpcz_store.cc:276] 0709 12:16:54.624537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.417895 (+4793358us) service_pool.cc:224] Handling call
0709 12:16:59.925917 (+508022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:59.942156 (+ 16239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:00.100125 (+157969us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54001ffed0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:00.100321 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156156288}
I20260709 12:17:00.103132 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:00.106314 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:00.095440 22752 rpcz_store.cc:276] 0709 12:16:54.729279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.737351 (+  8072us) service_pool.cc:224] Handling call
0709 12:16:54.737723 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:55.140101 (+402378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:00.078681 (+4938580us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54002baa54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:00.078996 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919758592}
I20260709 12:17:00.110070 22748 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:00.111629 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:00.110157 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:00.113103 23679 raft_consensus.cc:2410] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:17:00.109822 25602 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:00.115002 25635 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:00.115576 25635 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:00.115968 25635 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:00.116217 22823 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:00.119007 25718 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:00.121505 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:00.104633 25771 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:00.127894 25771 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:00.136539 25592 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:00.138001 22717 connection.cc:256] RPC call timeout handler was delayed by -4.3278670889999376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 12:17:00.138497 22717 connection.cc:256] RPC call timeout handler was delayed by -4.300348725999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2251s for a response
I20260709 12:17:00.138831 25700 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.123450 25718 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:17:00.143944 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 107915us
I20260709 12:17:00.157641 23685 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:17:00.161094 22746 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:00.158865 25718 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:00.165674 25700 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:00.166280 25718 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.167809 25718 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:00.170529 23493 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:00.172335 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:00.172070 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:00.173501 23656 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:00.174268 25665 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:00.175330 25665 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:00.168568 25700 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:00.181106 22717 connection.cc:256] RPC call timeout handler was delayed by -4.0758246619998317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 12:17:00.182356 22717 connection.cc:256] RPC call timeout handler was delayed by -3.9740785129999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 12:17:00.183991 22717 connection.cc:256] RPC call timeout handler was delayed by -3.9684163209999497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 12:17:00.184279 22717 connection.cc:256] RPC call timeout handler was delayed by -3.8073804440000458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 12:17:00.184505 22717 connection.cc:256] RPC call timeout handler was delayed by -3.8073804440000458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 12:17:00.184733 22717 connection.cc:256] RPC call timeout handler was delayed by -3.722780443999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 12:17:00.184955 22717 connection.cc:256] RPC call timeout handler was delayed by -3.722780443999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 12:17:00.185184 22717 connection.cc:256] RPC call timeout handler was delayed by -3.630980443999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 12:17:00.185400 22717 connection.cc:256] RPC call timeout handler was delayed by -3.630980443999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 12:17:00.185632 22717 connection.cc:256] RPC call timeout handler was delayed by -3.5607804439998745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 12:17:00.185853 22717 connection.cc:256] RPC call timeout handler was delayed by -3.5607804439998745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 12:17:00.186069 22717 connection.cc:256] RPC call timeout handler was delayed by -3.5427804440000727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 12:17:00.186293 22717 connection.cc:256] RPC call timeout handler was delayed by -3.5427804440000727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 12:17:00.186514 22717 connection.cc:256] RPC call timeout handler was delayed by -3.5166804440000305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 12:17:00.186740 22717 connection.cc:256] RPC call timeout handler was delayed by -2.6409804439999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2964s for a response
W20260709 12:17:00.213287 22717 connection.cc:256] RPC call timeout handler was delayed by -2.6409804439999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2964s for a response
I20260709 12:17:00.183105 25457 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.215124 25886 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.215628 25457 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.221673 25635 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.231711 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:00.182847 25649 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:00.238691 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd8c0 after lost signal to thread 22610
W20260709 12:17:00.239951 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08002653e0 after lost signal to thread 22623
I20260709 12:17:00.239907 23695 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
W20260709 12:17:00.247340 22607 debug-util.cc:398] Leaking SignalData structure 0x7b0800282300 after lost signal to thread 22630
I20260709 12:17:00.251094 25660 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.251744 25457 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:00.247033 25649 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.252792 25864 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.254344 25649 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:00.243453 25712 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.255430 25886 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:00.256443 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 84294.5us
W20260709 12:17:00.255473 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.264430 25602 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:00.266160 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08001397a0 after lost signal to thread 22777
I20260709 12:17:00.266525 25634 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:00.267278 25886 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:00.267622 25280 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.268790 25683 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:00.271919 25740 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.332348 25760 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:00.333002 25760 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.253885 25660 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:00.276298 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:00.276679 22864 connection.cc:256] RPC call timeout handler was delayed by -2.9662955369999509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22599999999999998s for a response
I20260709 12:17:00.276839 25754 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:00.274708 25639 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.278110 25717 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:00.279496 25801 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.279731 25180 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.281780 25848 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.282832 25704 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:00.364717 25704 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:00.365142 25704 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:00.280156 25743 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:00.280804 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.281136 25779 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.284754 25770 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:00.295029 23493 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:00.294303 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.332008 25280 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:00.272588 25725 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:00.254184 25864 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:00.340462 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:00.374279 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:00.340005 22864 connection.cc:256] RPC call timeout handler was delayed by -2.7282185070000651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 12:17:00.375207 22864 connection.cc:256] RPC call timeout handler was delayed by -2.5612955369999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.271s for a response
W20260709 12:17:00.375658 22864 connection.cc:256] RPC call timeout handler was delayed by -2.2201955370001087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3089s for a response
I20260709 12:17:00.357126 25717 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.353999 25740 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:00.352170 25754 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:00.362877 25801 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:00.366763 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:00.366922 25848 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:00.369383 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 128477us
W20260709 12:17:00.377805 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 86204.3us
I20260709 12:17:00.384093 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:00.384388 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.387717 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.380349 25683 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:00.391423 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:00.391825 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:00.392432 22900 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:00.392467 25801 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:00.395905 25756 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.401087 25801 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:00.396375 25743 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:00.366483 25704 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.399111 25849 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.410971 25704 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:00.416225 22895 raft_consensus.cc:2393] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:00.399381 25725 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:00.400321 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:00.401717 25801 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.408984 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:00.409785 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.393018 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.421263 22746 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:00.429131 22894 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 11: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:00.440588 25280 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:00.413062 25855 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.441223 22899 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:00.441694 25280 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.441777 25855 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.411207 25849 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:00.443187 22898 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:00.377699 25779 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.404763 25660 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:00.429677 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:00.367740 25180 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:00.458073 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08003bff20 after lost signal to thread 22851
I20260709 12:17:00.414821 25848 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.460495 22899 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
W20260709 12:17:00.462747 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea200 after lost signal to thread 22852
W20260709 12:17:00.462458 22864 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.194:36669 timed out after 1.756s (SENT) [suppressed 28 similar messages]
I20260709 12:17:00.401353 25756 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.440680 25801 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:00.481261 22865 connection.cc:256] RPC call timeout handler was delayed by -4.0875739750001685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 12:17:00.485982 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.460507 25660 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:00.493700 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5e20 after lost signal to thread 22925
I20260709 12:17:00.484912 22892 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
W20260709 12:17:00.491123 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 87989.7us
I20260709 12:17:00.491701 22893 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:00.483945 22865 connection.cc:256] RPC call timeout handler was delayed by -3.8832739750002929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260709 12:17:00.488193 22895 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:00.493544 22899 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:00.442698 25280 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:00.484887 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:00.500054 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 715) took 6034 ms. Trace:
W20260709 12:17:00.502231 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0500 after lost signal to thread 23729
W20260709 12:17:00.503898 22607 debug-util.cc:398] Leaking SignalData structure 0x7b0800271860 after lost signal to thread 23731
W20260709 12:17:00.504221 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08003b8720 after lost signal to thread 25169
W20260709 12:17:00.501191 22865 connection.cc:256] RPC call timeout handler was delayed by -3.861804002000099s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 12:17:00.506217 22865 connection.cc:256] RPC call timeout handler was delayed by -3.7304040020001139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
I20260709 12:17:00.481364 25848 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:00.506645 22865 connection.cc:256] RPC call timeout handler was delayed by -3.7304040020001139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 12:17:00.508102 22607 debug-util.cc:398] Leaking SignalData structure 0x7b0800339f00 after lost signal to thread 25390
I20260709 12:17:00.505489 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:00.510104 22865 connection.cc:256] RPC call timeout handler was delayed by -3.6872040020000441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 12:17:00.510221 22607 debug-util.cc:398] Leaking SignalData structure 0x7b0800396ae0 after lost signal to thread 25427
I20260709 12:17:00.497385 25660 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:00.510735 22865 connection.cc:256] RPC call timeout handler was delayed by -3.6206040020001637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 12:17:00.513962 22865 connection.cc:256] RPC call timeout handler was delayed by -3.6197040020001623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260709 12:17:00.514608 22865 connection.cc:256] RPC call timeout handler was delayed by -3.0138739750002514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3089s for a response
W20260709 12:17:00.515187 22865 connection.cc:256] RPC call timeout handler was delayed by -2.7973692050002228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2948s for a response
I20260709 12:17:00.514922 23493 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:00.515745 22865 connection.cc:256] RPC call timeout handler was delayed by -2.7881498900001134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2948s for a response
I20260709 12:17:00.502214 23672 rpcz_store.cc:276] 0709 12:16:54.316607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.933393 (+616786us) service_pool.cc:224] Handling call
0709 12:16:54.933839 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:54.934111 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:16:54.958720 (+ 24609us) log.cc:844] Serialized 14 byte log entry
0709 12:17:00.142913 (+5184193us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b180013b340. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:17:00.210314 (+ 67401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:00.223718 (+ 13404us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:00.304036 (+ 80318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:00.330600 (+ 26564us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:00.351275 (+ 20675us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25368,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":5106,"raft.queue_time_us":3845,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":5853,"spinlock_wait_cycles":8938240,"thread_start_us":37495,"threads_started":1,"wal-append.queue_time_us":5375178}
I20260709 12:17:00.516356 25683 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:00.519799 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.507084 25771 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:00.524748 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.525476 22899 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:17:00.520593 22895 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
W20260709 12:17:00.528469 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 69058us
I20260709 12:17:00.516507 25770 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:00.529584 25634 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:00.531520 25770 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.532121 25770 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:00.532745 25866 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:00.521381 25848 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.535938 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.507946 25635 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:00.522949 22607 debug-util.cc:398] Leaking SignalData structure 0x7b080039c120 after lost signal to thread 25593
I20260709 12:17:00.527225 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.527223 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.519764 25683 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.536861 22753 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:00.540515 22745 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:00.527874 25771 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.533713 25743 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:00.547097 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 65886.9us
I20260709 12:17:00.540539 25801 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:00.549252 25754 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:00.549106 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.549403 25801 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:00.550217 22752 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:00.550683 25891 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:00.550755 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3760 after lost signal to thread 25815
W20260709 12:17:00.551789 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08001a3500 after lost signal to thread 25827
I20260709 12:17:00.551390 25891 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:00.552214 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd880 after lost signal to thread 25831
W20260709 12:17:00.552523 22607 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4e20 after lost signal to thread 25832
I20260709 12:17:00.553654 25891 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:00.536973 25718 consensus_queue.cc:1059] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:00.554875 25718 raft_consensus.cc:3055] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:00.555264 25718 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:00.555413 25871 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:00.555671 25725 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:00.539510 25895 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.556661 22746 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:00.556515 25725 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.558032 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.558938 25855 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.559433 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.560163 25180 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:00.556303 25871 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.561132 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:00.561880 25725 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.547889 25771 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:00.558061 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.563206 25871 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.563766 25634 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:00.564399 25634 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:00.566366 25864 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.542145 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.551424 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.564842 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:00.567577 22898 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:00.565821 25756 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.571126 25895 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.573923 25895 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.574690 25717 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.575496 25779 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.575711 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:00.577044 25890 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:17:00.577068 22900 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:00.542917 25683 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:00.578372 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.578510 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.579746 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.581516 25801 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:00.560173 22896 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:17:00.577286 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.594026 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:00.595288 22898 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:00.556421 25718 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.599380 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.600587 22901 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:00.601647 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.602334 22901 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:17:00.603711 25893 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:17:00.577257 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.605556 22894 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:17:00.606050 25740 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:00.607060 22899 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 4.
I20260709 12:17:00.608680 22895 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:17:00.565451 25634 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:00.611536 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.590596 25280 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:00.616830 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 52071.9us
I20260709 12:17:00.616973 25649 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:00.617651 25649 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.618026 25649 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:00.620539 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:00.621254 22749 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:00.588413 22893 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
W20260709 12:17:00.634277 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 68169.2us
I20260709 12:17:00.640574 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:00.641367 22747 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:00.642410 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:00.643085 22751 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:00.643811 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.644518 22744 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:00.648801 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:00.649824 22901 raft_consensus.cc:2368] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9.
I20260709 12:17:00.653105 22790 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:00.659101 22825 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:00.654490 25891 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:17:00.662406 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:00.663623 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.642302 25849 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:00.671591 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.677150 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.677266 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:00.677567 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:00.678122 22826 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:00.659467 25761 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:00.680568 22822 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:17:00.679519 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:00.687258 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:00.678186 22824 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:17:00.690876 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:00.691586 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.692377 22901 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:17:00.693459 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.691963 22820 raft_consensus.cc:2376] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8. Re-sending same reply.
I20260709 12:17:00.699728 22899 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:17:00.700136 22899 pending_rounds.cc:85] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 4
I20260709 12:17:00.700480 22899 pending_rounds.cc:107] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:00.699097 22753 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:17:00.700814 22899 raft_consensus.cc:2889] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:00.703356 25665 consensus_meta.cc:287] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.002s
I20260709 12:17:00.703913 25665 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:00.707641 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:00.709100 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.712965 22898 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:17:00.710410 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.724139 25280 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:00.724704 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:00.725181 25771 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.691830 25761 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:00.726773 22753 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:00.725829 25280 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:00.698642 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:00.740139 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.740857 22747 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:00.727959 22751 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
W20260709 12:17:00.754359 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 107085us
I20260709 12:17:00.757014 22753 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:00.701828 25848 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.758284 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.760129 22900 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:00.760871 25901 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:00.761436 25901 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.761845 25901 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:00.732865 25280 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:00.768857 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.774192 22901 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:17:00.774662 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.776007 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.779714 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.781980 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.775712 22897 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:17:00.783242 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.783835 22899 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:17:00.784407 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 104976us
I20260709 12:17:00.785495 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:00.782833 22894 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
W20260709 12:17:00.787377 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 88799.7us
I20260709 12:17:00.787767 25280 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.788398 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:00.789438 25280 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:00.790012 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:00.785967 25665 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.773489 25683 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.791392 25665 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:00.793259 25683 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:00.793695 25665 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:00.775796 25898 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:00.805817 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:00.797881 25683 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:00.810494 25683 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.810993 25683 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:00.817114 25760 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:00.817724 25902 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:00.817915 25760 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.767259 25849 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 12:17:00.833873 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:00.857771 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.823138 22896 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:17:00.864673 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.865731 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.866603 22899 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:17:00.868101 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.828490 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:00.867846 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 58065us
I20260709 12:17:00.819257 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:00.832116 25905 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
I20260709 12:17:00.880630 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:00.881381 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:00.881958 25649 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:00.885484 22744 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:17:00.833231 25866 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:00.885743 22749 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:00.821759 25771 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:00.818538 25760 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:00.824260 25592 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:00.828536 25665 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:00.895790 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.894258 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.891142 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:00.896734 22899 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:00.897429 22751 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:17:00.818635 25902 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:17:00.832931 25801 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:17:00.897696 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:00.902086 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.903956 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:00.902015 25779 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:00.907953 25770 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.895704 25849 consensus_queue.cc:1243] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:00.913679 25717 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:00.913430 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.913956 23682 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:00.915156 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:00.916116 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.916708 25760 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:00.918337 25704 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.005s
I20260709 12:17:00.919256 25649 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:00.919807 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.921581 22865 leader_election.cc:400] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12.
I20260709 12:17:00.884224 25635 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.924221 25718 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:00.924065 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.954366 22748 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:17:00.955382 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.956936 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.957633 22748 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:00.925184 25602 raft_consensus.cc:3055] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:00.927147 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.931608 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:00.959147 22821 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
W20260709 12:17:00.931639 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:00.898442 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 105092us
I20260709 12:17:00.936153 22744 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:00.939427 23672 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:00.830296 25660 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.960116 22753 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:00.964399 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.941705 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.943987 22820 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:00.940191 22896 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 4.
I20260709 12:17:00.935871 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:00.796797 25761 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:00.947213 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.966445 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.951645 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:00.951874 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:00.950208 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:00.961841 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:00.962779 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:00.950240 22746 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:00.967821 23695 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:17:00.967417 22749 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:00.970360 22752 raft_consensus.cc:2410] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:00.970752 22751 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:00.971432 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:00.972419 22822 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:00.948097 25717 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:00.973773 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:00.977423 22717 leader_election.cc:336] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 2.055s (SENT)
I20260709 12:17:00.985667 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:00.987857 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:00.989534 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:00.959565 25602 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:00.990847 22824 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:00.995831 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.002375 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:01.000440 22753 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:01.003278 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:00.984851 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:00.972129 22750 raft_consensus.cc:2376] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9. Re-sending same reply.
I20260709 12:17:00.968581 25779 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:01.004577 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.004743 23689 raft_consensus.cc:2368] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9.
I20260709 12:17:00.990530 23685 raft_consensus.cc:2410] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:17:00.999549 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:00.988668 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:01.000381 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.001755 23674 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:01.004705 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:01.008368 22745 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 10: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:01.009788 22822 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:01.010555 22896 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:00.985244 25760 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:00.985440 25453 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:17:01.011610 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.011854 25760 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:00.976245 25735 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.013048 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:01.012984 25760 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:01.013520 25735 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:00.983497 25717 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:01.015218 25771 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:01.015796 25735 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:01.016137 25717 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:01.016746 25848 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:01.017256 25848 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:01.004447 25779 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:01.019965 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:01.020720 22898 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:01.022552 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:01.022945 22896 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:01.010880 25911 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:17:01.023852 25612 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:01.024518 25612 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:01.023988 25602 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:01.025408 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:01.025503 25602 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:01.025631 25612 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:01.026919 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.028419 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.029206 23659 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:01.029773 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.030083 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:00.986678 25660 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:01.031188 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:01.031260 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:01.031646 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:01.004428 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:01.032018 22820 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:01.032334 22824 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:01.032680 23682 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:00.963380 25635 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:01.033627 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.034329 23682 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:01.035177 25635 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:01.035900 23679 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:17:00.975835 25704 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:01.039793 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.039973 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:01.042148 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:01.042650 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.040197 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:01.044134 22826 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 5.
I20260709 12:17:01.045841 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.047986 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.048269 22896 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:01.045895 22790 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.045826 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:01.050870 23674 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:01.050280 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.053351 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.049206 25735 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:01.054919 25864 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:01.056066 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:01.061702 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:01.062251 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 140917us
I20260709 12:17:01.061913 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:01.056689 22790 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.039525 25902 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:01.055511 25871 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:01.061827 23695 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:01.064031 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.059434 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:01.015820 25771 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:01.065933 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.052213 25704 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:01.061088 25864 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:01.055802 25891 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:01.068220 22753 raft_consensus.cc:2393] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 8: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:01.076361 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:01.065665 25725 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:01.056140 25457 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:01.018297 25848 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:01.066505 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:01.103376 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 126040us
I20260709 12:17:01.101845 23685 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:01.082901 23689 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:01.060338 22576 catalog_manager.cc:5697] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.104395 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:01.105692 22745 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:01.105988 22576 catalog_manager.cc:5697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:17:01.108043 22576 catalog_manager.cc:5697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 6 to 7, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 7 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:17:01.111044 25904 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:01.112361 25704 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:01.115761 22748 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:17:01.089740 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:01.091131 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.058667 25635 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:01.091634 23656 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:01.120666 22744 raft_consensus.cc:2376] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9. Re-sending same reply.
I20260709 12:17:01.092749 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:01.059856 25735 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.093870 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.080407 25871 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.082957 25870 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:01.080739 25612 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:01.071026 25902 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:01.135886 25902 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:01.136633 23493 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.137481 25635 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:01.132193 25771 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:01.138701 25771 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:01.091718 25864 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:01.092157 25891 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:01.127259 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 58263.9us
I20260709 12:17:01.096685 25901 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:01.129478 25740 raft_consensus.cc:2764] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:17:01.129634 25770 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:01.133292 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:01.130353 25871 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:01.130250 25870 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:01.137897 25635 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:01.186719 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 52968.2us
I20260709 12:17:01.122712 23672 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:17:01.140470 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:01.140930 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:01.193212 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 52400.2us
I20260709 12:17:01.142170 22744 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:17:01.140987 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.146548 22750 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:17:01.148219 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.147015 22576 catalog_manager.cc:5697] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 5 to 6, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 6 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:17:01.150341 22748 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:17:01.198848 23672 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:01.150936 25891 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:01.161036 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:01.163552 23689 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:01.128021 25735 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:01.153069 25848 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:01.200704 23682 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:01.205004 22576 catalog_manager.cc:5697] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:01.202507 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 43620.8us
W20260709 12:17:01.202726 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 61816.2us
I20260709 12:17:01.210968 22864 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.159224 25639 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:17:01.189937 25635 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:01.140152 25904 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:17:01.218973 23656 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:01.220862 22896 raft_consensus.cc:3055] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:01.213654 22864 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.223558 23689 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:01.221438 22896 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:01.152601 25683 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:01.224574 22576 catalog_manager.cc:5697] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 5 to 8, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 8 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:17:01.226598 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:01.228507 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.235213 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:01.236133 22899 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:01.239307 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:01.216647 25740 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:01.245311 23689 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:01.242491 22576 catalog_manager.cc:5697] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.216199 25801 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:01.244230 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:01.232316 22896 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:01.247097 23682 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:01.248652 23659 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:01.250267 23656 raft_consensus.cc:2393] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:01.253489 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 59174.8us
I20260709 12:17:01.259909 25761 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:01.260610 25761 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.261655 23674 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:01.267467 22896 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:01.240615 25725 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:01.245357 25740 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.249694 25801 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.289714 23674 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:01.288533 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.285173 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1175) took 1221 ms. Trace:
I20260709 12:17:01.290874 23656 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:01.284127 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 70562.3us
W20260709 12:17:01.281210 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.290840 22827 rpcz_store.cc:276] 0709 12:17:00.049085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.118866 (+ 69781us) service_pool.cc:224] Handling call
0709 12:17:00.119285 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:01.261474 (+1142189us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:01.261522 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:01.261591 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:01.261640 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.270045 (+  8405us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400302854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:01.270095 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:01.270243 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2605307264}
I20260709 12:17:01.284662 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.279186 22899 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:01.294849 22576 catalog_manager.cc:5697] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:17:01.295763 23660 raft_consensus.cc:2410] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:01.266625 25592 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:01.261896 25789 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:01.318933 22818 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:17:01.319095 25789 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:01.319429 25719 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:17:01.322582 25779 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:01.323877 25789 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:01.324898 22898 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:01.289150 25740 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:01.300097 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 139122us
I20260709 12:17:01.339301 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:01.331499 22576 catalog_manager.cc:5697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 4 to 5, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 5 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.284683 25761 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:01.309103 22572 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43994 (request call id 148) took 39067 ms (client timeout 15000 ms). Trace:
I20260709 12:17:01.309497 25725 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:01.344403 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 116861us
I20260709 12:17:01.344445 22898 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:17:01.295734 25801 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:01.284917 25849 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:01.307936 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:01.338214 25914 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:17:01.356701 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:01.357667 22576 catalog_manager.cc:5697] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:17:01.358378 23656 raft_consensus.cc:2376] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8. Re-sending same reply.
W20260709 12:17:01.359238 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 51398.3us
I20260709 12:17:01.362164 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.287999 25922 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
W20260709 12:17:01.363811 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 79286.2us
I20260709 12:17:01.341338 25904 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:01.364969 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.368283 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.366142 22576 catalog_manager.cc:5697] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 4 to 7, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 7 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:17:01.370261 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.373649 22576 catalog_manager.cc:5697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 3 to 6, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 6 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.354424 25592 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:01.357460 25849 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:01.385848 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.396724 25901 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:01.397068 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.399335 25665 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:01.401080 25919 log.cc:927] Time spent T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:17:01.401479 25740 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:01.404743 25740 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:01.404631 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:01.406314 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 67133.7us
I20260709 12:17:01.406435 25789 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:01.407056 25789 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.407554 25789 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:01.409142 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.372391 25457 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:17:01.411958 25612 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:01.412550 25612 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:01.413007 25612 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:01.389590 25904 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:01.415004 25904 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:01.410662 22791 leader_election.cc:400] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:01.416666 22791 leader_election.cc:403] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:01.417259 25923 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:01.418587 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.419368 25923 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:01.424674 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.288401 25870 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:01.425650 25719 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:01.426297 25719 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:01.412137 25457 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:01.427235 25457 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:01.427585 25921 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:17:01.428188 25457 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:01.428947 25929 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:01.428965 25719 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:01.429600 25457 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:01.429770 25918 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:17:01.431763 25917 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:17:01.432286 25761 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:01.429786 25929 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.435909 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:01.409950 25592 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:01.428674 25926 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:01.438251 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 180793us
I20260709 12:17:01.456152 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:01.439635 23695 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:01.458326 25665 raft_consensus.cc:2764] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:17:01.448212 25926 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:01.459322 25926 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:01.459522 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 91596.4us
I20260709 12:17:01.462613 22899 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:01.434549 25761 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:01.442536 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 50749.4us
I20260709 12:17:01.443543 23685 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:01.441624 22896 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:17:01.434684 25929 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:01.458528 25816 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:01.467315 22791 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.469457 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.437126 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.469218 22896 pending_rounds.cc:85] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 4
I20260709 12:17:01.474704 22896 pending_rounds.cc:107] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:17:01.474852 23674 raft_consensus.cc:2368] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8.
I20260709 12:17:01.475085 22896 raft_consensus.cc:2889] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:01.473819 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:01.470381 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:01.487515 22753 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:01.490549 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:01.487313 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:01.491951 23656 raft_consensus.cc:2376] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9. Re-sending same reply.
W20260709 12:17:01.447566 25914 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:17:01.495694 22576 catalog_manager.cc:5697] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 6, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 6 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.392064 25849 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:01.402454 25864 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:01.511133 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:01.511837 22893 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:01.512514 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 150429us
I20260709 12:17:01.447124 25740 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:01.467242 25660 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:01.516259 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:01.527710 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 168682us
I20260709 12:17:01.532529 22576 catalog_manager.cc:5697] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 5 to 10, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 10 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.507658 25901 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:01.534632 22576 catalog_manager.cc:5697] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 4 to 8, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 8 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
W20260709 12:17:01.351238 22572 rpcz_store.cc:269] 0709 12:16:22.241500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.251189 (+  9689us) service_pool.cc:224] Handling call
0709 12:17:01.308750 (+39057561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:51.895085 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:51.967595 (+ 72510us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:51.976720 (+  9125us) write_op.cc:435] Acquired schema lock
0709 12:16:51.980605 (+  3885us) tablet.cc:662] Decoding operations
0709 12:16:52.048538 (+ 67933us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:52.048627 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:52.048652 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:16:52.049025 (+   373us) tablet.cc:701] Row locks acquired
0709 12:16:52.049042 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:16:52.049204 (+   162us) write_op.cc:270] Start()
0709 12:16:52.049333 (+   129us) write_op.cc:276] Timestamp: P: 1783599412049148 usec, L: 0
0709 12:16:52.049354 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:16:52.050053 (+   699us) log.cc:844] Serialized 1713 byte log entry
0709 12:16:52.675365 (+625312us) op_driver.cc:464] REPLICATION: finished
0709 12:16:52.842159 (+166794us) write_op.cc:301] APPLY: starting
0709 12:16:52.850800 (+  8641us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:52.871836 (+ 21036us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:52.932818 (+ 60982us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:53.046506 (+113688us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:53.046730 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:16:53.048249 (+  1519us) write_op.cc:312] APPLY: finished
0709 12:16:53.212065 (+163816us) log.cc:844] Serialized 40 byte log entry
0709 12:16:53.287256 (+ 75191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:53.302379 (+ 15123us) write_op.cc:454] Released schema lock
0709 12:16:53.314934 (+ 12555us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:53.420722 (+105788us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:53.432514 (+ 11792us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1122338,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":144872,"apply.run_cpu_time_us":5018,"apply.run_wall_time_us":555142,"num_ops":4,"prepare.queue_time_us":581981,"prepare.run_cpu_time_us":17800,"prepare.run_wall_time_us":230424,"raft.queue_time_us":259535,"raft.run_cpu_time_us":10209,"raft.run_wall_time_us":78063,"replication_time_us":625819,"thread_start_us":712456,"threads_started":4,"wal-append.queue_time_us":145607,"wal-append.run_cpu_time_us":36443,"wal-append.run_wall_time_us":2233623}]]}
W20260709 12:17:01.574750 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.575675 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.512537 25639 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:01.577911 22576 catalog_manager.cc:5697] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:17:01.579535 22576 catalog_manager.cc:5697] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.579990 25939 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:01.581681 22576 catalog_manager.cc:5697] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 2 to 6, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 6 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.583422 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:01.584156 22750 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:01.522761 25761 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:01.515377 25870 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:01.496752 25719 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:17:01.520494 25816 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:01.504601 25635 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:01.588706 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 60027.4us
I20260709 12:17:01.594166 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.517480 25665 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:17:01.537599 25683 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:01.601213 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:01.598969 25779 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:01.597653 22893 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:01.510717 25760 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
W20260709 12:17:01.602008 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.595070 22576 catalog_manager.cc:5697] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 5 to 8, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 8 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:17:01.578297 25639 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:01.613226 25639 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:01.613515 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:01.575053 25740 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:01.616506 22895 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:01.612780 22892 raft_consensus.cc:2410] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 12:17:01.620801 22576 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 6 to 8, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 8 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.611085 23494 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:01.627031 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 94976.9us
I20260709 12:17:01.628479 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:01.632915 22893 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:01.639619 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.641162 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.643849 22576 catalog_manager.cc:5697] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 3 to 4, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 4 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:17:01.616710 25930 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:01.654124 22576 catalog_manager.cc:5697] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:01.653016 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 73650.6us
I20260709 12:17:01.654560 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:01.631174 25718 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:01.616426 25936 raft_consensus.cc:2764] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:17:01.626456 25865 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:01.663061 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.655326 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:01.649399 25902 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.004s
I20260709 12:17:01.707108 25902 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:01.709682 25902 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:01.663579 25592 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:01.664089 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:17:01.715595 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 51632.2us
I20260709 12:17:01.717108 25718 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:01.718041 25931 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:01.718500 25931 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.718972 25931 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:01.718585 25718 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:01.719797 25935 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:01.718990 25280 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:01.720851 25280 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:01.721247 25280 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:01.721933 25901 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:01.722913 25908 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.070s	user 0.005s	sys 0.005s
I20260709 12:17:01.722581 25901 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:01.725903 25901 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:01.727180 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:01.644079 25717 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:01.616317 25870 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:01.645961 25761 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:01.696637 25864 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:01.697634 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 64225.6us
I20260709 12:17:01.698202 25779 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:01.671504 25735 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:01.699184 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:01.698952 25816 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:01.701608 25928 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:17:01.632652 25453 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:17:01.703198 25940 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:01.717324 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.673775 22576 catalog_manager.cc:5697] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 7, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 7 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.736340 22747 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:01.744715 22753 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:01.761291 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:01.744920 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 150833us
I20260709 12:17:01.670336 25930 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:17:01.766328 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 49074.2us
I20260709 12:17:01.767098 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:01.663388 25683 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:17:01.767072 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.776000 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.763891 25719 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:01.662364 25740 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:01.692015 25865 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:01.772533 25934 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:01.779093 22576 catalog_manager.cc:5697] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 3 to 4, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 4 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.801992 22576 catalog_manager.cc:5697] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 1 to 6, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 6 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.790289 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:01.773066 25864 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:01.805912 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 71784.8us
I20260709 12:17:01.817989 25929 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:01.820570 25929 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:01.821902 25948 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:01.822458 25948 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.822820 25948 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:01.766127 25848 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:17:01.749413 25789 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:01.844391 22750 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:01.853144 25948 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:01.857722 25717 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:01.778434 25940 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:01.860817 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46727us
I20260709 12:17:01.801460 25719 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:01.881350 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 114307us
I20260709 12:17:01.882848 22896 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:01.815681 25761 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:01.914085 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:01.909605 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.860522 25934 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:17:01.927870 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 100358us
I20260709 12:17:01.812996 25864 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:01.948100 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:01.949548 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:01.954500 23685 raft_consensus.cc:2376] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6. Re-sending same reply.
I20260709 12:17:01.950326 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:01.951373 25760 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:01.867131 25866 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.955744 23679 raft_consensus.cc:2376] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8. Re-sending same reply.
W20260709 12:17:01.931485 25891 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.004s
I20260709 12:17:01.983335 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:01.984027 22819 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:01.982295 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 234436us
I20260709 12:17:01.976065 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:01.932410 25649 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:01.944167 25635 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:01.958360 25864 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:02.010524 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.015163 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.017936 23685 raft_consensus.cc:2376] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8. Re-sending same reply.
I20260709 12:17:02.040880 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.043769 23674 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 12:17:02.008330 25771 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.003s
I20260709 12:17:02.046258 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.044951 23660 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:02.046885 23685 raft_consensus.cc:2376] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9. Re-sending same reply.
I20260709 12:17:02.046003 25945 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:02.050048 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.003185 25649 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:02.049953 25945 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.055907 25719 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:01.827355 25930 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:02.059015 25940 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:02.047263 25717 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:02.061439 25870 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:02.061539 25865 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:02.054613 25934 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.062700 23656 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:17:02.062639 23695 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:02.063102 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 131072us
W20260709 12:17:02.069260 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.071070 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:01.996672 25866 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:02.075441 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 76010us
I20260709 12:17:01.999125 25891 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.081387 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:02.084124 23672 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:02.084535 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:02.086651 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:02.096958 25639 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:02.070956 25612 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.657s	user 0.006s	sys 0.007s
I20260709 12:17:02.067968 25649 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:02.107139 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:02.108145 22753 raft_consensus.cc:2368] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6.
I20260709 12:17:02.032858 25280 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:02.080806 25871 consensus_meta.cc:287] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.877s	user 0.015s	sys 0.002s
I20260709 12:17:02.071519 25945 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:02.078567 25904 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.105123 22744 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:02.114262 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.117282 25719 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:02.118070 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.118849 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.139207 23685 raft_consensus.cc:2368] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9.
I20260709 12:17:02.119550 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.120066 25612 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:02.121527 25960 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:02.125890 23672 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:02.126590 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.127305 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.146560 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.131168 22822 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 9: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:02.132085 25964 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:02.151567 23660 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:02.132946 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.127329 22825 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 10: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:02.154388 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.105767 22750 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:02.140368 22826 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:17:02.141213 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.138447 23689 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:17:02.113340 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.138667 25948 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:02.160019 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.160808 23685 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:02.161275 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:02.161993 22893 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:02.162211 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.164467 23656 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 10: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:02.155117 23674 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:02.168648 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:02.178965 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.180955 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:02.187976 22827 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 6: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:02.183754 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:02.189141 23656 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:02.206604 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:02.152230 25964 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.142768 25871 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:02.177313 22901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5085cb71870c4e7782244635c250487e"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:02.230957 22901 raft_consensus.cc:606] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:02.231806 22901 raft_consensus.cc:614] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:02.234639 22865 leader_election.cc:336] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 2.017s (SENT)
I20260709 12:17:02.224916 25761 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:02.223402 25789 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:02.184772 25960 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.260002 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:02.189909 25931 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.223999 25964 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:02.171419 25904 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:02.263921 22823 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:17:02.266083 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 59620.5us
I20260709 12:17:02.269613 22744 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
W20260709 12:17:02.284703 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 203423us
I20260709 12:17:02.286055 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:02.288335 23656 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:02.246922 25955 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:02.316059 25953 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.320672 25953 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:02.323419 25948 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:02.323876 25457 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.894s	user 0.016s	sys 0.004s
W20260709 12:17:02.299974 25949 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:17:02.324376 25948 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:02.325675 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.317116 22750 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:02.262388 25761 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:02.340075 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:02.336395 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:02.359694 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:02.306238 25966 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.375200 22717 leader_election.cc:400] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9.
I20260709 12:17:02.378904 22717 leader_election.cc:403] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:17:02.375692 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58557.4us
I20260709 12:17:02.376613 25978 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:17:02.376710 25952 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 12:17:02.376459 25944 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:02.385602 22893 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:17:02.387801 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:02.387089 22893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:02.390157 22893 raft_consensus.cc:606] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:02.340109 25761 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:02.367187 25801 consensus_meta.cc:287] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.997s	user 0.020s	sys 0.000s
I20260709 12:17:02.393652 22893 raft_consensus.cc:614] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:02.397603 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:02.405618 25660 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:02.380553 25923 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.961s	user 0.016s	sys 0.006s
I20260709 12:17:02.406407 25660 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:02.407333 25923 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:02.408893 22824 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:02.412855 25926 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.953s	user 0.015s	sys 0.000s
I20260709 12:17:02.413425 25926 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:02.330379 25955 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.415011 25957 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:02.415824 25957 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:02.417037 25955 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:02.416846 25957 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.391175 25966 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.420172 25966 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:02.424100 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:02.430284 22897 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:02.437307 22819 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:02.406280 25735 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:02.441246 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 66219.1us
I20260709 12:17:02.392654 25978 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.443008 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:02.451174 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:02.459791 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:02.461068 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.462258 22819 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:17:02.447582 25978 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:02.464769 25871 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:02.465209 25972 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:17:02.396499 25944 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.466840 25979 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:02.467382 25979 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.467692 25979 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:02.468341 25649 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:02.415069 25280 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:02.448335 25953 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:02.478744 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.491322 22750 raft_consensus.cc:3055] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:02.491868 22750 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:02.440732 25592 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.001s
I20260709 12:17:02.501542 22744 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:02.488780 25924 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.497449 25955 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:17:02.493156 22750 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:02.478060 25660 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:02.470764 25649 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:02.496963 25634 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:17:02.522745 25953 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:17:02.511129 25929 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:02.512573 25864 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:02.514895 25457 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:02.498139 25789 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.533267 25924 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:02.497372 25934 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:17:02.515278 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:02.497068 25718 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:02.426966 25801 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:02.440507 25960 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:02.516427 22900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a35aee871f0b41e48335c0260a873076"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:02.518278 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:02.522133 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 62484.5us
I20260709 12:17:02.522209 22750 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:02.456238 25948 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9.
I20260709 12:17:02.472554 25956 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:02.542742 25945 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.584090 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:02.547695 22820 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:02.550913 25954 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:02.585779 25954 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:02.586658 25954 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:02.587862 22895 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:02.476090 25931 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:02.552795 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:02.580152 25924 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:02.580814 25968 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.200s	user 0.002s	sys 0.000s
I20260709 12:17:02.610199 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.611634 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.612942 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:02.504674 25849 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.972s	user 0.008s	sys 0.006s
I20260709 12:17:02.510775 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:02.540175 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:02.522217 25970 consensus_queue.cc:1175] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a89a4b420ea9496aab55475fc38bb6f7" responder_term: 7 status { last_received { term: 7 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:02.521855 25280 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:17:02.626672 25920 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:02.627305 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:02.563027 22821 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:02.628038 22819 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:02.572886 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.564286 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1188) took 1536 ms. Trace:
I20260709 12:17:02.629355 22822 rpcz_store.cc:276] 0709 12:17:01.027449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.046329 (+ 18880us) service_pool.cc:224] Handling call
0709 12:17:02.563835 (+1517506us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000f19d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:02.564120 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454736768}
I20260709 12:17:02.579651 22900 raft_consensus.cc:606] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:02.579942 22744 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:02.578308 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:02.584081 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.581485 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:02.578478 22753 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:02.479244 25612 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:02.547287 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.618157 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.505767 25592 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:02.627527 25920 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:02.577442 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:02.578052 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 752) took 1556 ms. Trace:
I20260709 12:17:02.635344 22827 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:02.692072 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 110678us
I20260709 12:17:02.568784 25639 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:02.562642 25864 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:02.569262 25735 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.568006 25871 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.699648 22901 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:02.561734 25457 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:02.700395 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 761) took 1008 ms. Trace:
I20260709 12:17:02.620206 25453 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.559713 25866 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:02.653592 22892 rpcz_store.cc:276] 0709 12:17:01.022015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.022169 (+   154us) service_pool.cc:224] Handling call
0709 12:17:02.577757 (+1555588us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b5400317c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:02.577929 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355099392}
I20260709 12:17:02.701458 22897 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:02.707883 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.578922 25718 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:02.552068 25904 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:02.704480 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:02.705433 22744 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:02.606410 25964 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.580909 25801 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:02.643509 25924 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:02.563508 25789 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.618805 25926 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:02.748571 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:02.725773 22748 rpcz_store.cc:276] 0709 12:17:01.692330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.692558 (+   228us) service_pool.cc:224] Handling call
0709 12:17:01.718211 (+ 25653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:01.776479 (+ 58268us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:01.776511 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:01.799658 (+ 23147us) log.cc:844] Serialized 26 byte log entry
0709 12:17:02.188364 (+388706us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:02.188410 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.188489 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.700103 (+511614us) raft_consensus.cc:1685] finished
0709 12:17:02.700130 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.700323 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1377,"raft.queue_time_us":102788,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":418184,"threads_started":2,"wal-append.queue_time_us":788103}
I20260709 12:17:02.709132 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.757292 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.631908 25941 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 12:17:02.762348 22825 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 9: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:02.760123 22826 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:02.765121 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.702380 25981 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:02.642988 25849 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:02.768648 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 64262.8us
I20260709 12:17:02.770080 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:02.770927 23656 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:02.772523 23659 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: [5.4-7.5]
W20260709 12:17:02.778957 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.769567 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:02.788980 23656 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:02.741250 25635 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:02.699486 25761 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.791118 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:02.790486 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:02.796922 23659 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:02.791617 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.797082 23656 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 6: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:02.794898 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.798096 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:02.797977 22825 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:02.800067 23685 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:02.799531 23672 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:17:02.799594 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.799954 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:02.802866 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:02.806665 23695 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:02.803366 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:02.732663 25735 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:02.806460 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:02.731920 25871 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:02.789285 22819 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
W20260709 12:17:02.803318 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 292623us
I20260709 12:17:02.816844 23682 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 10: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:02.817752 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:02.747553 25453 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:02.819448 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:02.825261 23659 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:02.825474 22821 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:02.823453 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:02.804301 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:02.826588 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:02.804044 23672 pending_rounds.cc:85] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 4
I20260709 12:17:02.829397 23672 pending_rounds.cc:107] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:02.829460 22895 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:17:02.829944 23672 raft_consensus.cc:2889] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:02.829077 23685 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:02.835506 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:02.836484 25978 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:02.836803 25735 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:02.801326 25981 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:02.839095 25981 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:02.839092 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:02.839885 23659 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:02.842350 23659 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:17:02.842708 23659 pending_rounds.cc:85] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 5
I20260709 12:17:02.809917 25760 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:02.842995 23659 pending_rounds.cc:107] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:17:02.843375 23659 raft_consensus.cc:2889] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:02.844337 25978 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:02.827123 25930 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:02.847188 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:02.848457 22820 raft_consensus.cc:2393] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:02.850124 22820 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:02.850487 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 550) took 1385 ms. Trace:
I20260709 12:17:02.850966 23682 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:02.853436 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:02.851003 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 55766.8us
I20260709 12:17:02.834486 22821 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:02.863722 22893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:02.800387 25983 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:02.855690 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:02.865135 22893 raft_consensus.cc:606] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:02.867632 22893 raft_consensus.cc:614] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:02.851002 22899 rpcz_store.cc:276] 0709 12:17:01.465458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.466138 (+   680us) service_pool.cc:224] Handling call
0709 12:17:01.466541 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:01.488268 (+ 21727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:01.488304 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:01.488820 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:17:02.577235 (+1088415us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b180046bf40. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:17:02.714196 (+136961us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:02.714251 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.714325 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.850162 (+135837us) raft_consensus.cc:1685] finished
0709 12:17:02.850183 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.850403 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2559,"raft.queue_time_us":785,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":22466,"spinlock_wait_cycles":3007232,"thread_start_us":136729,"threads_started":1,"wal-append.queue_time_us":1291059}
I20260709 12:17:02.800806 25976 raft_consensus.cc:2764] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:17:02.872634 23679 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:02.873942 25771 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:02.806912 25945 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:02.890976 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.803635 25660 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.889824 22818 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:02.882277 22820 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:02.904961 22820 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:02.906436 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:02.906951 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 89347.2us
I20260709 12:17:02.907393 22818 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:02.908968 23695 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:02.892477 22821 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:02.801028 25635 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:02.831524 23656 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:02.885028 25978 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:02.884976 25904 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.920228 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:02.927492 25453 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:02.909139 25871 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:02.911887 25991 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:02.892750 25983 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:02.931694 25976 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:02.932826 22897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 553) took 1459 ms (client timeout 1573 ms). Trace:
I20260709 12:17:02.933677 25849 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:02.934260 22750 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:17:02.987669 22750 pending_rounds.cc:85] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 4
I20260709 12:17:02.988343 22750 pending_rounds.cc:107] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:17:02.988588 22750 raft_consensus.cc:2889] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:02.931713 25891 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:02.875737 25959 consensus_queue.cc:1059] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:17:02.917794 25771 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.942626 22865 leader_election.cc:400] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8.
I20260709 12:17:02.826284 25457 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:02.943923 25719 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.794s	user 0.013s	sys 0.000s
I20260709 12:17:02.948997 23685 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:02.965822 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 466) took 1017 ms. Trace:
W20260709 12:17:02.998238 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 191825us
I20260709 12:17:03.008055 23493 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:02.970569 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:02.971442 22898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:02.984333 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:02.985598 25453 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.986326 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:02.972188 25779 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.231s	user 0.019s	sys 0.002s
I20260709 12:17:02.991587 23689 raft_consensus.cc:2410] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:02.970072 25945 consensus_queue.cc:1059] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:17:02.947154 25964 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:02.974663 25979 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.003s
I20260709 12:17:02.994297 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:03.026190 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:02.996243 23682 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:03.000087 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 462) took 1053 ms. Trace:
I20260709 12:17:02.963706 25978 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:02.905486 25660 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:02.997027 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:03.003551 22864 leader_election.cc:400] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6.
I20260709 12:17:02.968176 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:02.989758 25991 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.007542 22819 rpcz_store.cc:276] 0709 12:17:01.948415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.878389 (+929974us) service_pool.cc:224] Handling call
0709 12:17:02.965621 (+ 87232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:03.010354 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 67952.9us
I20260709 12:17:02.990996 25976 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.015738 22898 raft_consensus.cc:606] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.037556 22898 raft_consensus.cc:614] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:03.017262 22901 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
W20260709 12:17:02.987306 22897 rpcz_store.cc:269] 0709 12:17:01.473243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.473557 (+   314us) service_pool.cc:224] Handling call
0709 12:17:02.932604 (+1459047us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54006ead54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:02.932754 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2194549504}
I20260709 12:17:03.037726 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.021354 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:03.041538 22825 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:02.974506 25904 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:02.990619 25760 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:03.026219 22899 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:03.030764 23685 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:03.018882 25735 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:03.032348 22864 leader_election.cc:403] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:17:03.063673 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 60342.8us
I20260709 12:17:03.017853 25956 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:03.066915 25983 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:03.064697 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:03.032688 22896 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:03.018882 25602 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:03.076458 22825 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:03.029014 22824 rpcz_store.cc:276] 0709 12:17:01.946401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.946551 (+   150us) service_pool.cc:224] Handling call
0709 12:17:01.997247 (+ 50696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.409393 (+412146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.999786 (+590393us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54007a1f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:03.000024 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945614720}
I20260709 12:17:03.032380 22820 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:03.036435 22750 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:03.024221 25779 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:03.078155 22825 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:17:03.079780 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:03.040201 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:03.044787 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 109524us
I20260709 12:17:03.041451 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:03.080984 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:03.046675 22744 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 12:17:03.081739 23660 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:03.021166 25453 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:03.026743 25718 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:03.014906 25771 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:03.047860 25998 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.051839 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.053509 25760 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:03.098621 25871 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:03.054675 25635 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:03.054931 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.055968 23685 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:03.056232 22748 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:17:03.139173 22748 pending_rounds.cc:85] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 6
I20260709 12:17:03.139467 22748 pending_rounds.cc:107] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:17:03.139691 22748 raft_consensus.cc:2889] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:03.029515 25719 raft_consensus.cc:3055] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:03.028424 25979 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:03.057495 25947 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.995s	user 0.002s	sys 0.008s
I20260709 12:17:03.153182 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.157291 22750 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 10: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:03.060420 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:03.158241 22821 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 10: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:03.061748 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:03.056413 25954 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:03.048062 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:03.035243 25978 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:03.074718 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.076645 22827 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:17:03.069976 25717 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:03.083114 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:03.092159 22825 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:17:03.092306 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.168352 23679 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:03.037791 25991 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:03.093959 23672 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:17:03.094703 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 54592us
I20260709 12:17:03.043452 25976 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:03.101549 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.050681 25683 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:03.107949 22822 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:03.108740 25453 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:03.109025 25993 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:17:03.109508 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 73985.6us
I20260709 12:17:03.173390 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:03.174033 22865 leader_election.cc:400] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9.
I20260709 12:17:03.175483 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.110532 25771 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:03.115072 25930 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:03.115355 25634 raft_consensus.cc:3055] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:03.121093 25761 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:03.131981 22745 raft_consensus.cc:2410] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:17:03.054055 25904 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:03.042223 25995 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:17:03.140342 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.143431 25719 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:03.144234 25660 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:03.133049 25998 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:03.147620 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:03.154163 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.058283 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:03.137333 22820 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:03.159384 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.148602 25981 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.161505 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:03.163937 22752 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:03.166812 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:03.148422 25948 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:03.178412 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 137026us
I20260709 12:17:03.171733 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:03.152590 25871 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:03.220455 22744 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:03.216147 22752 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:03.222152 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:03.223577 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 51939.2us
I20260709 12:17:03.223620 22744 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:03.223731 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:03.220661 22745 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:03.224973 22751 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:03.225389 22744 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:03.226060 22745 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:03.187136 25634 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:03.190033 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 109619us
I20260709 12:17:03.193205 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:03.178679 25718 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:17:03.208972 22748 raft_consensus.cc:2368] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9.
I20260709 12:17:03.235380 22744 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:03.190033 25779 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:03.166249 25994 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:17:03.246963 23494 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.183750 25849 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 5. Current term is 6.
I20260709 12:17:03.237363 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:03.237481 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:03.185460 22865 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.254933 22896 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:03.255004 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.191627 25930 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:03.207405 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.260409 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:03.260699 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 75344.4us
I20260709 12:17:03.243477 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:03.263618 22746 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:03.190503 25717 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:03.277679 25634 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:03.278898 25634 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:03.279186 25717 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:03.245482 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.227751 26007 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:03.224344 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 547) took 1996 ms. Trace:
I20260709 12:17:03.249933 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.246524 25970 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:03.191640 25924 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:17:03.201843 25453 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:03.244710 26005 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.133s	user 0.005s	sys 0.000s
I20260709 12:17:03.266350 22865 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.294097 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.273267 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:03.225338 25981 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:03.274209 25779 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:03.274657 25979 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:03.275377 25683 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:03.276235 25771 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:03.276734 25995 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:03.277016 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:03.311444 25931 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:03.312283 25660 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:03.312479 25931 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:03.312873 25660 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:03.313309 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:03.313827 25931 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:03.290261 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:03.319906 25999 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:17:03.320313 22745 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 6.
I20260709 12:17:03.321918 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:03.242631 25944 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:03.322882 25944 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:03.323518 25944 consensus_queue.cc:1243] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:03.324378 25944 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:03.325112 25944 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:03.326411 25944 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:03.284078 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.323436 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:03.330150 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:03.307488 25926 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:03.336900 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 52921us
I20260709 12:17:03.337934 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:03.339069 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:03.334434 23679 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:03.288134 25719 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:03.315197 25979 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:03.315014 25940 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:03.314390 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:03.288236 25959 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:17:03.307669 25779 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:03.284924 25761 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:17:03.244416 25964 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:17:03.275270 25930 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:03.281924 22894 rpcz_store.cc:276] 0709 12:17:01.228462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.228645 (+   183us) service_pool.cc:224] Handling call
0709 12:17:01.242959 (+ 14314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:01.363353 (+120394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:01.363398 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:01.368370 (+  4972us) log.cc:844] Serialized 26 byte log entry
0709 12:17:01.835196 (+466826us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:01.835241 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.835325 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.993518 (+1158193us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:03.209078 (+215560us) raft_consensus.cc:1685] finished
0709 12:17:03.209101 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.224277 (+ 15176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5890,"raft.queue_time_us":147397,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":136,"spinlock_wait_cycles":13868416,"thread_start_us":499729,"threads_started":2,"wal-append.queue_time_us":571794}
I20260709 12:17:03.232162 25920 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:03.294768 25453 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:03.286700 25956 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:03.309541 25981 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:03.341318 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:03.342185 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.246054 25948 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:03.226819 25871 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:03.375260 25922 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:03.392755 25948 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:03.393574 25948 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:03.346186 25945 consensus_queue.cc:1059] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:17:03.403100 26014 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:03.405376 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.333242 22751 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:03.298487 25718 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:03.342819 25683 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:03.313843 25660 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:03.344091 25771 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:03.341137 25995 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:03.341137 25926 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:03.448985 25771 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.360611 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:03.371825 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.348716 26007 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:03.347074 22896 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
W20260709 12:17:03.429610 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.375643 25280 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:03.406159 25948 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:03.458459 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:03.461119 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 100613us
I20260709 12:17:03.459676 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.462631 22751 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:03.464774 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:03.434574 25683 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.434552 25940 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:03.471709 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 177772us
I20260709 12:17:03.454607 25926 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:03.454828 25771 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:03.473496 25864 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:17:03.435791 25904 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:17:03.467288 25920 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:03.452145 25994 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:17:03.535241 22744 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:03.542582 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 77860.7us
I20260709 12:17:03.545997 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.609476 22746 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:03.476249 25683 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:03.427906 26014 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:17:03.617988 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:03.618333 25735 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:03.618866 25735 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:03.619068 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:03.618976 22894 raft_consensus.cc:2368] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7.
I20260709 12:17:03.558894 25998 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:03.462584 26007 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.467734 25280 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:03.473232 25761 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:17:03.619845 25735 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:03.639909 25735 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:03.644630 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.647629 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:03.648492 22894 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:03.651306 26010 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:17:03.651093 25941 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:17:03.654196 22900 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:03.663816 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:03.588393 25602 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:03.586434 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:03.596412 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:03.473042 25991 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:03.550449 25983 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:03.548857 25891 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:03.603389 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:03.683162 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 79887.7us
I20260709 12:17:03.606711 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:03.612216 26006 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:17:03.559602 25940 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:03.572715 25970 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:03.553157 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:03.628449 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:03.629828 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:03.630728 22895 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:03.658349 22894 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:03.688232 22896 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:17:03.690034 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 286249us
I20260709 12:17:03.576408 25978 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:03.556691 25948 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:03.697757 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.698968 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:03.670163 25920 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:03.637596 26007 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:03.708328 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:03.690871 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 376542us
I20260709 12:17:03.723816 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:03.706656 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:03.735150 22895 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:03.729194 22900 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:03.637074 25922 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:17:03.730824 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:03.734699 23656 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: [8.4-11.5]
I20260709 12:17:03.732851 23674 raft_consensus.cc:2368] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8.
I20260709 12:17:03.740272 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:03.741158 23674 raft_consensus.cc:2376] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11. Re-sending same reply.
I20260709 12:17:03.745999 23659 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:03.745726 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:03.748055 23685 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:03.748178 22717 leader_election.cc:400] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9.
I20260709 12:17:03.693243 25789 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:03.751029 23672 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:17:03.704943 25941 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:03.753598 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:03.756630 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.757257 23689 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:03.747247 25760 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:03.725883 25979 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:03.776065 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:03.751554 25920 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:03.779790 26022 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:03.780535 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:03.781407 25940 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:03.784524 25602 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:03.786306 25719 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:03.786300 26028 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:03.788012 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:03.789774 25983 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:03.793977 25771 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:03.827142 25771 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:03.795902 25991 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:03.828332 25983 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:03.795620 25979 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:03.831000 25457 raft_consensus.cc:2764] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:17:03.770007 25904 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:17:03.809779 25849 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:03.836745 25849 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:03.843371 25957 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:03.844007 25957 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:03.845006 25957 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:03.846592 25959 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:03.847358 25959 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:03.848205 25976 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.665s	user 0.012s	sys 0.000s
I20260709 12:17:03.848711 25959 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:03.849802 25954 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.002s
I20260709 12:17:03.850710 22892 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:17:03.797369 25779 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:03.799219 25864 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:03.852774 25864 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:03.853694 25864 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:03.801802 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.754004 25453 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:03.810609 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 191634us
I20260709 12:17:03.864326 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:03.865391 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:17:03.856382 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 171524us
I20260709 12:17:03.822010 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:03.817803 23494 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.867282 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:03.869817 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.870813 22748 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:03.848671 25976 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:03.854357 25926 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:03.876715 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 54788us
I20260709 12:17:03.877935 22864 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:03.879575 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 61860.7us
I20260709 12:17:03.884601 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:03.884840 25976 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:03.885980 25735 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:03.886979 25991 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:03.889285 26022 raft_consensus.cc:2764] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:17:03.890122 26022 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:03.872143 25940 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:03.881112 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:03.905905 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:03.907068 22748 raft_consensus.cc:2393] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:03.908547 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:03.909233 22753 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:03.909576 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:03.910221 22744 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:03.862838 25957 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:03.883590 25904 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:03.920486 23493 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:03.920804 22864 leader_election.cc:400] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9.
I20260709 12:17:03.921151 22864 leader_election.cc:403] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:17:03.883785 22747 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:03.890374 25978 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:03.891430 25789 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:03.928058 26030 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:03.928483 26030 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.893165 25660 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:03.928807 26030 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:03.894084 25849 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:03.799325 25970 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:03.895915 25920 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:03.896875 25956 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:03.878700 25941 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:17:03.879971 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:03.914628 25761 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:17:03.899195 25634 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.003s
I20260709 12:17:03.899392 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:03.899886 25683 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:03.900640 25864 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:03.900895 25926 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:03.899482 25735 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:17:03.890843 25891 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:17:03.882689 22790 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:03.968974 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 86359.1us
I20260709 12:17:03.925315 25904 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:03.969907 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:03.915832 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:03.917554 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:03.886549 25280 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:03.927227 25954 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:17:03.877388 25922 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:03.931111 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:03.931762 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.977738 22898 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:03.936343 22753 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
W20260709 12:17:03.978701 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.980753 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:03.940693 22864 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:03.943260 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 63378.7us
I20260709 12:17:03.983057 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:03.898459 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:03.917024 25717 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:03.917497 26013 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.953898 22900 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:03.947391 25789 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:03.957131 25948 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:03.957583 22748 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:03.972275 22894 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:03.938967 25779 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9.
I20260709 12:17:03.945361 25976 raft_consensus.cc:2764] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:17:03.959806 22744 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:03.997548 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:03.974351 25761 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:04.082132 25280 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:04.083076 25280 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:04.082556 25761 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:04.084223 25280 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:04.087148 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.087517 25983 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:04.089593 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 149001us
I20260709 12:17:04.092068 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:04.093231 22753 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 10: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:04.097519 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:04.098716 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:04.038547 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.102526 25789 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:04.104326 23695 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:03.986433 25717 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.110916 25717 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:04.115198 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:04.116094 23679 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:03.999476 22895 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:17:04.126753 23679 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:17:04.141038 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 160399us
I20260709 12:17:04.138145 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:04.131909 23689 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:17:04.128156 23685 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:17:04.089805 25978 raft_consensus.cc:2764] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:17:04.215782 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 77786us
I20260709 12:17:04.216804 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:04.150206 26023 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:04.138399 25940 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:04.090304 25954 consensus_queue.cc:1243] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:03.976375 25922 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.171593 25789 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:04.174157 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 258584us
I20260709 12:17:04.179080 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:04.150506 25976 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:17:04.183414 25983 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:04.188144 25453 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.151105 26013 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:04.194070 26007 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:03.987020 26038 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.199s
I20260709 12:17:04.141573 26042 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:03.975118 25904 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:04.225396 22717 leader_election.cc:336] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.668s (SENT)
W20260709 12:17:04.233652 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.258772 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:04.221971 25634 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:17:04.227345 25871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.025s	sys 0.032s
I20260709 12:17:04.204523 26020 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:04.259239 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.239511 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:04.236112 26022 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:04.283915 23659 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:04.245255 26023 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:04.247102 25922 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:04.280254 22751 raft_consensus.cc:2410] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:17:04.287376 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 62020.6us
W20260709 12:17:04.298710 22717 leader_election.cc:336] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.762s (SENT)
W20260709 12:17:04.299759 22717 leader_election.cc:336] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.864s (SENT)
I20260709 12:17:04.300215 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:04.289017 25948 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:17:04.289753 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50375.2us
I20260709 12:17:04.265383 25779 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:04.297127 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:04.270908 25871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.026s	sys 0.032s
I20260709 12:17:04.304766 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:04.247982 25789 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:04.306254 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 336411us
I20260709 12:17:04.309965 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:04.312062 23695 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:04.259074 25453 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:04.322554 22717 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.942s (SENT)
I20260709 12:17:04.292414 26050 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:04.327127 22895 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:04.348964 22717 leader_election.cc:336] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.962s (SENT)
I20260709 12:17:04.317534 25634 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:04.333580 23695 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:04.333292 22752 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:17:04.313895 26022 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:04.315037 25941 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:04.348649 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:04.354331 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:04.283715 26020 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:04.361428 23674 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:04.328991 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:04.366453 22894 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:04.321026 25735 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:04.368314 23685 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:04.317116 25779 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:04.302223 25940 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:04.391201 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:04.375841 26051 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:17:04.358480 25941 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:04.392720 25718 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:04.389814 25761 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:04.376219 25683 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:04.439966 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 48845.5us
I20260709 12:17:04.441310 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:04.397374 25735 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:04.401400 25941 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:04.388293 25920 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:17:04.370975 26023 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:04.478899 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:04.490490 26049 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:17:04.482766 25683 raft_consensus.cc:2764] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:17:04.483594 26059 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:17:04.487596 25789 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:04.492967 25779 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:04.493194 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:04.494143 25920 consensus_queue.cc:1243] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:04.494534 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:04.495738 22865 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:04.489418 25926 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:04.496963 25926 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:04.498052 25926 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:04.499493 25926 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:04.489741 26048 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:17:04.513890 25904 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:04.517198 22748 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:04.517740 22753 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:17:04.519884 26046 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:17:04.525355 22744 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:04.528442 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:04.543128 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 192898us
W20260709 12:17:04.549072 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 200505us
I20260709 12:17:04.550271 22790 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:04.558504 22744 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:04.560850 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:04.563651 22746 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 6.
I20260709 12:17:04.531674 25779 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:04.529819 26007 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:04.539477 26044 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:17:04.585655 22748 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:04.584502 25849 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:04.584774 26058 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:17:04.587440 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:04.539162 26013 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:04.597162 22818 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:17:04.598659 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:04.604545 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:04.570210 25957 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:04.614807 22827 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:04.478675 26022 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:04.595170 26055 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:04.619287 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 123622us
I20260709 12:17:04.569959 25920 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:17:04.581370 25789 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:17:04.610174 25779 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:04.650710 23689 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:04.651001 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 562) took 1316 ms. Trace:
I20260709 12:17:04.613325 25957 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.659852 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:04.571107 25964 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:17:04.662201 22827 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:04.662757 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:04.668999 22749 rpcz_store.cc:276] 0709 12:17:03.330294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.330435 (+   141us) service_pool.cc:224] Handling call
0709 12:17:03.330738 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:03.705020 (+374282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.705159 (+   139us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:03.706078 (+   919us) log.cc:844] Serialized 26 byte log entry
0709 12:17:04.199775 (+493697us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:04.199832 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.199946 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:04.626485 (+426539us) raft_consensus.cc:1685] finished
0709 12:17:04.626512 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:04.646244 (+ 19732us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91638,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":15418,"thread_start_us":865850,"threads_started":2,"wal-append.queue_time_us":607221}
I20260709 12:17:04.624786 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:04.588155 25735 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:04.673998 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:04.677461 23682 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:04.651497 26066 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:04.673082 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:04.663959 26055 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:04.688023 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:04.693434 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:04.706264 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.707058 23682 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:04.709084 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:04.672008 25957 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:04.679069 25964 consensus_queue.cc:1243] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:04.715031 23682 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:04.714437 23679 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:04.713845 23656 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:17:04.693347 26057 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:17:04.712349 26066 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:04.726104 26062 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:17:04.727324 26066 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:04.712007 26028 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:04.728230 26028 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:04.729423 25976 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:04.730302 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:04.729203 26028 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:04.713742 26026 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:04.739145 22818 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:04.745110 23679 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:04.715319 25948 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:17:04.742748 26083 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.758196 26083 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:04.760732 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 136296us
I20260709 12:17:04.752657 26082 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:04.763718 26068 log.cc:927] Time spent T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 12:17:04.765857 26065 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 12:17:04.767395 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.740409 25964 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:17:04.782696 25922 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:04.784865 25922 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:04.747754 26056 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:17:04.800172 22818 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:04.839336 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:04.744282 26026 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:04.765595 26083 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:04.787583 25719 consensus_meta.cc:287] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.964s	user 0.015s	sys 0.000s
I20260709 12:17:04.849429 22822 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:04.853113 22748 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:17:04.852137 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:04.843060 25779 raft_consensus.cc:2764] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:17:04.876176 25717 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.765s	user 0.013s	sys 0.000s
W20260709 12:17:04.884895 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:04.890728 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 100669us
I20260709 12:17:04.841934 25922 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.895737 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:04.850771 26069 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.195s	user 0.000s	sys 0.005s
I20260709 12:17:04.889040 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:04.898862 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:04.899274 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:04.900818 22894 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:04.901006 22897 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:04.898859 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:04.853608 25976 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.907707 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:04.908629 22822 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 9: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:04.906279 22897 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:04.897208 22896 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:04.910964 22894 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:04.887748 25280 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:04.956648 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:04.907462 25719 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:04.963322 26079 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:04.966960 26084 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 12:17:04.967851 26073 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:17:04.969199 26082 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:04.967087 26037 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.808s	user 0.003s	sys 0.003s
W20260709 12:17:04.971329 25864 consensus_meta.cc:287] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.013s	user 0.008s	sys 0.006s
I20260709 12:17:04.970563 25926 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:04.956609 25660 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.027s	user 0.010s	sys 0.005s
I20260709 12:17:04.907418 25634 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:17:04.986469 26088 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:17:04.976642 25719 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.983194 25979 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.000181 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:05.004168 22753 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:04.913051 25779 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:04.904878 25922 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:05.013792 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:05.026772 26030 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.097s	user 0.015s	sys 0.000s
I20260709 12:17:05.027491 26030 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:05.021126 26055 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:05.022137 26084 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:05.029428 26084 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:05.030803 26084 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:05.032650 26084 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:05.037247 25922 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:05.043696 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 561) took 1713 ms. Trace:
I20260709 12:17:05.044409 22745 rpcz_store.cc:276] 0709 12:17:03.329942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.331314 (+  1372us) service_pool.cc:224] Handling call
0709 12:17:03.331583 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:03.552659 (+221076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.552723 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:03.562745 (+ 10022us) log.cc:844] Serialized 26 byte log entry
0709 12:17:03.615263 (+ 52518us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x7b48000ed258. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf96a8aa1 00007fadf969fb37 00007fadf969f9ca 00007fadf979726f 00007fadf9796f37 00007fadf97ab55c 00007fadf97ab508 00007fadf97ab488 00007fadf97ab443 00007fadf97aa6ec 00007fadf86d4a96
0709 12:17:03.801650 (+186387us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:03.801708 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.801788 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:04.778003 (+976215us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:05.043426 (+265423us) raft_consensus.cc:1685] finished
0709 12:17:05.043447 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:05.043615 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43313,"raft.queue_time_us":94682,"raft.run_cpu_time_us":1227,"raft.run_wall_time_us":174921,"spinlock_wait_cycles":51837056,"thread_start_us":366150,"threads_started":2,"wal-append.queue_time_us":313483}
I20260709 12:17:05.001520 25719 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:04.988350 26026 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:05.063262 25998 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.063951 25998 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:05.003824 25954 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:05.066022 25998 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:05.066272 25954 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:05.067207 25954 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:05.011893 25979 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:05.069099 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:05.069953 25683 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:05.070602 25979 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:05.071173 26064 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:05.071739 26064 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:05.072669 26064 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:05.073606 25683 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:05.029019 23660 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:05.076116 26089 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:05.076520 26089 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:05.077198 25683 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:05.077939 25683 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:05.079666 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 174061us
I20260709 12:17:05.079089 25683 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:05.080797 26075 raft_consensus.cc:3055] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:05.081236 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:05.082257 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:05.084894 26076 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:05.085372 26076 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.085714 26076 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:05.088212 26082 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:05.089093 26079 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:05.081246 25683 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:05.090651 25930 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:17:05.077456 26060 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.627s	user 0.000s	sys 0.002s
I20260709 12:17:05.097705 22745 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:04.893965 25717 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:05.075776 25849 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:05.103716 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 143950us
I20260709 12:17:05.103205 23494 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:04.914705 25976 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:04.913619 26083 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:17:05.112695 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:05.093756 25941 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.000s
I20260709 12:17:05.114989 25660 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:17:05.119705 23682 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:17:05.124396 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.132774 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:05.135212 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:05.081243 26075 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:05.141656 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:05.113595 25635 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:05.087951 26084 consensus_queue.cc:1059] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:17:05.115135 25634 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:05.120860 26007 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:05.174121 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:05.155011 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:05.175508 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:05.171135 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 279314us
W20260709 12:17:05.146744 25978 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.021s	sys 0.014s
I20260709 12:17:05.145257 25635 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.209928 25635 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:05.209091 25978 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.022s	sys 0.014s
I20260709 12:17:05.184445 25634 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:05.138391 25998 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:17:05.307996 26026 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.223960 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:05.312917 22790 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:05.313139 22826 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:05.323300 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:05.326221 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.318578 22821 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
I20260709 12:17:05.327265 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:05.327901 22824 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:05.331636 22822 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:05.335040 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:05.335830 22819 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:05.077512 26089 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:05.219827 26022 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:05.339354 22823 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:17:05.259727 26079 consensus_queue.cc:1243] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:05.218365 25891 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.138103 25941 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:05.346978 26062 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:17:05.355175 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.385490 22899 raft_consensus.cc:2376] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7. Re-sending same reply.
I20260709 12:17:05.336962 25864 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:05.334491 26098 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:05.354329 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.397964 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:05.398443 22895 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:05.352560 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.397133 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.399535 22897 raft_consensus.cc:2410] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:17:05.399915 22899 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:17:05.355145 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:05.383876 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 237172us
I20260709 12:17:05.356024 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.387277 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:05.393599 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.405959 22898 raft_consensus.cc:2376] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9. Re-sending same reply.
I20260709 12:17:05.382404 25994 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.407701 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:05.145587 25970 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.185s
I20260709 12:17:05.314913 25957 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:05.433207 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.434098 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.434633 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:05.435415 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:05.435649 22820 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:05.296289 25849 raft_consensus.cc:3055] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:05.338373 25922 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:17:05.337206 25871 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:17:05.446448 22897 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:05.468622 22899 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:05.463169 22898 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:05.453374 22900 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:05.387341 26030 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:05.483491 23659 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:05.485888 22897 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:05.397342 25864 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.343611 26026 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:05.465358 26044 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:17:05.487618 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 75422.7us
W20260709 12:17:05.496510 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 146118us
I20260709 12:17:05.498984 22745 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:05.437139 25991 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:05.502892 22825 raft_consensus.cc:2368] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11.
I20260709 12:17:05.385267 25891 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:05.506327 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:05.488418 26069 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:17:05.511333 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:05.468091 25849 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:05.536134 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:05.537252 22745 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:05.541132 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:05.542078 22893 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:05.542138 22897 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:05.497685 25995 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.500443 25864 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:05.505081 26038 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.549580 22818 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:05.558351 22898 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
W20260709 12:17:05.559177 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.571759 22898 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:05.572331 22898 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:05.442052 25994 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:05.620563 22900 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:05.616169 26007 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:05.549273 25717 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:05.574751 22897 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
W20260709 12:17:05.639921 26103 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:17:05.639472 22898 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:05.678625 26026 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:05.642524 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.679800 25998 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.680615 25998 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:05.642967 25634 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:05.523334 25991 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:05.685068 22894 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:17:05.685647 22894 pending_rounds.cc:85] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 5
I20260709 12:17:05.685927 22894 pending_rounds.cc:107] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:17:05.686200 22894 raft_consensus.cc:2889] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:05.687342 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.688239 22897 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:05.688577 25994 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:05.679736 22898 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:05.577703 26038 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:05.463979 26098 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:05.604422 26070 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:05.647639 25719 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.600s	user 0.006s	sys 0.005s
I20260709 12:17:05.650993 26020 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:05.651966 26030 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.654611 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 755) took 1655 ms. Trace:
W20260709 12:17:05.659417 26093 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 12:17:05.660140 25959 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:05.661696 25904 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:05.658557 25453 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:05.672260 25983 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:05.676326 25979 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 12:17:05.644055 26104 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:17:05.729416 25735 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:05.701660 22745 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:05.704766 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:05.717291 22898 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:05.722802 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:05.760843 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.731662 25634 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.769605 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:05.720011 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:05.730214 23660 rpcz_store.cc:276] 0709 12:17:03.999090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.999246 (+   156us) service_pool.cc:224] Handling call
0709 12:17:05.654320 (+1655074us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54003a84d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:05.654500 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139844480}
I20260709 12:17:05.735682 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:05.702534 26022 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:05.735780 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 208047us
I20260709 12:17:05.722543 22894 pending_rounds.cc:85] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 2
I20260709 12:17:05.739312 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:05.799113 22894 pending_rounds.cc:107] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 12:17:05.562873 25995 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:05.644804 26091 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
W20260709 12:17:05.749482 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 249180us
I20260709 12:17:05.686395 25991 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:05.790140 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:05.792433 22746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.005s	sys 0.005s
W20260709 12:17:05.822625 22746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.006s	sys 0.006s
I20260709 12:17:05.794041 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:05.823860 22745 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:05.799697 22894 raft_consensus.cc:2889] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:05.793497 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 70830.3us
I20260709 12:17:05.798473 23493 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:05.753301 25735 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:05.744535 25983 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:05.729274 25719 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:05.618350 25849 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:05.819223 22717 leader_election.cc:336] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.572s (SENT)
I20260709 12:17:05.819558 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:05.819962 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:05.844597 22819 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:05.744158 26020 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.845986 26020 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:05.848881 26020 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:05.828372 22865 leader_election.cc:400] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8.
I20260709 12:17:05.736785 26030 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:05.830701 22898 pending_rounds.cc:85] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 4
I20260709 12:17:05.854612 22898 pending_rounds.cc:107] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 12:17:05.854961 22898 raft_consensus.cc:2889] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:05.835807 23494 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.506s (SENT) [suppressed 27 similar messages]
I20260709 12:17:05.836834 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.856734 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:05.857543 22900 raft_consensus.cc:2368] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9.
W20260709 12:17:05.858206 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 59892.1us
W20260709 12:17:05.836943 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.837795 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:05.840517 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:05.841621 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.801815 26079 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:05.798540 25970 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.850092 22865 leader_election.cc:403] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:17:05.797921 25904 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:05.851928 22895 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:05.728385 26070 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:05.895100 22895 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:05.902014 23695 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:17:05.850297 25978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.000s	sys 0.040s
I20260709 12:17:05.896399 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:05.851999 26092 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
I20260709 12:17:05.898759 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:05.904170 22747 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:05.904284 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:05.906890 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:05.907833 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51707.7us
I20260709 12:17:05.909416 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:05.910619 23695 raft_consensus.cc:2393] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 10: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:05.803768 25634 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:05.912233 23674 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:05.914157 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 85960.3us
I20260709 12:17:05.914937 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:05.896879 25683 consensus_meta.cc:287] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.806s	user 0.014s	sys 0.000s
I20260709 12:17:05.857860 25941 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:05.925376 23659 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:05.930740 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:05.931017 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:05.934263 23695 raft_consensus.cc:2410] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:17:05.931649 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:05.931241 26124 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.923238 26114 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:05.895066 25991 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:05.939570 22745 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:05.902173 25998 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:05.943403 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:05.937067 26124 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:05.914556 26055 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.908787 25922 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:05.937508 26114 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:05.955556 26055 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:05.852066 26007 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:05.957146 26124 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:05.957598 26114 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:05.937984 25735 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:05.928062 26118 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:05.964888 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.927074 25717 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8.
W20260709 12:17:05.955242 26107 log.cc:927] Time spent T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
I20260709 12:17:05.939072 22895 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:05.917340 25849 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:05.972740 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:05.909312 25970 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:05.981479 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:05.987793 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:05.908313 25904 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:05.988267 22745 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
W20260709 12:17:05.990125 22717 leader_election.cc:336] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.777s (SENT)
I20260709 12:17:05.948863 25941 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.999475 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:06.012027 22717 leader_election.cc:336] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.822s (SENT)
I20260709 12:17:06.012892 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:06.049875 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:06.050840 22749 raft_consensus.cc:2393] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:05.963956 25991 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:05.974004 26028 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:06.092298 23679 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:05.994668 26084 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:06.079412 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:06.082455 26030 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:06.083205 26113 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:17:05.946632 25983 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:06.085628 25453 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:06.087532 26133 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:17:06.162909 25453 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:06.163810 25904 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:06.164667 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 574) took 1061 ms. Trace:
I20260709 12:17:06.165061 25453 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:06.096055 25717 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:06.165391 26116 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:06.025533 26105 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.331s	user 0.000s	sys 0.002s
W20260709 12:17:06.110167 26101 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:17:06.115458 26098 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:05.961977 25922 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:06.166141 26116 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:06.168746 25922 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:06.169147 26116 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:06.169463 25922 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:06.120147 22744 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:05.948042 26022 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:06.144348 26020 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.174860 26020 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:06.177999 26020 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:06.179975 25995 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:06.150547 25871 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:17:06.090135 26028 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:06.183070 25871 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:06.183651 25871 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:06.183828 26028 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:06.184921 26028 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:06.185998 25871 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:06.165269 22746 rpcz_store.cc:276] 0709 12:17:05.103164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.103403 (+   239us) service_pool.cc:224] Handling call
0709 12:17:05.103779 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:05.104175 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.104202 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:05.112797 (+  8595us) log.cc:844] Serialized 26 byte log entry
0709 12:17:05.823239 (+710442us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:05.823304 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:05.823411 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:06.164409 (+340998us) raft_consensus.cc:1685] finished
0709 12:17:06.164467 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.164603 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3643,"raft.queue_time_us":92,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":13867,"thread_start_us":691793,"threads_started":1,"wal-append.queue_time_us":821204}
W20260709 12:17:06.212221 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.108860 25970 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:06.242745 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.028595 25735 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:06.164469 26122 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:06.106124 25635 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.894s	user 0.013s	sys 0.001s
W20260709 12:17:06.077332 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 65366.5us
W20260709 12:17:06.344601 22752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 775) took 2867 ms (client timeout 1685 ms). Trace:
W20260709 12:17:06.348644 22717 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.897s (SENT)
W20260709 12:17:06.348407 22752 rpcz_store.cc:269] 0709 12:17:03.289580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.289799 (+   219us) service_pool.cc:224] Handling call
0709 12:17:06.156633 (+2866834us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400192dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:06.156822 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464672640}
I20260709 12:17:06.028014 25941 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:06.381429 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:06.188026 26076 consensus_meta.cc:287] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.102s	user 0.016s	sys 0.000s
W20260709 12:17:06.440472 22894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.027s	sys 0.092s
W20260709 12:17:06.441002 22894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.027s	sys 0.092s
W20260709 12:17:06.459486 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 469115us
I20260709 12:17:05.979321 26118 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:06.363078 26020 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.364600 25983 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:06.461665 23679 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:06.361186 25871 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.461603 22791 leader_election.cc:400] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9.
I20260709 12:17:06.480531 22791 leader_election.cc:403] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:17:06.481824 22823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.002s	sys 0.022s
W20260709 12:17:06.485987 22823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.002s	sys 0.022s
I20260709 12:17:06.460281 26139 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:06.490461 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 491096us
I20260709 12:17:06.487385 26119 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:06.479617 25970 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.363341 25635 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:06.500866 25931 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.883s	user 0.024s	sys 0.027s
I20260709 12:17:06.502689 25956 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:06.510407 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.487560 26121 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:06.530462 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1207) took 1912 ms. Trace:
I20260709 12:17:06.495507 26139 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:06.530988 22827 rpcz_store.cc:276] 0709 12:17:04.617701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.617906 (+   205us) service_pool.cc:224] Handling call
0709 12:17:04.648547 (+ 30641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:04.670344 (+ 21797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.530119 (+1859775us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b54001266d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:06.530371 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25357696}
I20260709 12:17:06.478401 26020 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:06.542856 23682 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 10: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:06.542893 22790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.024s	sys 0.022s
W20260709 12:17:06.523313 25931 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.905s	user 0.024s	sys 0.028s
I20260709 12:17:06.462703 26076 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:06.554551 22790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.024s	sys 0.022s
W20260709 12:17:06.563772 26132 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:17:06.564572 25931 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:06.564870 26135 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:17:06.566253 26131 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:06.567492 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 940) took 1257 ms. Trace:
I20260709 12:17:06.567917 22824 rpcz_store.cc:276] 0709 12:17:05.310423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.328608 (+ 18185us) service_pool.cc:224] Handling call
0709 12:17:05.358517 (+ 29909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:05.487592 (+129075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.487629 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:05.491407 (+  3778us) log.cc:844] Serialized 26 byte log entry
0709 12:17:05.863203 (+371796us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:05.863279 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:05.863689 (+   410us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:06.567168 (+703479us) raft_consensus.cc:1685] finished
0709 12:17:06.567195 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.567418 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18068,"raft.queue_time_us":50101,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":32076,"thread_start_us":445074,"threads_started":2,"wal-append.queue_time_us":946087}
I20260709 12:17:06.540061 26121 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:06.573812 26121 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:06.533113 26139 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:06.577224 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 579) took 1035 ms. Trace:
I20260709 12:17:06.577423 26139 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:06.577801 22753 rpcz_store.cc:276] 0709 12:17:05.542173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.089523 (+547350us) service_pool.cc:224] Handling call
0709 12:17:06.089881 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:06.106915 (+ 17034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.106959 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:06.107556 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 12:17:06.460176 (+352620us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:06.460224 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.460301 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:06.576984 (+116683us) raft_consensus.cc:1685] finished
0709 12:17:06.577009 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.577159 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6160,"raft.queue_time_us":6390,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":352175,"threads_started":1,"wal-append.queue_time_us":467382}
I20260709 12:17:06.486152 25871 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:06.556195 26126 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.645627 23656 raft_consensus.cc:2368] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11.
I20260709 12:17:06.533380 25956 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:06.491199 25991 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:06.519856 25970 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:06.624215 25634 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:06.710557 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:06.721668 22819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.010s	sys 0.031s
W20260709 12:17:06.722257 22819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.011s	sys 0.032s
W20260709 12:17:06.723476 22745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.004s	sys 0.020s
W20260709 12:17:06.724442 22745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.004s	sys 0.020s
I20260709 12:17:06.725800 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 578) took 1224 ms. Trace:
I20260709 12:17:06.726361 22745 rpcz_store.cc:276] 0709 12:17:05.501948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.079811 (+577863us) service_pool.cc:224] Handling call
0709 12:17:06.080272 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.080569 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:06.080995 (+   426us) log.cc:844] Serialized 14 byte log entry
0709 12:17:06.725087 (+644092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.725308 (+   221us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:06.725394 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.725513 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.725708 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13211,"prepare.queue_time_us":217,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"thread_start_us":630285,"threads_started":1}
W20260709 12:17:06.720167 26140 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 12:17:06.747644 23494 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.011s	sys 0.015s
W20260709 12:17:06.748342 23494 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.011s	sys 0.015s
W20260709 12:17:06.748786 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 912935us
I20260709 12:17:06.754290 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:06.759537 26022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.010s	sys 0.012s
I20260709 12:17:06.693878 26126 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:06.760958 25941 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:06.761475 26118 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:06.805517 25718 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:06.811510 26136 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 12:17:06.794559 26141 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
W20260709 12:17:06.792101 26022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.011s	sys 0.013s
I20260709 12:17:06.782136 26020 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:06.817627 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 66958.2us
I20260709 12:17:06.827100 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:06.809341 26084 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:06.846416 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 766) took 2490 ms. Trace:
I20260709 12:17:06.847956 23689 rpcz_store.cc:276] 0709 12:17:04.351211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.351377 (+   166us) service_pool.cc:224] Handling call
0709 12:17:04.361680 (+ 10303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.668921 (+307241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.841283 (+2172362us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b540059e054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:06.841591 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664062336}
W20260709 12:17:06.856637 26094 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 1.893s	user 0.004s	sys 0.012s
W20260709 12:17:06.857870 22751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 780) took 3387 ms (client timeout 2039 ms). Trace:
W20260709 12:17:06.858664 26134 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.867s	user 0.004s	sys 0.001s
W20260709 12:17:06.861320 22825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 926) took 2199 ms (client timeout 1816 ms). Trace:
W20260709 12:17:06.914423 22825 rpcz_store.cc:269] 0709 12:17:04.662333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.662478 (+   145us) service_pool.cc:224] Handling call
0709 12:17:06.860932 (+2198454us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b540022ef54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:06.861175 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1913687936}
I20260709 12:17:06.862579 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 798) took 1485 ms. Trace:
I20260709 12:17:06.916126 23682 rpcz_store.cc:276] 0709 12:17:05.377575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.386901 (+  9326us) service_pool.cc:224] Handling call
0709 12:17:06.862322 (+1475421us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003746d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:06.862499 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2595140864}
I20260709 12:17:06.869560 26038 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:06.871881 26119 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:06.876986 26070 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:06.879523 26082 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 12:17:06.896036 26144 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:17:06.866556 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 580) took 2882 ms. Trace:
W20260709 12:17:06.910456 22751 rpcz_store.cc:269] 0709 12:17:03.470032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.472548 (+  2516us) service_pool.cc:224] Handling call
0709 12:17:06.857502 (+3384954us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400406fd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:06.857751 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329756032}
I20260709 12:17:06.957660 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:06.973127 22747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 569) took 1957 ms (client timeout 1809 ms). Trace:
I20260709 12:17:06.941294 25970 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:06.907894 26076 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:06.910981 25871 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:06.930796 26007 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:06.938620 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:06.983326 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:06.983995 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.937618 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1287) took 1216 ms. Trace:
I20260709 12:17:06.919248 25956 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:06.922709 26119 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:06.996091 26096 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 1.802s	user 0.002s	sys 0.029s
W20260709 12:17:06.941754 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:06.942442 23660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.008s	sys 0.028s
W20260709 12:17:06.997248 23660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.008s	sys 0.028s
W20260709 12:17:06.945318 22717 leader_election.cc:336] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.074s (SENT)
I20260709 12:17:06.997656 25954 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:06.998065 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:06.999091 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 53825.7us
W20260709 12:17:06.999660 22717 leader_election.cc:336] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.097s (SENT)
W20260709 12:17:06.947086 22898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.021s	sys 0.015s
W20260709 12:17:07.000947 22898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.021s	sys 0.016s
W20260709 12:17:06.952081 22822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.014s	sys 0.024s
W20260709 12:17:07.001628 22822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.014s	sys 0.024s
I20260709 12:17:07.001507 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.002250 23659 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
W20260709 12:17:06.953735 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.003690 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.986557 26007 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:07.003903 25280 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:07.004868 25280 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:07.006141 26007 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:07.011829 26150 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:17:07.012027 23674 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:07.013597 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.014034 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.016076 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:06.935835 26152 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:17:07.019213 23659 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:07.024390 23682 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:17:06.947395 25864 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.343s	user 0.016s	sys 0.000s
W20260709 12:17:06.973891 22747 rpcz_store.cc:269] 0709 12:17:04.999483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.999838 (+   355us) service_pool.cc:224] Handling call
0709 12:17:06.956141 (+1956303us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400413554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:06.956440 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064365312}
I20260709 12:17:06.964690 26117 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:06.984777 22894 rpcz_store.cc:276] 0709 12:17:05.721537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.721750 (+   213us) service_pool.cc:224] Handling call
0709 12:17:05.722250 (+   500us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:05.833818 (+111568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.833852 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:05.834530 (+   678us) log.cc:844] Serialized 52 byte log entry
0709 12:17:06.441486 (+606956us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:06.441540 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.441641 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:06.937281 (+495640us) raft_consensus.cc:1685] finished
0709 12:17:06.937311 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.937532 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1628,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":13836,"thread_start_us":531064,"threads_started":1,"wal-append.queue_time_us":840789}
I20260709 12:17:06.961655 22892 rpcz_store.cc:276] 0709 12:17:03.984242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.984905 (+   663us) service_pool.cc:224] Handling call
0709 12:17:03.985315 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.985603 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:04.362809 (+377206us) log.cc:844] Serialized 14 byte log entry
0709 12:17:06.865815 (+2503006us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18003e4a60. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287
0709 12:17:06.865973 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.866055 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:06.866126 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.866263 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.866439 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145761,"prepare.queue_time_us":459039,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":134490,"spinlock_wait_cycles":7335424,"thread_start_us":516193,"threads_started":3,"wal-append.queue_time_us":298501,"wal-append.run_cpu_time_us":1762,"wal-append.run_wall_time_us":1093051}
I20260709 12:17:06.971340 26030 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:06.924937 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 495) took 1177 ms. Trace:
W20260709 12:17:07.038161 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.026s	sys 0.029s
I20260709 12:17:07.014243 23674 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:17:07.041600 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.027s	sys 0.029s
I20260709 12:17:07.034881 22825 rpcz_store.cc:276] 0709 12:17:05.747909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.923157 (+1175248us) service_pool.cc:224] Handling call
0709 12:17:06.924043 (+   886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.924468 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.924507 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.924569 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:06.924613 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.924688 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.924858 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:07.051810 23689 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:07.026922 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:07.043495 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 543151us
I20260709 12:17:07.031105 26026 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:07.037101 26030 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.067399 26070 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:07.072847 26089 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:07.076596 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 797) took 1935 ms (client timeout 2034 ms). Trace:
W20260709 12:17:07.077263 23656 rpcz_store.cc:269] 0709 12:17:05.141291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.141433 (+   142us) service_pool.cc:224] Handling call
0709 12:17:07.076302 (+1934869us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400374e54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:07.076505 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3453422848}
I20260709 12:17:07.039646 26117 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:07.084622 22895 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:07.087199 26052 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:07.087793 26052 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:07.088951 26052 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:07.092015 26030 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:07.094127 26052 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:07.065868 26126 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:07.097087 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 775) took 1199 ms. Trace:
I20260709 12:17:07.115057 23679 rpcz_store.cc:276] 0709 12:17:05.897695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.904068 (+  6373us) service_pool.cc:224] Handling call
0709 12:17:07.096764 (+1192696us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400080554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:07.096987 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364437248}
I20260709 12:17:07.116137 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:07.064642 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 237608us
W20260709 12:17:07.105088 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 50495.9us
I20260709 12:17:07.118769 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:07.126398 22825 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:07.127017 23659 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:07.101699 26028 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.916s	user 0.014s	sys 0.001s
I20260709 12:17:07.130978 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:07.041363 25864 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:07.132736 23679 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:17:07.082717 26117 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:07.163344 22892 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:17:07.139307 25959 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.395s	user 0.012s	sys 0.004s
W20260709 12:17:07.154153 26147 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.245s	user 0.001s	sys 0.003s
I20260709 12:17:07.178406 22748 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:07.134394 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 498) took 1325 ms. Trace:
I20260709 12:17:07.154763 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.150533 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.156466 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.182734 22894 raft_consensus.cc:2410] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:07.182127 22825 rpcz_store.cc:276] 0709 12:17:05.808738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.063674 (+1254936us) service_pool.cc:224] Handling call
0709 12:17:07.123440 (+ 59766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.127165 (+  3725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.134309 (+  7144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:07.185994 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.187377 23659 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:07.189103 22892 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:17:07.191203 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 770) took 1281 ms. Trace:
I20260709 12:17:07.145242 22895 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:17:07.174021 22826 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:17:07.174319 25849 consensus_meta.cc:287] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.189s	user 0.014s	sys 0.003s
W20260709 12:17:07.193251 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 240752us
W20260709 12:17:07.202371 22865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.000s	sys 0.021s
I20260709 12:17:07.195024 22895 pending_rounds.cc:85] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 5
I20260709 12:17:07.157570 25871 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:07.208195 22865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.000s	sys 0.022s
I20260709 12:17:07.208571 22895 pending_rounds.cc:107] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:17:07.217581 22895 raft_consensus.cc:2889] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:07.217787 22900 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
W20260709 12:17:07.218375 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 706233us
I20260709 12:17:07.209211 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.191797 23660 rpcz_store.cc:276] 0709 12:17:05.895549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.895716 (+   167us) service_pool.cc:224] Handling call
0709 12:17:05.924269 (+ 28553us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:17:05.936657 (+ 12388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.936691 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:17:05.937387 (+   696us) log.cc:844] Serialized 78 byte log entry
0709 12:17:06.997638 (+1060251us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:06.997680 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.997755 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:07.176678 (+178923us) raft_consensus.cc:1685] finished
0709 12:17:07.176701 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.176885 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21848,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":18047,"thread_start_us":1059846,"threads_started":1,"wal-append.queue_time_us":1235596}
I20260709 12:17:07.220364 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.221447 23660 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:07.223690 23660 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:07.225924 23660 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:07.229507 25976 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:07.230993 26084 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:07.232498 25280 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:07.233106 25280 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:07.233592 25280 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:07.202049 26154 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:07.239306 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.179955 25964 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.241815 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.240378 23689 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:07.241815 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 789) took 1390 ms. Trace:
I20260709 12:17:07.246451 22895 rpcz_store.cc:276] 0709 12:17:05.851244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.851401 (+   157us) service_pool.cc:224] Handling call
0709 12:17:05.851743 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.084366 (+1232623us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54006f0020. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f4a1d 00007fadf46db1a4 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419
0709 12:17:07.241545 (+157179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.241756 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517391232}
I20260709 12:17:07.148806 26042 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:07.131763 26157 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:17:07.166134 26038 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:17:07.251366 25964 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:07.249033 26088 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:17:07.258332 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 488) took 1551 ms. Trace:
I20260709 12:17:07.259728 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.241374 26162 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:07.266983 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 266593us
I20260709 12:17:07.255940 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:07.252594 25931 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.007s
W20260709 12:17:07.251427 26064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.857s	user 0.017s	sys 0.028s
I20260709 12:17:07.282042 22864 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:07.282930 22827 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.008s	sys 0.021s
I20260709 12:17:07.283892 22894 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
W20260709 12:17:07.329738 22827 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.008s	sys 0.021s
I20260709 12:17:07.266286 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 489) took 1559 ms. Trace:
I20260709 12:17:07.285220 22819 rpcz_store.cc:276] 0709 12:17:05.706609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.918099 (+211490us) service_pool.cc:224] Handling call
0709 12:17:05.931173 (+ 13074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:06.723587 (+792414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.723631 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:06.757465 (+ 33834us) log.cc:844] Serialized 26 byte log entry
0709 12:17:07.238829 (+481364us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:07.238870 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.238956 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:07.258073 (+ 19117us) raft_consensus.cc:1685] finished
0709 12:17:07.258094 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.258258 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155159,"spinlock_wait_cycles":11021184,"thread_start_us":1248808,"threads_started":2,"wal-append.queue_time_us":493454}
W20260709 12:17:07.301733 22717 leader_election.cc:336] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.173s (SENT)
I20260709 12:17:07.301991 22895 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:07.330291 22822 rpcz_store.cc:276] 0709 12:17:05.712558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.926259 (+213701us) service_pool.cc:224] Handling call
0709 12:17:05.926698 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:07.002065 (+1075367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:07.002095 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:07.002595 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:17:07.265792 (+263197us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:07.265851 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.265946 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:07.266007 (+    61us) raft_consensus.cc:1685] finished
0709 12:17:07.266024 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.266204 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97427,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":38329,"thread_start_us":1337426,"threads_started":2,"wal-append.queue_time_us":255802}
W20260709 12:17:07.298749 25735 consensus_meta.cc:287] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.936s	user 0.011s	sys 0.001s
I20260709 12:17:07.334429 22825 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 12:17:07.335387 25983 consensus_meta.cc:287] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.853s	user 0.013s	sys 0.001s
W20260709 12:17:07.336293 26176 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:17:07.336841 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.337634 23659 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:07.341820 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.342515 23659 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:07.332320 25931 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9.
I20260709 12:17:07.343374 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.344112 23689 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:17:07.345811 22897 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:17:07.346333 22897 pending_rounds.cc:85] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 5
I20260709 12:17:07.346545 22897 pending_rounds.cc:107] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:17:07.346799 22897 raft_consensus.cc:2889] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:07.347609 23659 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:07.349519 22898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 783) took 1520 ms. Trace:
I20260709 12:17:07.243834 26154 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:07.350152 22898 rpcz_store.cc:276] 0709 12:17:05.829019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.829970 (+   951us) service_pool.cc:224] Handling call
0709 12:17:05.830417 (+   447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:05.914464 (+ 84047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.914944 (+   480us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:05.916954 (+  2010us) log.cc:844] Serialized 52 byte log entry
0709 12:17:07.001331 (+1084377us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:07.001369 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.001430 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:07.349177 (+347747us) raft_consensus.cc:1685] finished
0709 12:17:07.349212 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.349428 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49558,"raft.queue_time_us":52742,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":11145,"thread_start_us":1027820,"threads_started":1,"wal-append.queue_time_us":1305565}
I20260709 12:17:07.352180 26154 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:07.352758 26154 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:07.352977 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.353240 26154 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:07.353965 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.355213 23659 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:07.355635 26082 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.356426 26082 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:07.356841 25976 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:07.357445 25976 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:07.358978 25983 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:07.359584 25983 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:07.359735 26030 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:07.358982 22896 raft_consensus.cc:2410] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:07.361706 26030 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:07.361887 25926 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.362376 25926 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:07.363824 25983 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.364941 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:07.365530 22895 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:07.366971 25983 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:07.367513 25983 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:07.368515 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 494) took 1625 ms. Trace:
I20260709 12:17:07.369787 25983 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:07.371541 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:07.371994 26154 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:07.372305 25280 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:07.373999 26153 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:07.374552 26153 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.374928 26153 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:07.378428 26064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.992s	user 0.017s	sys 0.028s
I20260709 12:17:07.328655 26125 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.379482 26125 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:07.381541 26125 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:07.304616 26143 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:07.382545 23494 connection.cc:256] RPC call timeout handler was delayed by -1.3683892130002278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 12:17:07.383023 23494 connection.cc:256] RPC call timeout handler was delayed by -1.3656892130002234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
W20260709 12:17:07.383348 23494 connection.cc:256] RPC call timeout handler was delayed by -1.3521892130002016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 12:17:07.383877 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 101918us
I20260709 12:17:07.353935 22898 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:07.385181 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:07.386420 22825 pending_rounds.cc:85] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 5
I20260709 12:17:07.394697 22825 pending_rounds.cc:107] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:17:07.395107 22825 raft_consensus.cc:2889] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:07.384274 23494 connection.cc:256] RPC call timeout handler was delayed by -1.06624455400015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260709 12:17:07.385475 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:07.397265 22894 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:07.369175 22824 rpcz_store.cc:276] 0709 12:17:05.743534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.570029 (+826495us) service_pool.cc:224] Handling call
0709 12:17:06.570599 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:06.646630 (+ 76031us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:07.040594 (+393964us) log.cc:844] Serialized 14 byte log entry
0709 12:17:07.269074 (+228480us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:07.300792 (+ 31718us) log.cc:844] Serialized 26 byte log entry
0709 12:17:07.301073 (+   281us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:07.301131 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.301263 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:07.368202 (+ 66939us) raft_consensus.cc:1685] finished
0709 12:17:07.368235 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.368423 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5184,"prepare.queue_time_us":484370,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":7678,"raft.queue_time_us":173410,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":10769280,"thread_start_us":494801,"threads_started":2,"wal-append.queue_time_us":199908}
I20260709 12:17:07.397019 25983 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:17:07.382576 26143 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:07.402356 26155 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:07.330678 25864 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:07.410924 22895 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:07.391791 26154 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:07.411621 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.421111 23660 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:07.421082 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.417757 23659 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:07.427918 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.437846 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.397265 25959 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:17:07.438666 23660 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:07.439160 25959 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:07.439749 25959 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:07.440877 25959 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:07.442723 25959 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:07.444074 26028 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:07.443817 26119 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:07.444809 26028 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:07.424379 25760 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.406339 26126 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.411104 26155 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.447365 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 490) took 1734 ms. Trace:
I20260709 12:17:07.407107 25849 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:07.452700 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.460893 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:07.335408 26172 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.119s
I20260709 12:17:07.332613 26162 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:07.464910 22894 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:07.459399 22823 rpcz_store.cc:276] 0709 12:17:05.712983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.498442 (+785459us) service_pool.cc:224] Handling call
0709 12:17:06.515360 (+ 16918us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:06.816052 (+300692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.816098 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:06.947973 (+131875us) log.cc:844] Serialized 52 byte log entry
0709 12:17:07.262918 (+314945us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:07.263320 (+   402us) log.cc:844] Serialized 14 byte log entry
0709 12:17:07.268883 (+  5563us) log.cc:844] Serialized 14 byte log entry
0709 12:17:07.280743 (+ 11860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.280838 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:07.447051 (+166213us) raft_consensus.cc:1685] finished
0709 12:17:07.447076 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.447267 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39339,"prepare.queue_time_us":751,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":5642,"raft.queue_time_us":205618,"raft.run_cpu_time_us":549,"raft.run_wall_time_us":33657,"spinlock_wait_cycles":109021312,"thread_start_us":415217,"threads_started":2,"wal-append.queue_time_us":287444}
I20260709 12:17:07.465557 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.470016 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.446753 26119 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.467586 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:07.473416 22894 raft_consensus.cc:2410] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:07.463286 26155 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:07.482802 26028 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:07.475006 26152 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:07.470193 26089 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:17:07.463675 26126 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:07.490239 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 270758us
I20260709 12:17:07.465706 25849 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:07.458971 25760 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:07.493770 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:07.500175 22717 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.652s (SENT)
W20260709 12:17:07.500496 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.500510 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:07.502017 22865 leader_election.cc:400] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11.
I20260709 12:17:07.488170 25991 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:07.508468 26162 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:07.508872 25871 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:07.509354 26162 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:07.509815 26162 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:07.510264 26162 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:07.512509 25760 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:07.516583 22896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 786) took 1681 ms (client timeout 1897 ms). Trace:
W20260709 12:17:07.517052 22896 rpcz_store.cc:269] 0709 12:17:05.835588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.837524 (+  1936us) service_pool.cc:224] Handling call
0709 12:17:07.516337 (+1678813us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400a83ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:07.516511 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3446442880}
I20260709 12:17:07.518316 26155 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:07.520089 25926 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.520857 25926 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:07.523439 25849 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.520937 26155 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:07.502305 22865 leader_election.cc:403] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:17:07.526993 26179 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11.
I20260709 12:17:07.503226 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:07.529542 25864 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.530196 25864 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:07.531553 26119 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.532131 26119 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:07.533190 26038 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.533746 26038 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:07.534330 26119 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.536012 26038 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:07.514415 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:07.551391 22865 connection.cc:256] RPC call timeout handler was delayed by -2.1874029739999514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
I20260709 12:17:07.551568 22819 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:17:07.552207 22865 connection.cc:256] RPC call timeout handler was delayed by -2.1730029739999281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260709 12:17:07.532423 25864 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:07.486771 26153 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:07.571659 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 68540.9us
W20260709 12:17:07.572988 22865 connection.cc:256] RPC call timeout handler was delayed by -1.2217029739997542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2889s for a response
W20260709 12:17:07.573653 22865 connection.cc:256] RPC call timeout handler was delayed by -1.0559810340000695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 12:17:07.574060 22865 connection.cc:256] RPC call timeout handler was delayed by -1.0127810339999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 12:17:07.575948 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:07.520718 25976 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.572765 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:07.585479 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:07.587016 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:07.600653 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.603807 23660 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:07.607836 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.611704 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.569109 26028 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.491991 26152 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:07.581789 26030 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:07.578028 25849 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.581645 25760 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:07.621915 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:07.597435 26173 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:07.624660 23660 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:07.627329 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.611317 26155 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:07.578743 25983 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:17:07.609012 26154 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:07.584061 25926 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:17:07.616312 26070 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:07.582012 25948 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:17:07.654078 25948 consensus_queue.cc:1243] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:17:07.654525 22748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 573) took 2558 ms (client timeout 2832 ms). Trace:
W20260709 12:17:07.655259 22748 rpcz_store.cc:269] 0709 12:17:05.096028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.096196 (+   168us) service_pool.cc:224] Handling call
0709 12:17:07.654300 (+2558104us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54000a8554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:07.654444 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4727465856}
I20260709 12:17:07.639580 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.628926 25849 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:07.644182 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.656854 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:07.648375 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:07.649042 22820 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 928) took 2932 ms (client timeout 1832 ms). Trace:
I20260709 12:17:07.628556 26173 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.658113 23659 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
W20260709 12:17:07.663233 22820 rpcz_store.cc:269] 0709 12:17:04.716772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.717569 (+   797us) service_pool.cc:224] Handling call
0709 12:17:07.648834 (+2931265us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54006cb454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:07.648958 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1618878848}
I20260709 12:17:07.665238 22750 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:17:07.667073 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.620352 26028 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:07.671998 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.674558 22820 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
W20260709 12:17:07.641628 26052 consensus_meta.cc:287] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.007s
I20260709 12:17:07.636837 26155 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:07.676189 26193 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:07.676798 26193 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:07.677143 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.677800 22820 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:17:07.677968 26155 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.678700 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.679164 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.679793 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.679872 23685 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:07.675678 26076 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:07.681166 26076 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.681499 26076 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:07.684891 26028 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.686161 26179 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:07.686851 26179 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:07.687417 26179 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:07.687819 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.688575 22820 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:07.690496 26154 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:07.691807 26126 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:07.691991 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.692489 25849 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:07.692989 22820 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:07.693523 26153 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.631179 25760 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:07.723769 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 500) took 1896 ms. Trace:
I20260709 12:17:07.712438 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.695863 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:07.715499 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.713490 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:07.716506 23660 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:07.738664 22824 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:07.740383 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:07.741838 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:07.641812 26187 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:07.744421 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.750442 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.736564 22825 rpcz_store.cc:276] 0709 12:17:05.827435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.241094 (+1413659us) service_pool.cc:224] Handling call
0709 12:17:07.252334 (+ 11240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.395666 (+143332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.723370 (+327704us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b540045c754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:07.723648 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187746688}
I20260709 12:17:07.749413 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.751801 22820 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:07.758426 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.760695 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.760840 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:07.762048 22825 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:07.762219 22820 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:07.669025 26173 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:07.762835 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.763134 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.763629 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:07.764104 22819 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:07.764523 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.753481 26187 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:07.710932 26075 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:07.770910 26187 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:07.771124 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.771515 26075 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:07.772527 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.774008 22822 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:07.693928 25849 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:17:07.693732 26076 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:07.716910 26152 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:07.776434 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:07.776767 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:07.778432 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 148205us
I20260709 12:17:07.778618 22746 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:07.778723 22753 raft_consensus.cc:2410] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:17:07.718331 26082 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.775985 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:07.779762 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:07.756142 26153 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:07.787724 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:07.787895 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:07.788812 22747 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:07.790120 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.790829 23695 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:17:07.791121 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:07.792886 25760 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:07.793529 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:07.794265 23660 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:07.794492 26126 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:07.794967 26126 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.795326 26126 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:07.795545 25964 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:07.796648 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:07.797317 22744 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:07.798265 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:07.781435 22746 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:07.756376 25959 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:07.799772 25959 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:07.800242 25959 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:07.754107 25983 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:07.803408 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:07.804490 25998 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:07.804945 25998 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.805397 25998 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:07.714155 26162 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:07.809134 26162 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.740161 26193 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:07.819159 22753 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:07.813781 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.782218 22865 leader_election.cc:400] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11.
I20260709 12:17:07.782052 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:07.783000 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:07.815006 23493 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:07.821306 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:07.823834 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:07.783272 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:07.784967 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:07.802309 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:07.819900 22865 leader_election.cc:403] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:07.817363 22824 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:07.828438 22745 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:07.782073 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.820482 22748 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:07.819955 22822 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:07.846597 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:07.812314 26153 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.852104 23660 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:07.836757 22744 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 10: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:07.858201 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:07.827744 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:07.858951 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 76891.2us
I20260709 12:17:07.811041 26070 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:07.859030 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.870069 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:07.876062 23660 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:07.845629 25948 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:07.865906 22753 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:07.845809 26118 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:07.870561 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:07.874398 22747 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:07.872864 22745 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
W20260709 12:17:07.871208 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 43553us
I20260709 12:17:07.892637 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:07.893065 22819 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:07.810640 26126 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:07.894774 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:07.858536 26177 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:07.895941 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:07.900197 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:07.901018 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.909386 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:07.899704 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:07.873373 25997 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:07.889758 26118 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.875571 25991 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:07.875371 26028 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:07.877918 26070 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:07.900611 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.874943 26153 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:07.894732 26199 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:07.915113 22892 raft_consensus.cc:2376] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11. Re-sending same reply.
I20260709 12:17:07.890044 25948 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:07.922314 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 54301.7us
I20260709 12:17:07.897312 26117 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:07.916357 22895 raft_consensus.cc:2410] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:17:07.913599 25976 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:07.934929 25976 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.935463 25976 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:07.935768 25635 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:07.895792 26162 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:17:07.915419 25849 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:07.930922 22896 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:07.941805 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.921252 26118 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:07.922747 26028 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.932368 26199 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:07.944202 26028 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:07.945921 26199 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:07.947268 25849 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.947685 25849 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:07.949304 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:07.949991 22894 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:07.943107 22895 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:07.921525 25991 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:07.952028 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.939989 22892 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:07.953183 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.958062 22895 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 6.
I20260709 12:17:07.953104 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:07.959455 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.961346 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.954582 22823 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:17:07.968983 22823 pending_rounds.cc:85] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 4
I20260709 12:17:07.970116 22894 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:07.965888 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.959177 25991 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:07.953985 25964 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:07.970386 22823 pending_rounds.cc:107] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:17:07.970546 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 594) took 2425 ms. Trace:
I20260709 12:17:07.972442 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.932157 25948 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:07.981505 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.984004 26197 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:17:07.979072 25964 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.984826 25964 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:07.977680 22893 rpcz_store.cc:276] 0709 12:17:05.545391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.568211 (+ 22820us) service_pool.cc:224] Handling call
0709 12:17:05.568586 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:05.569025 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:05.569067 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:07.758399 (+2189332us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b2c001e6a18. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:17:07.775370 (+ 16971us) log.cc:844] Serialized 26 byte log entry
0709 12:17:07.855836 (+ 80466us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:07.855875 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:07.855953 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:07.970250 (+114297us) raft_consensus.cc:1685] finished
0709 12:17:07.970273 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:07.970485 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9151,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":23250,"spinlock_wait_cycles":19063680,"thread_start_us":55666,"threads_started":1,"wal-append.queue_time_us":129366}
I20260709 12:17:07.987522 22893 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:07.993412 25998 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:07.994081 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.981076 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.975046 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:07.996037 22894 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:07.998870 22823 raft_consensus.cc:2889] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:08.028445 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:08.029610 22894 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:07.912338 26177 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:08.001154 26028 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.046432 22895 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:08.043429 22823 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:08.071190 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:08.071883 22895 raft_consensus.cc:2376] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9. Re-sending same reply.
I20260709 12:17:08.077486 22823 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:08.064694 25976 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.001574 26173 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:08.032620 25964 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.068372 26076 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:08.091104 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.091727 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 939) took 2861 ms. Trace:
I20260709 12:17:08.098337 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:08.102005 22899 pending_rounds.cc:85] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 3
I20260709 12:17:08.102610 22899 pending_rounds.cc:107] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:17:08.102919 22899 raft_consensus.cc:2889] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:08.089133 26142 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:08.108629 26142 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:08.087049 25891 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:08.118635 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.088390 26193 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:08.123970 25922 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:08.104094 26126 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:08.142896 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.144696 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:08.135574 26204 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 12:17:08.154439 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.151566 22823 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:08.141746 26145 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.129556 25959 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:08.161960 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:08.169736 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 260441us
I20260709 12:17:08.172366 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:08.192068 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.198431 26117 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:17:08.168237 25983 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:08.204555 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:08.207768 25976 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:08.168742 25998 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:08.198097 25957 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:08.226303 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:08.229701 23660 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:08.167783 25948 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:08.219257 25978 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:08.189869 26145 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:08.251001 26209 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:17:08.252650 25849 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:08.254573 25959 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:08.254879 26157 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.255620 26157 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.257736 22824 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:17:08.258152 22824 pending_rounds.cc:85] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 4
I20260709 12:17:08.258425 22824 pending_rounds.cc:107] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:17:08.258698 22824 raft_consensus.cc:2889] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:08.261418 25849 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:08.265434 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:08.266147 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:08.265424 23695 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:08.267194 23689 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:08.268466 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:08.268853 26118 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.269444 23660 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
W20260709 12:17:08.259406 26179 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.005s
I20260709 12:17:08.272017 26145 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:08.272509 26179 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:08.275520 26179 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:08.279248 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.280320 22820 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:17:08.281541 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.282225 22820 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:17:08.285588 23689 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:08.286199 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.288426 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:08.293143 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 171708us
I20260709 12:17:08.295642 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.296818 22820 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:08.299059 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.283800 25978 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:08.303633 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.308137 22820 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:08.310969 26118 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:08.314342 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.315193 22822 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:08.315060 25991 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.316197 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.317020 22822 raft_consensus.cc:2410] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:17:08.317377 25991 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:08.317893 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.320240 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:08.321460 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 791) took 3125 ms. Trace:
I20260709 12:17:08.321966 22750 rpcz_store.cc:276] 0709 12:17:05.196332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.407471 (+211139us) service_pool.cc:224] Handling call
0709 12:17:07.656911 (+2249440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.665891 (+  8980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.321207 (+655316us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54000a8550. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:08.321352 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5025580928}
I20260709 12:17:08.322474 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:08.323498 23689 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:08.322474 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:08.324339 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:08.325098 23685 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:08.326925 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:08.327741 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:08.328083 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:08.328560 23685 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:08.328698 22893 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:08.331905 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:08.321305 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:08.311054 26055 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:08.343915 26193 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:08.300647 26173 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:08.365005 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:08.366443 22822 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:08.365828 22825 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:08.367169 22825 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:08.372020 23672 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:08.371659 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 173640us
W20260709 12:17:08.379030 22717 leader_election.cc:336] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.148s (SENT)
W20260709 12:17:08.380394 22717 leader_election.cc:336] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.627s (SENT)
I20260709 12:17:08.381018 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:08.386173 22717 leader_election.cc:336] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.763s (SENT)
I20260709 12:17:08.388106 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:08.391152 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:08.392803 23685 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:08.367906 22825 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.395926 22825 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:08.390375 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:08.396819 23679 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:08.404835 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.302958 26075 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:17:08.405822 23685 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:08.364045 25948 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:08.420596 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:08.425606 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:08.422290 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:08.423914 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:08.423018 22901 raft_consensus.cc:2410] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:08.414319 22822 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
W20260709 12:17:08.415200 26187 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.006s
I20260709 12:17:08.399398 25959 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:08.431144 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:08.443953 22901 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:08.455456 25948 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:08.456481 22895 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:08.459760 26187 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:08.463207 25922 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:08.434283 25976 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:08.464028 25922 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:08.464344 25976 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:08.464705 25922 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:08.462478 26187 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:08.421253 26213 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:08.467727 25978 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.471645 26055 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:08.472517 26055 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:08.464882 25976 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:08.419358 26162 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11.
I20260709 12:17:08.480134 22898 raft_consensus.cc:2410] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:17:08.481739 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.473734 26055 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:08.487049 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 50981.4us
I20260709 12:17:08.487802 22791 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:08.425016 26127 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:08.507786 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.513809 25957 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:08.495239 25920 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:08.515599 25920 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:08.515821 26180 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.019s	user 0.004s	sys 0.000s
I20260709 12:17:08.516036 25920 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:08.496982 26052 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:17:08.501597 26127 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:08.546473 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 117479us
W20260709 12:17:08.548189 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 56678.5us
I20260709 12:17:08.548921 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:08.547834 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:08.554396 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:08.550665 26148 raft_consensus.cc:2764] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:17:08.561116 26075 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 12:17:08.566545 26153 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.627s	user 0.015s	sys 0.005s
I20260709 12:17:08.573175 26075 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:08.573048 26153 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.573572 26075 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:08.575112 22751 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:08.575295 26153 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:08.567343 25976 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.556281 26213 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:17:08.577077 25976 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:08.575897 26153 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:08.574445 26075 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.578742 26075 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:08.579900 26153 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:08.580400 26153 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:08.568796 26219 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:17:08.550441 25920 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:08.583361 26070 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.006s
I20260709 12:17:08.583763 26030 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:08.584342 26030 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:08.584753 25920 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:08.554136 25959 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:08.585485 25959 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:08.585893 25959 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:08.587483 25719 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:08.571774 26052 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:08.590837 26052 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:08.583896 26070 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:08.590521 26028 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:08.592841 26221 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:17:08.601824 22826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 486) took 2895 ms (client timeout 1845 ms). Trace:
W20260709 12:17:08.605324 22826 rpcz_store.cc:269] 0709 12:17:05.705986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.769203 (+ 63217us) service_pool.cc:224] Handling call
0709 12:17:08.601530 (+2832327us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54007a1f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:08.601728 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3226335616}
I20260709 12:17:08.581095 26127 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:08.592064 26052 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:08.631494 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 74562.4us
W20260709 12:17:08.634311 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 79700.3us
I20260709 12:17:08.636708 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:08.638576 26120 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:17:08.646154 23656 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:08.648175 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:08.654363 23685 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:08.649380 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:08.649644 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:08.649979 26070 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:08.651911 26142 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:08.655155 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:08.666888 22894 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:08.666733 26226 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:08.642328 26052 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.674161 25978 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:08.693049 26052 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:08.693948 26178 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:08.694695 26178 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:08.681973 25959 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:08.695932 26178 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:08.692235 25978 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.707659 25959 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:08.707829 26178 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:08.655016 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:08.656944 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:08.761025 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 103946us
I20260709 12:17:08.661993 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1222) took 1047 ms. Trace:
I20260709 12:17:08.767241 22824 rpcz_store.cc:276] 0709 12:17:07.614842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.917541 (+302699us) service_pool.cc:224] Handling call
0709 12:17:07.927065 (+  9524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:08.260060 (+332995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.661683 (+401623us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54001248d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:08.661915 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759242112}
W20260709 12:17:08.806389 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.701663 25922 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:08.812721 25922 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:08.814381 25849 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:08.816078 25849 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:08.703909 25978 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:08.713187 26153 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:08.823029 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 57192.6us
I20260709 12:17:08.826763 26153 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:08.839344 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 184236us
I20260709 12:17:08.845180 25976 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:08.848219 25976 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:08.848557 26075 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:17:08.850665 25976 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:08.851251 25920 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:08.852928 26158 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.857713 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:08.857743 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 586) took 1096 ms. Trace:
I20260709 12:17:08.871428 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:08.872080 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:08.873574 23685 raft_consensus.cc:2368] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10.
I20260709 12:17:08.854252 26158 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:08.875090 25849 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:08.878099 26158 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:08.884052 22749 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:08.885233 22900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 599) took 2961 ms (client timeout 2131 ms). Trace:
W20260709 12:17:08.851325 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.896626 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:08.898058 26227 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:08.899160 26227 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:08.902074 26227 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:08.902798 26227 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:08.903949 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:08.905587 26122 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:08.906600 26122 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:08.866696 22751 rpcz_store.cc:276] 0709 12:17:07.761038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.763289 (+  2251us) service_pool.cc:224] Handling call
0709 12:17:08.857083 (+1093794us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b5400192dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:08.857418 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717977984}
W20260709 12:17:08.886189 22900 rpcz_store.cc:269] 0709 12:17:05.923654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.926935 (+  3281us) service_pool.cc:224] Handling call
0709 12:17:08.884511 (+2957576us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002fdd54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:08.884786 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2948119424}
I20260709 12:17:08.929981 26230 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.932339 26230 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:08.934015 26143 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:08.935952 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:08.938227 25964 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:08.939533 26157 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:08.942620 26155 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:08.948256 26122 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:08.950161 26177 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:08.937644 26230 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:08.960973 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:08.961884 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:08.961140 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:08.965247 22751 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:08.965938 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1209) took 3770 ms. Trace:
I20260709 12:17:08.975616 22818 rpcz_store.cc:276] 0709 12:17:05.195069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.195257 (+   188us) service_pool.cc:224] Handling call
0709 12:17:05.309674 (+114417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:05.562618 (+252944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.965115 (+3402497us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54001257d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:08.965622 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550560512}
I20260709 12:17:08.983460 26177 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.985059 26177 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:08.986093 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:08.987150 22744 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:08.983534 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 87129.3us
I20260709 12:17:08.927328 25922 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:08.989121 26156 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:17:08.988513 25922 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.999366 25922 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:08.990085 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:08.987775 26177 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:09.003419 22748 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:09.006213 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:09.009356 22896 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:17:09.009922 26235 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.325s	user 0.005s	sys 0.000s
I20260709 12:17:08.996551 22791 leader_election.cc:400] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10.
I20260709 12:17:08.985978 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 797) took 1792 ms. Trace:
I20260709 12:17:09.012019 22896 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:09.012238 22791 leader_election.cc:403] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:17:08.990859 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:09.013283 26148 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:09.013517 22747 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:09.015050 26215 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:09.015592 26215 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:09.017771 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:09.018749 22896 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:09.019102 22897 rpcz_store.cc:276] 0709 12:17:07.193921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.194178 (+   257us) service_pool.cc:224] Handling call
0709 12:17:07.194617 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.347254 (+152637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.985307 (+1638053us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54004ec854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:08.985746 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346804096}
I20260709 12:17:09.023229 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:09.024390 22897 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:17:09.025502 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:09.026698 22747 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 10: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:17:09.027866 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.009387 22900 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:08.967501 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:09.032855 22750 raft_consensus.cc:2368] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7.
I20260709 12:17:09.032737 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:09.033207 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:09.034127 23685 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:08.093067 22821 rpcz_store.cc:276] 0709 12:17:05.225289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.327422 (+102133us) service_pool.cc:224] Handling call
0709 12:17:05.327681 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:05.327877 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:05.358183 (+ 30306us) log.cc:844] Serialized 14 byte log entry
0709 12:17:07.950915 (+2592732us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b18002e1b00. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:17:08.086320 (+135405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:08.086389 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:08.086454 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.086607 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:08.086756 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9060,"prepare.queue_time_us":30139,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":10324,"raft.queue_time_us":9589,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4426,"spinlock_wait_cycles":31743232,"thread_start_us":125228,"threads_started":1}
I20260709 12:17:09.036998 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:09.038295 22824 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 11: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:05.140825 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:09.041887 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:09.042639 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:09.044996 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:09.046446 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:09.017428 26215 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:09.049361 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.049516 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:09.050350 22753 raft_consensus.cc:2368] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10.
I20260709 12:17:09.051230 22746 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:09.051682 22750 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:17:09.052453 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.052681 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.053485 22746 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:09.053577 22750 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:09.054355 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.055416 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.056413 22745 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:09.056521 22818 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:09.058076 26215 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:09.063648 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:09.066120 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:09.067286 22747 raft_consensus.cc:2368] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9.
I20260709 12:17:09.067361 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:09.051545 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.082165 26120 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:09.084898 26030 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:09.072992 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:09.073935 22746 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:09.073559 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:09.076771 22748 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:09.076838 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:09.078030 22823 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:09.073740 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.063973 25922 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:09.086019 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:09.087150 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:09.089195 26227 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:09.090487 23656 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: [6.4-9.5]
I20260709 12:17:09.090337 26120 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:09.110952 22896 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:09.094524 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:09.095295 22819 raft_consensus.cc:2410] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
W20260709 12:17:09.099001 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.071281 26148 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10.
I20260709 12:17:09.095292 23685 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:09.108649 22752 raft_consensus.cc:2410] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:17:09.093276 22744 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:09.118115 22751 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:09.120012 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:09.122946 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 97477.3us
W20260709 12:17:09.123700 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.124559 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:09.127586 26064 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:09.128012 22894 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:09.128121 26064 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.128818 26064 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:09.128865 26030 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:09.129510 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:09.130082 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.131407 22744 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:09.132870 25922 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:09.133422 26148 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.133474 26215 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:09.134105 22824 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:09.134454 26215 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:09.136059 22745 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:09.134402 26148 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:09.134967 25957 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:09.137194 26177 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.142849 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:09.143235 26148 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:09.143635 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:09.143792 25957 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.143802 22823 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:09.142606 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:09.122547 25959 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:09.153909 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:09.176802 26198 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.177764 26198 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:09.178192 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:09.179454 22892 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:09.180876 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:09.182425 22897 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 10: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:09.153116 25957 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:09.183370 26030 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:09.184290 26030 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:09.187512 22900 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:09.183421 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:09.189085 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:09.189936 23695 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:09.191121 26083 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.191972 26083 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:09.195338 22749 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:09.195786 26148 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.196540 26148 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:09.198997 26148 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:09.207715 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:09.209116 22894 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:09.210830 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:09.211018 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 68592.2us
I20260709 12:17:09.211882 26148 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:09.212386 26148 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.212828 26148 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:09.213129 25771 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:09.214115 25771 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:09.215395 25991 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:09.215819 25771 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:09.142750 26177 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:09.221021 26177 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:09.187184 22751 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:09.231968 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:09.233330 22898 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:09.221927 26215 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:09.253499 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:09.260391 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:09.240398 26083 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:09.256729 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:09.265343 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:09.266225 22896 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:09.186309 26030 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:09.272140 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.273531 22751 raft_consensus.cc:2410] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:17:09.275506 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:09.266067 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:09.290637 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 284818us
W20260709 12:17:09.294317 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 340673us
I20260709 12:17:09.296787 22865 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:09.295104 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:09.293697 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:09.300308 22821 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:09.311154 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.311749 26116 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:09.315541 26116 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:09.315429 22573 catalog_manager.cc:5697] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 4 to 6, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 6 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:09.316619 22749 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:09.311336 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:09.283026 26227 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:17:09.312759 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 63127.8us
I20260709 12:17:09.316905 26116 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:09.333689 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:09.327557 25959 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:09.340926 25991 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:09.346374 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:09.346453 26070 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:17:09.348800 25978 consensus_meta.cc:287] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.526s	user 0.014s	sys 0.004s
I20260709 12:17:09.349824 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:09.356048 22898 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:09.358490 25991 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:09.364161 22573 catalog_manager.cc:5697] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 5 to 10, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 10 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:09.366640 25959 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:09.369832 22749 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:09.371073 26227 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:09.375672 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:09.410183 22894 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:09.373487 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:09.377943 22744 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:09.336418 26198 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:09.379150 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.380947 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.381701 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.357350 25978 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:09.383445 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:09.324342 26052 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.218s
I20260709 12:17:09.387683 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:09.388458 22747 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:09.390684 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:09.391055 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:09.391603 22825 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:17:09.353106 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 386064us
I20260709 12:17:09.353637 26160 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:09.352676 26244 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:17:09.349678 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:09.405092 22900 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:09.406533 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:09.407069 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.422231 22892 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:09.378597 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:09.424139 22751 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:09.418716 22750 raft_consensus.cc:2368] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10.
I20260709 12:17:09.376189 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:09.407498 26153 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:09.430020 22745 raft_consensus.cc:2368] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10.
I20260709 12:17:09.434638 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:09.436476 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.437278 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 491) took 3601 ms. Trace:
I20260709 12:17:09.443723 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:09.444856 22821 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:09.452030 23695 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:09.455768 23685 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:09.451285 22824 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:09.459323 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:09.460271 22819 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:09.464831 22573 catalog_manager.cc:5697] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 4 to 8, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 8 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:17:09.471071 26148 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:09.471983 25957 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:09.474108 26148 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:09.445994 26052 consensus_queue.cc:1243] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:09.476190 22746 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:09.477353 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.477998 22746 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:09.437723 22827 rpcz_store.cc:276] 0709 12:17:05.713310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.532229 (+818919us) service_pool.cc:224] Handling call
0709 12:17:06.532632 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:07.393240 (+860608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:07.393291 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:07.402983 (+  9692us) log.cc:844] Serialized 26 byte log entry
0709 12:17:07.498773 (+ 95790us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:08.986986 (+1488213us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b18004396c0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf81773c7 00007fadf47899a7 00007fadf47990bf
0709 12:17:08.987297 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 12:17:09.287077 (+299780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.292642 (+  5565us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:09.292718 (+    76us) raft_consensus.cc:1685] finished
0709 12:17:09.304819 (+ 12101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:09.315087 (+ 10268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2748,"prepare.queue_time_us":97699,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":176997,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":23440,"spinlock_wait_cycles":7440768,"thread_start_us":1184719,"threads_started":4,"wal-append.queue_time_us":629303,"wal-append.run_cpu_time_us":1750,"wal-append.run_wall_time_us":1001944}
I20260709 12:17:09.444839 26198 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:09.484588 22573 catalog_manager.cc:5697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:09.485265 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.485208 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.500116 22818 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 11. Ops: []
I20260709 12:17:09.500639 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.507700 22896 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
W20260709 12:17:09.509757 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 191510us
I20260709 12:17:09.513520 22752 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:09.514474 26075 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:09.514935 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.516324 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.516952 22752 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:09.517848 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.519296 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:09.520226 22900 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:09.522625 26126 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:09.523559 26126 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:09.524292 22573 catalog_manager.cc:5697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 6 to 7, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 7 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:09.524977 26126 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:09.526901 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.528183 26083 raft_consensus.cc:2764] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:17:09.529290 22751 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:09.530355 22746 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:09.528327 22748 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:09.515117 26075 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:09.458146 26215 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:09.526211 22573 catalog_manager.cc:5697] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 1 to 7, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 7 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:09.530894 26117 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:09.542160 22826 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
W20260709 12:17:09.558228 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 58081.3us
W20260709 12:17:09.559659 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 210199us
I20260709 12:17:09.495131 26198 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:09.592308 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:09.593427 23674 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:09.594316 26117 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:09.595580 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:09.596417 22827 raft_consensus.cc:2393] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 10: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:09.597082 26117 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:09.598337 22573 catalog_manager.cc:5697] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 2 to 7, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 7 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:09.600883 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:09.603011 26177 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:17:09.604725 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 57007us
W20260709 12:17:09.605443 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 222443us
I20260709 12:17:09.600647 22573 catalog_manager.cc:5697] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
W20260709 12:17:09.594062 22576 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43994 (request call id 149) took 19190 ms (client timeout 15000 ms). Trace:
W20260709 12:17:09.616209 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.474134 25957 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:09.674193 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:09.609730 26198 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:09.605029 26215 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:09.700305 26248 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.135s	user 0.003s	sys 0.000s
I20260709 12:17:09.738982 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:09.713685 22573 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 8 to 9, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 9 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:09.714954 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:09.759630 26215 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:09.765692 25978 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:09.767104 25718 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:09.767251 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 93139.7us
I20260709 12:17:09.683969 25991 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:09.794934 22864 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:09.802214 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:09.802980 25718 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:09.728154 26245 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.003s
I20260709 12:17:09.750376 26172 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:09.713384 26117 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.824959 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:09.841921 22892 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:09.847858 22752 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:09.807016 26070 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:17:09.851313 25994 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.852063 25994 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:09.841769 25978 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:09.855279 25978 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.854995 26117 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:09.855718 25978 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:09.857559 26117 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:09.684989 25976 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 12:17:09.883818 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:09.900422 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:09.901393 22826 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:09.860450 26227 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:09.866051 25994 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:09.896863 22573 catalog_manager.cc:5697] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 6 to 7, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 7 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:09.933270 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:09.942286 23656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.015s	sys 0.028s
W20260709 12:17:09.943058 23656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.015s	sys 0.028s
I20260709 12:17:09.900570 26172 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:09.848995 26064 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.706s	user 0.014s	sys 0.005s
I20260709 12:17:09.954000 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:09.951877 23674 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:09.957988 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:09.962385 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:09.959189 22573 catalog_manager.cc:5697] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 3 to 5, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 5 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
W20260709 12:17:09.966156 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 271233us
I20260709 12:17:09.971302 22897 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 12:17:09.962914 22823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.016s	sys 0.028s
W20260709 12:17:09.975741 22823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.016s	sys 0.028s
W20260709 12:17:09.630285 22576 rpcz_store.cc:269] 0709 12:16:50.403491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.403772 (+   281us) service_pool.cc:224] Handling call
0709 12:17:09.593660 (+19189888us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:02.401957 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:02.402768 (+   811us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:02.402857 (+    89us) write_op.cc:435] Acquired schema lock
0709 12:17:02.402870 (+    13us) tablet.cc:662] Decoding operations
0709 12:17:02.404979 (+  2109us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:02.405085 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:02.405125 (+    40us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:17:02.615425 (+210300us) tablet.cc:701] Row locks acquired
0709 12:17:02.615498 (+    73us) write_op.cc:260] PREPARE: finished
0709 12:17:02.615792 (+   294us) write_op.cc:270] Start()
0709 12:17:02.616045 (+   253us) write_op.cc:276] Timestamp: P: 1783599422615682 usec, L: 0
0709 12:17:02.616095 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:17:02.796249 (+180154us) log.cc:844] Serialized 9920 byte log entry
0709 12:17:03.454294 (+658045us) op_driver.cc:464] REPLICATION: finished
0709 12:17:03.974162 (+519868us) write_op.cc:301] APPLY: starting
0709 12:17:04.000523 (+ 26361us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:04.179095 (+178572us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:04.179260 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:04.182094 (+  2834us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:04.182682 (+   588us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 12:17:04.182745 (+    63us) write_op.cc:312] APPLY: finished
0709 12:17:04.187703 (+  4958us) log.cc:844] Serialized 169 byte log entry
0709 12:17:04.188000 (+   297us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:04.188332 (+   332us) write_op.cc:454] Released schema lock
0709 12:17:04.188457 (+   125us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:04.195690 (+  7233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:04.195752 (+    62us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":186008,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":468655,"apply.run_cpu_time_us":7208,"apply.run_wall_time_us":249236,"num_ops":25,"prepare.queue_time_us":283929,"prepare.run_cpu_time_us":36417,"prepare.run_wall_time_us":683983,"raft.queue_time_us":337304,"raft.run_cpu_time_us":61314,"raft.run_wall_time_us":239021,"replication_time_us":837974,"thread_start_us":831454,"threads_started":4,"wal-append.queue_time_us":246574,"wal-append.run_cpu_time_us":126281,"wal-append.run_wall_time_us":2148357}]]}
W20260709 12:17:09.947211 26030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.014s	sys 0.031s
W20260709 12:17:09.980441 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 306455us
I20260709 12:17:09.972963 22747 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
W20260709 12:17:09.974884 22821 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.002s
I20260709 12:17:09.982179 22821 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
W20260709 12:17:09.955391 25771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.009s	sys 0.034s
I20260709 12:17:10.005596 22826 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:10.011547 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:09.982594 26030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.015s	sys 0.031s
W20260709 12:17:09.980110 26247 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
W20260709 12:17:10.013131 25771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.009s	sys 0.034s
I20260709 12:17:09.984143 26083 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:10.046314 22898 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
W20260709 12:17:10.051854 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 61244.4us
I20260709 12:17:09.985484 22573 catalog_manager.cc:5697] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 4 to 7, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 7 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:09.955265 26064 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:10.074433 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 464847us
I20260709 12:17:10.076020 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:10.079803 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:10.090521 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:10.098999 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 52396.6us
I20260709 12:17:10.110026 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:10.124212 22819 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.584s	user 0.013s	sys 0.000s
I20260709 12:17:10.144634 22573 catalog_manager.cc:5697] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 3 to 6, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 6 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:10.065356 26083 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:09.962268 26075 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:10.199241 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:10.200654 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 124853us
I20260709 12:17:10.201375 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:10.202883 22822 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:17:10.202517 25957 consensus_queue.cc:1175] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a89a4b420ea9496aab55475fc38bb6f7" responder_term: 13 status { last_received { term: 9 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:10.210171 26177 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.216118 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 816) took 1196 ms. Trace:
I20260709 12:17:10.216710 22901 rpcz_store.cc:276] 0709 12:17:09.019189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.019351 (+   162us) service_pool.cc:224] Handling call
0709 12:17:09.019843 (+   492us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:09.021472 (+  1629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.021506 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:09.022361 (+   855us) log.cc:844] Serialized 52 byte log entry
0709 12:17:09.419906 (+397545us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:09.419950 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.420025 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.215686 (+795661us) raft_consensus.cc:1685] finished
0709 12:17:10.215710 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.215906 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":769,"raft.queue_time_us":1506,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":212,"thread_start_us":397075,"threads_started":1,"wal-append.queue_time_us":576601}
I20260709 12:17:10.111302 26156 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:10.192705 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:10.194499 22893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.008s	sys 0.034s
W20260709 12:17:10.194994 25635 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.136s	sys 0.223s
W20260709 12:17:10.227715 22893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.009s	sys 0.034s
I20260709 12:17:10.195838 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:10.199409 26075 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:10.201818 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:10.189265 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:10.226545 22894 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.791s	user 0.006s	sys 0.006s
I20260709 12:17:10.229621 22894 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
W20260709 12:17:10.227792 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 425204us
I20260709 12:17:10.124939 22819 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:17:10.234141 22752 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:10.169490 26227 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:10.239916 22573 catalog_manager.cc:5697] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 5 to 6, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 6 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:10.242133 22892 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
W20260709 12:17:10.250169 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 73159.1us
W20260709 12:17:10.227618 25635 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.137s	sys 0.224s
I20260709 12:17:10.109416 26030 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
W20260709 12:17:10.230160 25959 consensus_meta.cc:287] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.816s	user 0.013s	sys 0.003s
I20260709 12:17:10.271764 22573 catalog_manager.cc:5697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 6 to 9, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 9 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:10.238191 26227 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.277676 22573 catalog_manager.cc:5697] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 5 to 9, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 9 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:10.268857 25959 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:10.280562 22573 catalog_manager.cc:5697] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 2 to 5, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 5 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:10.282697 22573 catalog_manager.cc:5697] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 2 to 7, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 7 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:10.283067 25959 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:10.292740 26129 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:10.293453 26129 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:10.294727 26129 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:10.300716 22573 catalog_manager.cc:5697] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 2 to 4, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 4 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:10.305596 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 824) took 1144 ms. Trace:
I20260709 12:17:10.306221 22893 rpcz_store.cc:276] 0709 12:17:09.162520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.162737 (+   217us) service_pool.cc:224] Handling call
0709 12:17:09.176205 (+ 13468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.236416 (+ 60211us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:09.280648 (+ 44232us) log.cc:844] Serialized 14 byte log entry
0709 12:17:10.228168 (+947520us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.254873 (+ 26705us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.255099 (+   226us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:10.255152 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.255253 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.305295 (+ 50042us) raft_consensus.cc:1685] finished
0709 12:17:10.305319 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.305511 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46382,"prepare.queue_time_us":32746,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2004,"raft.queue_time_us":63587,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":15281,"thread_start_us":896267,"threads_started":1,"wal-append.queue_time_us":958166}
W20260709 12:17:10.305771 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 104176us
I20260709 12:17:10.310988 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:10.315075 25959 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:10.257141 26153 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:10.247255 26120 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:10.219538 26055 consensus_queue.cc:1175] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2c3a0d56045540b7802937559599f09c" responder_term: 13 status { last_received { term: 11 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: [12.7-12.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:10.337021 26172 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:10.338094 26172 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:10.338860 26172 consensus_queue.cc:1243] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:10.339965 26083 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:10.341140 26083 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:10.315043 26117 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:10.350236 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 91034.1us
I20260709 12:17:10.345186 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:10.361066 22900 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.840s	user 0.013s	sys 0.001s
I20260709 12:17:10.363911 22900 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:10.367470 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:10.375268 22818 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.055s
W20260709 12:17:10.375887 22818 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.000s	sys 0.055s
I20260709 12:17:10.375294 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:10.348534 22790 connection.cc:256] RPC call timeout handler was delayed by -1.133212450999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 12:17:10.344074 26227 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:10.257332 26177 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:10.367825 26064 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:10.395684 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 142400us
I20260709 12:17:10.394140 25976 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:10.417224 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:10.420289 22744 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.018s	sys 0.035s
W20260709 12:17:10.420893 22744 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.018s	sys 0.035s
W20260709 12:17:10.422636 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 441309us
I20260709 12:17:10.444389 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:10.446681 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 951) took 1273 ms. Trace:
I20260709 12:17:10.447389 22823 rpcz_store.cc:276] 0709 12:17:09.170688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.222388 (+ 51700us) service_pool.cc:224] Handling call
0709 12:17:09.245565 (+ 23177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.288963 (+ 43398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.289010 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:09.303958 (+ 14948us) log.cc:844] Serialized 26 byte log entry
0709 12:17:09.976263 (+672305us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:10.439253 (+462990us) log.cc:844] Serialized 14 byte log entry
0709 12:17:10.439715 (+   462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.439824 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.439878 (+    54us) raft_consensus.cc:1685] finished
0709 12:17:10.439896 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.440075 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21225,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":16810,"thread_start_us":1055447,"threads_started":2,"wal-append.queue_time_us":937546}
W20260709 12:17:10.439909 26215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.000s	sys 0.049s
I20260709 12:17:10.450059 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 620) took 1044 ms. Trace:
W20260709 12:17:10.455863 26215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.000s	sys 0.049s
W20260709 12:17:10.487432 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.488341 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 803) took 1117 ms. Trace:
I20260709 12:17:10.450824 26064 consensus_queue.cc:1059] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:17:10.482614 25978 consensus_meta.cc:287] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.625s	user 0.013s	sys 0.003s
I20260709 12:17:10.481341 25718 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:10.519346 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.488829 23656 rpcz_store.cc:276] 0709 12:17:09.349515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.350396 (+   881us) service_pool.cc:224] Handling call
0709 12:17:09.350965 (+   569us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:09.351830 (+   865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.351881 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:09.352741 (+   860us) log.cc:844] Serialized 52 byte log entry
0709 12:17:09.960998 (+608257us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:10.022835 (+ 61837us) log.cc:844] Serialized 14 byte log entry
0709 12:17:10.466317 (+443482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.466404 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.466461 (+    57us) raft_consensus.cc:1685] finished
0709 12:17:10.466473 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.466636 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41639,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":85853,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":17812,"thread_start_us":1033710,"threads_started":2,"wal-append.queue_time_us":914630}
I20260709 12:17:10.465804 22749 rpcz_store.cc:276] 0709 12:17:09.389465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.421141 (+ 31676us) service_pool.cc:224] Handling call
0709 12:17:09.433210 (+ 12069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.439517 (+  6307us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:09.957409 (+517892us) log.cc:844] Serialized 14 byte log entry
0709 12:17:10.431392 (+473983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:10.431458 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:10.431536 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.431618 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.434283 (+  2665us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":741029,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":4913,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":882419,"threads_started":2}
I20260709 12:17:10.524127 22745 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:10.526896 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:10.539767 26129 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:10.521054 25718 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:10.551726 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.519074 25978 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:10.532270 26260 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:17:10.571096 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.553470 25718 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:10.596508 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:10.597033 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 942) took 1101 ms. Trace:
I20260709 12:17:10.601217 22750 rpcz_store.cc:276] 0709 12:17:09.472069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.500970 (+ 28901us) service_pool.cc:224] Handling call
0709 12:17:09.522537 (+ 21567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.522770 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:10.024052 (+501282us) log.cc:844] Serialized 14 byte log entry
0709 12:17:10.566277 (+542225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:10.566344 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:10.573254 (+  6910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.573341 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.573515 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":695604,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":7766,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":3000,"thread_start_us":964846,"threads_started":2}
I20260709 12:17:10.569056 26260 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:10.579277 26177 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:10.687079 26268 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:10.664790 25771 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:10.671108 26070 raft_consensus.cc:3055] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:10.618276 26261 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 12:17:10.696136 26177 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:17:10.715641 22864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.007s	sys 0.028s
W20260709 12:17:10.724836 22864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.008s	sys 0.028s
W20260709 12:17:10.726132 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 626072us
I20260709 12:17:10.727591 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:10.728935 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 320872us
W20260709 12:17:10.731386 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 169097us
I20260709 12:17:10.736899 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:10.714638 25771 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:10.739519 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.075s	sys 0.142s
W20260709 12:17:10.739956 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.075s	sys 0.142s
W20260709 12:17:10.740278 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 639151us
I20260709 12:17:10.718190 26070 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:10.742347 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 427856us
I20260709 12:17:10.724501 26177 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:10.741537 25771 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:10.757043 22745 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:17:10.751201 26177 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:10.774232 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 619) took 1385 ms. Trace:
I20260709 12:17:10.777403 22744 rpcz_store.cc:276] 0709 12:17:09.389203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.418483 (+ 29280us) service_pool.cc:224] Handling call
0709 12:17:09.440284 (+ 21801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.649122 (+208838us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:10.428246 (+779124us) log.cc:844] Serialized 14 byte log entry
0709 12:17:10.756442 (+328196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:10.756505 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:10.766064 (+  9559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.773979 (+  7915us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54004051d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:10.774031 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.774171 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":569571,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":8800,"raft.queue_time_us":1121,"spinlock_wait_cycles":377160064,"thread_start_us":975792,"threads_started":2}
W20260709 12:17:10.781625 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 377554us
W20260709 12:17:10.758064 26257 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.308s	user 0.003s	sys 0.001s
I20260709 12:17:10.772856 26153 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:10.775187 26258 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.307s	user 0.000s	sys 0.003s
I20260709 12:17:10.790102 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:10.800344 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 72893.6us
I20260709 12:17:10.779330 25978 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:10.806209 22750 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:17:10.806733 22750 pending_rounds.cc:85] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 5
W20260709 12:17:10.796833 26275 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:17:10.796236 26153 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:10.790135 26282 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.809016 22750 pending_rounds.cc:107] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:17:10.818691 22750 raft_consensus.cc:2889] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:10.821117 22864 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:10.804841 26268 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:10.820140 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 83389.2us
I20260709 12:17:10.805217 26156 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.825867 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:10.790287 26030 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 12:17:10.828735 26264 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
I20260709 12:17:10.830374 26156 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:10.833550 26156 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:10.836652 25976 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:10.837491 25976 consensus_queue.cc:1243] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:10.837440 26030 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:10.839432 26030 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:10.827276 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:10.843184 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 66124.3us
I20260709 12:17:10.777669 22823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1"
dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:43202
I20260709 12:17:10.844295 22823 raft_consensus.cc:606] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:10.844852 22823 raft_consensus.cc:614] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:10.815127 22790 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Timed out: RequestConsensusVote RPC to 127.17.249.194:36669 timed out after 1.685s (SENT)
I20260709 12:17:10.849128 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:10.811802 26260 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:10.824275 26055 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:10.880596 22790 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:10.826980 26268 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.818527 26278 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:10.871091 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 45268.3us
I20260709 12:17:10.938360 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 963) took 1283 ms. Trace:
W20260709 12:17:10.876643 26271 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:17:10.872033 26117 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:17:10.950922 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1237) took 1020 ms. Trace:
I20260709 12:17:10.951402 22825 rpcz_store.cc:276] 0709 12:17:09.931017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.931193 (+   176us) service_pool.cc:224] Handling call
0709 12:17:09.957078 (+ 25885us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:10.095049 (+137971us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:10.095086 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:10.095831 (+   745us) log.cc:844] Serialized 52 byte log entry
0709 12:17:10.598246 (+502415us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:10.598299 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.598395 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.950624 (+352229us) raft_consensus.cc:1685] finished
0709 12:17:10.950648 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.950842 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19899,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":479153,"threads_started":1,"wal-append.queue_time_us":660087}
I20260709 12:17:10.953730 25922 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:10.954380 25922 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:10.955025 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:10.955801 22825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8"
dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:43202
I20260709 12:17:10.955500 25922 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:10.956435 22825 raft_consensus.cc:606] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:10.956809 22825 raft_consensus.cc:614] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:10.958300 26279 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:17:10.955055 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 101653us
I20260709 12:17:10.947655 22827 rpcz_store.cc:276] 0709 12:17:09.655527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.655758 (+   231us) service_pool.cc:224] Handling call
0709 12:17:09.724962 (+ 69204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.770425 (+ 45463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:09.770471 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:09.771161 (+   690us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.081465 (+310304us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:10.609675 (+528210us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:10.621656 (+ 11981us) log.cc:844] Serialized 14 byte log entry
0709 12:17:10.622410 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.628237 (+  5827us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:10.864550 (+236313us) raft_consensus.cc:1685] finished
0709 12:17:10.938038 (+ 73488us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:10.938279 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":491917,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":18559,"raft.run_cpu_time_us":485,"raft.run_wall_time_us":34450,"spinlock_wait_cycles":3945216,"thread_start_us":803029,"threads_started":2,"wal-append.queue_time_us":637520}
W20260709 12:17:10.874995 26276 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 12:17:10.990602 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:10.875738 26270 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:17:10.864084 26126 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:11.002189 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.955139 25994 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:17:11.004914 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 168936us
I20260709 12:17:10.967204 26268 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:11.012204 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 190001us
I20260709 12:17:10.959977 26055 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:11.035758 25718 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:11.037487 26055 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:10.968545 26172 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:17:10.823264 26070 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.039505 26294 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:10.873811 26269 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.230s
I20260709 12:17:10.880666 26282 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:11.041069 26288 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.042838 22827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22"
dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:43202
I20260709 12:17:11.065192 22827 raft_consensus.cc:606] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.065610 22827 raft_consensus.cc:614] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:10.872080 26030 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.022718 25957 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.071005 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:11.074301 22750 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:11.055938 26257 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:17:11.068974 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:11.012024 26285 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:11.076356 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:11.076210 23660 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:11.038677 25718 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:11.084492 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:11.043478 26294 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:11.088505 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.088620 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:11.088979 26283 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 12:17:11.092422 23672 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:11.098112 23685 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:11.095849 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.093282 23656 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:11.064216 26272 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:11.003798 26284 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:17:11.074501 26260 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:11.103917 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 64225.5us
I20260709 12:17:11.089327 26292 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:11.015342 26126 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.081487 26285 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:11.130867 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 248514us
I20260709 12:17:11.131929 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:11.132045 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 621) took 1195 ms. Trace:
I20260709 12:17:11.133060 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:11.133826 22717 connection.cc:256] RPC call timeout handler was delayed by -1.6128635420000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 12:17:11.134615 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0978411080000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260709 12:17:11.135066 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0978411080000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260709 12:17:11.135571 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0897411079999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 12:17:11.135977 22717 connection.cc:256] RPC call timeout handler was delayed by -1.045641107999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:17:11.136369 22717 connection.cc:256] RPC call timeout handler was delayed by -1.045641107999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:17:11.136858 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.097606 26294 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:11.113184 26075 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.877s	user 0.013s	sys 0.002s
I20260709 12:17:11.149690 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:11.082504 25957 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:11.099363 26287 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:11.132546 22753 rpcz_store.cc:276] 0709 12:17:09.936654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.936792 (+   138us) service_pool.cc:224] Handling call
0709 12:17:09.962924 (+ 26132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.008093 (+ 45169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.008145 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.086038 (+ 77893us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.392189 (+306151us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:10.392234 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.392306 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.131757 (+739451us) raft_consensus.cc:1685] finished
0709 12:17:11.131789 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.131975 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34224,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":17312,"spinlock_wait_cycles":4480,"thread_start_us":204952,"threads_started":1,"wal-append.queue_time_us":484071}
W20260709 12:17:11.157815 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 361798us
I20260709 12:17:11.161394 23689 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:11.163196 26299 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:11.156785 26055 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:11.164687 26262 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.414s	user 0.003s	sys 0.000s
I20260709 12:17:11.166205 26290 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.166692 26290 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:11.168915 26290 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:11.168985 26075 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:11.169461 26290 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.169616 26075 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.169935 26290 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.171520 26284 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.172020 26284 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:11.172400 23685 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:11.174089 26075 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:11.174101 26284 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:11.175189 26284 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:11.124676 26030 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:11.137451 26172 consensus_queue.cc:1243] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:11.184791 22900 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:11.144359 25922 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:11.181572 23672 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:11.218840 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:11.146556 26156 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:11.138438 26285 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:11.085844 26288 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:11.222833 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:11.219684 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 272588us
I20260709 12:17:11.226922 23685 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:11.227255 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 158367us
I20260709 12:17:11.238236 23659 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:17:11.235224 26156 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:11.240494 26291 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:17:11.240655 26156 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.220779 26117 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:11.217319 26153 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:11.231926 22790 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.194:36669 timed out after 1.823s (SENT) [suppressed 17 similar messages]
W20260709 12:17:11.242558 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 92930.8us
I20260709 12:17:11.159464 25771 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:11.222424 25922 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:17:11.230053 26198 consensus_meta.cc:287] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.407s	user 0.010s	sys 0.009s
I20260709 12:17:11.255442 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:11.260238 22790 connection.cc:256] RPC call timeout handler was delayed by -1.0207124510000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
I20260709 12:17:11.164721 26055 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.151775 26272 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:11.139758 26292 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:11.271898 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.242296 26284 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:11.275383 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:11.269404 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.270166 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:11.274742 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.267153 23685 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:11.272411 22827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c"
dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:43202
I20260709 12:17:11.279292 22827 raft_consensus.cc:606] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.279791 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.261356 26279 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:11.263403 25922 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:11.277741 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:11.272904 26295 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:17:11.285988 23685 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: [4.3-7.4]
I20260709 12:17:11.282831 23689 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:11.291270 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:11.294318 26296 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:17:11.294689 26292 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:11.296018 26290 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:11.297621 26055 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:11.299814 25957 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:11.299984 25771 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:11.306865 23672 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:11.260550 26177 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.268033 26198 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.312166 22790 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.283041 26269 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:11.272153 26172 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:17:11.312352 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:11.282699 26303 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:11.329267 26302 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:17:11.329674 26298 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.329478 26303 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:11.330405 26298 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:11.332634 26303 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:11.332794 26298 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:11.334040 26083 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.992s	user 0.009s	sys 0.009s
I20260709 12:17:11.335474 22745 raft_consensus.cc:2393] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:11.296029 26288 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:11.338299 26279 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.318686 26129 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:11.341960 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 78515.4us
I20260709 12:17:11.345001 23494 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.346015 25771 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:11.346959 26117 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:11.348546 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:11.294710 26272 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:11.349828 26153 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:11.350447 26153 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:11.311390 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.348835 26117 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:11.328843 26305 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:11.272104 26300 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:17:11.358708 22896 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:11.342044 26177 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:11.386868 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 74786.9us
I20260709 12:17:11.349689 26292 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:17:11.359340 26055 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:11.358419 25994 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:11.401420 26227 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.997s	user 0.015s	sys 0.001s
I20260709 12:17:11.402122 26227 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:11.404676 26227 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:11.364348 25771 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:17:11.392092 26268 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:11.413341 22790 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.414188 26227 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:11.414902 22790 leader_election.cc:400] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10.
I20260709 12:17:11.414048 26153 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:11.416970 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.416803 26227 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:11.417716 26227 consensus_queue.cc:1243] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:11.421062 26198 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:11.424553 26215 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:11.428108 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.429119 26215 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:11.430603 22790 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:11.431795 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.431591 26126 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:11.436419 26215 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:11.381871 26083 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:17:11.369527 26284 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.446199 26215 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:11.450738 22790 leader_election.cc:400] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9.
I20260709 12:17:11.454407 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.455580 23659 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:11.460965 23656 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
W20260709 12:17:11.464239 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 164266us
I20260709 12:17:11.466928 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.470312 22745 raft_consensus.cc:2368] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10.
I20260709 12:17:11.387445 26308 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:11.475728 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.457367 26282 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:11.479455 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 101076us
I20260709 12:17:11.473560 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.475745 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.478508 22747 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:11.476670 22744 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:11.482688 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.480417 22753 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:11.483975 22749 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 7: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:11.486048 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.486117 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.486500 22748 raft_consensus.cc:1217] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[4.3-7.4]   Dedup: 4.3->[7.4-7.4]
I20260709 12:17:11.489158 22748 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: [4.3-7.4]
I20260709 12:17:11.483677 22752 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:11.495746 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.498558 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:11.499286 22744 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:11.464978 26294 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:11.504933 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.507154 26308 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.515255 26308 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:11.516791 26299 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:11.517308 26299 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:11.517750 26308 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:11.506937 25994 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:11.519830 26267 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.753s	user 0.002s	sys 0.003s
I20260709 12:17:11.518513 26299 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:11.511379 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 60818.5us
I20260709 12:17:11.519893 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:11.521201 22750 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:11.508759 22864 leader_election.cc:400] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10.
I20260709 12:17:11.491963 26282 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:11.555809 22750 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:11.556977 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 48459.7us
I20260709 12:17:11.557158 22744 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:11.562233 26117 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:11.564651 26117 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:11.552157 26308 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.565117 26117 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:11.565485 26308 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:11.566237 26117 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:11.567925 26308 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:11.569885 25922 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:11.557827 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:11.571249 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.572944 25718 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:11.573033 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:11.575313 25718 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:11.575687 26311 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:11.574571 26117 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:11.576385 26294 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:11.577558 26282 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:11.579353 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:11.579898 26282 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:11.580518 26282 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:11.580866 26282 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:11.580961 26309 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:17:11.581287 26282 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:11.573836 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:11.582540 22790 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.583007 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.584290 23674 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:11.584589 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.582718 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:11.593560 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:11.596230 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:11.594830 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:11.595727 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.607540 22750 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 7.
I20260709 12:17:11.582096 26308 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:11.612507 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:11.605152 25959 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:11.613862 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:11.614151 26268 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:11.614975 26153 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:11.615386 22790 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.615888 26314 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:11.616727 26292 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:11.617266 26292 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:11.617595 26287 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:11.618055 22790 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.618259 26292 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:11.609476 25718 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:11.620435 26215 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:17:11.623153 26055 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:11.624042 26227 raft_consensus.cc:993] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: : Instructing follower e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:17:11.621577 26278 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:11.620688 25959 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:11.626206 25959 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:11.606432 26299 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:11.606088 26289 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:11.585041 25978 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:17:11.631840 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:11.609925 26308 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.633528 26278 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:11.636772 25922 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:11.659560 22790 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.662022 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.662901 26153 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:11.674636 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 59372.6us
I20260709 12:17:11.649003 26308 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:11.685685 26278 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:11.674598 25922 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:11.695744 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.697301 26293 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:11.697923 26293 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:11.698993 26293 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:11.700611 26293 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:11.704372 26215 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.705160 26215 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.705186 26282 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:11.708329 26282 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:11.709092 26285 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:11.709666 26304 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:11.710248 26304 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:11.687558 26289 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:11.711753 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:11.712503 22744 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:11.711437 26304 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:11.714879 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 52950us
I20260709 12:17:11.720535 22790 leader_election.cc:400] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10.
I20260709 12:17:11.721647 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:11.732708 22894 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:11.736503 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.739322 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:11.744349 22744 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:11.745878 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:11.746941 22900 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:11.747313 26265 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:11.748375 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:11.749056 22898 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:11.752969 26055 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:11.752801 26287 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:17:11.753607 26055 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:11.753860 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:11.754534 22900 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:11.737793 26156 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:11.755687 26156 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:11.756062 26156 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:11.756338 22894 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:11.760039 22892 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:11.763180 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:11.763901 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.765033 22900 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:11.768266 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 831) took 1835 ms. Trace:
I20260709 12:17:11.768715 22896 rpcz_store.cc:276] 0709 12:17:09.933224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.947317 (+ 14093us) service_pool.cc:224] Handling call
0709 12:17:09.962065 (+ 14748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.360158 (+1398093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.767976 (+407818us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54004eb954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:11.768185 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3211384704}
I20260709 12:17:11.775543 26215 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:11.777433 26070 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:11.754665 26055 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:11.779258 26055 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:11.781951 26285 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:11.782650 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46211.3us
I20260709 12:17:11.786018 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:11.786831 22750 raft_consensus.cc:2376] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11. Re-sending same reply.
I20260709 12:17:11.786880 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.787863 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.788257 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.789059 22744 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 10: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:11.789104 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.789330 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:11.789851 22750 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:11.790046 26304 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:11.805943 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 110303us
W20260709 12:17:11.813627 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.838132 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.840157 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:11.840251 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:11.859524 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 51531.6us
I20260709 12:17:11.860175 22746 raft_consensus.cc:2410] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:17:11.860414 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:11.860752 22896 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:11.861064 22744 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
W20260709 12:17:11.861523 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.864562 22744 raft_consensus.cc:1217] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-11.6]   Dedup: 7.4->[9.5-11.6]
I20260709 12:17:11.865257 22744 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: [7.4-11.6]
I20260709 12:17:11.865291 22750 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:11.867959 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:11.868245 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.869138 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:11.869493 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:11.870993 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:11.871408 26075 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.871963 26075 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:11.874948 22744 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:11.864707 26289 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:11.878887 22744 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:11.878969 26289 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.848506 26153 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:11.882314 22746 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:11.884419 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.877478 25922 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:11.887737 22744 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:11.879681 26298 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:11.880923 26289 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:11.864627 26265 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:17:11.915684 23656 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:17:11.887024 26313 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:11.916258 23656 pending_rounds.cc:85] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 4
I20260709 12:17:11.916594 23656 pending_rounds.cc:107] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:11.916843 23656 raft_consensus.cc:2889] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:11.916728 26313 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:11.920574 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.920686 26297 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:11.921213 26297 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:11.921693 22896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:11.922225 26227 raft_consensus.cc:1081] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Signalling peer e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:17:11.922351 22896 raft_consensus.cc:606] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:11.923082 22896 raft_consensus.cc:614] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:11.925554 26156 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:11.902185 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.884768 26308 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:11.904592 26333 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:17:11.912855 26075 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:11.939742 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 55419.4us
I20260709 12:17:11.941001 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:11.903182 22744 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:11.931186 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.878063 26287 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 12:17:11.944471 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 72299.3us
I20260709 12:17:11.943177 23674 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:11.916023 26116 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:11.946810 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.897315 26314 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:11.954766 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.952277 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.961871 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.898245 25922 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.962699 23656 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:11.962775 23660 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:11.949090 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:11.957885 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.901079 26298 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:11.980170 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:12.007506 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:11.998531 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:12.008360 23656 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:12.008970 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:11.953502 26116 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:11.961879 26303 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:12.023304 26303 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:12.024502 26303 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:12.025995 26303 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:11.945314 25978 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:17:12.027259 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:12.016831 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.018618 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:12.016467 25635 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:11.977269 26075 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:17:12.020157 26116 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:12.021224 23679 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:12.019693 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:11.976531 25922 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:12.030508 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 89622.3us
I20260709 12:17:11.976016 26298 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:12.038000 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:12.039889 22744 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 12:17:12.017477 26333 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:17:11.922246 26297 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:12.041105 22744 pending_rounds.cc:85] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 4
I20260709 12:17:12.036259 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:12.054075 22744 pending_rounds.cc:107] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:17:12.056250 22744 raft_consensus.cc:2889] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:12.035769 26215 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:12.031734 26227 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:12.013638 26287 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:17:12.087395 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 138424us
I20260709 12:17:12.088364 26070 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:12.089231 26070 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:12.089843 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.036779 26314 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:12.106412 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 68536.4us
W20260709 12:17:12.110654 26333 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:12.090499 26070 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:12.111629 26156 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:12.112711 26291 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:17:12.114238 26308 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:12.115345 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:12.116397 23674 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:12.118762 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:12.132905 23660 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:12.140276 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:12.086751 26215 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.108340 26297 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:12.101470 26116 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:12.099704 26340 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.116146 26332 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:12.132766 25978 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:12.189148 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 54338.7us
I20260709 12:17:12.247176 22864 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:12.248319 23660 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:12.140393 25991 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:12.192199 26323 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:17:12.213675 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:12.219439 26343 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:17:12.229981 23682 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:12.232460 26314 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:12.244529 26083 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.254536 22893 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:12.148238 26215 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:12.147696 26075 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:12.252230 26288 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:12.250633 22864 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:12.254596 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 805) took 1130 ms. Trace:
I20260709 12:17:12.054936 26153 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:12.261719 23682 rpcz_store.cc:276] 0709 12:17:11.124816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.138885 (+ 14069us) service_pool.cc:224] Handling call
0709 12:17:12.229219 (+1090334us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b58002c3a98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:17:12.229538 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.253382 (+ 23844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.254539 (+  1157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37256064}
I20260709 12:17:12.267802 22894 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:17:12.251753 26332 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:12.276495 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:12.283156 22901 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:12.266772 26288 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.284610 26288 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:12.288506 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:12.292729 26198 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:12.293249 26198 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:12.293895 25994 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:12.294947 25771 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:12.295230 25994 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:12.295663 25994 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:12.295799 25771 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:12.296180 25771 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:12.296551 25994 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:12.297024 25771 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:12.298007 25994 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:12.298331 25771 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:12.303257 22899 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:12.304956 25635 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:12.295254 26299 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:12.307303 26304 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:12.308007 26304 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:12.302412 22896 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:12.317034 22898 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:12.278892 26308 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:12.294215 26198 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:12.321092 26282 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:12.321290 26337 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:12.321983 25635 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:12.322492 26337 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:12.325531 26337 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:12.326633 26198 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:12.249871 26340 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:12.260969 26075 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.328410 26075 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:12.329643 26340 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:12.253598 25991 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:12.261045 26083 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:12.332239 25991 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:12.332791 25991 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:12.333112 26083 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:12.327440 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:12.327252 26304 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:12.340029 22865 connection.cc:256] RPC call timeout handler was delayed by -1.5351980360001107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 12:17:12.342710 22865 connection.cc:256] RPC call timeout handler was delayed by -1.4316980359999434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 12:17:12.343238 22865 connection.cc:256] RPC call timeout handler was delayed by -1.3803980360000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 12:17:12.343649 22865 connection.cc:256] RPC call timeout handler was delayed by -1.2255980360000649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 12:17:12.345181 26083 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.345748 26083 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:12.346997 22895 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:12.250001 25978 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:12.354087 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 290663us
W20260709 12:17:12.356261 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.357507 22901 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:12.359301 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:12.361934 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:12.365062 22898 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:17:12.351940 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:12.367502 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.370369 26030 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:12.373392 26030 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:12.374377 26030 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:12.382978 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:12.333168 25991 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:12.380437 26288 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:12.390023 26129 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:12.397255 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:12.397612 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:12.400838 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 49014.8us
W20260709 12:17:12.401252 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.399998 22825 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:17:12.400260 22897 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
W20260709 12:17:12.408931 22790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.020s	sys 0.033s
W20260709 12:17:12.409515 22790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.020s	sys 0.033s
I20260709 12:17:12.387668 26227 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:12.410351 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:12.415211 22827 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:12.327523 26332 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:12.394272 26311 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:12.418581 22825 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:12.399760 26129 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.389861 25922 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:12.428772 22819 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:12.428563 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:12.430146 22823 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:12.405236 26308 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:12.452350 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:12.459474 22818 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:12.465227 22896 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:12.407357 26298 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:12.428779 26129 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:12.469754 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 64252.2us
I20260709 12:17:12.452015 26304 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:12.452390 26083 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:12.478585 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.479389 22818 pending_rounds.cc:85] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 4
I20260709 12:17:12.485020 22818 pending_rounds.cc:107] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:17:12.485404 22818 raft_consensus.cc:2889] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:12.490262 22900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.023s	sys 0.018s
I20260709 12:17:12.490522 22823 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:12.459347 26156 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:12.491750 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 286485us
I20260709 12:17:12.491873 22822 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:17:12.494594 22900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.023s	sys 0.018s
I20260709 12:17:12.497617 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:12.430467 26311 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:12.483675 26304 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.528294 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:12.427609 25991 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:12.532917 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 244507us
I20260709 12:17:12.537036 22749 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:12.539162 22749 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:12.540226 22822 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:17:12.540649 22822 pending_rounds.cc:85] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 4
I20260709 12:17:12.542336 22822 pending_rounds.cc:107] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:17:12.542599 22822 raft_consensus.cc:2889] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:12.526320 26304 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:12.527783 26083 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:12.545100 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:12.545145 25978 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:12.555107 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:12.555876 22822 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:17:12.533452 26285 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:12.520233 26156 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:12.531118 26341 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:12.562891 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:12.581353 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:12.563952 26287 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:12.550031 26299 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:12.591014 26287 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:12.593505 26287 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:12.594105 26287 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:12.594954 26288 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:12.595883 26311 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:12.596482 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:12.598264 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:12.566883 25991 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:12.568749 26308 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:12.524122 26227 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:12.609480 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.610074 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:12.611281 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:12.612155 22747 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:12.613538 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:12.613672 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:12.614640 22819 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:12.608461 22827 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:12.616350 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:12.619925 22864 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:12.620436 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:12.614545 22748 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:12.621425 22821 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:12.600376 26353 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:12.602802 26285 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:12.577781 26198 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:17:12.609665 26308 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.615981 26083 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:12.577605 26341 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:12.637251 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.626132 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:12.638455 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:12.690210 22823 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:12.642011 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:12.645051 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:12.651024 26363 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:12.651181 26308 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:12.696049 22819 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
W20260709 12:17:12.700162 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 83926.2us
I20260709 12:17:12.628334 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:12.625243 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:12.704941 22826 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
W20260709 12:17:12.682173 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.706269 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:12.707325 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:12.709398 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:12.711217 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:12.710918 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 85810.8us
W20260709 12:17:12.656167 26342 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.466s	user 0.002s	sys 0.003s
W20260709 12:17:12.657230 26356 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:17:12.656795 26360 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:17:12.723399 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:12.719602 22826 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:12.638729 26353 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.615857 26359 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:12.727535 26366 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:17:12.717289 26299 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:12.652465 26298 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:12.727559 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:12.651808 25922 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:12.679867 26361 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:12.715523 26355 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:17:12.725019 26116 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.007s
I20260709 12:17:12.717587 26156 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:12.734663 22748 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:12.768299 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:12.780611 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:12.776595 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:12.766798 26355 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.723157 26075 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:12.792959 22819 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:12.725417 25718 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:17:12.764256 26361 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:12.760092 26298 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:12.738387 26353 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:12.791232 26363 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:12.772478 26070 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:12.810343 26070 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:12.810942 26070 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:12.742766 26341 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:12.797998 26297 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.008s
I20260709 12:17:12.797081 26116 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:12.819454 26116 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:12.820648 26116 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:12.821530 26070 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:12.786969 26300 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:17:12.801519 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:12.804316 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:12.805150 26075 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:12.807037 26304 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:12.798112 26355 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:12.808904 26314 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.788889 26083 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:17:12.804167 26289 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.866s	user 0.007s	sys 0.006s
W20260709 12:17:12.829531 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.799777 26298 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.832958 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:12.869030 22897 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:12.856318 22825 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:12.773319 26311 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 12:17:12.858139 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.823096 26363 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:12.861402 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:12.863977 23689 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:12.798997 26285 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:12.831995 26341 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:17:12.875011 26289 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:12.875456 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:12.893971 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 799) took 1820 ms. Trace:
I20260709 12:17:12.854126 26070 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:12.894428 23679 rpcz_store.cc:276] 0709 12:17:11.073494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.087480 (+ 13986us) service_pool.cc:224] Handling call
0709 12:17:11.087873 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.035765 (+947892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.891344 (+855579us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b5400706f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:12.893887 (+  2543us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052099968}
I20260709 12:17:12.878906 26314 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:12.799589 26361 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:12.826721 26308 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:12.894398 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:12.971747 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:12.895162 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.862183 26337 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:12.973248 22895 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:12.972988 26337 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:12.951936 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 242627us
I20260709 12:17:12.894466 22819 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:12.966338 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:12.976413 22825 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:12.898000 25994 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.600s	user 0.017s	sys 0.002s
I20260709 12:17:12.880409 26298 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:12.989908 23656 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:12.992269 22820 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:13.001183 22825 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
W20260709 12:17:13.004750 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 139515us
W20260709 12:17:13.014580 26129 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.003s
W20260709 12:17:13.016036 26215 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.743s	user 0.012s	sys 0.000s
I20260709 12:17:13.019731 25994 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:13.031306 26359 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:13.039021 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:13.042927 25994 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:13.045112 22819 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:13.053282 22820 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:13.034471 26215 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:13.030951 26129 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:13.054893 26314 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:13.054585 22790 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:13.074308 22897 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:13.060766 26304 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:13.055296 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:13.078524 26347 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:13.079226 26347 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:13.079741 22790 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:13.080271 26347 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:13.081601 22790 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:13.025979 26083 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:13.056540 25994 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:13.056711 26352 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.084292 26352 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:13.086041 26357 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.375s	user 0.001s	sys 0.001s
I20260709 12:17:13.086609 26308 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:13.073457 26387 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:13.062472 26030 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:13.090304 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:13.093953 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:13.102377 26386 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:17:13.105880 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:13.109840 22820 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:13.111369 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 849) took 1304 ms. Trace:
I20260709 12:17:13.106454 22819 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:13.102867 26366 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:13.107200 25994 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:13.107795 26313 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:13.113837 26313 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.111860 22900 rpcz_store.cc:276] 0709 12:17:11.806688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.807365 (+   677us) service_pool.cc:224] Handling call
0709 12:17:11.859524 (+ 52159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:11.867662 (+  8138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.867701 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:11.877988 (+ 10287us) log.cc:844] Serialized 26 byte log entry
0709 12:17:12.507011 (+629023us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:12.507071 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.507176 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.085284 (+578108us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:13.110926 (+ 25642us) raft_consensus.cc:1685] finished
0709 12:17:13.110959 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.111279 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3416,"raft.queue_time_us":7685,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":3791,"spinlock_wait_cycles":7198592,"thread_start_us":604456,"threads_started":1,"wal-append.queue_time_us":759369}
I20260709 12:17:13.112313 26289 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:13.116209 26129 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:13.089089 26387 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:13.118749 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:13.119702 26387 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:13.120500 26387 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.121068 26387 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:13.119776 26075 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:13.123451 26075 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:13.103446 26156 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:13.122982 26341 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:17:13.037511 26285 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:13.126078 26341 consensus_queue.cc:1243] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:13.126297 22749 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:13.126951 26341 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:13.127488 22749 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:13.127764 26341 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:13.126037 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:13.124473 26075 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:13.114323 26313 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:13.062915 26337 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:13.096467 26352 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:13.119781 26289 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:13.102878 26030 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:13.133428 26156 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:17:13.166154 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 133884us
I20260709 12:17:13.153457 26289 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.155354 26075 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:13.146087 26227 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:13.131740 26355 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:13.157354 26391 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:13.170075 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:13.151309 25922 consensus_queue.cc:1175] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" responder_term: 7 status { last_received { term: 6 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:13.129123 26341 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:13.151063 26361 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:13.170552 26289 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:13.192283 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:13.199440 22895 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:13.178009 26387 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:13.200058 26341 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:13.178375 26391 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:13.225764 26391 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:13.178596 26030 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:13.210306 26353 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:13.243351 26030 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:13.248168 26355 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:13.250195 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 644) took 1304 ms. Trace:
I20260709 12:17:13.211704 26397 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:17:13.254652 26382 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.255162 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:13.233632 22749 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:13.255944 26353 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:13.256453 26129 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:13.256608 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 238918us
I20260709 12:17:13.257087 25994 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.257236 25718 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:13.257826 26282 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.258351 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:13.253326 26361 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:13.254271 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.300098 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:13.256551 26215 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:13.265661 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 48766us
I20260709 12:17:13.307621 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:13.308713 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.308585 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:13.264788 22750 rpcz_store.cc:276] 0709 12:17:11.944969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.945503 (+   534us) service_pool.cc:224] Handling call
0709 12:17:11.959413 (+ 13910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.959689 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:12.032055 (+ 72366us) log.cc:844] Serialized 14 byte log entry
0709 12:17:12.234858 (+202803us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18001d8f00. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:13.022748 (+787890us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b18001d8f00. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf1694a40 00007fadf168f4e4 00007fadf168f455 00007fadf81773c7 00007fadf47899a7 00007fadf47990bf 00007fadf4799038
0709 12:17:13.027541 (+  4793us) log.cc:844] Serialized 14 byte log entry
0709 12:17:13.233231 (+205690us) log.cc:844] Serialized 14 byte log entry
0709 12:17:13.234528 (+  1297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:13.234647 (+   119us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:13.234846 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.234980 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.249547 (+ 14567us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":833725,"prepare.queue_time_us":1089124,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":1563,"raft.queue_time_us":67539,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":6320,"spinlock_wait_cycles":18243712,"thread_start_us":199321,"threads_started":1}
I20260709 12:17:13.282730 23689 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:13.289152 22897 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:13.296339 23656 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:13.296396 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.297170 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.311794 22898 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:13.311841 23682 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:13.293915 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:13.265278 22824 raft_consensus.cc:2368] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11.
W20260709 12:17:13.301748 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.303251 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:13.303431 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:13.314424 23674 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:13.304174 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.305222 22893 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:13.305599 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:13.316035 22894 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:13.251763 26377 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:13.316289 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:13.319064 22826 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:13.321383 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:13.302209 25994 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:13.323118 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:13.323438 25922 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:13.298571 26298 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:13.324072 25922 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:13.325809 26298 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:13.327006 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.328320 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.328562 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.325204 25922 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:13.317708 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:13.331883 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.334189 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:13.335500 22895 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:13.339819 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.340476 23659 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:13.348914 22894 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:17:13.352540 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.357342 22900 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:13.359323 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.342432 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.360949 22893 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:13.360991 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:13.339509 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:13.362767 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:13.361645 23685 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:13.364856 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.365038 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:13.365497 23656 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:13.319381 26337 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:13.371829 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:13.361582 26261 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:17:13.374385 26261 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:13.294680 26382 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:13.374866 26261 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:13.376085 26261 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:13.376894 26382 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:13.362006 26332 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:17:13.378716 26404 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:17:13.379530 26332 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:13.379992 26332 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:13.381086 26332 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:13.382207 26377 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:13.300269 26353 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:17:13.366918 26064 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:13.365154 26340 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:17:13.388661 26340 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:13.389061 26340 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:13.390038 26340 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:13.391197 26337 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:13.391649 26337 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:13.298266 26129 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:13.399528 26407 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:17:13.372099 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 50798.1us
I20260709 12:17:13.401607 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:13.377753 26261 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:13.404299 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:13.404784 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:13.303952 25718 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:13.420858 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.308060 26282 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:13.412197 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:13.422816 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.412410 26129 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:13.414147 26075 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.415974 23659 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:13.430835 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.431618 23695 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:13.435858 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:13.409687 22818 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:13.382556 26332 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:13.369765 25991 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:13.440779 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.412230 26397 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:13.441768 23656 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:13.445794 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:13.452430 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48196.4us
I20260709 12:17:13.452656 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.453585 23659 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:13.457243 22897 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:17:13.458586 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.461887 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:13.463842 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.433423 26399 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:13.433089 26340 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:13.468735 22823 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:13.460430 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:13.440655 26391 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:13.477089 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:13.476094 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:13.440749 26129 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:13.417749 26407 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:17:13.415974 26313 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:13.432192 26289 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:13.580142 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:13.482932 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:13.552534 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.557049 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.546227 22746 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:13.590240 26129 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:13.554514 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:13.497978 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:13.701936 22900 raft_consensus.cc:2368] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8.
I20260709 12:17:13.703169 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.703884 22900 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
W20260709 12:17:13.585490 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.571270 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:13.467348 26405 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:17:13.543932 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:13.707091 22819 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: []
W20260709 12:17:13.531291 26390 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:17:13.496256 26387 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:17:13.580948 22747 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:13.536885 26282 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:13.532963 26377 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:13.573923 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:13.716777 22827 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:13.580327 26371 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.565s	user 0.001s	sys 0.002s
I20260709 12:17:13.587975 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:13.597069 23674 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:13.535725 25994 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:13.599411 23682 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:13.572301 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.543293 26274 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:13.588675 26153 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:13.732277 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.433832 26075 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:13.733546 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.540104 25718 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:13.476104 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:13.447911 26358 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:13.481279 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:13.471588 26373 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.458s	user 0.000s	sys 0.003s
I20260709 12:17:13.464059 26156 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:13.623665 22897 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:13.564114 23695 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:13.464857 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:13.628500 26289 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:13.629396 22820 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:17:13.739656 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.557015 26337 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:13.482064 22864 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:13.784096 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 302077us
I20260709 12:17:13.695794 26391 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:13.685091 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 224727us
I20260709 12:17:13.545477 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:13.789582 22825 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 8: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:13.463071 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:13.536224 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:13.624068 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:13.790899 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 166902us
I20260709 12:17:13.705647 22892 raft_consensus.cc:2410] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:13.791227 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:13.690938 26215 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:17:13.715497 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 236948us
I20260709 12:17:13.724102 23689 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:13.725540 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:13.727588 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.728811 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:13.796170 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:13.797163 23685 raft_consensus.cc:2410] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:17:13.733438 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.799122 23674 raft_consensus.cc:2410] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:17:13.563938 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:13.730886 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:13.800031 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 69292.9us
I20260709 12:17:13.800581 22894 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 9. Ops: [7.5-7.5]
W20260709 12:17:13.800941 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.746693 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:13.777258 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46056.5us
I20260709 12:17:13.779608 26397 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:17:13.779630 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:13.735800 26341 consensus_meta.cc:287] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.001s
I20260709 12:17:13.738575 26153 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:13.447590 25991 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:13.708364 23679 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:13.815269 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:13.815968 22824 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:13.816694 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:13.817171 22893 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:13.817407 22744 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:13.724020 26332 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:13.793545 22897 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:17:13.724992 26359 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:13.820914 25991 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:13.821007 26359 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:13.821625 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:13.822927 26083 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.728439 26274 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:13.835947 26274 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:13.836932 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:13.837137 26274 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:13.838896 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:13.839607 26416 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:13.840163 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:13.734747 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:13.840863 22751 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:13.841213 22827 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:13.841513 26416 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:13.842139 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:13.785534 26405 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:17:13.842571 26419 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:13.778667 26358 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:13.843421 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:13.844475 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:13.844657 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:13.844506 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 641) took 1537 ms. Trace:
I20260709 12:17:13.845582 22899 rpcz_store.cc:276] 0709 12:17:12.307188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.349889 (+ 42701us) service_pool.cc:224] Handling call
0709 12:17:12.370911 (+ 21022us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:12.384819 (+ 13908us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:12.544161 (+159342us) log.cc:844] Serialized 14 byte log entry
0709 12:17:13.144919 (+600758us) log.cc:844] Serialized 14 byte log entry
0709 12:17:13.259078 (+114159us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:13.259618 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 12:17:13.259761 (+   143us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:13.259988 (+   227us) log.cc:844] Serialized 14 byte log entry
0709 12:17:13.260171 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.260245 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.579499 (+319254us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:13.844271 (+264772us) raft_consensus.cc:1685] finished
0709 12:17:13.844295 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.844444 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113911,"prepare.queue_time_us":268880,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":1385,"raft.queue_time_us":689490,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":5344,"spinlock_wait_cycles":6803328,"thread_start_us":676144,"threads_started":3,"wal-append.queue_time_us":326691}
I20260709 12:17:13.803730 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:13.804456 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.840867 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:13.798241 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:13.811045 22894 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:17:13.801610 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:13.808044 26289 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:13.813902 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:13.851987 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 50447.4us
I20260709 12:17:13.777159 25978 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:13.817803 22745 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:13.785223 26337 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:13.785331 26379 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:13.822681 22750 raft_consensus.cc:2410] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:17:13.795017 25718 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:13.820812 22897 pending_rounds.cc:85] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 4
I20260709 12:17:13.858271 22897 pending_rounds.cc:107] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:17:13.858889 22897 raft_consensus.cc:2889] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:13.805347 22895 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:13.839862 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:13.859242 22893 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 12:17:13.811038 26382 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:13.794826 26215 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:13.809796 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.793658 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:13.814713 22748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:42834
I20260709 12:17:13.876072 22748 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:13.876217 23672 raft_consensus.cc:2410] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:17:13.876500 22748 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:13.854291 22745 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:13.858349 22827 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:13.877307 22751 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
W20260709 12:17:13.839103 26409 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.297s	user 0.003s	sys 0.001s
I20260709 12:17:13.739908 26116 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:17:13.833968 26401 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:13.886721 22824 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:13.866216 22744 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:13.807732 26397 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:13.856047 26395 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:13.849841 22820 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:13.879118 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 855) took 1519 ms. Trace:
W20260709 12:17:13.880196 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 82059.1us
I20260709 12:17:13.922602 22901 rpcz_store.cc:276] 0709 12:17:12.360300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.360512 (+   212us) service_pool.cc:224] Handling call
0709 12:17:12.382913 (+ 22401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:12.540630 (+157717us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:12.540661 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:12.574618 (+ 33957us) log.cc:844] Serialized 26 byte log entry
0709 12:17:12.761271 (+186653us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:12.761330 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.761430 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.470903 (+709473us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:13.866757 (+395854us) raft_consensus.cc:1685] finished
0709 12:17:13.866804 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.879059 (+ 12255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3187,"raft.queue_time_us":69319,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8475,"spinlock_wait_cycles":3913472,"thread_start_us":282267,"threads_started":2,"wal-append.queue_time_us":306732}
I20260709 12:17:13.848392 26332 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:13.824188 26407 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:13.883661 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:13.864768 23656 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:13.872831 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:13.943069 23674 raft_consensus.cc:2410] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:13.811343 26387 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:17:13.808367 26269 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:17:13.949999 23656 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:13.903491 22748 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:13.905507 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.857519 26289 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.811206 26399 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:17:13.868551 25718 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.919615 23695 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:13.867686 26129 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:13.963277 23682 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:13.881835 26313 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:13.880163 26215 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:13.929837 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:13.931475 22823 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:13.932768 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:13.981241 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 51520.9us
I20260709 12:17:13.880704 22895 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:13.982316 26422 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:13.879438 26359 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:13.886894 26314 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:13.944670 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:13.999513 22750 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:13.976889 23689 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:14.005122 25976 raft_consensus.cc:3055] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:14.005630 25976 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:13.866817 26083 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:14.009210 26083 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:14.012346 26153 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:14.012713 22750 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:13.984711 26129 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.013804 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:14.013959 26129 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:14.016384 26129 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:14.016783 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:14.019790 22750 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:13.979176 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.020866 22899 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:14.021075 26391 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:13.955201 26407 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:13.984123 22820 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:14.024852 26407 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:14.025831 26358 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:14.026242 22750 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:14.026469 26397 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:14.028210 26397 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:14.033753 22894 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:13.984359 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 150643us
I20260709 12:17:13.907928 26401 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:13.959811 25718 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:13.996438 26332 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:13.955883 26289 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:13.999354 26314 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:13.948575 26412 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.407s	user 0.003s	sys 0.003s
W20260709 12:17:14.043505 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 247402us
W20260709 12:17:14.061446 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 79242.3us
I20260709 12:17:14.039717 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:14.075212 23682 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:14.078058 22717 leader_election.cc:400] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11.
I20260709 12:17:14.051247 26075 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:14.057770 26314 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:14.081224 22899 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:14.090039 22717 leader_election.cc:403] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:17:14.064435 26379 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:14.076748 26391 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:17:14.080672 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:14.006706 25976 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:14.064709 25978 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:14.131582 25978 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:14.088867 26332 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:17:14.133149 26332 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:14.081082 26387 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:17:14.133531 26399 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11.
I20260709 12:17:14.134068 26387 consensus_queue.cc:1243] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:14.119225 25976 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:14.120038 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:14.121018 22819 raft_consensus.cc:2410] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:17:14.123914 26411 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.582s	user 0.004s	sys 0.000s
I20260709 12:17:14.126413 26379 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:14.127513 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:14.139693 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 61751.7us
I20260709 12:17:14.143699 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:14.146998 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:14.135756 26116 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.149457 26116 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:14.155885 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:14.156761 23679 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:14.096752 26422 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:14.161666 26116 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:14.163115 26422 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:14.163506 26215 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:14.165689 26215 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:14.165740 23689 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:17:14.166266 23689 pending_rounds.cc:85] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 5
I20260709 12:17:14.153998 26289 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:14.161713 22751 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:14.128530 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:14.168560 22749 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:14.170198 22749 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:17:14.170532 22749 pending_rounds.cc:85] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 4
I20260709 12:17:14.129560 22899 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:14.170585 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:14.133563 26332 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:14.171847 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.130066 26274 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:14.173256 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:14.173990 22818 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:14.109884 26401 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:14.173256 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.176610 22899 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 11: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:17:14.176925 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.177556 22749 pending_rounds.cc:107] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:17:14.166651 23689 pending_rounds.cc:107] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:17:14.172600 26332 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:14.177904 22749 raft_consensus.cc:2889] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:14.182282 25718 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:14.182046 26274 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:14.183362 22752 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:14.127942 25991 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:14.189023 22747 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:17:14.195163 22752 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:14.178287 23689 raft_consensus.cc:2889] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:14.196848 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.199661 23656 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: [5.4-9.6]
I20260709 12:17:14.204048 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.205009 22899 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:14.201678 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:14.167539 26419 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:14.210374 23672 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:14.209767 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:14.215165 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:14.216977 23656 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:14.219810 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:14.220779 23689 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:14.223371 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:14.210923 23493 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.206205 26332 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:14.233898 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:14.234228 23695 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:14.237608 23656 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:14.191850 26314 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:14.243371 26314 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:14.244346 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.253328 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:14.254310 22747 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:14.219977 26289 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:14.247484 26358 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:14.273147 22747 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:14.270473 26314 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:17:14.284068 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 91246.2us
W20260709 12:17:14.285008 22717 leader_election.cc:336] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.058s (SENT)
I20260709 12:17:14.286871 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:14.286098 23493 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:14.275849 26116 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 12:17:14.291464 26431 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
I20260709 12:17:14.277709 26306 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:17:14.277323 26430 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:14.311002 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:14.313855 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.302723 23679 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:14.275938 26314 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.316221 22901 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:14.307226 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:14.306769 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.291476 26064 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:17:14.320063 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.320061 26064 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:14.326103 26408 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.791s	user 0.007s	sys 0.000s
I20260709 12:17:14.325986 26064 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:14.305876 22747 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:14.329578 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:14.330535 22894 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:14.335707 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46706.5us
I20260709 12:17:14.331903 26314 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:14.305998 26422 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:14.362563 26289 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.371134 26274 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:14.339367 22895 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:14.403578 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1331) took 1026 ms. Trace:
I20260709 12:17:14.370395 22747 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:14.414232 26364 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:14.415729 23689 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:14.427171 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:14.413601 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 106467us
W20260709 12:17:14.419129 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 134134us
I20260709 12:17:14.413440 23682 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:14.420661 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:14.426514 26364 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:14.424541 22892 rpcz_store.cc:276] 0709 12:17:13.377456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.811717 (+434261us) service_pool.cc:224] Handling call
0709 12:17:13.833642 (+ 21925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.850924 (+ 17282us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:13.985005 (+134081us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.064235 (+ 79230us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.387646 (+323411us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b180017f020. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf1694a40 00007fadf168f4e4 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287 00007fadf479a208
0709 12:17:14.403059 (+ 15413us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:14.403138 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:14.403207 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.403295 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:14.403494 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":337905,"prepare.queue_time_us":130063,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":2730,"raft.queue_time_us":342926,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":10289,"spinlock_wait_cycles":4187904,"thread_start_us":177893,"threads_started":2,"wal-append.queue_time_us":216866}
I20260709 12:17:14.335948 26064 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:14.419198 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.384243 22894 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:14.422420 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1332) took 1044 ms. Trace:
W20260709 12:17:14.421591 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.422926 23685 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:14.333463 25978 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:14.445000 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.375100 25718 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:14.338485 26306 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.121s
I20260709 12:17:14.361397 26419 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.460812 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:14.469497 22897 raft_consensus.cc:2368] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11.
I20260709 12:17:14.464570 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:14.470857 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.472088 22717 leader_election.cc:400] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8.
I20260709 12:17:14.472249 22897 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 12: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:14.449429 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.449445 22896 rpcz_store.cc:276] 0709 12:17:13.377728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.818218 (+440490us) service_pool.cc:224] Handling call
0709 12:17:13.851226 (+ 33008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.851428 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:14.050980 (+199552us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.421838 (+370858us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.422052 (+   214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:14.422102 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:14.422151 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.422222 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:14.422354 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176216,"prepare.queue_time_us":129994,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":144328,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":167,"thread_start_us":329554,"threads_started":2,"wal-append.queue_time_us":303527}
I20260709 12:17:14.465515 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:14.463488 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.401170 25991 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:14.460398 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:14.475282 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:14.472854 22717 leader_election.cc:403] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:17:14.474498 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.421855 26422 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.483968 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.474315 22892 raft_consensus.cc:2376] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7. Re-sending same reply.
I20260709 12:17:14.481132 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.482736 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.448477 26379 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:14.461923 26261 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:14.492623 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.487108 26395 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:14.496266 22896 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:14.465554 26129 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.422444 26289 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:14.484650 25976 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:14.484951 26377 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:14.509824 22892 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:14.488544 26422 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:14.462972 26282 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:17:14.488027 26401 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8.
I20260709 12:17:14.488880 26361 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:14.510198 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:14.484582 26430 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:14.525650 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:14.512578 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.484874 26419 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:14.526831 26361 raft_consensus.cc:3055] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:14.518951 26364 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:14.527464 26361 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:14.528374 26419 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:14.529080 26419 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:14.524492 26433 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:17:14.528565 26361 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:14.531746 26395 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:14.532447 26395 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:14.532827 22748 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:14.532835 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44942.2us
W20260709 12:17:14.535508 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.532657 26361 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:14.533408 26395 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:14.539319 22825 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:14.534461 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 542) took 1202 ms. Trace:
I20260709 12:17:14.534539 25978 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:14.535365 26419 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:14.543154 22818 rpcz_store.cc:276] 0709 12:17:13.332105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.445623 (+113518us) service_pool.cc:224] Handling call
0709 12:17:14.534228 (+1088605us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54001261d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:14.534367 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891361536}
I20260709 12:17:14.544036 26261 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:14.544677 26261 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:14.545487 26274 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:14.546227 26274 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:14.512993 26353 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.014s	sys 0.037s
I20260709 12:17:14.549115 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:14.551235 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:14.551787 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:14.553570 22823 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:14.555709 22821 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
W20260709 12:17:14.527384 26441 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:17:14.557772 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:14.508989 26129 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:14.463318 26378 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:17:14.560876 26030 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.567726 26030 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:14.570088 26030 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:14.559428 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:14.572027 22822 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:14.573189 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:14.564771 26407 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:17:14.574348 22822 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:14.559561 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:14.574687 26444 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
I20260709 12:17:14.575264 26424 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:14.575749 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:14.576387 26443 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:14.577010 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:14.561290 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.562064 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.549994 26391 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:14.565809 23660 raft_consensus.cc:2410] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:17:14.558395 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:14.551561 26430 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:14.582966 26424 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:14.551816 26353 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.014s	sys 0.037s
I20260709 12:17:14.578414 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:14.595712 22865 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.599498 22826 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:14.607175 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:14.607520 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 817) took 1175 ms. Trace:
I20260709 12:17:14.564855 25978 consensus_queue.cc:1243] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:14.603607 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.606710 26379 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:14.608664 23659 rpcz_store.cc:276] 0709 12:17:13.432253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.454222 (+ 21969us) service_pool.cc:224] Handling call
0709 12:17:13.476833 (+ 22611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.847043 (+370210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.847073 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:13.847137 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:13.847167 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.607257 (+760090us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400462b54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:14.607314 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:14.607460 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850920704}
I20260709 12:17:14.622817 22822 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:17:14.625072 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 59101.2us
I20260709 12:17:14.625792 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:14.627619 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:14.628683 22826 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:14.629364 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:14.630162 26353 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:14.630822 26453 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:14.633319 26261 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:14.587492 26391 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.635727 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:14.564515 26282 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:17:14.647262 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:14.588565 26419 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:17:14.608958 26378 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:17:14.677008 26440 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
W20260709 12:17:14.680089 26434 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.255s	user 0.002s	sys 0.000s
I20260709 12:17:14.682237 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 656) took 1084 ms. Trace:
I20260709 12:17:14.682587 22893 rpcz_store.cc:276] 0709 12:17:13.597957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.880486 (+282529us) service_pool.cc:224] Handling call
0709 12:17:13.908056 (+ 27570us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:17:13.919436 (+ 11380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.919496 (+    60us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:17:14.123303 (+203807us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b2c001e6a18. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:17:14.124169 (+   866us) log.cc:844] Serialized 78 byte log entry
0709 12:17:14.278143 (+153974us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:14.290336 (+ 12193us) log.cc:844] Serialized 14 byte log entry
0709 12:17:14.423182 (+132846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.423258 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:14.679365 (+256107us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:14.681984 (+  2619us) raft_consensus.cc:1685] finished
0709 12:17:14.682010 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:14.682179 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132545,"prepare.queue_time_us":21274,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":73,"raft.queue_time_us":135741,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":20348,"spinlock_wait_cycles":49817856,"thread_start_us":152182,"threads_started":1,"wal-append.queue_time_us":259895}
I20260709 12:17:14.687851 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:14.645568 26083 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:14.636940 26391 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:14.637369 25976 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:14.695132 22824 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
W20260709 12:17:14.697952 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 66933.5us
W20260709 12:17:14.667724 26446 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:17:14.604303 26377 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:17:14.659999 26397 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:14.688539 26379 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:14.605899 26424 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:14.618400 25718 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:17:14.688807 26382 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.638960 25978 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:17:14.668591 26289 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:14.710129 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.652070 26359 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:17:14.697292 26215 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:14.705011 26448 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:17:14.701273 26083 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.706095 26401 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:17:14.723574 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.714316 26419 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.010s
W20260709 12:17:14.735790 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 174987us
I20260709 12:17:14.737025 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:14.737993 22748 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:14.696043 26387 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 12:17:14.727953 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.732721 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:14.738909 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.736999 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.718175 26379 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:14.750659 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:14.724843 26083 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:14.753659 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:14.751619 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:14.750707 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:14.766534 23695 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:14.688194 26430 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:14.752859 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 971) took 1175 ms. Trace:
I20260709 12:17:14.735026 26401 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:14.754076 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 659) took 1155 ms. Trace:
I20260709 12:17:14.756983 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:14.775027 22900 rpcz_store.cc:276] 0709 12:17:13.598652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.935868 (+337216us) service_pool.cc:224] Handling call
0709 12:17:13.953891 (+ 18023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.661516 (+707625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.661564 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:14.661636 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:14.661684 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.753749 (+ 92065us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54006eb254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:14.753818 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:14.753997 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626666880}
I20260709 12:17:14.768898 22819 rpcz_store.cc:276] 0709 12:17:13.577565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.727169 (+149604us) service_pool.cc:224] Handling call
0709 12:17:14.752505 (+1025336us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54005d9154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:14.752763 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":731459968}
I20260709 12:17:14.760703 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:14.777724 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 142045us
I20260709 12:17:14.749734 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:14.712970 26075 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:17:14.742667 26306 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.726188 26358 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:17:14.780581 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 43763.3us
I20260709 12:17:14.791191 26364 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:14.793102 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:14.794315 26282 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:14.795164 26377 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:14.798833 26261 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:14.748911 26340 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:14.805025 22790 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:14.725404 26215 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:14.781144 26401 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:14.718928 26382 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:14.846000 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50935.2us
I20260709 12:17:14.809058 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:14.849237 22893 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
I20260709 12:17:14.849707 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:14.852718 22898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 654) took 1551 ms (client timeout 1934 ms). Trace:
I20260709 12:17:14.821775 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.804983 26452 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:14.855537 26452 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:14.860728 23695 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
W20260709 12:17:14.853302 22898 rpcz_store.cc:269] 0709 12:17:13.301015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.333753 (+ 32738us) service_pool.cc:224] Handling call
0709 12:17:14.852437 (+1518684us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002fec54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:14.852621 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2525208960}
I20260709 12:17:14.858566 26452 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:14.867223 26452 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:14.867974 26452 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:14.758040 26416 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:17:14.874408 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 973) took 1295 ms. Trace:
I20260709 12:17:14.874961 22825 rpcz_store.cc:276] 0709 12:17:13.578964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.848729 (+269765us) service_pool.cc:224] Handling call
0709 12:17:14.539123 (+690394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.539787 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.874150 (+334363us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54001261d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:14.874334 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586894080}
I20260709 12:17:14.788019 26455 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:17:14.805933 26454 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:17:14.880434 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 75536.4us
I20260709 12:17:14.779619 26129 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:14.886750 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 93754.7us
I20260709 12:17:14.891532 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:14.888212 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:14.869271 26452 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:14.809121 26399 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:17:14.888734 26359 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:14.918679 26289 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:14.884212 26466 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:14.907497 26129 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:14.906482 26416 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:14.915206 26455 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:14.837837 26306 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:15.000566 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 178945us
I20260709 12:17:15.014647 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:14.881172 26340 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:14.910745 26470 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:17:15.012342 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 111208us
I20260709 12:17:15.016163 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:15.019327 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:15.022974 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 122007us
I20260709 12:17:14.946964 26359 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:17:14.959519 26451 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:17:15.027532 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.030309 22753 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:14.993114 26378 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:15.033447 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:15.034914 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:15.021435 26447 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 12:17:15.050344 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.052336 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.058501 23659 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:15.059839 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:15.060738 22750 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:15.007324 26463 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:14.959659 26471 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:17:15.022818 26466 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:15.011669 26289 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:15.051070 26377 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:15.041805 26424 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:15.030030 26455 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.089883 22753 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:17:15.036929 26470 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:14.932322 26379 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:15.081658 26462 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.261s	user 0.000s	sys 0.002s
I20260709 12:17:15.109359 26282 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:15.015578 26416 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.114773 26306 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:15.119591 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 269950us
I20260709 12:17:15.159327 22717 leader_election.cc:400] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11.
W20260709 12:17:15.160117 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 410460us
I20260709 12:17:15.104815 26358 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:15.183099 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:15.125209 26285 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:15.109900 26364 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:15.196657 22750 raft_consensus.cc:2410] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
W20260709 12:17:15.160912 26451 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:17:15.156641 26447 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:17:15.210278 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:15.214804 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:15.183840 26358 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:15.161528 26471 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:17:15.207908 26064 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.743s	user 0.013s	sys 0.001s
W20260709 12:17:15.227001 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 185605us
W20260709 12:17:15.228760 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 206472us
I20260709 12:17:15.236706 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:15.251169 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:15.206141 26382 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:15.208731 26215 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:15.252300 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 494532us
I20260709 12:17:15.120048 26359 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.220013 26030 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:15.220191 25994 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:15.256147 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:15.268564 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:15.273458 22895 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:15.219820 26116 raft_consensus.cc:2764] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:17:15.262874 26470 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.289143 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:15.225621 26471 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:15.157119 26455 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.220801 26282 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:17:15.261209 26361 consensus_meta.cc:287] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.001s
I20260709 12:17:15.284025 23660 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:17:15.351524 22750 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:15.350415 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:15.275569 26083 consensus_meta.cc:287] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.004s
I20260709 12:17:15.356227 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:15.266880 26449 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.330s	user 0.002s	sys 0.000s
I20260709 12:17:15.266222 26453 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:15.231307 26332 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 12:17:15.364216 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 340591us
I20260709 12:17:15.364420 23682 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:17:15.358120 22896 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:17:15.364475 23685 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:17:15.212899 26285 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:15.227890 26261 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:17:15.366570 22895 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:15.367431 23674 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:15.367625 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:15.368572 22898 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:15.266571 26465 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.266834 26479 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.371251 22893 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:15.371479 26340 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:15.284132 26477 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:17:15.403340 26422 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.877s	user 0.015s	sys 0.000s
I20260709 12:17:15.290242 26457 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.277s
I20260709 12:17:15.368862 26487 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.429687 26487 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.430500 26422 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:15.433178 26487 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:15.433851 26422 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:15.370208 26215 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:15.373467 26083 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:15.434851 26215 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:15.421671 26285 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:15.435931 26215 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.436820 26083 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:15.438293 26274 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:15.409752 26314 consensus_meta.cc:287] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.988s	user 0.014s	sys 0.000s
I20260709 12:17:15.439111 26314 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:15.440613 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.441403 26314 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:15.249607 26289 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.442487 22899 raft_consensus.cc:2368] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9.
I20260709 12:17:15.443239 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.444342 22750 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:15.445549 23679 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:17:15.410923 23682 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:15.446245 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.224747 26466 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.271634 26378 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:17:15.401921 26471 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:15.413139 26465 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.413894 26477 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.419051 26479 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:15.424094 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.425233 22892 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:15.445446 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.372138 26359 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:15.459249 22749 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:15.470584 26493 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.462677 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:15.403679 26453 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:15.451849 26486 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:15.452581 26471 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:15.412231 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:15.492452 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 80295.5us
I20260709 12:17:15.448125 26427 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:15.493561 22892 raft_consensus.cc:2410] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:17:15.460573 22823 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:15.484028 23689 raft_consensus.cc:2393] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:15.456122 26416 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:15.459661 26480 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:17:15.498474 22819 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:15.495427 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:15.459360 26477 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:15.499558 22822 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:15.496176 26378 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:15.496352 26427 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:17:15.526968 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 270866us
I20260709 12:17:15.528286 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:17:15.524518 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 167644us
I20260709 12:17:15.533151 26427 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.531514 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:15.536083 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:15.539865 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:15.545553 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 52327us
I20260709 12:17:15.547972 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:15.483083 26493 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:15.549932 26391 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.840s	user 0.004s	sys 0.008s
I20260709 12:17:15.551923 26391 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:15.544073 26453 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.559497 22744 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 12:17:15.554662 26129 consensus_meta.cc:287] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.001s
I20260709 12:17:15.560727 26129 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:15.552794 26401 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.668s	user 0.006s	sys 0.006s
I20260709 12:17:15.553463 26493 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:15.554658 26465 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:15.555238 26490 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:15.555860 26455 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:15.496734 26486 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.555259 26479 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:15.557839 26379 consensus_queue.cc:1059] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:15.540031 26427 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:15.599149 26401 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:15.616729 26478 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:15.618335 26490 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:15.618832 26490 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:15.620049 26490 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.621527 26490 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:15.585604 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:15.543892 26473 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:15.597519 26129 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.587167 26378 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:15.588403 26382 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:17:15.618680 26401 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:15.611435 26484 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:17:15.536352 26274 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:15.589970 26466 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:15.630620 26486 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:15.624043 26282 raft_consensus.cc:3055] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:15.627619 26391 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:15.633385 26282 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:15.650377 26395 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:15.651010 26395 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:15.651935 26395 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.631551 26129 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.665663 26395 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:15.665827 26358 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.670444 26477 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:15.692214 26474 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 12:17:15.693419 25991 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:15.693890 25991 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:15.694895 25991 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.696408 25991 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:15.690339 26486 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.701814 26459 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:17:15.701936 26500 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:17:15.702342 26459 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:15.703294 26459 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.704329 26459 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:15.704357 26419 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:15.704994 26419 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:15.705859 26419 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:15.707473 26399 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.707574 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:15.708262 26399 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.709705 26477 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:15.679284 26465 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.713187 26419 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:15.714928 26485 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.715590 26460 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:15.715862 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 555576us
I20260709 12:17:15.700460 22745 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:15.721588 22821 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:17:15.722084 22821 pending_rounds.cc:85] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 5
I20260709 12:17:15.722662 22821 pending_rounds.cc:107] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:17:15.722049 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:15.722995 22821 raft_consensus.cc:2889] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:15.723013 22827 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:15.711664 26399 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:15.710927 26486 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:15.735589 26468 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.737s	user 0.002s	sys 0.000s
I20260709 12:17:15.737987 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 831) took 1003 ms. Trace:
I20260709 12:17:15.738492 23656 rpcz_store.cc:276] 0709 12:17:14.735028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.735197 (+   169us) service_pool.cc:224] Handling call
0709 12:17:14.735562 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.806402 (+ 70840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.806454 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:14.838712 (+ 32258us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.103913 (+265201us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:15.103971 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.737494 (+633523us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b540028fd54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:15.737553 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.737608 (+    55us) raft_consensus.cc:1685] finished
0709 12:17:15.737623 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.737907 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":824,"raft.queue_time_us":72913,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":159815424,"thread_start_us":205838,"threads_started":1,"wal-append.queue_time_us":375334}
I20260709 12:17:15.743033 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:15.743759 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.743419 22790 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:15.744302 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.682648 26282 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.745941 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:15.746994 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.750044 22751 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:15.723085 26460 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:15.750635 26483 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:15.747519 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.751701 22747 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:15.752379 26460 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:15.748273 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.752664 26481 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:15.753255 26378 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:15.754587 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:15.744453 26391 raft_consensus.cc:2764] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:17:15.757416 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.763561 26481 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:15.764065 22750 raft_consensus.cc:2410] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:15.764434 26391 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.765214 26391 consensus_queue.cc:1243] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:15.766534 26391 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:15.768007 26483 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:15.768450 26483 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:15.720927 26465 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:15.770838 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:15.771503 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.769521 26483 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:15.779498 26483 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:15.782280 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 684) took 1191 ms. Trace:
I20260709 12:17:15.782764 22744 rpcz_store.cc:276] 0709 12:17:14.591269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.591418 (+   149us) service_pool.cc:224] Handling call
0709 12:17:14.591840 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:15.559925 (+968085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.781923 (+221998us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54004042d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:15.782204 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2224695040}
I20260709 12:17:15.785333 26486 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:15.723155 26485 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:15.776352 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.786916 26129 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:15.787253 26379 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:15.787881 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:15.789233 26482 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:15.789848 26482 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.790202 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:15.777233 26382 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:15.792374 26482 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:15.792506 26378 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:15.793131 26378 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:15.794085 26378 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:15.794981 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 852) took 1062 ms. Trace:
I20260709 12:17:15.795625 26378 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:15.749883 26477 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:17:15.755308 26490 consensus_queue.cc:1059] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:17:15.795639 23659 rpcz_store.cc:276] 0709 12:17:14.732752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.739365 (+  6613us) service_pool.cc:224] Handling call
0709 12:17:14.757681 (+ 18316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.059187 (+301506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.794621 (+735434us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540059d8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:15.794900 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643891584}
I20260709 12:17:15.803064 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 683) took 1222 ms. Trace:
I20260709 12:17:15.813783 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:15.787931 26379 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:15.815698 22895 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:15.816457 26379 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.811358 22752 rpcz_store.cc:276] 0709 12:17:14.580854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.600678 (+ 19824us) service_pool.cc:224] Handling call
0709 12:17:14.601087 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.601462 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:14.601495 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:14.606918 (+  5423us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.719814 (+1112896us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b180030b980. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:17:15.743746 (+ 23932us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:15.743819 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.743904 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.802647 (+ 58743us) raft_consensus.cc:1685] finished
0709 12:17:15.802677 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.802971 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29350,"raft.queue_time_us":7287,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":15630,"spinlock_wait_cycles":2392448,"thread_start_us":11873,"threads_started":1,"wal-append.queue_time_us":1193827}
I20260709 12:17:15.808456 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 689) took 1075 ms. Trace:
I20260709 12:17:15.792608 26465 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:15.820359 26358 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:15.823356 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:15.824440 25991 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.825207 25991 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:15.826242 26064 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:15.827237 26332 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.828028 26332 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.850556 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:15.853430 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:15.854450 22895 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:15.856849 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:15.858752 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:15.866501 22895 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:15.867518 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:15.869143 22894 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:15.820057 22746 rpcz_store.cc:276] 0709 12:17:14.733179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.736320 (+  3141us) service_pool.cc:224] Handling call
0709 12:17:14.752554 (+ 16234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.793284 (+ 40730us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:14.794018 (+   734us) log.cc:844] Serialized 14 byte log entry
0709 12:17:15.685159 (+891141us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b180010ea60. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf865358f 00007fadf1692571 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd
0709 12:17:15.735662 (+ 50503us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b180010ea60. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:15.805713 (+ 70051us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b180010ea60. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287
0709 12:17:15.805862 (+   149us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:15.806429 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.806615 (+   186us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:15.806650 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.806723 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.808154 (+  1431us) raft_consensus.cc:1685] finished
0709 12:17:15.808185 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.808368 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79535,"prepare.queue_time_us":183,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":953239,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":26464,"spinlock_wait_cycles":95562112,"thread_start_us":193406,"threads_started":3,"wal-append.queue_time_us":146771}
I20260709 12:17:15.882210 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:15.889477 23659 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:15.891556 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:15.892520 23689 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:15.899928 22752 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:15.901242 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:15.902690 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:15.850046 26379 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:15.901964 22899 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:15.873471 26395 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:15.883643 26430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.012s	sys 0.000s
I20260709 12:17:15.872689 26358 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:15.918382 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:15.913983 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 123852us
I20260709 12:17:15.919266 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.919878 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:15.920852 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:15.921433 22750 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:15.873103 26477 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:15.919303 22744 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:15.876730 26129 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:15.928453 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.925753 22749 raft_consensus.cc:2410] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:17:15.915611 26430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.013s	sys 0.000s
I20260709 12:17:15.929144 22746 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:15.827203 26064 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.905400 26361 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:15.912694 26460 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:15.943286 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:15.944303 22900 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:17:15.944208 22744 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:15.926376 26401 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:15.932621 26129 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.920406 26332 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:15.948546 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:15.933166 26477 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.956128 22899 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:15.949795 22753 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:15.946247 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:15.957610 26477 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:15.958166 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:15.959017 26460 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:15.959159 26419 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.959553 26460 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:15.960001 26460 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:15.959709 26419 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.960186 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:15.958698 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:15.962057 26419 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:15.950809 23689 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:15.963204 26419 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:15.959025 26495 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:17:15.964102 26419 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:15.953245 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:15.924957 26358 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:15.965185 26419 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:15.965911 26358 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:15.966501 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:15.968004 22717 leader_election.cc:400] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9.
I20260709 12:17:15.968919 26489 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:15.969197 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:15.965745 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:15.970922 22750 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:15.977401 23659 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:15.940929 26306 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.979846 26306 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:15.937991 26464 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:15.981622 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.949316 26361 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:15.982386 26306 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:15.984256 26361 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:15.987406 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:15.988806 22892 raft_consensus.cc:2410] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:17:15.993661 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:15.973296 26129 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:15.976787 25991 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:15.955089 26401 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:16.000041 26401 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:16.006107 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:16.007483 22746 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:15.973886 26477 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:16.019941 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.926115 26465 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 12:17:16.024245 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 66189.1us
I20260709 12:17:16.025679 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:15.951613 26083 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:16.027618 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:16.035648 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:16.035940 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 66807us
I20260709 12:17:16.010251 26485 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:16.015496 26489 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:16.022691 26397 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:16.063201 22750 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:16.065908 26358 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:16.068711 26498 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.478s	user 0.004s	sys 0.000s
I20260709 12:17:16.071028 23695 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:17:16.079397 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 52025.2us
I20260709 12:17:16.041885 26477 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:16.053999 26306 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:16.073879 26497 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:16.077819 26361 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.044816 26083 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:16.103950 26064 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:16.106899 26083 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:16.104018 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:16.097234 26116 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:16.110262 26515 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:16.110841 26515 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:16.111778 26515 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:16.110415 26116 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:16.112874 26116 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:16.085341 26395 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:16.113092 26515 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:16.121860 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:16.129104 26306 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:16.129724 26306 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.130081 26306 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:16.135502 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:16.136662 22753 raft_consensus.cc:2393] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 12: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:16.137641 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:16.113866 26497 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:16.139863 22746 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 12:17:16.146000 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.139144 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:16.148111 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.146351 22897 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:16.144510 26477 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:16.152796 26382 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:16.144693 23493 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:16.138772 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:16.155290 26491 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:16.140034 26129 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:16.155835 26491 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.156314 26491 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:16.097921 26361 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:16.159325 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 63420.8us
I20260709 12:17:16.162364 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:16.164861 26522 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:16.165099 26358 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:16.165447 26522 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:16.165949 26522 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:16.158849 26460 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:16.171949 26460 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:16.173264 26497 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:16.146881 26495 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:16.175472 26495 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:16.176550 26495 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:16.177599 26516 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:17:16.177109 22575 catalog_manager.cc:5697] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:16.186146 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.197548 22893 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: [7.5-9.6]
W20260709 12:17:16.199806 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.179253 22575 catalog_manager.cc:5697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:16.207192 22753 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:16.212890 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:16.214915 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:16.216118 22901 raft_consensus.cc:2368] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:16.218804 22901 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:16.227329 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:16.226585 22717 leader_election.cc:400] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:16.229172 22717 leader_election.cc:403] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:17:16.208809 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 45057.2us
I20260709 12:17:16.232945 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:16.233724 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.233773 22747 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:16.237840 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:16.240056 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:16.251430 22898 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:16.260445 22899 raft_consensus.cc:1217] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Deduplicated request from leader. Original: 2.2->[4.3-8.5]   Dedup: 4.3->[6.4-8.5]
I20260709 12:17:16.261241 22899 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: [4.3-8.5]
I20260709 12:17:16.251353 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:16.264492 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:16.266968 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 681374us
I20260709 12:17:16.268656 23672 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: [4.3-8.5]
I20260709 12:17:16.269335 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:16.271513 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:16.272204 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:16.273566 23679 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:16.273746 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:16.274642 22825 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:16.259580 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:16.232221 26282 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:16.281952 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:16.243901 26483 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:16.293587 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:16.284698 22827 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:16.295284 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:16.297673 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 554291us
I20260709 12:17:16.296177 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:16.290401 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.297384 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:16.299659 22824 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:16.273814 26274 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:16.298178 22821 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:16.308517 26274 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:16.293877 26397 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:17:16.311937 26397 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:16.312376 26397 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:16.313658 26378 consensus_meta.cc:287] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.004s
I20260709 12:17:16.313336 26397 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:16.314550 22896 raft_consensus.cc:2410] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:17:16.315547 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:16.284387 26481 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.007s
I20260709 12:17:16.316231 22898 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:16.316368 26481 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:16.317337 22752 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:16.317260 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:16.318531 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:16.319264 26456 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:16.319970 26456 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:16.253916 25976 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:17:16.298938 25978 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:17:16.302347 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:16.333175 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:16.329278 22747 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:16.336385 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:16.338119 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:16.274156 26517 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:16.346326 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:16.291949 26129 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:16.285817 26466 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:16.349184 22824 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:16.314663 26397 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:16.361234 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:16.324245 25994 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:16.326596 26470 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:16.366233 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:16.370952 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:16.373541 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:16.408246 23689 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:16.407977 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:16.408010 22819 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:16.409750 23672 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:16.410135 26494 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:16.413415 23679 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: []
W20260709 12:17:16.966477 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:16.547585 26528 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:17:16.363803 26517 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:16.727963 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:16.981968 26379 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.067s	user 0.004s	sys 0.017s
I20260709 12:17:16.369781 25991 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:16.346670 26526 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.190s
W20260709 12:17:16.506151 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 145003us
I20260709 12:17:16.407589 26470 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.369994 26395 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 12:17:16.371938 25994 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.367481 25978 consensus_queue.cc:1243] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:16.969523 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:16.968938 22819 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.559s	user 0.021s	sys 0.019s
I20260709 12:17:17.040372 22819 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:16.971877 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:16.973182 26466 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:16.975551 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:16.977063 22823 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:17:16.977787 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:16.948639 23656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.005s	sys 0.005s
I20260709 12:17:17.044366 22827 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
W20260709 12:17:17.044657 23656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.005s	sys 0.005s
W20260709 12:17:16.979355 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 605909us
I20260709 12:17:17.045426 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:17.046065 22827 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
W20260709 12:17:16.967618 22746 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.001s
I20260709 12:17:17.047190 22746 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
W20260709 12:17:16.685854 26537 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.275s	user 0.001s	sys 0.001s
I20260709 12:17:16.986732 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:16.989089 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:16.989668 22751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.061s	sys 0.069s
I20260709 12:17:17.043617 22825 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:17.052234 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:17.054076 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:17.052263 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:17.052791 22751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.062s	sys 0.069s
W20260709 12:17:16.982944 26401 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.977s	user 0.010s	sys 0.014s
I20260709 12:17:16.514405 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:16.971464 25718 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:17:16.988152 26306 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.858s	user 0.007s	sys 0.011s
I20260709 12:17:17.018064 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 861) took 1049 ms. Trace:
I20260709 12:17:16.985114 26459 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:17.031759 23494 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.949s (SENT) [suppressed 16 similar messages]
I20260709 12:17:17.058969 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:17.061161 23659 rpcz_store.cc:276] 0709 12:17:15.959449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.959683 (+   234us) service_pool.cc:224] Handling call
0709 12:17:17.008366 (+1048683us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5400190854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:17.008503 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36549888}
I20260709 12:17:17.063580 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:17.064955 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 706) took 1072 ms. Trace:
I20260709 12:17:17.065366 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 679) took 1212 ms. Trace:
I20260709 12:17:17.065788 22896 rpcz_store.cc:276] 0709 12:17:15.853199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.853388 (+   189us) service_pool.cc:224] Handling call
0709 12:17:17.065161 (+1211773us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54002ff154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:17.065306 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991213440}
I20260709 12:17:17.012944 26473 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.065380 22750 rpcz_store.cc:276] 0709 12:17:15.993043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.993285 (+   242us) service_pool.cc:224] Handling call
0709 12:17:17.064735 (+1071450us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b54000a8a54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:17.064891 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137574144}
I20260709 12:17:17.092576 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:17.020080 26470 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:17.068403 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:17.097662 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:17.010982 25991 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:17.010339 26494 raft_consensus.cc:697] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:17.104072 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:17.120589 22821 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:17.051502 26358 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.051677 26453 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.051093 25994 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:17.180765 26459 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.181134 26387 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:17.183177 26534 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.097375 26215 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:17.186182 26282 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.893s	user 0.005s	sys 0.010s
I20260709 12:17:17.103860 26538 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:17.190197 22824 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:17.095835 25718 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.210518 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:17.070755 26401 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.104413 26353 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:17.091061 26306 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.239882 22821 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:17.104712 26473 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.249464 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:17.249735 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:17.252384 22824 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:17.223127 26481 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:17.265877 22752 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:17.120357 25991 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:17.269402 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:17.229308 25718 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:17.270282 23679 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:17.262750 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:17.274331 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:17.196822 26358 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.281062 23685 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:17.232215 26538 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:17.284539 26515 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.137s	user 0.017s	sys 0.000s
W20260709 12:17:17.284904 26536 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 12:17:17.285506 23660 raft_consensus.cc:2410] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:17.286378 26538 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:17.286958 26116 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.168s	user 0.010s	sys 0.013s
I20260709 12:17:17.287168 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 990) took 1153 ms. Trace:
I20260709 12:17:17.287416 26116 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.287571 22749 rpcz_store.cc:276] 0709 12:17:16.133369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.139994 (+  6625us) service_pool.cc:224] Handling call
0709 12:17:16.140376 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:16.140810 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:16.246618 (+105808us) log.cc:844] Serialized 14 byte log entry
0709 12:17:16.369524 (+122906us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:16.409408 (+ 39884us) log.cc:844] Serialized 52 byte log entry
0709 12:17:16.409581 (+   173us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:16.409638 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.409752 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.286872 (+877120us) raft_consensus.cc:1685] finished
0709 12:17:17.286897 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.287095 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15225,"prepare.queue_time_us":105758,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":136,"raft.queue_time_us":24772,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":9534336,"thread_start_us":212189,"threads_started":2,"wal-append.queue_time_us":250518}
I20260709 12:17:17.289853 26116 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:17.291447 26517 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.292613 23689 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:17.293558 25994 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.293949 26465 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:17.296387 26465 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:17.297426 26465 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.297894 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 995) took 1085 ms. Trace:
I20260709 12:17:17.299381 26456 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.298446 22747 rpcz_store.cc:276] 0709 12:17:16.212880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.340117 (+127237us) service_pool.cc:224] Handling call
0709 12:17:16.340581 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:16.376483 (+ 35902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:16.408552 (+ 32069us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:16.546016 (+137464us) log.cc:844] Serialized 26 byte log entry
0709 12:17:17.098656 (+552640us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:17.098705 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.098801 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.297654 (+198853us) raft_consensus.cc:1685] finished
0709 12:17:17.297679 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.297824 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":253308,"raft.queue_time_us":28417,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":31883,"thread_start_us":126606,"threads_started":1,"wal-append.queue_time_us":324096}
W20260709 12:17:17.294152 26511 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.314s	user 0.002s	sys 0.002s
W20260709 12:17:17.295655 26542 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:17:17.302598 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 984) took 2279 ms. Trace:
I20260709 12:17:17.303051 22748 rpcz_store.cc:276] 0709 12:17:15.023183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.023325 (+   142us) service_pool.cc:224] Handling call
0709 12:17:15.023635 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:15.733169 (+709534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:15.733209 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:15.733755 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.932873 (+199118us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:15.932930 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.933044 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.293669 (+1360625us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b240051d1d8. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15189c4 00007fadf1516acb 00007fadf16d1dc9 00007fadf16d1a55 00007fadf16d109d 00007fadf430310e 00007fadf431a88c 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221
0709 12:17:17.302262 (+  8593us) raft_consensus.cc:1685] finished
0709 12:17:17.302286 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.302507 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":709058,"raft.queue_time_us":710580,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":23523712,"thread_start_us":169524,"threads_started":1,"wal-append.queue_time_us":225444}
I20260709 12:17:17.304296 26399 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:17.304970 26399 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.307228 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 710) took 1152 ms. Trace:
I20260709 12:17:17.307401 26399 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:17.307228 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 715) took 1121 ms. Trace:
I20260709 12:17:17.308436 22752 rpcz_store.cc:276] 0709 12:17:16.185801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.320097 (+134296us) service_pool.cc:224] Handling call
0709 12:17:16.320434 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:17.270182 (+949748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.306897 (+ 36715us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54000a8054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:17.307144 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173566848}
I20260709 12:17:17.307854 22753 rpcz_store.cc:276] 0709 12:17:16.155015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.159585 (+  4570us) service_pool.cc:224] Handling call
0709 12:17:16.159871 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.229982 (+ 70111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.306985 (+1077003us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b5400413554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:17.307144 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70256512}
I20260709 12:17:17.220651 26459 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.314119 23679 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:17:17.314704 23679 pending_rounds.cc:85] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 5
I20260709 12:17:17.315042 23679 pending_rounds.cc:107] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:17:17.315344 23679 raft_consensus.cc:2889] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:17.205730 26453 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.304284 25994 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:17.258405 26289 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:17.226346 26215 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:17.311123 26541 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.489s	user 0.000s	sys 0.009s
I20260709 12:17:17.347536 22824 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:17.222575 26534 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.363386 26215 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:17.364367 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.364179 26534 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:17.337507 26522 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.170s	user 0.015s	sys 0.002s
I20260709 12:17:17.367600 22819 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:17.248272 26353 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.368994 22822 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 6.
W20260709 12:17:17.336643 26491 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.180s	user 0.019s	sys 0.000s
I20260709 12:17:17.375594 26430 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:17.376163 26469 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:17.387245 26491 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:17.388038 26539 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:17:17.242406 26466 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.278251 26481 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.392869 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:17.395323 22746 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:17.381029 23679 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:17:17.415390 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:17.420594 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.501546 22819 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:17.528905 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:17.531756 22748 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:17.421262 26399 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:17.519224 26464 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:17.542675 23679 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:17.367642 26289 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.546460 26399 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.385962 26522 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.521121 26547 raft_consensus.cc:3055] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:17.557570 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 833) took 1374 ms. Trace:
W20260709 12:17:17.553671 22826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.029s	sys 0.036s
W20260709 12:17:17.562412 22826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.029s	sys 0.037s
W20260709 12:17:17.559885 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 491287us
I20260709 12:17:17.558595 22746 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:17.386262 26494 consensus_queue.cc:237] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.565979 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:17.562165 23656 rpcz_store.cc:276] 0709 12:17:16.183263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.183615 (+   352us) service_pool.cc:224] Handling call
0709 12:17:16.184089 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:16.184539 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:16.184578 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:16.185377 (+   799us) log.cc:844] Serialized 52 byte log entry
0709 12:17:17.045075 (+859698us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:17.556758 (+511683us) log.cc:844] Serialized 14 byte log entry
0709 12:17:17.557175 (+   417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.557281 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.557326 (+    45us) raft_consensus.cc:1685] finished
0709 12:17:17.557338 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.557498 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1685,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":30260,"thread_start_us":1233276,"threads_started":2,"wal-append.queue_time_us":814299}
I20260709 12:17:17.548132 26491 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:17.553781 26397 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.179s	user 0.010s	sys 0.005s
I20260709 12:17:17.579200 23682 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:17.583209 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:17.590443 22748 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:17.558540 26547 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:17.592005 23493 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:17.548202 26464 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:17.614756 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.590266 26469 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:17.590880 26391 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:17.603619 26540 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:17:17.616827 26387 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:17.571094 26424 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:17:17.624058 26482 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.631721 26424 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:17.632429 26424 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:17.633730 26427 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.633666 26424 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.616716 26491 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:17.618520 26397 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.638204 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 708) took 1633 ms. Trace:
I20260709 12:17:17.600267 26353 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:17.645423 22744 rpcz_store.cc:276] 0709 12:17:16.004927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.005103 (+   176us) service_pool.cc:224] Handling call
0709 12:17:16.005464 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.165491 (+160027us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:16.165528 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:16.165591 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:16.165633 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.637882 (+1472249us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54000a9454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:17.637949 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.638132 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10416,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":359681920}
I20260709 12:17:17.623952 26551 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.621491 26379 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.604568 26399 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:17.640956 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 609187us
I20260709 12:17:17.627354 26526 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.592598 26401 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.627990 26473 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:17.626294 26469 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:17.634557 26427 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.643167 26358 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.636441 26456 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:17.687067 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:17.688716 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.671350 26453 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:17.665130 26491 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:17.637948 26391 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.666376 26459 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.631935 26482 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.679666 26424 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:17.695276 26456 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.683995 26387 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:17.684448 26495 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:17.664453 26397 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.669780 26379 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.688356 26399 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:17.735216 26399 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.737475 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 572) took 1392 ms. Trace:
I20260709 12:17:17.737748 26399 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.693217 26550 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:17.738698 26550 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.741287 26550 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:17.738029 22826 rpcz_store.cc:276] 0709 12:17:16.345257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.345506 (+   249us) service_pool.cc:224] Handling call
0709 12:17:16.345979 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:16.968909 (+622930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:16.968939 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:16.980533 (+ 11594us) log.cc:844] Serialized 26 byte log entry
0709 12:17:17.563440 (+582907us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:17.563503 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.564151 (+   648us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.737231 (+173080us) raft_consensus.cc:1685] finished
0709 12:17:17.737253 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.737398 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":619071,"raft.queue_time_us":626751,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":112,"thread_start_us":544518,"threads_started":1,"wal-append.queue_time_us":672715}
I20260709 12:17:17.748030 26490 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:17.748765 26490 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.751153 26289 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:17.753481 26491 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.754720 26482 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:17.755688 26469 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.672088 26526 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.759613 26526 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.760543 26526 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.760810 26456 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:17.761660 26456 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.763602 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 692) took 1475 ms. Trace:
I20260709 12:17:17.764042 22899 rpcz_store.cc:276] 0709 12:17:16.288281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.288503 (+   222us) service_pool.cc:224] Handling call
0709 12:17:16.288966 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:16.322830 (+ 33864us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:16.323140 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 12:17:17.604599 (+1281459us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b18000fbb60. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf865358f 00007fadf1692571 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd
0709 12:17:17.607345 (+  2746us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:17.608071 (+   726us) log.cc:844] Serialized 26 byte log entry
0709 12:17:17.608266 (+   195us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:17.608319 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.608423 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.763253 (+154830us) raft_consensus.cc:1685] finished
0709 12:17:17.763372 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.763534 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1273276,"prepare.queue_time_us":8291,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":12230,"raft.queue_time_us":1244335,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":23575,"spinlock_wait_cycles":72962432,"thread_start_us":73678,"threads_started":1,"wal-append.queue_time_us":1026524}
I20260709 12:17:17.765594 26397 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.671188 26547 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.768186 26427 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:17.768959 26427 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:17.708011 26481 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:17.727523 26459 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:17.769443 25718 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.770483 26459 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.665630 26551 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.773311 26459 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:17.773729 26551 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:17.775549 26464 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:17.776314 26379 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:17.777120 26379 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.777699 26391 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:17.731980 26282 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:17.731554 26495 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.778688 26282 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:17.790768 22790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.030s	sys 0.022s
W20260709 12:17:17.791492 22790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.031s	sys 0.022s
W20260709 12:17:17.791844 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 751703us
I20260709 12:17:17.762214 26456 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.732692 26387 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.774662 26477 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:17.777724 26379 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.769539 26427 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.804019 22818 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:17:17.809397 23685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 839) took 1539 ms (client timeout 1770 ms). Trace:
I20260709 12:17:17.811429 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:17.830732 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:17.814248 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:17.832739 22894 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:17.815505 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:17.835541 22897 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:17.814810 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:17.816831 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.793430 22790 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:17.794261 23689 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:17.838384 26289 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:17:17.795256 26470 consensus_meta.cc:287] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.007s
W20260709 12:17:17.838984 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 45674.7us
I20260709 12:17:17.840171 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:17.816534 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:17.812852 23656 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:17.843256 22898 raft_consensus.cc:2410] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:17:17.846444 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:17.828960 23685 rpcz_store.cc:269] 0709 12:17:16.269862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.270022 (+   160us) service_pool.cc:224] Handling call
0709 12:17:17.809134 (+1539112us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54007080d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:17.809312 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242875264}
I20260709 12:17:17.853935 22897 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:17.841459 22790 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:17.858615 22751 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:17.862046 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:17.862278 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:17.863091 22748 raft_consensus.cc:2410] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:17:17.867079 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:17.868217 22751 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:17.877776 26548 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:17.804905 26490 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.883515 26548 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:17.883903 26490 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:17.882568 26561 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:17.893675 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 221434us
W20260709 12:17:17.898907 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.879501 26538 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:17.900841 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:17.900738 26538 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.901665 22744 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:17.902370 26556 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.902971 26495 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:17.902459 26466 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.903137 26556 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.903785 26466 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.851454 26551 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:17.907363 26551 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.907958 26551 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:17.909000 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 563) took 1639 ms. Trace:
I20260709 12:17:17.909250 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 832) took 3046 ms. Trace:
I20260709 12:17:17.909584 23695 rpcz_store.cc:276] 0709 12:17:14.862757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.863017 (+   260us) service_pool.cc:224] Handling call
0709 12:17:14.863495 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:16.070699 (+1207204us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b54005e4320. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf47811c0 00007fadf4782231 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c
0709 12:17:16.071597 (+   898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.908985 (+1837388us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540073b254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:17.909171 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492499072}
I20260709 12:17:17.794461 26391 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.851643 26464 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:17.825289 26515 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:17.839661 26459 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.884052 26548 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:17.839277 26470 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.896502 26490 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.813004 25991 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:17.824594 26473 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.856189 26560 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.855819 26397 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:17:17.858135 26534 raft_consensus.cc:2764] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:17:17.838892 26289 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.962148 22893 raft_consensus.cc:1217] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Deduplicated request from leader. Original: 2.2->[4.3-8.5]   Dedup: 4.3->[6.4-8.5]
I20260709 12:17:17.962512 22894 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:17.962939 22893 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: [4.3-8.5]
I20260709 12:17:17.838871 26456 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:17.794241 26526 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.810930 26477 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:17.917584 23660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 838) took 1660 ms (client timeout 2121 ms). Trace:
W20260709 12:17:17.918920 26554 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:17:17.919804 26306 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.925560 22752 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:17:17.978649 22752 pending_rounds.cc:85] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 5
I20260709 12:17:17.878211 26482 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:17.913764 26561 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.979362 26482 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.980803 26561 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:17.981541 26482 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:17.983789 26427 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:17.984055 26477 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:17.954445 26559 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:17.985071 26559 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.986498 26526 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.959735 26379 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:17.926728 26391 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:17.989100 25991 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:17.964519 26560 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.969605 26289 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:17.991896 26560 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.000541 26470 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.001842 26456 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.002588 26456 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:18.004334 26490 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.005373 26391 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.005440 26456 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.007360 26538 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.010592 26466 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:17.952978 26359 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:18.012342 26359 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:18.015690 26387 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:17.942655 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:18.016431 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 169114us
I20260709 12:17:17.909467 22820 rpcz_store.cc:276] 0709 12:17:16.269699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.270919 (+  1220us) service_pool.cc:224] Handling call
0709 12:17:16.294069 (+ 23150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:16.375186 (+ 81117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:16.375223 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:16.411748 (+ 36525us) log.cc:844] Serialized 26 byte log entry
0709 12:17:17.603192 (+1191444us) spinlock_profiling.cc:243] Waited 965 us on lock 0x7b18003a6060. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:17:17.824541 (+221349us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:17.824579 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.824648 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:17.908710 (+ 84062us) raft_consensus.cc:1685] finished
0709 12:17:17.908728 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.908939 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":574961,"raft.queue_time_us":113223,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":92714,"spinlock_wait_cycles":2219392,"thread_start_us":221141,"threads_started":1,"wal-append.queue_time_us":1495218}
I20260709 12:17:17.956794 22823 raft_consensus.cc:2368] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10.
I20260709 12:17:17.959259 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:17.960273 23674 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:17.945010 26481 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.968899 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:17.952047 25718 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:17.973865 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:17.943040 26562 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:17.974879 22896 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:17.943217 26459 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:17.941445 26515 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:17.979004 22752 pending_rounds.cc:107] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 9.6
W20260709 12:17:17.970713 23660 rpcz_store.cc:269] 0709 12:17:16.257586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.257806 (+   220us) service_pool.cc:224] Handling call
0709 12:17:17.917263 (+1659457us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000a4454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:17.917493 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345190656}
I20260709 12:17:18.029599 22752 raft_consensus.cc:2889] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:18.025419 22893 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:18.026258 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:17.957772 26282 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.027801 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:18.024080 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.030678 22750 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:18.033004 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.035416 22893 raft_consensus.cc:2410] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:17:18.026831 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.036034 22895 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:18.037104 22895 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:18.037474 22820 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:18.037498 22821 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:18.037931 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.038635 22825 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:18.039885 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.026295 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.042577 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:18.043184 22825 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.042017 22900 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:18.043933 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.030891 22894 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:17:18.041152 22822 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:18.044286 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.044564 22826 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:18.045377 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.041152 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.046120 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.048233 22895 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:18.049453 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.050716 22895 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:18.038646 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:18.046845 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.054009 22894 raft_consensus.cc:2410] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:17:18.045086 22896 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:18.055392 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.047449 22749 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:18.056208 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.058058 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.058341 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:18.054347 22750 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:18.059602 22821 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:18.060531 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.061117 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:18.061757 22894 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:17.955210 26473 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.063897 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.023458 26391 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.065994 22750 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:17:18.067637 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.069742 23679 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:18.071432 22749 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:18.068218 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.068387 22894 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:18.066453 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.075652 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.076557 22900 raft_consensus.cc:2393] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 10: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:18.034179 26464 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.073570 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.080376 22893 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:17:18.080857 22893 pending_rounds.cc:85] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 7
I20260709 12:17:18.055199 25718 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.084949 22893 pending_rounds.cc:107] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:17:18.079823 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.084990 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.086000 23685 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: [4.3-8.5]
I20260709 12:17:18.088434 22825 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:18.086149 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.045042 26491 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.056197 26466 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.054992 26306 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.066881 26359 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.094201 26306 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.095759 22745 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:18.096488 26306 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.097245 26491 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.099167 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.099395 26491 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.100320 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.101375 22822 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:18.102439 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.103070 26515 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.104035 26430 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:18.104501 26430 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:18.085255 26464 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.062106 26397 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:18.090025 22824 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:18.027776 26481 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.061619 26482 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:18.061915 26494 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.117733 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.118255 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.119050 23660 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:18.060266 26469 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.093556 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.093319 26466 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.088200 22893 raft_consensus.cc:2889] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:18.087317 26282 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.089829 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:18.107295 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 61509.8us
I20260709 12:17:18.107329 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.137189 22825 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:17:18.137827 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.138270 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.092187 22750 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:18.139719 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.140395 22825 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:18.113242 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.116151 22744 pending_rounds.cc:85] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 5
I20260709 12:17:18.120771 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.116628 26359 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.117370 26387 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.122028 26572 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:18.033944 26562 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.067466 26460 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:17:18.170738 26387 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:18.171553 26460 consensus_queue.cc:1243] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:18.172369 26359 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.173177 26387 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.173324 26562 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.123656 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.174399 22901 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:18.175396 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.123862 26483 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:18.124454 26538 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:18.129132 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.131330 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.063866 26566 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.083145 26556 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.114753 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:18.181967 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 67302.5us
I20260709 12:17:18.112458 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:18.141256 22744 pending_rounds.cc:107] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:17:18.183019 22744 raft_consensus.cc:2889] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:18.141705 22747 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:18.142750 23493 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.184352 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.143252 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.144974 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.105429 26430 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.146675 22822 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:17:18.147070 22865 leader_election.cc:336] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.875s (SENT)
I20260709 12:17:18.186116 22750 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:18.122305 26459 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:18.120905 26399 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:17:18.131131 26379 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.153839 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:18.192929 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:18.106439 25718 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.131573 26494 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:18.156131 26481 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.144686 26469 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.079581 26391 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:18.159742 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:18.217891 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.236181 22746 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:18.160452 26473 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.131793 26565 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.161556 22745 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:18.163060 22826 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:18.146019 26282 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.168884 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.177446 22752 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:18.178090 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.224278 26359 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:18.183014 22748 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:17:18.254973 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 845) took 4431 ms. Trace:
W20260709 12:17:18.188719 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 65157.6us
I20260709 12:17:18.179093 26483 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:18.193573 22824 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:18.194167 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.257716 22750 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:18.188593 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.258819 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:18.259254 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 70764.7us
I20260709 12:17:18.260103 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.260804 22750 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:18.261126 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.195013 22864 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.194105 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:18.193130 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.195343 26574 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:18.263746 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 68851.6us
I20260709 12:17:18.255524 22745 rpcz_store.cc:276] 0709 12:17:13.816553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.817424 (+   871us) service_pool.cc:224] Handling call
0709 12:17:13.817679 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.125468 (+307789us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b4c00165a80. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf2a4ba20 00007fadf2a5ca29 00007fadf2a22644 00007fadf2a49f2d 00007fadf2a49b93 00007fadf477a18b 00007fadf477acb5 00007fadf4775f30 00007fadf47777de 00007fadf4781b49 00007fadf4782416
0709 12:17:14.567835 (+442367us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54002ccf20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46fd06f 00007fadf4775f60 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62
0709 12:17:15.654973 (+1087138us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002ccf20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46fc520 00007fadf4775f70 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62
0709 12:17:17.091216 (+1436243us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b54002ccf20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f4597 00007fadf4775f9e 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62
0709 12:17:18.095290 (+1004074us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b58003bc9d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46db0aa 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4
0709 12:17:18.247897 (+152607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.248204 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952425600}
I20260709 12:17:18.265497 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.266008 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.254102 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.191843 26424 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:18.180437 26538 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:18.237663 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.266758 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.273860 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.196935 26534 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:18.181984 26559 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.196673 26495 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:17:18.263338 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 70292.2us
I20260709 12:17:18.195979 26569 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:17:18.199858 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.193552 25994 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:18.262609 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.267766 22745 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:18.200973 26556 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:18.269986 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.234534 26547 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:18.267154 22751 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:18.196324 26477 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:18.274076 26359 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:17:18.275321 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 81291.4us
I20260709 12:17:18.297857 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:18.298902 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.227563 26494 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.278249 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.278249 26490 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:18.280805 22748 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:18.282692 23672 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:18.283130 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.285199 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.287458 22750 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:18.306705 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.285017 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:18.269587 26421 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:17:18.271250 26399 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:18.280541 26548 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:18.184736 26566 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.324083 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.324805 23659 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:18.325875 26566 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:18.230644 25718 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.326143 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.200611 26379 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.269286 26424 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.327210 26424 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:18.328085 26361 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:18.328456 26379 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.329480 26430 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.295414 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.286357 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:18.335331 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 49062.9us
I20260709 12:17:18.337160 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.336905 26424 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.296694 26359 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.278298 26534 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:18.339030 26359 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:18.315701 26460 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:18.339581 26379 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:18.340191 26379 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.339685 26534 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.340579 26379 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:18.300493 22865 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:18.278053 26560 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:18.276803 26538 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:18.340901 26469 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.274995 26481 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:18.284390 26382 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:18.343349 26481 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:18.343745 26382 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.344201 26382 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:18.344615 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.270763 26387 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:17:18.305482 26526 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:18.347465 26560 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.347625 26526 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.348039 26560 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:18.348433 26526 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:18.296639 26495 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:18.351398 26566 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:18.254130 26289 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:18.351742 26495 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.354305 26289 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.291738 26482 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:18.286440 26556 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:18.354941 26460 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.355162 26482 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:18.355463 26460 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:18.355770 26482 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:18.355309 26556 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:18.270913 26473 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:18.357225 26473 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:18.357659 26473 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.309409 26483 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.360132 26391 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.360857 26483 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:18.361104 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.361886 23679 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
W20260709 12:17:18.363448 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 63568.8us
I20260709 12:17:18.364275 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:18.365433 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:18.366287 26490 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:18.366685 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:18.366752 26490 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.367619 26490 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:18.367796 26568 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:18.368649 26568 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:18.369035 26568 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.369377 26568 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:18.325907 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.284175 25994 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.293941 26477 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.314616 26564 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:18.309753 26551 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.326742 23682 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:18.254586 26565 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.342417 26395 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:18.344470 26481 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.304674 26559 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:17:18.344197 26282 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:18.311681 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.407189 23660 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:18.319921 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.375137 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:18.324141 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 864) took 1072 ms. Trace:
I20260709 12:17:18.387084 25994 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.313663 26463 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:18.392442 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 79153.8us
I20260709 12:17:18.413446 26424 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.389945 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:18.440317 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 50494.9us
I20260709 12:17:18.442167 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:18.442991 26459 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:18.443568 26459 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.443909 26459 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.445638 26559 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:18.446272 26559 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.446655 26559 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:18.395617 22821 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:18.321031 26399 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.388434 26564 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.340979 26534 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:18.315062 23685 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:18.475085 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.408959 23689 rpcz_store.cc:276] 0709 12:17:17.251672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.293543 (+ 41871us) service_pool.cc:224] Handling call
0709 12:17:17.293813 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:17.838410 (+544597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.323843 (+485433us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b5400291dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:18.324073 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150329216}
I20260709 12:17:18.338660 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.477056 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.477839 23689 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:18.401018 26395 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.413367 26551 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.417069 26522 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.479369 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:18.483598 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.483945 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 990) took 1497 ms. Trace:
I20260709 12:17:18.484473 22818 rpcz_store.cc:276] 0709 12:17:16.986934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.100210 (+113276us) service_pool.cc:224] Handling call
0709 12:17:17.100596 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:17.827534 (+726938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.483637 (+656103us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54005d8c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:18.483869 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616793856}
I20260709 12:17:18.388909 26477 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:18.428148 26548 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.389060 26361 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:17:18.429562 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 54527.8us
I20260709 12:17:18.450770 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.461205 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.467119 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.463275 26399 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.467725 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.468173 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.505652 26538 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.514704 22893 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:18.481868 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.516942 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:18.475943 23685 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:18.488222 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.519038 23659 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:18.490200 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.467345 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.496008 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.464449 26463 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:18.498656 26361 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:18.499233 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.499493 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.524346 22900 raft_consensus.cc:2410] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:17:18.485070 26561 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:18.500483 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.528098 23682 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
W20260709 12:17:18.542766 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.501747 26560 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:18.504247 26526 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.463507 26282 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:18.552356 26282 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.537459 26561 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.552827 26282 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:18.552992 26579 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:17:18.554343 26561 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:18.504420 26485 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:18.496876 26456 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:17:18.555017 26561 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:18.555390 26561 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.555723 26561 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:18.483752 26395 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:18.497231 26490 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.511794 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:18.555981 26568 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:18.557149 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 45474.7us
I20260709 12:17:18.557870 26490 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:18.558022 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:18.558465 26568 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.474354 26564 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.499939 26382 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.595651 22746 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:18.523721 26361 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.549839 22751 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:18.515350 26566 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:17:18.559161 26485 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:18.600522 26382 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.601349 26314 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:18.559438 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.603544 22744 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:18.603832 26361 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.605279 22744 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:18.512120 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.607594 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:18.608317 23679 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.559626 26460 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:18.612926 26460 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.540851 26473 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.614315 23656 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:18.615231 26473 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.617655 22750 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:17:18.617309 26395 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.618029 22750 pending_rounds.cc:85] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 4
I20260709 12:17:18.618287 22750 pending_rounds.cc:107] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:18.618501 22750 raft_consensus.cc:2889] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:18.620261 26560 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.629038 26282 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.576819 26482 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:18.631368 26569 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:18.632220 26482 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.633030 22753 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:18.560618 26526 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:18.560981 26551 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:18.565501 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:18.548854 25994 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:18.571787 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 233167us
I20260709 12:17:18.638290 26395 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.638588 26551 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:18.639370 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.639930 25994 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.640187 26395 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:18.640359 26466 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.640853 26395 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:18.640928 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 75622.2us
I20260709 12:17:18.641507 26395 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:18.642009 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.643046 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:18.576691 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:18.645846 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:18.646610 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 70032.6us
I20260709 12:17:18.647526 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:18.648617 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:18.582710 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.649787 26551 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:18.650090 23659 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:18.651702 26075 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:18.652554 26075 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:18.654925 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:18.656174 26538 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.656577 26382 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:18.656728 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:18.657174 26382 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:18.657727 26382 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.655040 26483 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:18.659579 26483 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.659655 26556 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.660190 26483 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:18.662038 26556 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:18.584321 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 105068us
W20260709 12:17:18.585624 22823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 991) took 1596 ms (client timeout 1875 ms). Trace:
W20260709 12:17:18.591588 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.530481 26565 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.596035 22895 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:17:18.654861 26464 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.004s
I20260709 12:17:18.560166 26391 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:18.634596 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:18.670725 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:18.676229 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:18.663980 22823 rpcz_store.cc:269] 0709 12:17:16.989103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.063200 (+ 74097us) service_pool.cc:224] Handling call
0709 12:17:18.579260 (+1516060us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b54005d9154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:18.585535 (+  6275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048758656}
I20260709 12:17:18.672430 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:18.678454 22745 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 10: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:18.665890 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:18.666662 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.679385 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.525573 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:18.663899 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:18.668068 26314 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:18.680092 23682 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:18.693779 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:18.694414 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:18.694517 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:18.667831 26551 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.697836 26551 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.698904 26497 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:18.679216 26397 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:18.701380 26466 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:18.701901 26397 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:18.702491 26466 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:18.703024 26466 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:18.703924 26466 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.677892 25718 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:18.705518 26466 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:18.702514 26397 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:18.708731 22746 raft_consensus.cc:2393] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:18.695397 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:18.693656 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:18.695801 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:18.709520 23685 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:18.710240 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:18.696735 23695 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:18.693126 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:18.696693 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 861) took 1447 ms. Trace:
I20260709 12:17:18.712803 23679 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:18.711723 23674 rpcz_store.cc:276] 0709 12:17:17.250803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.270422 (+ 19619us) service_pool.cc:224] Handling call
0709 12:17:17.284330 (+ 13908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:18.019479 (+735149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.696433 (+676954us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b5400190854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:18.696630 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553895808}
I20260709 12:17:18.702160 26559 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.674856 26424 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:18.670336 26556 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.716863 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:18.694924 26353 raft_consensus.cc:2764] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:17:18.718642 26550 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:18.723394 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:18.735916 23685 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:18.736179 26421 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.736542 22746 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:18.736721 26421 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.738585 26399 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.724380 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:18.674698 26464 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.726898 22752 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:18.726917 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.728097 26526 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.708209 26391 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:18.729143 26395 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.730692 23659 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:18.673077 26459 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.734651 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:18.764935 22900 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:17:18.742478 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 47141.1us
I20260709 12:17:18.722155 26359 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:18.750595 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.765108 22745 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:18.598497 26561 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:18.752494 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.742993 26550 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:18.753507 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:18.678304 26495 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:17:18.755546 22746 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:18.755576 22753 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:18.761257 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:18.761826 22744 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:18.712682 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:18.733197 25718 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:18.736064 26215 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:18.735402 26424 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:18.705485 26483 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.753211 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:18.770298 26459 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.757321 25994 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:18.760843 26526 consensus_queue.cc:1243] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:18.827600 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:18.772495 22899 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:18.774720 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:18.776952 26395 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.777073 26463 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.778967 22897 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:18.771122 26399 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.763167 26282 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:18.731492 26564 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:18.804474 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 91894.2us
I20260709 12:17:18.805184 22750 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:18.847330 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:18.804680 22894 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:18.805529 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:18.849452 22744 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:18.806166 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.808691 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:18.759166 26556 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.822515 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.855618 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.856451 22892 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 15: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:17:18.826105 22819 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 992) took 1833 ms (client timeout 1559 ms). Trace:
I20260709 12:17:18.771569 22896 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:18.856810 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:18.856822 22819 rpcz_store.cc:269] 0709 12:17:16.993145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.051808 (+ 58663us) service_pool.cc:224] Handling call
0709 12:17:18.825938 (+1774130us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54000f19d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:18.826043 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719962368}
I20260709 12:17:18.762877 26587 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:17:18.778774 26359 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.784963 26382 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.786415 26361 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.815131 26397 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:18.839959 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 77051us
I20260709 12:17:16.970928 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:18.874174 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.816507 26424 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:18.813344 26391 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:18.831355 26358 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 12:17:18.843240 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 68639.4us
I20260709 12:17:18.848412 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:18.851018 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 45007.7us
I20260709 12:17:18.863336 26463 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:18.825568 25718 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:18.860981 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.818198 26379 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.848668 22575 catalog_manager.cc:5697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 6 to 7, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 7 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:18.871064 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:18.866250 22894 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:18.898633 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:18.899639 22898 raft_consensus.cc:2410] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:17:18.899796 22894 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:18.847748 26215 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:18.875012 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:18.906615 23685 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:18.885071 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:18.858605 26395 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:18.909580 26395 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:18.904762 26215 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:18.834830 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1283) took 1859 ms. Trace:
I20260709 12:17:18.910691 26215 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:18.911008 26534 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:18.911825 26534 consensus_queue.cc:1243] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:18.914951 26379 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.902419 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:18.915877 26564 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.916669 26460 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:18.916623 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:18.917301 26460 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:18.919541 26482 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.922041 26397 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:18.885358 26391 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:18.923277 26391 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:18.923337 26589 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:17:18.925303 26358 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:18.925874 26358 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:18.893498 26463 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.927842 26463 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:18.887531 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:18.929762 23656 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:18.859539 26421 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:18.864334 26535 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.867745 26399 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:18.844523 26547 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:17:18.894335 22893 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:18.909973 22894 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:18.945953 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:18.872888 26561 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:18.901264 22573 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43984 (request call id 157) took 18725 ms (client timeout 15000 ms). Trace:
I20260709 12:17:18.844878 26550 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.934021 22747 raft_consensus.cc:1217] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[4.3-9.5]   Dedup: 4.3->[7.4-9.5]
I20260709 12:17:18.895130 22900 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:18.932744 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:18.931705 22892 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:18.957340 23494 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:18.947767 23656 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:18.958654 22747 pending_rounds.cc:85] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 3
I20260709 12:17:18.959017 22747 pending_rounds.cc:107] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:17:18.909924 26075 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:18.959266 22747 raft_consensus.cc:2889] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:18.905400 26481 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:18.918207 26460 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.971051 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:19.000306 22575 catalog_manager.cc:5697] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 5 to 7, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 7 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:18.948168 22573 rpcz_store.cc:269] 0709 12:17:00.175771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.182544 (+  6773us) service_pool.cc:224] Handling call
0709 12:17:18.901174 (+18718630us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:10.950978 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:10.951689 (+   711us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:10.951743 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:17:10.951762 (+    19us) tablet.cc:662] Decoding operations
0709 12:17:10.953396 (+  1634us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:10.953504 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:10.953533 (+    29us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:17:11.083808 (+130275us) tablet.cc:701] Row locks acquired
0709 12:17:11.105872 (+ 22064us) write_op.cc:260] PREPARE: finished
0709 12:17:11.146171 (+ 40299us) write_op.cc:270] Start()
0709 12:17:11.226335 (+ 80164us) write_op.cc:276] Timestamp: P: 1783599431126061 usec, L: 0
0709 12:17:11.231028 (+  4693us) op_driver.cc:348] REPLICATION: starting
0709 12:17:11.305567 (+ 74539us) log.cc:844] Serialized 7582 byte log entry
0709 12:17:11.677509 (+371942us) op_driver.cc:464] REPLICATION: finished
0709 12:17:11.738214 (+ 60705us) write_op.cc:301] APPLY: starting
0709 12:17:11.762142 (+ 23928us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:11.886845 (+124703us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:11.887032 (+   187us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:11.910075 (+ 23043us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:11.910600 (+   525us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 12:17:11.910665 (+    65us) write_op.cc:312] APPLY: finished
0709 12:17:12.061018 (+150353us) log.cc:844] Serialized 131 byte log entry
0709 12:17:12.118876 (+ 57858us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:12.180586 (+ 61710us) write_op.cc:454] Released schema lock
0709 12:17:12.192108 (+ 11522us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:12.205079 (+ 12971us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:12.205129 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":399366,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":8931,"apply.run_cpu_time_us":11087,"apply.run_wall_time_us":481049,"num_ops":19,"prepare.queue_time_us":157053,"prepare.run_cpu_time_us":11538,"prepare.run_wall_time_us":574733,"raft.queue_time_us":134848,"raft.run_cpu_time_us":2598,"raft.run_wall_time_us":61802,"replication_time_us":430141,"spinlock_wait_cycles":36224,"thread_start_us":221136,"threads_started":4,"wal-append.queue_time_us":142353,"wal-append.run_cpu_time_us":36631,"wal-append.run_wall_time_us":1790885}]]}
I20260709 12:17:18.960397 26548 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:18.947319 26559 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:19.020836 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.966902 26534 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:17:19.023831 26382 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:19.029832 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 79678.1us
I20260709 12:17:18.991093 26550 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:18.910547 26395 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:18.943879 26535 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.967242 26582 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:18.972659 26564 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:19.032347 26430 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:19.031563 22899 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:19.041273 26361 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:19.041749 26595 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:17:19.036254 26314 consensus_queue.cc:1059] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 12:17:19.043658 26477 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.000s
I20260709 12:17:19.044170 26477 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:19.049360 26556 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:18.943902 26358 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:18.974174 26497 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:17:19.053700 26427 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:19.054268 26427 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:19.055452 26427 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:19.056602 26427 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:19.030090 25718 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:19.059392 26551 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:19.061843 26592 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:17:18.953449 26455 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:17:19.068902 26483 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:19.075079 26430 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:19.075723 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:19.076161 26430 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:19.077119 22900 raft_consensus.cc:2368] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13.
I20260709 12:17:19.029709 26353 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:17:19.079542 26314 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:19.080061 26314 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:19.080904 26314 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:19.082367 26314 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:19.085112 26547 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.085534 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:19.085649 26547 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:19.086982 25994 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:19.087482 25994 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:19.088150 26547 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:19.088313 25994 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:19.088698 26547 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:19.089762 26547 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:19.090108 26547 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:19.037840 26494 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:17:19.091820 26564 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.092271 26582 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:19.092365 26564 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:19.093284 26582 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:19.094980 26497 consensus_queue.cc:1243] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:19.095721 26497 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:19.096127 26497 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:19.002436 26399 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 12:17:19.096938 26497 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:19.098106 26497 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:19.075080 26129 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:17:19.100185 26129 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:19.101006 22899 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:19.032486 26465 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:17:19.102550 23494 leader_election.cc:400] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13.
I20260709 12:17:19.108999 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:19.094502 26564 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:19.070246 26535 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:19.101275 26129 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:19.135555 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:19.137079 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.115500 26482 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:19.111582 26538 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:17:19.123313 26551 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:19.131722 26477 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:19.138203 26464 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:19.123883 26547 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:19.180066 26600 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:17:19.228809 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:19.230739 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.233798 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:19.031733 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:19.234984 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:19.237730 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 205865us
I20260709 12:17:19.240162 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.255885 22826 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:19.246874 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:19.259677 26129 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:19.262893 26353 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:19.221597 22575 catalog_manager.cc:5697] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 4 to 5, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 5 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.266822 22575 catalog_manager.cc:5697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 8 to 9, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 9 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.252249 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.254004 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:19.271375 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.272835 22818 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:19.271821 22819 raft_consensus.cc:2393] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:19.271459 23659 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:19.277753 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.278021 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.278926 22818 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:19.289674 26075 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:19.293234 26075 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:19.293730 26075 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:19.294060 22746 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:19.281549 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:19.295529 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:19.291175 26353 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:19.296653 22746 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:19.297500 26075 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:19.306980 26075 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:19.259756 22747 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:19.316854 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:19.317930 22747 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:19.318261 26424 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:19.321225 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.317827 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:19.228066 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:19.322396 22825 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:17:19.324494 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.325611 22824 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:19.332708 22822 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:19.335758 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.336709 22820 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:19.279609 22819 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:19.334422 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.343426 22822 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:19.345140 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:19.346467 22900 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 7: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:19.347394 26427 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:19.348661 26427 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:19.349458 22894 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:17:19.349980 22894 pending_rounds.cc:85] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 6
I20260709 12:17:19.349498 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:19.350328 22894 pending_rounds.cc:107] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:17:19.350898 22894 raft_consensus.cc:2889] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:19.351276 26455 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:19.351891 26455 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:19.365855 22746 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:19.321477 26424 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:19.387234 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:19.388298 22900 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 11: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:19.386451 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:19.399724 26547 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:19.401631 26427 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:19.402169 22575 catalog_manager.cc:5697] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 4 to 10, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 10 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:17:19.409252 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:19.410671 22894 raft_consensus.cc:2410] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:17:19.411216 22575 catalog_manager.cc:5697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 5 to 6, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 6 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:19.413216 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:19.376322 26466 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.670s	user 0.006s	sys 0.007s
I20260709 12:17:19.415448 22575 catalog_manager.cc:5697] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 5 to 8, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 8 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:19.417711 22575 catalog_manager.cc:5697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 8, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 8 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.425115 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:19.426141 22824 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:19.444998 22900 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:19.446113 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:19.446743 22820 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:19.451611 26574 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:19.452562 26574 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:19.427274 22575 catalog_manager.cc:5697] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:19.455291 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:19.456311 22894 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:19.457216 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:19.353442 26455 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:19.464673 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 96240.9us
I20260709 12:17:19.375474 26470 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:17:19.459595 26455 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:19.473467 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.473716 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.474465 22825 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:19.465095 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1013) took 1198 ms. Trace:
I20260709 12:17:19.477645 22790 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:19.487933 22818 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:18.910952 22827 rpcz_store.cc:276] 0709 12:17:16.975731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.093780 (+118049us) service_pool.cc:224] Handling call
0709 12:17:17.115335 (+ 21555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:17.295290 (+179955us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:17.635091 (+339801us) log.cc:844] Serialized 14 byte log entry
0709 12:17:17.812477 (+177386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:17.812527 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:17.812568 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.834490 (+1021922us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54001252d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:18.834556 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:18.834725 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8716,"prepare.queue_time_us":457533,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":9270,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":50809,"spinlock_wait_cycles":413060992,"thread_start_us":516437,"threads_started":2,"wal-append.queue_time_us":270006,"wal-append.run_cpu_time_us":1337,"wal-append.run_wall_time_us":1001896}
W20260709 12:17:19.495982 26463 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.009s
I20260709 12:17:19.496201 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.496558 26463 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:19.498421 26574 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:19.499910 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:19.500056 22896 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:17:19.515266 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:19.473069 26391 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.018s
I20260709 12:17:19.467090 26466 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:17:19.501222 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:19.501464 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:19.486048 26604 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:17:19.487145 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1005) took 1329 ms. Trace:
I20260709 12:17:19.503360 22575 catalog_manager.cc:5697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 8 to 9, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 9 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.516288 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:19.523919 22745 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
W20260709 12:17:19.502481 22821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1297) took 1438 ms (client timeout 1826 ms). Trace:
I20260709 12:17:19.503393 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:19.529695 22895 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:19.530949 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:19.526993 26391 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:19.533463 26391 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:19.533835 26215 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.622s	user 0.012s	sys 0.009s
I20260709 12:17:19.535756 22747 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
W20260709 12:17:19.540117 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.541602 22896 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:19.541603 26391 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.544725 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:19.544843 22575 catalog_manager.cc:5697] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
W20260709 12:17:19.528867 22821 rpcz_store.cc:269] 0709 12:17:18.064408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.065976 (+  1568us) service_pool.cc:224] Handling call
0709 12:17:19.502029 (+1436053us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54001257d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:19.502257 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735134592}
I20260709 12:17:19.534457 26215 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:19.552955 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:19.557399 22826 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:19.550750 22896 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:19.559841 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.562456 22901 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:19.564932 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.551597 22895 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:19.528661 22894 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:19.527626 22751 rpcz_store.cc:276] 0709 12:17:18.137276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.295106 (+157830us) service_pool.cc:224] Handling call
0709 12:17:19.466373 (+1171267us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54001e8cd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:19.466614 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493406464}
I20260709 12:17:19.551414 22892 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:19.555606 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:19.557168 22575 catalog_manager.cc:5697] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 10 to 11, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 11 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.584843 22819 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
W20260709 12:17:19.600344 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.589896 22898 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:19.587555 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 120849us
I20260709 12:17:19.559084 26215 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:19.564580 23659 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:19.610121 26466 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:19.610879 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:19.612490 26526 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:19.613340 26526 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:17:19.613780 26550 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.575s	user 0.013s	sys 0.005s
I20260709 12:17:19.616235 26463 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:19.550858 26391 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:19.642819 22900 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:19.620309 26466 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:19.650210 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.652240 22864 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:19.653709 26613 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.097s	user 0.002s	sys 0.000s
W20260709 12:17:19.657673 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 97639.1us
I20260709 12:17:19.666558 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.477453 22748 rpcz_store.cc:276] 0709 12:17:18.266362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.307802 (+ 41440us) service_pool.cc:224] Handling call
0709 12:17:18.308118 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:18.308362 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:18.515381 (+207019us) log.cc:844] Serialized 14 byte log entry
0709 12:17:19.463412 (+948031us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b180012e9e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf1694a40 00007fadf168f4e4 00007fadf168f455 00007fadf81773c7 00007fadf47899a7 00007fadf47990bf 00007fadf4799038
0709 12:17:19.463947 (+   535us) log.cc:844] Serialized 14 byte log entry
0709 12:17:19.464368 (+   421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:19.464441 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:19.464574 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.464697 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:19.464898 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":831894,"prepare.queue_time_us":1193308,"prepare.run_cpu_time_us":157,"prepare.run_wall_time_us":10653,"raft.queue_time_us":285,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":12540,"spinlock_wait_cycles":94378624,"thread_start_us":275912,"threads_started":2,"wal-append.queue_time_us":157954}
W20260709 12:17:19.662482 26314 consensus_meta.cc:287] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.522s	user 0.015s	sys 0.005s
I20260709 12:17:19.625128 26526 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:19.686209 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.689086 22824 raft_consensus.cc:2410] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:17:19.686271 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.693914 22821 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:19.690794 26427 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:19.698684 26427 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:19.699298 26427 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:19.698308 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.707558 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:19.707995 22746 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:17:19.720172 22825 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:19.722851 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.726939 22820 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:19.729630 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:19.735031 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:19.741108 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.749775 22749 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:17:19.753681 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:19.754118 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.754348 22820 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:19.742846 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1021) took 1085 ms. Trace:
I20260709 12:17:19.755138 22744 rpcz_store.cc:276] 0709 12:17:18.645762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.673324 (+ 27562us) service_pool.cc:224] Handling call
0709 12:17:19.719847 (+1046523us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b5400413a54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:19.731133 (+ 11286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155024768}
I20260709 12:17:19.757222 22746 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:19.743023 26534 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:19.760439 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 48995.7us
I20260709 12:17:19.765950 22819 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:19.733311 26314 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:17:19.769065 22751 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:19.772917 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.773705 22827 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:19.775133 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.774689 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.776607 22827 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:17:19.776878 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:19.779595 26615 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 12:17:19.781862 26617 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.240s	user 0.000s	sys 0.002s
I20260709 12:17:19.782177 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:19.782910 26616 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.114s	user 0.001s	sys 0.001s
I20260709 12:17:19.783686 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.784341 26534 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:19.785888 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 741) took 1341 ms. Trace:
I20260709 12:17:19.786345 22750 rpcz_store.cc:276] 0709 12:17:18.444936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.741422 (+296486us) service_pool.cc:224] Handling call
0709 12:17:18.804999 (+ 63577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:18.847066 (+ 42067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.785489 (+938423us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b54004056d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:19.785720 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145393536}
I20260709 12:17:19.787145 22748 raft_consensus.cc:2368] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:19.790936 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:19.791972 22744 raft_consensus.cc:2368] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
W20260709 12:17:19.793999 26612 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:17:19.795258 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.796048 22827 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:19.796272 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.796931 22822 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:19.803368 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:19.748929 26466 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:19.807657 22896 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:19.777873 26391 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:19.814023 22901 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: [12.7-14.8]
W20260709 12:17:19.819022 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.810844 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:19.820883 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.825065 22892 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:17:19.824994 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:19.825081 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:19.829634 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 743) took 1264 ms. Trace:
I20260709 12:17:19.830001 22896 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:19.831699 22896 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:19.830276 22752 rpcz_store.cc:276] 0709 12:17:18.564915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.758552 (+193637us) service_pool.cc:224] Handling call
0709 12:17:18.766865 (+  8313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:18.767105 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:19.723312 (+956207us) log.cc:844] Serialized 14 byte log entry
0709 12:17:19.828617 (+105305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:19.828723 (+   106us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:19.828849 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.828974 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:19.829417 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":699657,"prepare.queue_time_us":722179,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":102,"thread_start_us":339563,"threads_started":2}
I20260709 12:17:19.832904 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:19.833600 26607 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:19.834106 26607 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:19.834986 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:19.837179 26574 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:19.837736 26574 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.838477 26574 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:19.833773 22893 raft_consensus.cc:2368] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:19.839001 22900 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:19.802290 26314 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:19.841478 22820 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:19.825713 26391 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:19.843560 26618 log.cc:927] Time spent T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
I20260709 12:17:19.844106 26391 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:19.879875 22900 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:19.884366 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.885289 22819 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:19.885097 26129 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:19.886200 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:19.886936 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 129462us
I20260709 12:17:19.890200 26494 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:19.890717 26494 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.891114 26494 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:19.891391 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.891599 26582 consensus_queue.cc:1059] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:19.893465 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:19.895659 22819 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:19.894301 22823 raft_consensus.cc:2376] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12. Re-sending same reply.
I20260709 12:17:19.898983 22818 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:19.900668 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.899456 22827 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:17:19.916232 22827 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:19.919914 23695 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:19.921816 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.924005 22827 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:17:19.891130 26497 consensus_meta.cc:287] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.793s	user 0.016s	sys 0.002s
I20260709 12:17:19.943238 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.944600 22900 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:17:19.950591 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:19.951969 23660 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:19.934962 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:19.968055 22893 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:19.967861 22898 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:19.982861 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:19.984103 22825 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:19.987047 22894 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:19.987372 22901 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:20.001206 22823 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:20.010761 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:20.014868 22820 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:20.019939 22822 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:19.947962 26534 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:20.012310 22717 leader_election.cc:336] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.643s (SENT)
I20260709 12:17:20.032845 22750 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:20.030426 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:20.035475 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:20.039239 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 202543us
I20260709 12:17:20.045701 22748 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:20.046416 22825 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:20.053612 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:20.043128 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:20.059154 22747 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 13: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:20.057894 22752 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:20.062117 22753 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:20.073312 22751 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:17:20.040720 26497 raft_consensus.cc:3055] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:20.076907 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 740) took 1632 ms. Trace:
I20260709 12:17:20.081684 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:20.082731 22820 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:20.083256 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:20.080909 22749 rpcz_store.cc:276] 0709 12:17:18.444505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.729304 (+284799us) service_pool.cc:224] Handling call
0709 12:17:19.733177 (+1003873us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:19.759317 (+ 26140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.071430 (+312113us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b5400413a50. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:20.076813 (+  5383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2287920896}
I20260709 12:17:19.948216 26607 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:19.983435 22819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b"
dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
mode: GRACEFUL
new_leader_uuid: "2c3a0d56045540b7802937559599f09c"
 from {username='slave'} at 127.0.0.1:43202
I20260709 12:17:20.100867 22819 raft_consensus.cc:606] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Received request to transfer leadership to TS 2c3a0d56045540b7802937559599f09c
I20260709 12:17:20.101395 22819 raft_consensus.cc:614] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:20.111033 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:20.115298 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:20.080577 26497 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:20.121592 22823 raft_consensus.cc:2376] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11. Re-sending same reply.
I20260709 12:17:20.118888 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:20.153299 26471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.006s	sys 0.026s
W20260709 12:17:20.154076 26471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.006s	sys 0.027s
I20260709 12:17:20.155520 26611 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:17:20.159271 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:20.116336 26391 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:20.170089 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:20.192073 22746 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:20.201041 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:20.143812 26607 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:20.205243 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 239260us
W20260709 12:17:20.205943 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.213003 22819 raft_consensus.cc:2368] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13.
I20260709 12:17:20.114099 26534 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
W20260709 12:17:20.215587 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.219293 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:20.194136 26215 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:20.227499 26627 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:17:20.227712 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:20.230185 25718 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:20.230690 25718 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:20.232266 26628 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:17:20.237399 26624 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 12:17:20.239337 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 139671us
W20260709 12:17:20.241859 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 208335us
I20260709 12:17:20.185853 26526 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:20.186847 26550 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:20.257711 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:20.268689 22823 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:17:20.278445 26391 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:20.279294 26391 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:20.281805 26391 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:20.287230 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 440427us
I20260709 12:17:20.295127 26550 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:20.295445 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:20.312358 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:20.313205 22819 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:20.314810 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:20.323863 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 66243.1us
I20260709 12:17:20.311111 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:20.329581 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.340378 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:20.314953 26391 raft_consensus.cc:2764] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:17:20.239427 26497 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:20.357604 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:20.372274 26564 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:20.373385 26564 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:20.374913 23656 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:20.377526 26387 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:20.378334 26387 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:20.380846 26387 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:20.380940 22753 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:20.332399 26534 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:20.382802 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:20.384058 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:20.363997 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:20.393910 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 53807.7us
W20260709 12:17:20.395331 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 107881us
I20260709 12:17:20.395537 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:20.396479 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:20.397207 22746 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:17:20.404532 26430 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:20.406963 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 81981us
I20260709 12:17:20.414763 22823 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:20.416477 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:20.417555 22820 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 10: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:20.388727 26550 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:20.394006 26427 consensus_meta.cc:287] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.689s	user 0.016s	sys 0.001s
I20260709 12:17:20.397135 26391 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:20.406209 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:20.418596 22751 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:17:20.431109 22825 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:20.431219 26643 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:20.398974 26387 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:20.441723 22823 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:20.436506 26564 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:20.452911 26643 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.456599 26643 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:20.475723 26391 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:20.476554 26391 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:20.478868 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 865) took 1582 ms. Trace:
I20260709 12:17:20.478498 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:20.479744 26387 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.480255 26387 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:20.483155 22827 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:20.486057 25718 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:20.425308 26534 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:20.488814 26534 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:20.490090 22864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.018s	sys 0.030s
W20260709 12:17:20.490459 22864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.018s	sys 0.030s
I20260709 12:17:20.489886 26534 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:20.491989 26455 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.016s	user 0.008s	sys 0.008s
I20260709 12:17:20.493271 22821 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:17:20.494930 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 587981us
I20260709 12:17:20.445601 26427 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:20.501322 26622 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.448s	user 0.002s	sys 0.000s
I20260709 12:17:20.501560 26427 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:20.504659 22819 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
W20260709 12:17:20.509696 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 101479us
I20260709 12:17:20.479305 23695 rpcz_store.cc:276] 0709 12:17:18.861471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.861633 (+   162us) service_pool.cc:224] Handling call
0709 12:17:18.873524 (+ 11891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:19.920487 (+1046963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.389098 (+468611us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540028fd54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:20.444249 (+ 55151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405584768}
I20260709 12:17:20.516916 26637 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:20.520040 26358 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:20.466295 26643 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:20.525794 26643 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:20.527684 26129 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.642s	user 0.014s	sys 0.000s
I20260709 12:17:20.528401 26632 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.529013 26632 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:20.543052 26455 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:20.544190 26455 consensus_queue.cc:1243] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:20.544919 26607 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:20.545540 26607 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:20.546691 26607 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:20.548571 26607 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:20.554863 26633 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.555557 26632 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:20.555704 26633 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:20.564662 25718 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:20.567134 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50897.6us
I20260709 12:17:20.517611 26637 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:20.518363 26574 consensus_meta.cc:287] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.007s
W20260709 12:17:20.584138 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 105912us
W20260709 12:17:20.572386 26494 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.005s
I20260709 12:17:20.587244 22791 leader_election.cc:400] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:20.587726 22791 leader_election.cc:403] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:17:20.591440 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:20.592080 23685 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:17:20.593390 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:20.594329 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:20.595395 23659 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:20.628641 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:20.630277 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 59368us
I20260709 12:17:20.574312 26637 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:20.637671 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:20.580436 26391 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:20.652014 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.656047 22896 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:17:20.661563 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 83781.4us
I20260709 12:17:20.630062 26623 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:20.585117 26574 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:20.577744 26075 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:17:20.637722 26471 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
W20260709 12:17:20.670465 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.596799 26494 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:20.661175 26215 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:17:20.674355 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:20.676316 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:20.692627 23659 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:20.677929 26574 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:20.678918 22897 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:20.679116 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:20.679443 26075 consensus_queue.cc:1243] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:20.699590 22749 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:20.699990 23682 raft_consensus.cc:2368] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:20.679637 26568 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.668334 26623 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:20.683991 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 301385us
I20260709 12:17:20.653105 26631 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 12:17:20.687031 26477 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:17:20.693547 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:20.675563 26427 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:17:20.703017 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 69277.5us
I20260709 12:17:20.702370 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:20.694916 23695 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:20.680233 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:20.665473 26633 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:20.732514 26641 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:17:20.733806 26641 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:20.734251 26641 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:20.735481 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:20.738847 26640 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:20.732605 26427 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:20.718849 26568 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:20.739251 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 342863us
I20260709 12:17:20.740371 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:20.741263 26633 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:20.741605 26568 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:20.741676 26633 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:20.743026 26633 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:20.744015 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:20.749140 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.719823 26623 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:20.753693 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:20.754355 23660 raft_consensus.cc:2368] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:20.739428 26640 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:20.750887 26631 consensus_queue.cc:1243] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:20.773420 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:20.774842 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:20.777217 22790 leader_election.cc:400] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:20.777709 26631 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:20.778501 22790 leader_election.cc:400] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:20.778852 22790 leader_election.cc:403] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:17:20.768620 26649 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:17:20.781965 23660 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: [5.4-10.6]
I20260709 12:17:20.743359 26427 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:20.768270 26455 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.771121 26626 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:20.769335 26640 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:20.812805 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:20.820951 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:20.861835 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:20.862619 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:20.876453 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 106586us
I20260709 12:17:20.819769 26652 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:20.892884 26659 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
W20260709 12:17:20.894752 26657 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:17:20.895974 26646 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:17:20.897286 26534 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:20.813773 26471 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 12:17:20.897374 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 82402.3us
I20260709 12:17:20.876179 26626 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:20.912029 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:20.820369 26455 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:20.921798 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:20.924049 26473 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.924721 26473 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:20.932312 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:20.783298 26641 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:20.904901 26607 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 12:17:20.950021 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 137561us
I20260709 12:17:20.953327 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:20.955659 26574 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:20.959251 26568 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:20.959837 26568 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:20.960285 26568 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:20.955958 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45751.5us
I20260709 12:17:20.951440 26659 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:20.965791 23660 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:17:20.975071 26626 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:20.979487 26497 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:20.982995 26534 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:20.983723 26534 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:20.985893 26387 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 12:17:20.956955 26494 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:20.967360 26659 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:20.986445 26387 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:20.971917 26607 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:21.006294 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:20.990116 26534 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:21.011133 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 198384us
I20260709 12:17:21.007807 26473 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:21.004901 26629 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 12:17:21.015204 26661 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:17:21.027951 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:21.033685 26666 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:21.035177 26129 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:21.035471 26666 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:21.036305 26430 raft_consensus.cc:2764] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:17:21.037660 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:21.044215 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:21.035355 26455 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:21.050033 26664 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:17:21.050731 26466 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:21.051239 26466 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:21.051534 26664 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:21.051942 26664 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.052255 26466 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:21.053717 26466 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:21.055116 22748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "2c3a0d56045540b7802937559599f09c"
 from {username='slave'} at 127.0.0.1:41468
I20260709 12:17:21.055450 23682 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:17:21.057349 22748 raft_consensus.cc:606] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Received request to transfer leadership to TS 2c3a0d56045540b7802937559599f09c
I20260709 12:17:21.057855 22748 raft_consensus.cc:614] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:21.036434 26666 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:21.059725 23659 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:21.011315 26607 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:21.044780 26430 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:21.065763 23682 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:21.052294 26664 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:21.071605 22790 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:21.076898 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.077857 23659 raft_consensus.cc:2410] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:17:21.065121 26215 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:21.080078 26215 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:21.081314 26215 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:21.062295 26387 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:21.080229 26455 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:21.082754 26215 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:21.088361 22744 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:17:21.085675 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.090811 26455 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:21.091136 26534 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.091593 26455 consensus_queue.cc:1243] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:21.091773 26534 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:21.084602 26568 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:21.093617 22899 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:21.094421 26534 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:21.095084 26666 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:21.096571 26666 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:21.097380 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.098835 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.096480 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.086917 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.100224 22746 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:21.084756 22748 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:21.058885 26659 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.101581 26659 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:21.099586 22745 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:21.104501 22748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "2c3a0d56045540b7802937559599f09c"
 from {username='slave'} at 127.0.0.1:41468
I20260709 12:17:21.076778 26665 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:17:21.105897 22748 raft_consensus.cc:606] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Received request to transfer leadership to TS 2c3a0d56045540b7802937559599f09c
I20260709 12:17:21.106434 26665 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:21.106982 26075 raft_consensus.cc:3055] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:21.062105 26633 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.107440 26075 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:21.099594 26568 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:21.108289 26477 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:17:21.110052 26667 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:17:21.107002 26665 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:21.108507 26075 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:21.111857 26665 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.112535 26075 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:21.113376 26665 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:21.114216 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 224169us
I20260709 12:17:21.109318 26633 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:21.108870 26477 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:21.106487 22748 raft_consensus.cc:614] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:21.092401 26607 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:21.116976 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:21.118059 26477 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:21.121238 26637 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:21.116101 26471 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:21.132289 26471 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:21.121011 22750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:41468
I20260709 12:17:21.133589 26637 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:21.133517 26471 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:21.132562 26649 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.245s	user 0.000s	sys 0.004s
I20260709 12:17:21.134096 26641 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:21.077633 26640 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:21.135027 22894 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:17:21.135279 26471 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:21.135713 26387 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:21.135955 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:21.136395 26387 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:21.137521 26387 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:21.120814 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.139299 26651 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:21.139919 26651 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:21.129537 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:21.140815 22748 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:21.120762 26623 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:21.141175 26651 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.142930 26623 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:21.108486 26455 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:17:21.118724 26629 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.147452 26629 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:21.153059 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.137530 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:21.153842 22744 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:21.155645 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:21.158058 22751 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:21.161296 26640 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:21.160917 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.088382 26652 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:21.124298 23682 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:21.164340 23660 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 12:17:21.168792 26663 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:21.169612 26663 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:21.170696 26663 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:21.173055 22748 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:21.133545 22750 raft_consensus.cc:606] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:21.156361 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:21.177824 22744 raft_consensus.cc:1217] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-13.7]   Dedup: 7.4->[9.5-13.7]
I20260709 12:17:21.177568 22751 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:21.187027 22744 pending_rounds.cc:85] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 4
W20260709 12:17:21.180541 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 184573us
I20260709 12:17:21.200376 22744 pending_rounds.cc:107] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:17:21.201081 22744 raft_consensus.cc:2889] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:21.203897 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:21.207309 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:21.209012 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:21.198994 26652 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:21.189079 26633 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 12:17:21.179735 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 203862us
I20260709 12:17:21.220865 23493 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:21.196132 26391 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:21.241454 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:21.242401 22748 raft_consensus.cc:2393] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:17:21.247623 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45415.4us
I20260709 12:17:21.247088 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:21.257189 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.250402 26391 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:21.262064 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.258530 26652 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:21.262881 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:21.263146 26391 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.264794 22895 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:17:21.265988 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:21.266707 22896 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
W20260709 12:17:21.271104 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 114868us
I20260709 12:17:21.271617 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:21.271982 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:21.272409 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:21.273087 22823 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:17:21.272943 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:21.273206 22894 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:21.263902 22897 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:21.271660 22899 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:21.281101 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:21.271765 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.231912 26473 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 12:17:21.267680 26670 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 12:17:21.291580 23660 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:17:21.293084 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:21.289450 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:21.290424 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.279156 26075 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.271116 26574 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:21.263228 26652 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:21.300583 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.308395 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:21.310192 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.312601 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.313189 23660 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:21.315590 26129 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:21.316190 26129 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:21.306723 26471 raft_consensus.cc:2764] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:17:21.301213 26497 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:17:21.317173 26129 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:21.324266 26664 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.329360 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.330116 23656 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:21.331071 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.301934 26574 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.332898 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:21.285878 26430 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:17:21.360939 26430 consensus_queue.cc:1243] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:21.361982 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.363483 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.364480 23674 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:21.365283 23679 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:21.365389 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.366529 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.318539 26129 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:21.367157 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58865.6us
I20260709 12:17:21.368140 26215 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:21.302870 26652 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:21.368626 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:21.370090 26631 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.303395 26550 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:21.370672 26631 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:21.357669 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.358417 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:21.372216 23672 raft_consensus.cc:2368] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12.
I20260709 12:17:21.372278 22820 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:21.359275 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.373026 26631 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:21.360409 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:21.375231 22823 raft_consensus.cc:2410] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:17:21.379112 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 106246us
I20260709 12:17:21.381562 22791 leader_election.cc:400] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:21.383188 22827 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:21.395747 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.385113 23682 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
W20260709 12:17:21.406687 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 158292us
I20260709 12:17:21.297650 26455 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:17:21.408586 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.411578 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:21.415086 23660 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:21.412583 23659 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:21.425985 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:21.427173 22820 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 10: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:17:21.427662 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.301743 26075 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:21.428094 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 47500us
I20260709 12:17:21.386229 26574 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:21.433172 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.331982 26629 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:21.436520 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:21.442770 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.446686 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:21.454489 22821 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:21.447508 26631 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:21.448490 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:21.456892 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:21.459183 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.460014 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.464206 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.465116 23659 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:21.466657 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 213305us
I20260709 12:17:21.462680 23685 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:21.424203 26651 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:21.461340 22865 connection.cc:256] RPC call timeout handler was delayed by -1.7980616469999404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 12:17:21.428496 26685 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:21.472985 22865 connection.cc:256] RPC call timeout handler was delayed by -1.4282979550000618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 12:17:21.481925 22865 connection.cc:256] RPC call timeout handler was delayed by -1.3904979550000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:17:21.479945 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.483619 23660 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:21.471910 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:21.485330 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:21.482376 22865 connection.cc:256] RPC call timeout handler was delayed by -1.3625979549999556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 12:17:21.487720 22865 connection.cc:256] RPC call timeout handler was delayed by -1.2896979550000651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:17:21.488054 22865 connection.cc:256] RPC call timeout handler was delayed by -1.2545979550000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 12:17:21.488292 22865 connection.cc:256] RPC call timeout handler was delayed by -1.1895681749999767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 12:17:21.488523 22865 connection.cc:256] RPC call timeout handler was delayed by -1.1816979549998905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 12:17:21.488749 22865 connection.cc:256] RPC call timeout handler was delayed by -1.0214979550000862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
I20260709 12:17:21.491245 26682 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:21.491945 26682 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.492393 26682 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:21.496037 26075 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:21.426914 26652 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:21.498325 26676 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:17:21.499023 26652 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:21.499759 26652 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:21.500255 26652 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:21.459589 26662 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:21.501365 26652 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:21.503072 26662 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:21.503719 26662 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:21.512480 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 64058.2us
W20260709 12:17:21.514315 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:21.515074 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.487392 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:21.486672 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:21.517303 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:21.514875 23689 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:21.517993 22753 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:21.525147 23695 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:21.527246 22750 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:17:21.527973 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 65843.6us
I20260709 12:17:21.534647 23659 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:21.472426 26626 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:21.540795 26626 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:21.537385 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.486903 26664 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:21.479226 26387 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:17:21.543347 26684 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:21.515219 26685 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:21.487071 26651 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.549356 26430 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.549999 26430 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:21.551213 26651 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:21.553812 26387 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:21.554266 26387 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:21.555297 26387 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:21.556809 26387 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:21.559653 26666 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:21.560281 26629 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:17:21.552116 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 84656.4us
I20260709 12:17:21.567546 26663 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:21.567956 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:21.568830 26391 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:21.552464 26679 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:21.569103 26663 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:21.579787 26663 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:21.580719 26685 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:21.580847 26663 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.568925 26430 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:21.573062 26679 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:21.584615 26679 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:21.572533 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:21.587160 26665 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:21.588215 23656 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:21.592080 23660 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:21.579092 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:21.574330 23682 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:21.562489 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:21.596043 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:21.597982 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 110685us
I20260709 12:17:21.594029 22821 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:21.602350 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.605361 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:21.610378 22753 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:21.612903 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:21.603370 22750 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:21.631494 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:21.642110 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46477.9us
I20260709 12:17:21.578584 26455 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:17:21.648681 26477 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:21.651324 26574 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.652158 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:21.653846 26574 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:21.654148 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:21.648404 26129 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:21.654523 26629 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:21.655359 26395 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:21.663779 26471 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:21.574688 26550 raft_consensus.cc:993] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: : Instructing follower a89a4b420ea9496aab55475fc38bb6f7 to start an election
I20260709 12:17:21.588920 26497 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:21.673738 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 111333us
I20260709 12:17:21.676290 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:21.701786 22897 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:21.702651 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:21.670154 26665 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:21.560285 26666 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.578733 26075 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 12:17:21.575809 26626 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:21.679754 22899 raft_consensus.cc:2410] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:17:21.616061 26631 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:21.657099 26391 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:21.656351 26534 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:21.655953 26607 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:21.694015 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.577872 26659 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 12:17:21.703334 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.678362 22748 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:21.703522 22821 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:21.694654 26395 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:21.704142 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:21.730137 22827 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:21.696341 26471 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:21.648423 26651 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:17:21.708698 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.707162 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:21.700810 26685 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:21.689198 26455 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:21.684314 26129 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:21.712831 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:21.713939 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.718637 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:21.719326 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.719688 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:21.705905 26466 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.652s	user 0.013s	sys 0.000s
I20260709 12:17:21.719615 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.793007 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.792527 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.794914 23685 raft_consensus.cc:2368] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:21.795244 22819 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:21.677978 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:21.720466 22749 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
W20260709 12:17:21.730307 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 216540us
I20260709 12:17:21.707305 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.797118 23695 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:21.737340 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:21.795861 23659 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:21.731815 23674 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:17:21.736886 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:21.799554 22825 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:21.803085 22820 raft_consensus.cc:2376] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11. Re-sending same reply.
I20260709 12:17:21.713675 26631 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.804625 23689 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:21.804680 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:21.800794 22823 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:21.809142 22824 raft_consensus.cc:2410] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:17:21.696035 26629 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:21.818118 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 81909.7us
I20260709 12:17:21.732568 26395 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:21.737205 26075 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:21.740024 26471 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:21.823360 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.832357 23682 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:21.731731 26391 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:21.708433 26665 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:21.839771 26391 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:21.841195 26665 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:21.812736 26631 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:21.835500 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:21.835424 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.844915 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:21.792451 26455 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:21.814534 26680 raft_consensus.cc:1081] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Signalling peer a89a4b420ea9496aab55475fc38bb6f7 to start an election
I20260709 12:17:21.722232 26682 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:21.859716 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:21.834923 26215 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.868494 26215 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.875654 26215 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:21.825255 26075 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:21.804059 26685 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.888309 23679 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:21.888708 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:21.889652 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:21.891610 26574 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:21.893481 26129 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:21.904397 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:21.905613 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:21.909554 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 89637.9us
I20260709 12:17:21.916410 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:21.916898 22897 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:17:21.917380 22899 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:21.911494 26637 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:21.930395 22825 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:21.907056 26387 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:21.910483 26659 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:21.942968 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.918442 26637 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:21.919838 26665 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:17:21.967697 22717 connection.cc:256] RPC call timeout handler was delayed by -1.6350439339998957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 12:17:21.923959 26574 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:21.951013 26075 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:21.987393 26666 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:21.952008 26665 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.942138 26607 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:21.979972 26659 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.992868 26682 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:21.993481 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:17:21.994252 26698 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:17:21.994270 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 156115us
I20260709 12:17:21.995002 26626 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.005182 26685 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:21.944394 26696 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:22.008991 26637 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:22.010134 26629 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:22.057147 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:22.011178 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.013255 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:22.016250 26663 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:22.016326 22717 connection.cc:256] RPC call timeout handler was delayed by -1.1089880699998957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 12:17:22.058761 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:22.059228 22717 connection.cc:256] RPC call timeout handler was delayed by -1.1017880699998841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
I20260709 12:17:22.061952 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:22.020267 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:22.021070 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:22.018469 26477 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:22.049495 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:22.064391 26684 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:22.052819 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:22.065138 22820 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:22.065764 22744 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:21.971527 26697 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:21.947834 26387 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:22.066884 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 73539.8us
I20260709 12:17:22.055542 26568 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.033710 26665 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:22.102221 26697 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:22.103098 26682 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:22.104604 26697 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:21.947562 26455 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:22.105888 26697 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:22.106865 26703 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:22.107607 26631 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:22.109086 26395 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:22.068297 26626 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:22.110116 26631 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:22.102459 26471 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:22.111506 26626 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:22.112876 22825 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:22.113554 26473 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:22.114004 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.058911 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:22.101186 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:22.055658 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:22.115998 23656 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:22.116773 26473 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:22.116566 26568 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:22.116640 26497 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:22.066990 26633 raft_consensus.cc:2764] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:17:22.101922 26387 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:22.104918 26684 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:22.120482 26568 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:22.120803 26684 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:22.121896 26395 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:22.121690 26430 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:17:22.122077 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 66501.4us
I20260709 12:17:22.123027 26430 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:22.123612 26693 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:22.123682 26471 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:22.116194 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.102352 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:22.029170 26466 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:22.125427 26497 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:22.125854 26430 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.059379 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.121728 26684 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:22.138077 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:22.138895 22744 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:22.141804 22824 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
W20260709 12:17:22.145356 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 134268us
I20260709 12:17:22.146396 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:22.148011 22791 leader_election.cc:400] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:21.986555 26662 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:22.152086 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:22.154656 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:22.158197 22744 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:22.160377 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:22.155537 22790 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:22.163113 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:22.131592 26697 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:22.135218 26387 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:22.168569 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:22.141856 26430 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:22.168084 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 65839.2us
I20260709 12:17:22.044548 26659 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:22.175123 22748 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:22.162722 26696 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:22.183492 22747 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:22.140877 26494 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:17:22.134419 26466 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:22.141623 26534 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:22.162211 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:22.156143 26640 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:22.047582 26702 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 12:17:22.168179 26697 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:22.126832 26693 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:22.184450 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 125219us
I20260709 12:17:22.187777 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:22.203840 22823 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:22.174367 26666 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:22.143492 26633 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:17:22.168062 26471 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:22.169328 26684 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:22.159195 26641 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:22.153276 26663 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:22.102121 26607 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:22.101588 26574 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:22.173506 26709 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:22.198228 26637 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:22.247011 26637 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.247536 26637 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:22.249059 26430 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:22.248732 26697 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:22.237035 26693 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:22.252264 26693 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:22.217146 26215 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:22.257366 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.256772 26215 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:22.193533 26497 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:17:22.215545 26666 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:22.252249 26430 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:22.227206 26534 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:22.277127 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 57535.1us
I20260709 12:17:22.279994 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:22.281704 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:22.284962 26659 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:22.285319 26662 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:22.288079 26707 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:17:22.291603 26663 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:22.294704 26695 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.315s	user 0.005s	sys 0.000s
I20260709 12:17:22.295872 26709 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:22.299582 26717 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:17:22.303345 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:22.306553 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:22.275740 26666 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:22.312266 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:22.313114 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:22.316239 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:22.317824 22896 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:22.317849 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:22.320331 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:22.314213 22899 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
W20260709 12:17:22.323611 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 135994us
I20260709 12:17:22.324425 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.273038 26466 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:22.327940 26466 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:22.333840 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:22.339075 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:22.339839 22899 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:22.340898 26697 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:22.345979 22892 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:22.346560 22892 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:22.347566 22892 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:22.348734 22892 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:22.350311 26215 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:22.351728 26665 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:22.352890 22827 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:22.355069 22896 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:22.356405 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:22.359881 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.361573 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:22.362228 22745 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:22.362062 26666 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:22.318125 26641 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:22.365278 26633 consensus_queue.cc:1059] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:22.367376 26075 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:22.367805 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50746.7us
I20260709 12:17:22.368263 26663 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:22.369283 26455 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:22.370908 22745 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:22.373400 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:22.375837 26705 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.263s	user 0.003s	sys 0.000s
I20260709 12:17:22.381072 26652 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:22.410513 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:22.388751 26497 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:22.281697 26637 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:22.400641 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:22.356778 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 80623.4us
I20260709 12:17:22.403512 26633 raft_consensus.cc:3055] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:22.439754 22897 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:22.425673 26664 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:22.425184 26427 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:22.451026 26427 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.451472 26427 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:22.455389 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:22.445063 26637 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:22.445063 26666 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:22.432533 26685 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:22.463140 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:22.463976 22745 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:22.433018 26497 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:22.468879 26497 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:22.413915 26652 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:22.469672 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:22.470032 26652 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:22.473834 22892 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:17:22.493932 22892 pending_rounds.cc:85] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 5
I20260709 12:17:22.494288 22892 pending_rounds.cc:107] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:17:22.474254 26696 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:22.474833 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 150458us
I20260709 12:17:22.438076 26129 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:17:22.498330 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 59095.9us
I20260709 12:17:22.502115 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:22.502485 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:22.471302 26652 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:22.486114 26664 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:22.488286 22575 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 130) took 21776 ms (client timeout 15000 ms). Trace:
I20260709 12:17:22.511442 22827 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:22.494591 22892 raft_consensus.cc:2889] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:22.504853 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:22.496523 26722 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:17:22.506811 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.463912 26665 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:22.506291 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.432333 26633 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:22.474988 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.492903 26685 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:22.513939 26680 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:22.521136 23674 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:22.506170 26666 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:22.507726 26715 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:17:22.523375 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.538672 22827 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:22.527585 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:22.529729 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:22.548323 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.531467 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:22.542301 23494 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.548229 22897 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:22.549649 22900 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:22.550491 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:22.553545 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:22.555295 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:22.555953 22893 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:22.558274 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:22.558992 22827 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:22.522722 26129 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:22.561350 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:22.482517 26427 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:22.555862 22717 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.562s (SENT) [suppressed 20 similar messages]
I20260709 12:17:22.563014 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:22.562561 23679 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:22.564687 22894 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:22.565649 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:22.566421 22892 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:22.567189 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:22.534878 26723 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.567356 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:22.534353 26680 raft_consensus.cc:697] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:22.540494 26696 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:22.546232 26568 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:22.571605 22819 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:22.573021 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:22.572283 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:22.579052 23660 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:22.568256 23689 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:22.579628 22823 raft_consensus.cc:2410] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:17:22.576532 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:22.580507 22821 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:22.574870 23659 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:22.538753 23682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:45644
I20260709 12:17:22.581911 23682 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:22.582508 23682 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:22.582898 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:22.588384 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:22.567015 26664 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:22.580152 26215 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.588802 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:22.583572 26466 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.601485 26466 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:22.603879 26466 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:22.603528 22574 catalog_manager.cc:5697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 6 to 8, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 8 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:22.605341 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:22.568027 26129 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.608181 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:22.559757 26684 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:22.600131 22822 pending_rounds.cc:85] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 6
I20260709 12:17:22.616111 22822 pending_rounds.cc:107] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:17:22.589095 22824 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
W20260709 12:17:22.599100 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 98906.5us
I20260709 12:17:22.555053 26574 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:22.614640 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:22.599180 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:22.627753 22825 raft_consensus.cc:2410] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:22.584417 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:22.616525 22822 raft_consensus.cc:2889] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:22.618294 22893 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:22.622313 22827 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:22.561594 26702 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.646935 22748 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:22.623795 23682 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:22.596431 26427 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:22.636970 22818 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:17:22.639932 22820 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:22.606650 22574 catalog_manager.cc:5697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:22.643329 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:22.642195 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56165.5us
I20260709 12:17:22.651921 23660 raft_consensus.cc:2410] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:22.652160 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:22.653635 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:22.612082 26129 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:22.582005 26696 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:22.569250 26693 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:17:22.597891 26568 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:22.577368 26430 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:17:22.625092 26684 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.667361 22825 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:22.663573 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:22.597666 26664 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:22.598369 26685 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:22.599772 26215 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:22.677695 22574 catalog_manager.cc:5697] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 5 to 7, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 7 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:22.717696 23682 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:22.511803 22575 rpcz_store.cc:269] 0709 12:17:00.711607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.711962 (+   355us) service_pool.cc:224] Handling call
0709 12:17:22.488099 (+21776137us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:20.675061 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:20.708954 (+ 33893us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:20.709005 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:17:20.709039 (+    34us) tablet.cc:662] Decoding operations
0709 12:17:20.710470 (+  1431us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:20.710593 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:20.710618 (+    25us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:17:20.903452 (+192834us) tablet.cc:701] Row locks acquired
0709 12:17:20.903514 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:17:20.903816 (+   302us) write_op.cc:270] Start()
0709 12:17:20.904051 (+   235us) write_op.cc:276] Timestamp: P: 1783599440903708 usec, L: 0
0709 12:17:20.904091 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:17:20.954854 (+ 50763us) log.cc:844] Serialized 5623 byte log entry
0709 12:17:21.402263 (+447409us) op_driver.cc:464] REPLICATION: finished
0709 12:17:21.858984 (+456721us) write_op.cc:301] APPLY: starting
0709 12:17:21.874727 (+ 15743us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:21.914288 (+ 39561us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:21.919232 (+  4944us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:21.986519 (+ 67287us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:21.986945 (+   426us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:17:21.987023 (+    78us) write_op.cc:312] APPLY: finished
0709 12:17:21.987500 (+   477us) log.cc:844] Serialized 100 byte log entry
0709 12:17:21.987731 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:21.987925 (+   194us) write_op.cc:454] Released schema lock
0709 12:17:21.988001 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:21.988616 (+   615us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:21.988654 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4164034,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":409859,"apply.run_cpu_time_us":5971,"apply.run_wall_time_us":151729,"num_ops":14,"prepare.queue_time_us":475982,"prepare.run_cpu_time_us":21233,"prepare.run_wall_time_us":541035,"raft.queue_time_us":70269,"raft.run_cpu_time_us":64472,"raft.run_wall_time_us":311123,"replication_time_us":497887,"thread_start_us":679573,"threads_started":4,"wal-append.queue_time_us":224057}]]}
W20260709 12:17:22.698770 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.597077 26680 consensus_queue.cc:237] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:22.581007 26723 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:22.724248 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 60748.2us
I20260709 12:17:22.727029 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.728816 22574 catalog_manager.cc:5697] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 5 to 7, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 7 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:22.730036 22823 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:22.690656 26607 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:22.735291 22821 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:17:22.687084 26696 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:22.656672 26702 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:22.741324 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:22.734948 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 179084us
W20260709 12:17:22.752780 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.719365 26684 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:22.720045 26471 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:22.768890 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.732112 26466 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:22.762773 22574 catalog_manager.cc:5697] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 7 to 9, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 9 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:22.743395 26607 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.754609 26659 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:22.782207 22748 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:22.783963 22821 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
W20260709 12:17:22.786391 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 50229.1us
I20260709 12:17:22.775597 26466 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.780544 26607 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:22.765614 26708 consensus_queue.cc:1059] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:17:22.812690 26708 raft_consensus.cc:3055] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:22.813148 26708 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:22.789224 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:22.815140 22748 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:22.815500 22748 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:22.781100 26697 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:17:22.815945 26666 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:22.790593 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:22.816716 22820 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:17:22.794166 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.816324 22748 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:22.816217 26641 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:22.818199 22748 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:22.819041 22895 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:22.773023 26471 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:22.821275 26471 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:22.772681 26662 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 12:17:22.799881 26729 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:17:22.801931 26723 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:22.803485 26702 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:22.814200 26708 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:22.824618 26682 consensus_queue.cc:1059] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:22.828756 22748 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
W20260709 12:17:22.829716 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.810070 26215 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:22.772888 26706 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:17:22.788098 26568 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:22.817587 26664 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:22.825650 26708 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:22.809195 22574 catalog_manager.cc:5697] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 11. New cstate: current_term: 11 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
W20260709 12:17:22.827734 26727 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.144s	user 0.000s	sys 0.002s
W20260709 12:17:22.838706 26731 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:17:22.846354 22865 leader_election.cc:400] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13.
I20260709 12:17:22.845957 26633 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:22.796804 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 159405us
I20260709 12:17:22.797951 26466 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:17:22.848404 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 87602.3us
I20260709 12:17:22.846838 22865 leader_election.cc:403] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:17:22.849545 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 58324.3us
I20260709 12:17:22.849947 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:22.853196 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:22.854223 23493 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:22.855471 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:22.856032 26663 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:22.856590 26662 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:22.854669 22753 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:17:22.838838 26706 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:22.860786 26633 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:22.858898 26427 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13.
I20260709 12:17:22.882727 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:22.866318 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:22.888844 22897 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:22.863468 26662 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:22.861027 26663 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:22.865092 26706 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:22.915640 26737 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:17:22.933928 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 57831.4us
I20260709 12:17:22.916474 26735 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:22.867228 26550 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:22.865435 26497 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:17:22.928090 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 186798us
I20260709 12:17:22.939493 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:22.940696 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 74700.5us
I20260709 12:17:22.941883 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.900439 26640 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:22.924813 26662 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:22.898531 26129 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:22.933743 26663 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:22.899892 26739 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:22.935547 26631 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:22.957623 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.946633 26723 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:22.953719 26743 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:17:22.975057 26075 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:22.977538 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:22.939317 26550 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:22.972990 26704 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:22.981527 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.986742 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:22.991763 22897 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:22.995101 26682 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:22.996755 26497 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:22.997934 26497 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:22.998584 26682 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.004248 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:23.005084 22895 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:23.006688 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:23.008072 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.963505 26735 consensus_queue.cc:1243] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:22.964377 26666 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:17:23.001956 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:23.037283 22820 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:23.040994 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 50243.3us
I20260709 12:17:22.991178 26550 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:23.013280 26534 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.051859 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:23.063385 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:23.076176 22820 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:23.077461 22791 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:23.035732 26735 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:23.082263 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:22.990423 26723 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:23.085537 22826 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:23.029968 26682 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:23.036752 26697 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:17:23.040861 26607 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:23.112679 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 55013.8us
I20260709 12:17:23.113675 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:23.114048 26607 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:23.115010 26568 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:17:23.116410 26747 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:17:23.116611 26723 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:23.030072 26704 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:23.119323 26704 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:23.080420 26215 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:23.120700 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 335654us
I20260709 12:17:23.121639 22818 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:23.084205 26631 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:23.084064 26075 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:23.127308 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.128412 22753 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
W20260709 12:17:23.123703 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 261278us
I20260709 12:17:23.102191 26640 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:23.031518 26706 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:23.133692 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.079487 26739 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:23.138155 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:23.108206 26702 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.120653 26471 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:23.147212 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:23.075698 26534 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:23.110633 26751 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.140988 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:23.142290 22753 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:23.155145 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:23.160207 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:23.142815 23656 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:23.144785 22745 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:23.155285 26706 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:23.145462 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:23.162101 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:23.143370 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 228703us
W20260709 12:17:23.131701 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 174186us
I20260709 12:17:23.150990 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.192643 22751 raft_consensus.cc:2368] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10.
I20260709 12:17:23.144496 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:23.155112 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:23.193493 22899 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:23.193564 23660 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:23.127691 26075 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:23.173775 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.151953 26471 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:23.181619 26746 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:17:23.191161 22895 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:23.139881 26704 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.141464 26750 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.224191 22899 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:23.142136 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:23.153605 23682 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:17:23.192668 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:23.226032 23682 pending_rounds.cc:85] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 6
I20260709 12:17:23.226372 23682 pending_rounds.cc:107] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:17:23.231149 23682 raft_consensus.cc:2889] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:23.141631 26631 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:23.232892 26631 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:23.191489 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.196859 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:23.199419 26759 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.236096 26534 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:23.236387 26759 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:23.197479 26075 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:23.157037 26708 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.243086 26708 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:23.244042 26684 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:23.162469 26751 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:23.245114 26708 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:23.207739 26471 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:23.246659 26751 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:23.208655 26682 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:23.155611 26702 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:23.248895 26702 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:23.197374 26685 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:17:23.189846 26696 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:23.218847 26640 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:17:23.252434 26640 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:23.252487 26684 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:23.147717 26659 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:23.258356 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:23.259183 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 66619.2us
I20260709 12:17:23.259495 22898 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:23.252862 26640 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:17:23.254384 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:23.257285 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 115275us
I20260709 12:17:23.271893 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:23.196429 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:23.227355 26750 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:23.277276 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.258291 23674 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:23.260254 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:23.278111 22753 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:23.238538 26759 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:23.272281 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.273662 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:23.274646 26659 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:23.275055 26684 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:23.262595 26723 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:23.263190 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:23.263633 26129 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:23.278168 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:23.278093 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:23.254940 26739 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:23.288441 22893 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:23.290350 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.291918 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:23.292233 22790 leader_election.cc:400] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10.
W20260709 12:17:23.292805 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 68843.1us
I20260709 12:17:23.303690 22790 leader_election.cc:403] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:17:23.277442 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 81115.8us
I20260709 12:17:23.298306 26696 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:23.218601 26662 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:23.233916 26466 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:23.301651 22744 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:17:23.304487 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:23.305331 26751 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10.
I20260709 12:17:23.309273 26762 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.309805 26685 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:23.309530 26640 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:23.279201 26764 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:23.287309 26708 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:23.315964 23493 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:23.226369 26704 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:23.321575 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:23.322434 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:23.327311 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:23.327905 26750 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:23.312127 26665 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.301137 26723 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.334690 26466 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:23.328207 26759 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 12:17:23.330915 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.331445 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:23.332970 26663 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:23.303084 26666 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:23.351045 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.350811 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:23.355954 22748 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:23.357542 23679 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:23.359233 23682 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:23.295039 26702 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:23.352602 26708 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:23.363981 26473 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:23.391873 26756 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:23.396917 26473 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:23.397027 26756 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.397475 26756 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:23.397166 26763 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:17:23.397890 26473 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:23.399338 26473 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:23.399906 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 68577.7us
I20260709 12:17:23.364837 26704 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:23.353996 26215 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:23.402992 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 46740.2us
I20260709 12:17:23.402895 26215 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:23.301065 26633 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:17:23.407826 26633 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:23.408308 26633 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:23.409019 26662 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:23.370744 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.409348 26633 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:23.334956 26742 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:23.346730 26696 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:23.375844 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:23.382799 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 67011.1us
I20260709 12:17:23.415585 22899 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:23.389206 22753 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:23.409052 26215 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:23.422096 22752 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:23.423362 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:23.424412 22901 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:23.343967 26685 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:23.427115 26685 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:23.428018 26497 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:17:23.430442 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.368436 26755 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:17:23.431774 26755 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:23.432265 26755 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:23.433393 26755 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:23.436658 26663 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:23.436956 26764 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.354210 26680 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:17:23.439195 26666 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:23.439599 26215 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.439700 26760 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.440128 26215 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:23.440356 26666 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:23.440506 26760 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:23.437881 26764 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:23.383978 26665 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:23.443461 26742 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.384970 26723 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:23.444077 26742 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:23.369886 26693 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:17:23.449828 26708 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:23.346391 26762 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:23.438459 26680 raft_consensus.cc:3055] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:17:23.497936 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 69940.5us
I20260709 12:17:23.465690 22790 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:23.489908 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 88406.4us
I20260709 12:17:23.510203 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:23.515615 22898 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:23.550019 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.557096 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:23.557883 22893 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
W20260709 12:17:23.559542 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 258348us
I20260709 12:17:23.560629 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:23.566365 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44956.1us
I20260709 12:17:23.573884 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:23.502429 26680 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:23.571687 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:23.567183 26702 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:23.507789 26748 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.515425 26750 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:23.583487 22901 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:23.585870 22894 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:23.555734 26755 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:23.567734 26633 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:23.590292 22898 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:23.597349 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:23.628324 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:23.508889 26427 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:17:23.585039 26550 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.507s	user 0.000s	sys 0.013s
I20260709 12:17:23.517577 26075 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:23.643884 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:23.608383 26659 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:23.575695 26534 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:17:23.685295 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 83467.5us
I20260709 12:17:23.680380 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.628381 26750 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.686772 22748 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:23.688663 22750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:41468
I20260709 12:17:23.692566 22750 raft_consensus.cc:606] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:23.687979 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.693041 22750 raft_consensus.cc:614] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:23.691910 22790 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:23.696651 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:23.697631 23674 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:23.625702 26215 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:23.704057 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.709074 22748 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:23.670368 26704 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:23.678730 26684 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:23.656225 26631 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:23.704057 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:23.705001 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:23.716776 22752 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:23.717619 22818 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:17:23.717944 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:23.721676 23682 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:23.721029 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:23.677834 26742 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:23.781874 23682 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:23.710484 26680 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:23.762589 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:23.766227 26767 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:17:23.770107 26766 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:17:23.770212 26685 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:23.711459 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:23.715102 26684 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:23.721449 26631 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.679926 26550 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:23.779075 26760 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:23.694399 26729 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:17:23.782585 23679 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:23.783876 23660 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:23.694494 26750 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:23.687829 26752 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:23.686888 26764 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:23.628742 26748 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:23.790663 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 205726us
I20260709 12:17:23.862522 22751 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:17:23.810103 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:23.863737 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.719916 26704 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.710664 26754 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:17:23.835217 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 123992us
I20260709 12:17:23.781525 26215 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:17:23.783262 22624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 57389.8us
I20260709 12:17:23.830983 26631 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:23.870556 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 298879us
I20260709 12:17:23.831295 26682 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.827373 26665 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:23.846531 22744 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.004s
I20260709 12:17:23.873903 22744 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:23.875273 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:23.851446 26641 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:23.852048 26680 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:23.825990 26742 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:17:23.854399 26752 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.867754 26704 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:23.867866 26754 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.868316 26764 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:23.868547 26215 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.872506 26696 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:23.948197 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:23.948978 22898 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:23.905663 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:23.852628 26760 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:23.880960 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.000s	sys 0.006s
W20260709 12:17:23.955155 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.007s
W20260709 12:17:23.955554 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 614114us
W20260709 12:17:23.923238 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48531.9us
I20260709 12:17:23.951872 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:23.955986 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:23.956749 22744 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:23.956853 22901 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:23.963426 22744 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:23.907975 26641 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:23.907663 26455 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:23.965198 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 59648.2us
I20260709 12:17:23.984910 22746 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:23.912506 26665 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:23.988869 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:23.987536 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:23.992570 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:23.995512 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:23.998135 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:23.940420 26215 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:23.878368 26682 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:23.941136 26764 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.003989 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:24.008615 23682 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:23.934579 26752 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:23.872918 26756 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:23.993404 22895 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
W20260709 12:17:24.003542 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.012594 22894 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:24.015163 22898 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:24.020115 26783 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:23.941427 26754 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:24.032616 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 47637.5us
I20260709 12:17:23.993278 26466 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:23.996634 26641 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:24.046134 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:24.010236 26696 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:24.006964 26663 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.025468 26697 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:24.049073 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.064154 23679 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:24.050719 22790 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:24.160151 22898 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:24.153349 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:24.154422 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:23.934051 26684 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.024785 26764 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:24.164048 23498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.013s	sys 0.040s
I20260709 12:17:24.040552 26759 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.008621 26739 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:17:24.044483 26568 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:17:24.193284 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 189362us
I20260709 12:17:24.000087 26455 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:24.181440 23498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.013s	sys 0.040s
I20260709 12:17:24.160995 23672 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:24.051414 26075 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:24.191120 22901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:24.006728 26760 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.002575 26665 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:24.272375 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.273470 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.273916 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.276714 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:24.078293 26696 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.280653 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:24.303722 22898 raft_consensus.cc:2368] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12.
I20260709 12:17:24.174598 26753 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:24.292126 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.293278 22901 raft_consensus.cc:606] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:24.307045 22895 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:17:24.315297 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.316375 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.317945 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.318912 22899 raft_consensus.cc:2368] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14.
W20260709 12:17:24.322470 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 310162us
W20260709 12:17:24.325027 22867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.016s	sys 0.019s
I20260709 12:17:24.325726 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:24.353886 22867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.016s	sys 0.022s
I20260709 12:17:24.354774 22894 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:24.356405 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.359308 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.358870 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.372180 22895 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:24.058548 26783 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.259933 26684 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:24.301312 26473 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.901s	user 0.017s	sys 0.008s
I20260709 12:17:24.380769 22895 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:24.385368 22896 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:24.380678 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.391391 22893 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:24.174090 26663 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:24.294040 26568 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:24.415964 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:24.417268 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.416424 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.418679 22899 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:24.419642 22893 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:24.322959 26427 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:24.314610 26696 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:24.200029 26759 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:24.371625 26685 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:24.383374 26075 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:24.389178 26640 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:24.399817 26697 raft_consensus.cc:697] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:24.445616 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.391930 26550 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:24.428296 26666 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.331117 26753 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.439157 26473 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:24.434365 26748 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:24.442128 26427 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:24.454545 26739 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:24.478955 26708 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.028s	user 0.016s	sys 0.001s
I20260709 12:17:24.497758 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.506474 22893 raft_consensus.cc:2410] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:24.510267 22894 raft_consensus.cc:2410] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:17:24.512814 22901 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:17:24.513168 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 462515us
I20260709 12:17:24.468777 26782 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:24.518740 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:24.459506 26075 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.523762 22894 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:24.523633 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:24.489102 26666 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:24.549024 26768 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.521s	user 0.001s	sys 0.001s
I20260709 12:17:24.549629 26776 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:24.550760 26810 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:24.551898 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 808) took 1237 ms. Trace:
I20260709 12:17:24.553052 26753 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:24.553505 26777 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.494s	user 0.001s	sys 0.001s
I20260709 12:17:24.539149 26780 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:24.556087 26471 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.310s	user 0.014s	sys 0.000s
I20260709 12:17:24.556607 26471 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.558997 22899 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:24.560042 26811 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.560679 26811 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.561576 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:24.531396 26697 consensus_queue.cc:237] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.565412 23682 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:24.566630 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.525257 26568 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:24.567101 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:24.566687 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:24.567951 23689 raft_consensus.cc:2368] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15.
I20260709 12:17:24.567811 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:24.567423 23656 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:24.568740 23659 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:24.525578 26782 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:24.571798 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:24.501691 26473 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:24.550489 26776 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:24.574216 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:24.578327 22865 connection.cc:256] RPC call timeout handler was delayed by -1.96185672300021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
I20260709 12:17:24.579627 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:24.614244 22865 connection.cc:256] RPC call timeout handler was delayed by -1.8484567230000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260709 12:17:24.514735 26708 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.590298 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:24.579209 26807 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.591425 22893 raft_consensus.cc:2410] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:17:24.507823 26739 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.599984 22894 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:24.591702 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:24.584084 26455 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:24.603487 26550 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:24.605033 26808 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:17:24.609112 26805 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 12:17:24.609709 26790 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:24.552389 22747 rpcz_store.cc:276] 0709 12:17:23.314711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.314880 (+   169us) service_pool.cc:224] Handling call
0709 12:17:23.315198 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.322990 (+  7792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:23.323029 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:23.323601 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 12:17:23.507783 (+184182us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:23.507846 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.507947 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:24.551626 (+1043679us) raft_consensus.cc:1685] finished
0709 12:17:24.551652 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.551823 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":23951,"thread_start_us":133254,"threads_started":1,"wal-append.queue_time_us":384624}
I20260709 12:17:24.615469 22899 raft_consensus.cc:2410] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 12:17:24.617018 22865 connection.cc:256] RPC call timeout handler was delayed by -1.8178567230002045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 12:17:24.618104 26723 consensus_meta.cc:287] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.173s	user 0.012s	sys 0.005s
W20260709 12:17:24.660985 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.000s	sys 0.015s
I20260709 12:17:24.621033 26760 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:24.655712 22865 connection.cc:256] RPC call timeout handler was delayed by -1.80885672300019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 12:17:24.663054 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.000s	sys 0.016s
I20260709 12:17:24.650478 23659 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
W20260709 12:17:24.695399 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 706546us
I20260709 12:17:24.648628 26808 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:24.712363 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:24.714491 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:24.695434 22865 connection.cc:256] RPC call timeout handler was delayed by -1.7125567230000343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:17:24.715751 22865 connection.cc:256] RPC call timeout handler was delayed by -1.7044567230000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 12:17:24.716276 22865 connection.cc:256] RPC call timeout handler was delayed by -1.6927567230002296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 12:17:24.716550 22865 connection.cc:256] RPC call timeout handler was delayed by -1.6729567230001976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 12:17:24.716789 22865 connection.cc:256] RPC call timeout handler was delayed by -1.5667567230000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 12:17:24.717692 22865 connection.cc:256] RPC call timeout handler was delayed by -1.3948567230002027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 12:17:24.718175 22865 connection.cc:256] RPC call timeout handler was delayed by -1.379556723000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 12:17:24.611511 26427 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.731235 26759 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:24.665470 26789 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 12:17:24.718418 22865 connection.cc:256] RPC call timeout handler was delayed by -1.3786567230001765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 12:17:24.711220 26466 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:24.697626 26704 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.734s	user 0.012s	sys 0.000s
I20260709 12:17:24.663622 26665 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:24.652137 26813 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:24.740203 22865 connection.cc:256] RPC call timeout handler was delayed by -1.3696567230001619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 12:17:24.781672 22865 connection.cc:256] RPC call timeout handler was delayed by -1.3408567230001154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 12:17:24.782145 22865 connection.cc:256] RPC call timeout handler was delayed by -1.2958567230000426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
I20260709 12:17:24.718698 26471 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:24.718567 26706 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:24.731648 26666 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:24.740579 26816 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:24.716785 26808 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:24.695647 26723 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.644239 26807 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:24.740269 26795 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.243s	user 0.001s	sys 0.001s
I20260709 12:17:24.728866 26663 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:24.783669 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:24.719717 26783 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:24.743983 26759 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:24.662583 26790 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:24.794996 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.781994 26781 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.777992 26799 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:24.804719 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:24.787850 26706 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:24.828224 26793 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:17:24.832005 26471 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.833024 26790 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:24.833233 26666 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.652268 26782 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.793342 26816 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:24.800585 26215 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.004s
W20260709 12:17:24.841923 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.779691 26704 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.855222 26809 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:24.850878 26471 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.858979 26815 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:24.859329 26471 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:24.804375 26075 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:24.859709 26739 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:24.860667 26706 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:24.861896 26706 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:24.863221 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58607.7us
I20260709 12:17:24.843631 26799 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:24.865471 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:24.845211 26473 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:24.792853 26801 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:17:24.839243 26781 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.833542 26466 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.802496 26759 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:24.849882 26633 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.189s	user 0.012s	sys 0.004s
I20260709 12:17:24.859911 26471 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.852785 26811 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:24.859669 26815 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.866998 26822 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.929771 26822 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.930712 22893 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:24.932335 26822 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:24.867470 26799 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:24.866698 26750 consensus_meta.cc:287] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.004s	user 0.000s	sys 0.010s
I20260709 12:17:24.868742 26801 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:24.933979 26750 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:24.934556 26801 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:24.935549 26801 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.936337 26750 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:24.936882 26801 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:24.938651 26754 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.867s	user 0.005s	sys 0.006s
I20260709 12:17:24.874650 26780 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:24.939134 26754 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:24.879253 26666 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.941577 26754 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:24.942044 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.943652 22892 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:24.867460 26804 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:24.947335 26755 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.947925 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:24.949555 26809 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:24.950107 26809 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.894754 26816 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:24.951424 26756 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:24.953235 22895 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:24.895352 26471 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.794195 26813 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.895251 26781 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:24.956308 26471 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:24.898979 26784 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:24.899721 26817 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:24.958312 26817 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.959975 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.960841 26817 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:24.904098 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:24.962379 26770 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.318s	user 0.009s	sys 0.000s
W20260709 12:17:24.958606 26752 consensus_meta.cc:287] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.907s	user 0.006s	sys 0.005s
I20260709 12:17:24.964130 26752 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:24.964980 22826 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
W20260709 12:17:24.965646 26775 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 1.109s	user 0.000s	sys 0.002s
I20260709 12:17:24.899616 26776 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:24.911388 26215 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.904413 26762 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:24.968327 26816 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.968796 26215 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:24.878944 26759 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:24.914202 26811 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.914923 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:24.969995 26759 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:24.970530 22744 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:24.970134 26811 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.916069 26815 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:24.916692 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1071) took 1647 ms. Trace:
I20260709 12:17:24.972666 26811 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:24.905946 26723 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:24.973989 26816 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:24.965811 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:24.907604 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 810) took 1591 ms. Trace:
I20260709 12:17:24.975600 22900 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:24.975639 22751 rpcz_store.cc:276] 0709 12:17:23.316331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.331557 (+ 15226us) service_pool.cc:224] Handling call
0709 12:17:23.332036 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:23.863299 (+531263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.907233 (+1043934us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b540043ec54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:24.907513 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219321088}
I20260709 12:17:24.977598 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:24.870669 26631 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.966s	user 0.005s	sys 0.007s
I20260709 12:17:24.925069 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.925395 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:24.979827 22901 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:24.980100 22896 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:24.980741 26631 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:24.953236 22825 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:17:24.932377 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:24.984704 22894 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:17:24.916949 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.985448 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:24.987957 22895 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:17:24.979063 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:24.986969 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.972313 22746 rpcz_store.cc:276] 0709 12:17:23.269267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.270353 (+  1086us) service_pool.cc:224] Handling call
0709 12:17:23.273447 (+  3094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:23.994336 (+720889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.906724 (+912388us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54004704d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:24.916612 (+  9888us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597386624}
W20260709 12:17:25.038817 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 50125.4us
I20260709 12:17:25.013375 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.034541 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.060799 22827 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:25.060583 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:25.059952 22821 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:25.014173 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.062798 22819 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:25.059011 22823 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:25.051743 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:25.065085 22893 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:25.054178 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:25.066165 22898 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:24.995985 22900 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
W20260709 12:17:24.924575 26764 consensus_meta.cc:287] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.002s
I20260709 12:17:25.071476 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.073406 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:25.072746 22745 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:25.091341 22748 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:25.075862 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:24.921607 26684 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.003s
W20260709 12:17:24.928805 26641 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.766s	user 0.007s	sys 0.004s
I20260709 12:17:24.991423 22751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:41468
W20260709 12:17:24.992129 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.102021 22751 raft_consensus.cc:606] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:25.104871 22751 raft_consensus.cc:614] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:24.887476 22865 leader_election.cc:400] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12.
I20260709 12:17:25.081214 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:24.995718 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.110386 22823 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:25.110654 22826 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 7.
I20260709 12:17:25.111503 22896 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
W20260709 12:17:24.881067 26680 consensus_meta.cc:287] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.964s	user 0.010s	sys 0.002s
I20260709 12:17:25.100728 26764 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.130113 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:25.130548 26813 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:25.131047 23659 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:25.132570 26764 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:25.133639 26736 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.055547 22565 maintenance_manager.cc:419] P cca02bb097e24340a2d738fc4f06877d: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033336
I20260709 12:17:25.134451 26736 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.043993 22895 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:25.092303 22752 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:17:24.927232 26696 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:25.130208 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:25.088876 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:25.138767 23682 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:25.039085 26811 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:25.075822 26497 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:25.096467 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.139652 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:25.140574 22896 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:17:25.090378 26809 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:24.928056 26708 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:24.918766 26682 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.038357 26817 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.942138 26666 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:25.043252 26816 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.104929 22894 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:25.105458 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:25.002023 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.160449 22820 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:25.105775 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:25.161459 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.056068 26574 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.106683 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:25.109280 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.112392 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.067703 23494 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.106889 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:25.115504 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.117287 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.120967 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:25.124737 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:25.169770 22901 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:25.169859 23674 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:24.948001 26755 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:24.928234 26665 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.094769 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 811) took 1674 ms. Trace:
I20260709 12:17:24.913966 26704 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:24.891026 26807 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:25.144656 22748 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
W20260709 12:17:25.144758 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 257523us
I20260709 12:17:25.097416 26742 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.147730 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:25.145712 23659 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:25.149679 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:25.180955 23685 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:25.106873 26760 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.087041 26762 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:17:25.162729 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:25.184430 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.184783 22820 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:25.164250 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:25.093089 26776 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:17:25.165346 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:25.169756 22745 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:25.176987 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:25.177271 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 109680us
I20260709 12:17:25.107788 26641 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:25.174552 22753 rpcz_store.cc:276] 0709 12:17:23.420586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.423682 (+  3096us) service_pool.cc:224] Handling call
0709 12:17:23.424039 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.424497 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:23.573505 (+149008us) log.cc:844] Serialized 14 byte log entry
0709 12:17:23.903764 (+330259us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:23.987069 (+ 83305us) log.cc:844] Serialized 26 byte log entry
0709 12:17:23.987299 (+   230us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:23.987356 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.987455 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:25.094514 (+1107059us) raft_consensus.cc:1685] finished
0709 12:17:25.094535 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.094690 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183424,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":15153,"raft.queue_time_us":2808,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":18319,"thread_start_us":437925,"threads_started":2,"wal-append.queue_time_us":477618}
I20260709 12:17:25.203610 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.181459 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:25.165349 26497 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:25.190174 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.206979 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:25.207243 23689 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 10: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:25.193152 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.208389 23685 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:25.208617 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:25.210009 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:25.193971 22752 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:25.195155 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.209535 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:25.200588 22894 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:25.171365 26682 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.204195 22753 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 8.
I20260709 12:17:25.207391 22746 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:25.217098 22745 raft_consensus.cc:2410] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:17:25.216046 22820 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:25.219153 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.220008 22820 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:25.221971 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:25.222589 22898 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:25.224753 26466 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:25.225389 26808 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:25.225884 26824 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:25.227053 26682 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:25.227818 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:25.228490 23685 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:25.229432 26682 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.229990 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:25.231127 26708 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:25.231679 26708 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:25.231566 26497 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.232860 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:25.233443 23685 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:25.233963 26708 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:25.234937 23659 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:25.149451 26811 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:25.227190 26666 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:25.236166 22751 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:25.225387 26466 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:25.269343 26466 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:25.271020 26752 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.272339 23685 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
W20260709 12:17:25.277441 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:25.277781 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.283680 26755 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:25.285822 26696 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.209486 26760 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:25.287721 23695 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:25.288748 26760 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:25.289470 26776 consensus_queue.cc:1243] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:25.206357 26807 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:17:25.293888 26809 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:25.189772 26742 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:25.297171 26742 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.302564 26641 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:25.303684 22897 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:25.245172 26704 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:25.305157 26704 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.305575 26704 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:25.310446 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.162354 26817 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:25.321112 22827 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:25.322309 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1404) took 1039 ms. Trace:
I20260709 12:17:25.215145 26736 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:25.323026 22892 rpcz_store.cc:276] 0709 12:17:24.273306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.273540 (+   234us) service_pool.cc:224] Handling call
0709 12:17:25.312436 (+1038896us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54004ed9d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:25.312610 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1492162944}
I20260709 12:17:25.177712 26574 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:25.243449 22898 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:25.245414 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:25.185207 26684 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:17:25.264436 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 57532.3us
I20260709 12:17:25.265267 26808 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:25.260385 26824 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.242817 22901 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:25.238123 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:17:25.358539 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 120488us
I20260709 12:17:25.359485 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:25.219820 23494 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:25.328905 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:25.166447 26816 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:25.336803 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:25.365037 23674 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:17:25.258678 26764 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:25.338557 22744 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:25.361572 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:25.343376 22823 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:25.346446 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:25.354017 22820 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:25.366107 26824 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:25.372653 22820 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:25.372882 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.374377 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.355052 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.355122 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:25.309527 26696 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.183611 26665 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:25.273038 26640 raft_consensus.cc:2764] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:17:25.401952 22894 raft_consensus.cc:606] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:25.382063 22893 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:25.387651 22823 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:25.390646 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 895) took 1383 ms. Trace:
W20260709 12:17:25.402921 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 163068us
W20260709 12:17:25.391650 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 171906us
I20260709 12:17:25.408793 23493 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:25.370656 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:25.413498 22823 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:25.415648 22822 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:17:25.415999 22823 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:25.417703 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:25.368070 26075 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:25.407617 23660 rpcz_store.cc:276] 0709 12:17:24.007072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.032839 (+ 25767us) service_pool.cc:224] Handling call
0709 12:17:24.067930 (+ 35091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:24.068387 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:24.439263 (+370876us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.937692 (+498429us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b180021b860. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:17:25.157031 (+219339us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:25.174255 (+ 17224us) log.cc:844] Serialized 26 byte log entry
0709 12:17:25.174578 (+   323us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:25.174631 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.174728 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:25.390284 (+215556us) raft_consensus.cc:1685] finished
0709 12:17:25.390403 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.390571 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":331602,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":1981,"raft.queue_time_us":15581,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":17539,"spinlock_wait_cycles":17902848,"thread_start_us":445658,"threads_started":2,"wal-append.queue_time_us":894404}
I20260709 12:17:25.411805 26427 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:25.419456 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:25.375864 26784 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:25.419516 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.420801 22823 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:25.374625 26824 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:25.368309 26807 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:25.407163 26497 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:25.424197 26816 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.415858 26494 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:25.359674 26684 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:25.375309 26776 raft_consensus.cc:2764] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:17:25.420037 22826 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:25.403342 26752 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:25.402989 26813 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:25.430424 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:25.442174 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.448734 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.427937 26815 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:25.427866 26075 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.457165 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.458349 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:25.459758 26704 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:25.460093 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.429709 26751 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.406584 26696 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:25.464732 22752 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:25.444418 26494 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.464813 22750 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:17:25.463876 23493 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:25.468538 22747 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:25.468519 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:25.471777 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.440186 26801 raft_consensus.cc:2764] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:17:25.429775 26823 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:25.477280 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:25.440047 26497 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.441576 26659 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:25.451797 26427 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:25.485270 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.483593 23493 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:25.439074 26755 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:17:25.462649 26815 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.443110 26807 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.456406 26784 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:25.451639 26471 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:17:25.449079 26764 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:17:25.451989 26682 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:17:25.455133 26813 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:25.549307 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 65831.8us
W20260709 12:17:25.553486 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 68323.5us
I20260709 12:17:25.494398 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:25.554459 22752 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:25.479874 26666 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:17:25.542548 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 65355.8us
I20260709 12:17:25.468003 26075 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:25.481621 26751 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:25.552829 26742 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:25.488029 26640 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:17:25.491247 26494 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:25.492628 26497 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:25.557292 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:25.536775 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.542392 26801 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:25.481504 26574 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.491873 26824 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:25.489993 26215 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:25.490655 26652 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:25.567795 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:25.557168 26825 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:17:25.549932 26815 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:25.556478 26665 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.490648 26752 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:25.514058 26659 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:25.558089 26807 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:25.557369 26811 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.560380 26742 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:25.583750 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.583093 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:25.587711 26828 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:17:25.572340 26809 raft_consensus.cc:2764] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:17:25.545280 26684 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.499989 26823 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:25.583088 26824 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:25.584673 26817 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:25.591532 26742 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:25.593160 26755 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.556454 26784 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.606002 26640 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:25.589395 26652 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:25.608215 26811 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.632849 26817 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:25.659891 22750 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:25.585064 26427 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.661849 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:25.663930 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 96220.3us
W20260709 12:17:25.649699 26831 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.162s	user 0.001s	sys 0.001s
I20260709 12:17:25.639940 26640 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:25.642912 26704 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.650400 26817 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.635540 26755 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:25.652952 26696 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:25.667941 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.671638 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:25.669436 26809 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:17:25.673252 26666 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:25.671463 26817 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:25.665707 26752 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:25.683763 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:25.676592 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.676891 22865 leader_election.cc:400] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15.
I20260709 12:17:25.667104 26682 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:25.685576 22865 leader_election.cc:403] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:25.674361 22750 raft_consensus.cc:2376] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14. Re-sending same reply.
I20260709 12:17:25.647418 26811 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:25.706039 22823 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:17:25.686532 26834 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:17:25.675104 26809 consensus_queue.cc:1243] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:25.713634 22823 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:17:25.676442 26755 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.679107 26813 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:25.679500 26751 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:25.718303 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.719365 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.720381 22818 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:25.718423 22752 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:25.715551 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:25.723649 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:25.721863 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.725659 22822 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:25.702442 26682 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:25.732165 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 55482.9us
I20260709 12:17:25.707547 26808 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:25.739988 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:25.668882 26659 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:25.718073 26801 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:25.744333 22822 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:25.676106 26666 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:25.724260 26839 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:25.674530 26652 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.744850 26842 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15.
I20260709 12:17:25.745580 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.746145 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:25.731333 26809 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:25.751049 26823 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:25.755932 22822 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:25.766551 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.757547 22790 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.674841 26640 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.758554 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.719627 26708 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:17:25.763602 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.777498 22750 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:25.768992 22818 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:25.763579 22752 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:17:25.772851 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:25.774296 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:25.768055 26810 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.166s	user 0.008s	sys 0.027s
I20260709 12:17:25.743207 26808 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:25.765425 26809 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:25.788292 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:25.789733 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.776840 26839 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:25.791774 22818 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:25.776650 26838 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:25.783655 26823 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:17:25.788512 26810 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.008s	sys 0.027s
I20260709 12:17:25.800776 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.808228 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:25.810624 22750 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:25.779268 26840 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 12:17:25.809852 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 64425.5us
I20260709 12:17:25.793241 26764 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:25.812121 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.792920 26844 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:25.818895 26641 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:25.812071 26764 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.819547 26641 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:25.821826 22752 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:25.793365 26682 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:25.828399 26797 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 1.272s	user 0.000s	sys 0.004s
I20260709 12:17:25.829071 26846 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:17:25.830338 26846 raft_consensus.cc:3055] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:25.830866 26846 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:25.831820 26846 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:25.832360 26776 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:25.832788 26776 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:25.833201 26846 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:25.826366 26494 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.835753 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:25.836987 26802 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.106s	user 0.001s	sys 0.002s
I20260709 12:17:25.839242 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 638) took 2146 ms. Trace:
I20260709 12:17:25.839650 22824 rpcz_store.cc:276] 0709 12:17:23.692739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.692885 (+   146us) service_pool.cc:224] Handling call
0709 12:17:23.716612 (+ 23727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.830164 (+113552us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:24.026337 (+196173us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.371975 (+345638us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:24.387896 (+ 15921us) log.cc:844] Serialized 26 byte log entry
0709 12:17:24.413254 (+ 25358us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:24.413318 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.413418 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:25.836360 (+1422942us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:25.838890 (+  2530us) raft_consensus.cc:1685] finished
0709 12:17:25.839004 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.839149 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149505,"prepare.queue_time_us":452029,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":358472,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":19133,"spinlock_wait_cycles":3225472,"thread_start_us":318079,"threads_started":2,"wal-append.queue_time_us":630571}
W20260709 12:17:25.841749 26833 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.293s	user 0.000s	sys 0.002s
I20260709 12:17:25.841471 26817 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:25.811373 26810 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:25.817299 26723 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:25.843956 22790 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:25.802735 26801 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:25.848306 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.850060 26811 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.850903 26723 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.851467 26762 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:25.851261 26641 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.833668 26776 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:25.852445 26779 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.661s	user 0.002s	sys 0.002s
I20260709 12:17:25.852275 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:25.861438 22753 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:25.854411 22752 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:25.854391 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:25.825238 26764 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:25.856021 26823 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:25.879613 26776 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:25.879765 26823 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:25.880774 26823 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:25.833861 26807 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:25.853582 26782 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:25.878976 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.848621 26494 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:25.852687 26817 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:25.860183 26723 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:25.859797 26762 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:25.821213 26809 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.896448 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:25.897876 22819 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:25.898264 22823 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 9: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:25.911172 26809 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:25.911978 26807 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:25.913509 26808 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:25.903484 26497 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:25.917596 26497 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:25.919263 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.920182 22753 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:25.920488 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:25.921500 22750 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:25.921578 23493 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:25.939062 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 529816us
I20260709 12:17:25.940346 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:25.941205 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:25.922406 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:25.943115 22753 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:25.953251 22753 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:25.956045 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.937932 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.969511 22751 raft_consensus.cc:2410] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:17:25.969781 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:25.970199 22819 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:25.977305 22750 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:25.955058 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:25.991707 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.995857 22751 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:25.997284 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:25.992736 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 815) took 2466 ms. Trace:
W20260709 12:17:25.999115 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 205101us
I20260709 12:17:25.984697 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:26.003289 22819 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:26.003540 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:26.004127 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:26.004174 22753 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:26.005599 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:25.931571 26682 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:25.998898 22749 rpcz_store.cc:276] 0709 12:17:23.503820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.504009 (+   189us) service_pool.cc:224] Handling call
0709 12:17:23.504442 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.514579 (+ 10137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:23.514628 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:23.569134 (+ 54506us) log.cc:844] Serialized 26 byte log entry
0709 12:17:23.784928 (+215794us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:23.784976 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.785054 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:25.802929 (+2017875us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:25.932623 (+129694us) raft_consensus.cc:1685] finished
0709 12:17:25.932654 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.969643 (+ 36989us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11797,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7268,"spinlock_wait_cycles":20248320,"thread_start_us":195312,"threads_started":1,"wal-append.queue_time_us":429918}
I20260709 12:17:26.005157 22745 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
W20260709 12:17:26.015771 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.016705 26840 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:26.017498 26840 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:25.979307 26497 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:26.021194 26640 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.015220 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:26.022814 26640 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:26.023725 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:26.024729 22745 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:26.026412 22751 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:17:26.027029 22751 pending_rounds.cc:85] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 6
I20260709 12:17:26.027305 22751 pending_rounds.cc:107] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:17:26.027601 22751 raft_consensus.cc:2889] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:26.030400 22749 raft_consensus.cc:1217] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Deduplicated request from leader. Original: 7.3->[9.4-11.5]   Dedup: 9.4->[11.5-11.5]
I20260709 12:17:26.031072 22749 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: [9.4-11.5]
I20260709 12:17:26.032181 22753 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:25.981194 26427 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:26.039376 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 54577us
I20260709 12:17:26.037817 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
W20260709 12:17:26.039767 22717 leader_election.cc:336] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.562s (SENT)
I20260709 12:17:26.040310 22899 raft_consensus.cc:606] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:26.040534 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:26.038806 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:26.039428 22826 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:26.036401 26640 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:25.993247 26693 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:17:26.013324 26845 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:17:25.992705 26494 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:26.041383 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:25.904223 26810 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:26.005836 26736 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:26.046247 22753 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:26.057564 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:26.058902 26808 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:26.069785 22745 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:25.978760 26762 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.044085 26427 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:26.075868 26742 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.053521 26494 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.078415 26838 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:26.012208 26815 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:26.079140 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:26.044217 26693 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.086550 26854 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:26.091043 26844 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:26.092046 26804 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:17:26.095885 26835 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.383s	user 0.006s	sys 0.002s
I20260709 12:17:26.098060 22746 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:26.108034 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:26.125316 26494 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:26.122033 26840 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:26.115157 26846 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:17:26.100728 26811 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:17:26.131142 26693 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:26.119503 26723 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.134407 26762 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:26.145364 26838 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:26.131111 26804 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:26.213446 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1076) took 1174 ms. Trace:
I20260709 12:17:26.213893 22744 rpcz_store.cc:276] 0709 12:17:25.039212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.040976 (+  1764us) service_pool.cc:224] Handling call
0709 12:17:26.213210 (+1172234us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400406fd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:26.213383 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566609280}
W20260709 12:17:26.213176 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 220906us
I20260709 12:17:26.187536 26682 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:26.188306 26736 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:26.212368 26854 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:26.168892 26652 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 12:17:26.398057 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 317854us
I20260709 12:17:26.395823 26846 consensus_queue.cc:1243] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:26.500728 26427 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:26.500937 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:17:26.531468 26858 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
W20260709 12:17:26.534376 26860 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.321s	user 0.000s	sys 0.000s
I20260709 12:17:26.535537 26815 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:26.538487 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 973) took 1455 ms. Trace:
I20260709 12:17:26.538946 22893 rpcz_store.cc:276] 0709 12:17:25.082751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.086418 (+  3667us) service_pool.cc:224] Handling call
0709 12:17:26.538195 (+1451777us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54004eb954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:26.538404 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558035328}
I20260709 12:17:26.544023 26682 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:26.289439 26804 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:26.552083 26075 consensus_meta.cc:287] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.984s	user 0.022s	sys 0.001s
I20260709 12:17:26.552631 26804 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:26.559856 26838 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:26.570426 26776 consensus_meta.cc:287] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.000s
I20260709 12:17:26.573663 22790 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:26.578274 26809 consensus_meta.cc:287] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.000s
W20260709 12:17:26.581100 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:26.591040 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.582387 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:26.583365 22751 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:26.584002 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:26.592710 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:26.583798 26854 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.595219 26838 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:26.595557 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 917) took 1492 ms. Trace:
I20260709 12:17:26.596791 26631 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:26.597472 26823 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:26.641027 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.587633 26859 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.598598 26816 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:17:26.598907 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:26.601135 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.513959 26844 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:26.594233 22790 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:26.598492 22864 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:26.605108 23672 rpcz_store.cc:276] 0709 12:17:25.103544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.103692 (+   148us) service_pool.cc:224] Handling call
0709 12:17:25.122088 (+ 18396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.390929 (+268841us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:25.390972 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:25.391026 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:25.391072 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.595261 (+1204189us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54002ff8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:26.595321 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:26.595495 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24327,"raft.queue_time_us":24880,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":561128320}
W20260709 12:17:26.654439 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 60289.7us
I20260709 12:17:26.617988 26755 raft_consensus.cc:476] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 12:17:26.656059 22790 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:26.657526 22790 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:26.552721 26075 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:26.661110 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 767) took 1705 ms. Trace:
I20260709 12:17:26.666658 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:26.666980 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 68589.8us
I20260709 12:17:26.667565 23672 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:26.663043 22893 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:26.669153 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:26.664942 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.667001 22897 rpcz_store.cc:276] 0709 12:17:24.948345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.948485 (+   140us) service_pool.cc:224] Handling call
0709 12:17:24.948744 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.304210 (+355466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.653413 (+1349203us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54006eb754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:26.653658 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815607552}
I20260709 12:17:26.641170 26494 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:26.672176 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.606829 26863 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:26.676375 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:26.638748 26823 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:26.660959 26782 consensus_meta.cc:287] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.774s	user 0.007s	sys 0.006s
I20260709 12:17:26.680222 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:26.682901 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:26.676463 26640 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:26.685051 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:26.705386 22901 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:26.685391 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.706836 23659 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:26.677323 26838 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:17:26.679387 26723 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:26.698192 26864 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:26.714448 26864 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:26.715144 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.688156 23674 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:26.688971 26755 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.723656 26755 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:26.724192 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:26.724910 23674 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:26.677717 26815 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:26.666493 26846 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:26.727645 26846 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.730397 26846 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:26.690415 26867 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:26.733461 26867 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:26.733654 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:26.734470 22894 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:26.678907 26816 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:26.735481 26816 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:26.712054 26684 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.736754 26684 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.736658 26816 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.738070 23656 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:26.691228 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:26.740026 23656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 922) took 1634 ms (client timeout 2124 ms). Trace:
I20260709 12:17:26.694808 22750 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:26.697041 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.741988 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.677155 22899 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:26.656445 26742 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:26.699126 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:26.742758 23685 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:26.685081 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:26.700237 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.743680 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:26.507936 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:26.740433 23656 rpcz_store.cc:269] 0709 12:17:25.105360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.105503 (+   143us) service_pool.cc:224] Handling call
0709 12:17:26.739819 (+1634316us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540059e054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:26.739937 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3624571264}
I20260709 12:17:26.744831 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:26.745076 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:26.745641 26762 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 12:17:26.745877 23656 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:26.665834 26631 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:26.746208 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.746691 26631 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.740039 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:26.598508 26870 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:17:26.734692 26867 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:26.748385 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:26.748534 26867 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:26.748965 23682 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:26.750401 26427 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:26.751080 26871 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.751153 26427 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:26.751869 26871 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:26.715297 26864 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.753796 26864 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:26.754127 26427 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:26.754364 26871 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:26.696040 26863 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.654004 26736 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:26.755816 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.756705 26863 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:26.758366 26684 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:26.759701 26764 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.870s	user 0.013s	sys 0.000s
I20260709 12:17:26.686949 23695 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:17:26.760228 26764 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.760771 26840 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:26.761435 23695 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:26.761979 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1343) took 1722 ms. Trace:
I20260709 12:17:26.762758 23695 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:26.702565 22895 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:26.764227 22820 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:26.659791 26844 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:26.762337 22827 rpcz_store.cc:276] 0709 12:17:25.039642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.322601 (+282959us) service_pool.cc:224] Handling call
0709 12:17:25.883831 (+561230us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:25.885566 (+  1735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:25.885599 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:25.891430 (+  5831us) log.cc:844] Serialized 52 byte log entry
0709 12:17:26.358894 (+467464us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:26.358958 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.359067 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:26.684365 (+325298us) raft_consensus.cc:1685] finished
0709 12:17:26.684392 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:26.730771 (+ 46379us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54007a1a50. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:26.761897 (+ 31126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1584,"raft.queue_time_us":2931,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":3763,"spinlock_wait_cycles":1288025856,"thread_start_us":459165,"threads_started":1,"wal-append.queue_time_us":605605}
I20260709 12:17:26.731191 26815 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:26.732800 23659 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:26.735929 26666 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:26.777076 26666 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:26.778245 26666 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.697417 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.676679 26776 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.701643 26823 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:26.717249 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:26.721261 26847 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:26.764659 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:26.709510 22865 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:26.767591 22747 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:26.768998 23682 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:26.791465 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1037) took 1704 ms. Trace:
I20260709 12:17:26.661397 26859 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:26.646961 26811 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:17:26.770967 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:26.775287 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.780197 23679 raft_consensus.cc:2410] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:26.747300 26631 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:26.759475 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:26.726506 26755 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:26.780731 26870 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:26.764545 23685 raft_consensus.cc:2368] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12.
I20260709 12:17:26.786736 23672 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:26.779636 26764 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:26.799484 23689 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 8: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:26.808957 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 99612.6us
I20260709 12:17:26.794665 22820 rpcz_store.cc:276] 0709 12:17:25.087216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.412169 (+324953us) service_pool.cc:224] Handling call
0709 12:17:25.412612 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.764682 (+1352070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.791105 (+ 26423us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001261d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:26.791382 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3107961088}
W20260709 12:17:26.804184 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44866.9us
I20260709 12:17:26.812254 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:26.735858 23674 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:26.787194 26666 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:26.827669 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.829424 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:26.830004 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:26.831976 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:26.835026 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.770416 26640 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:26.835031 23672 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:26.840263 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:26.841967 26723 raft_consensus.cc:2764] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:17:26.842717 23682 pending_rounds.cc:85] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 5
I20260709 12:17:26.845168 23682 pending_rounds.cc:107] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:17:26.845691 23682 raft_consensus.cc:2889] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:26.850478 23685 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:26.851752 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:26.852547 23674 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:26.834072 26665 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:26.855245 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:26.837221 26847 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:26.859928 22574 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57362 (request call id 55) took 36268 ms (client timeout 15000 ms). Trace:
I20260709 12:17:26.794909 26568 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:17:26.833709 26838 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:26.793052 26776 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:26.849531 26840 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:26.833678 26427 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:17:26.842763 26810 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:17:26.848716 26871 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:17:26.856346 26641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.010s	sys 0.015s
I20260709 12:17:26.864660 23685 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
W20260709 12:17:26.861846 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 379891us
I20260709 12:17:26.907059 22900 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
W20260709 12:17:26.860944 22574 rpcz_store.cc:269] 0709 12:16:50.588021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.588352 (+   331us) service_pool.cc:224] Handling call
0709 12:17:26.856211 (+36267859us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:23.061141 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:23.190330 (+129189us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:23.192457 (+  2127us) write_op.cc:435] Acquired schema lock
0709 12:17:23.195347 (+  2890us) tablet.cc:662] Decoding operations
0709 12:17:23.205362 (+ 10015us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:23.205420 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:23.205453 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:17:23.205931 (+   478us) tablet.cc:701] Row locks acquired
0709 12:17:23.205948 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:17:23.206102 (+   154us) write_op.cc:270] Start()
0709 12:17:23.206225 (+   123us) write_op.cc:276] Timestamp: P: 1783599443206049 usec, L: 0
0709 12:17:23.206246 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:17:23.206992 (+   746us) log.cc:844] Serialized 2499 byte log entry
0709 12:17:23.722727 (+515735us) op_driver.cc:464] REPLICATION: finished
0709 12:17:24.016774 (+294047us) write_op.cc:301] APPLY: starting
0709 12:17:24.016918 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:24.017189 (+   271us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:24.017367 (+   178us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:24.018426 (+  1059us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:24.018744 (+   318us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:17:24.019217 (+   473us) write_op.cc:312] APPLY: finished
0709 12:17:24.019619 (+   402us) log.cc:844] Serialized 52 byte log entry
0709 12:17:24.021227 (+  1608us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:24.021536 (+   309us) write_op.cc:454] Released schema lock
0709 12:17:24.021626 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:24.023456 (+  1830us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:24.023502 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56192,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":247380,"apply.run_cpu_time_us":3949,"apply.run_wall_time_us":6664,"num_ops":6,"prepare.queue_time_us":107583,"prepare.run_cpu_time_us":63217,"prepare.run_wall_time_us":260391,"raft.queue_time_us":264047,"raft.run_cpu_time_us":6667,"raft.run_wall_time_us":229587,"replication_time_us":487815,"thread_start_us":470729,"threads_started":4,"wal-append.queue_time_us":149881,"wal-append.run_cpu_time_us":24455,"wal-append.run_wall_time_us":1665021}]]}
I20260709 12:17:26.827284 26844 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.828848 26870 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:26.848413 26798 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:17:26.880671 22752 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 12:17:26.881562 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:26.882738 22753 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:17:26.909540 22753 pending_rounds.cc:85] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 6
I20260709 12:17:26.909821 22753 pending_rounds.cc:107] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:17:26.910130 22753 raft_consensus.cc:2889] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:26.858585 26665 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:26.864312 26693 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.001s
I20260709 12:17:26.885354 26723 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:26.948956 22750 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 9: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:26.867910 26840 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:26.907672 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:26.954941 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:26.959465 22752 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:26.959594 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 52053.1us
W20260709 12:17:26.906144 26641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.011s	sys 0.015s
I20260709 12:17:26.963145 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:26.951208 26665 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:26.966945 26764 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:26.970016 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:26.962339 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:26.901185 26871 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:26.973209 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:26.972888 26872 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:26.993443 22752 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:26.959180 26838 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:26.860424 26815 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:26.927300 26801 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:17:27.006088 26810 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:26.994997 26809 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:26.975613 26868 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:17:26.985571 26075 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:26.994010 26872 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.961398 26693 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:26.970237 26764 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:17:27.001830 26494 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:27.051066 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 393581us
W20260709 12:17:27.031858 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 53289.3us
I20260709 12:17:27.012449 26708 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:27.048782 26809 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:27.098937 26641 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:27.099643 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:27.100939 26868 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:27.102706 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:27.110438 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:27.111608 22748 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:27.120062 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:27.122807 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:27.155344 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.156505 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 54098.7us
I20260709 12:17:27.157114 22753 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:27.157727 23656 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:27.155040 26867 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:27.097011 26870 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:27.175518 22752 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:17:27.176688 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:27.177398 22752 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:27.094745 26859 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:27.161188 22748 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:27.164021 22823 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:27.166167 23672 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:27.102705 26708 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:27.091449 26872 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:27.174306 23494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.008s	sys 0.012s
I20260709 12:17:27.174980 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:27.187644 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:27.188436 23494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.008s	sys 0.012s
W20260709 12:17:27.188979 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 796571us
I20260709 12:17:27.183079 22790 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:27.183651 22753 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:27.044989 26810 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:27.194604 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:27.210548 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:27.206102 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:27.210578 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:27.087579 26871 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:27.186960 26708 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:27.219980 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:27.209568 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:27.208228 26776 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:27.213235 26574 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:27.155964 26809 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:27.236703 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 406796us
I20260709 12:17:27.234607 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:27.238184 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:27.247753 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.249738 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 55247.5us
W20260709 12:17:27.250347 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.212922 26791 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:17:27.209213 26640 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:27.254244 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:27.232522 26886 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.246245 26862 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:27.275446 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:27.278255 22717 leader_election.cc:400] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12.
W20260709 12:17:27.269027 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 413877us
I20260709 12:17:27.235559 26798 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.279507 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.279930 22717 leader_election.cc:403] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:17:27.253708 26871 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:27.287024 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:27.281060 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:27.288502 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:27.289258 22900 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:27.289371 22791 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:27.291256 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:27.292201 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:27.330127 22898 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:27.330271 22894 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:27.284475 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:27.332427 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48042.1us
I20260709 12:17:27.297747 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:27.262111 26859 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:27.311223 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:27.260411 26877 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:27.293022 26427 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.282024 26862 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:27.341063 26776 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:27.340834 26427 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:27.341141 26862 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:27.341544 26776 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:27.343102 26427 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:27.343575 26568 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:27.343765 26427 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:27.344034 26568 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:27.344308 26427 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:27.344977 26568 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:27.345186 26427 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:27.346277 26568 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:27.279791 26809 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:27.279171 26574 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:27.351928 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 49180.7us
I20260709 12:17:27.284756 26870 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:27.357124 22900 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
W20260709 12:17:27.364363 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 53224.4us
I20260709 12:17:27.292825 26659 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:27.381047 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:27.369956 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:27.284206 26868 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12.
I20260709 12:17:27.370636 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:27.386528 22900 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:27.309864 26723 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:27.388402 22747 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.023s
W20260709 12:17:27.393394 22747 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.008s	sys 0.023s
I20260709 12:17:27.293265 26811 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:17:27.291520 26863 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:17:27.399590 22898 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:27.351519 26693 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:27.370280 26877 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:27.281445 26886 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:27.379671 26878 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:27.417402 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:27.448423 22901 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:27.299206 26798 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:27.342509 26776 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:27.424042 22894 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:27.424829 22900 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:27.470988 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:27.412510 26882 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:17:27.401232 26859 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:27.443946 26847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.014s	sys 0.033s
W20260709 12:17:27.576505 26847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.015s	sys 0.034s
I20260709 12:17:27.576892 26847 raft_consensus.cc:697] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:27.577922 26847 consensus_queue.cc:237] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:27.459026 26631 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.000s
W20260709 12:17:27.578876 26879 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
W20260709 12:17:27.579155 26864 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.825s	user 0.009s	sys 0.005s
I20260709 12:17:27.579185 26631 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:27.473297 26892 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 12:17:27.582741 26886 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:27.532675 26776 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:27.535460 26893 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.416507 26682 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:27.537494 26641 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:27.539601 26904 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:27.545333 22752 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:17:27.546161 26823 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.745s	user 0.012s	sys 0.000s
I20260709 12:17:27.547617 22901 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:17:27.548390 26810 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:27.552489 26659 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:27.475337 26816 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
W20260709 12:17:27.556418 26885 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 12:17:27.558467 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:27.478988 22898 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:27.499441 26880 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:17:27.513556 26574 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:27.586480 22749 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
W20260709 12:17:27.514863 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 315925us
I20260709 12:17:27.644811 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:27.552981 26494 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.602515 26641 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:27.633859 22896 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 7.
W20260709 12:17:27.633157 26665 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.658s	user 0.014s	sys 0.000s
I20260709 12:17:27.601801 26631 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:27.646822 26887 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.389s	user 0.001s	sys 0.001s
I20260709 12:17:27.673686 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:27.674551 22827 raft_consensus.cc:2376] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13. Re-sending same reply.
I20260709 12:17:27.636584 26808 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:27.651747 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:27.587064 26881 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:27.652464 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:27.655006 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:27.688369 22819 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
W20260709 12:17:27.602272 26884 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.374s	user 0.000s	sys 0.001s
W20260709 12:17:27.599345 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 351112us
I20260709 12:17:27.657091 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:27.658488 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:27.694024 22896 raft_consensus.cc:2410] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
W20260709 12:17:27.647810 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 358508us
I20260709 12:17:27.632726 26904 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:27.682981 22823 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:27.598507 26893 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:27.635906 26857 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:17:27.694236 22750 raft_consensus.cc:2410] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:17:27.598243 26682 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:27.661928 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:27.698668 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:27.587342 26723 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:27.661463 26791 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.662592 26659 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.708153 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:27.713099 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:27.721351 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:27.723763 23660 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:27.631893 26823 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:27.693862 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:27.684427 26881 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:27.762130 22896 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:27.657069 26896 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:17:27.690205 26859 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:27.747730 22898 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
W20260709 12:17:27.764756 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56721.2us
I20260709 12:17:27.765206 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:27.773723 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 80018.7us
I20260709 12:17:27.672850 26764 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.662070 26494 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:27.668550 26665 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:27.745645 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:27.679553 26684 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:17:27.803493 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:27.775101 26888 log.cc:927] Time spent T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.387s	user 0.001s	sys 0.001s
W20260709 12:17:27.812893 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 479555us
I20260709 12:17:27.689764 26708 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:27.807934 26889 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.402s	user 0.000s	sys 0.001s
I20260709 12:17:27.815630 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:27.817139 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1426) took 1143 ms. Trace:
I20260709 12:17:27.854836 22893 rpcz_store.cc:276] 0709 12:17:26.673550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.674522 (+   972us) service_pool.cc:224] Handling call
0709 12:17:26.674917 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:26.677692 (+  2775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:26.677735 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:26.678289 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.092838 (+414549us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:27.092905 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.093114 (+   209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:27.816756 (+723642us) raft_consensus.cc:1685] finished
0709 12:17:27.816791 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:27.817029 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2334,"raft.queue_time_us":16414,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":109,"thread_start_us":409968,"threads_started":1,"wal-append.queue_time_us":539658}
W20260709 12:17:27.776134 26891 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 12:17:27.821991 22901 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:27.764484 26682 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:27.823376 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.802084 26897 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.735884 26910 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.727814 26742 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.725530 26631 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:27.803045 26890 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.385s	user 0.000s	sys 0.001s
I20260709 12:17:27.782467 26782 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:27.842665 22896 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
W20260709 12:17:27.847291 22717 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.508s (SENT) [suppressed 11 similar messages]
I20260709 12:17:27.694944 26811 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:27.731665 26900 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.817294 26895 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
W20260709 12:17:27.878280 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.880980 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.888055 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:27.852391 26838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.004s	sys 0.023s
I20260709 12:17:27.899868 22827 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:27.916855 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:27.803787 26659 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:27.911724 26905 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:17:27.822103 26764 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:27.477861 26901 consensus_queue.cc:1175] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" responder_term: 11 status { last_received { term: 11 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:27.911293 26798 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:27.911108 26838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.005s	sys 0.023s
I20260709 12:17:27.942128 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:27.893167 26427 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:27.933810 26804 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.380s	user 0.011s	sys 0.017s
I20260709 12:17:27.784394 26791 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:27.934072 26840 consensus_meta.cc:287] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.955s	user 0.013s	sys 0.002s
I20260709 12:17:27.976877 22892 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:17:27.910457 26811 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:27.905380 26631 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:27.988121 26764 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:27.899796 26881 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:27.989277 26893 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:27.865091 26904 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:27.990253 26918 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:17:27.921193 26900 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:27.911844 26742 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:27.994300 26862 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.000s
I20260709 12:17:27.902735 26910 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:27.896664 26897 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:27.962059 26838 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:27.980300 26801 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.060056 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:28.036065 26899 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
I20260709 12:17:27.986671 26659 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.039961 26427 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.980190 26840 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:28.078166 23685 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:28.079681 22893 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:28.052907 26893 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:28.084457 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 259992us
W20260709 12:17:28.071645 26911 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 12:17:28.067082 26881 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:28.060029 26801 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:28.091897 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:28.095405 22894 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:28.096031 22753 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:28.075798 26659 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.041736 26946 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 12:17:28.109071 26915 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:17:28.061650 26862 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:28.110868 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 925) took 1304 ms. Trace:
W20260709 12:17:28.097548 26872 consensus_meta.cc:287] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.892s	user 0.010s	sys 0.005s
I20260709 12:17:28.102958 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:28.171711 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 954) took 1054 ms. Trace:
I20260709 12:17:28.172573 22753 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:28.119764 26665 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.102936 26864 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:28.131446 26926 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:17:28.135660 26940 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:17:28.137888 26809 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.791s	user 0.015s	sys 0.002s
I20260709 12:17:28.139900 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.113765 26494 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:28.141958 26900 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:28.144804 26910 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.148164 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:28.149148 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44252.6us
I20260709 12:17:28.089810 26823 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.172227 22745 rpcz_store.cc:276] 0709 12:17:27.116986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.159070 (+ 42084us) service_pool.cc:224] Handling call
0709 12:17:27.159570 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.169344 (+  9774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.169377 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.169919 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.478395 (+308476us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:27.478460 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.478574 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:28.171459 (+692885us) raft_consensus.cc:1685] finished
0709 12:17:28.171482 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.171645 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18622,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":7754,"spinlock_wait_cycles":41088,"thread_start_us":308085,"threads_started":1,"wal-append.queue_time_us":509526}
I20260709 12:17:28.096997 26893 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:28.164491 23679 rpcz_store.cc:276] 0709 12:17:26.806545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.846392 (+ 39847us) service_pool.cc:224] Handling call
0709 12:17:26.857850 (+ 11458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:26.858213 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:26.858239 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:26.859769 (+  1530us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.310224 (+450455us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:27.732819 (+422595us) log.cc:844] Serialized 14 byte log entry
0709 12:17:27.885326 (+152507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.885460 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:28.110574 (+225114us) raft_consensus.cc:1685] finished
0709 12:17:28.110598 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.110765 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123229,"prepare.queue_time_us":243061,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":29,"raft.queue_time_us":225274,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":6991,"thread_start_us":768403,"threads_started":3,"wal-append.queue_time_us":706338}
W20260709 12:17:28.188647 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 385150us
I20260709 12:17:28.081945 26427 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:28.227515 26427 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.229683 26897 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:28.197644 22898 raft_consensus.cc:2410] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:17:28.231524 26811 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:28.195704 26864 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:28.177865 26909 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.318s	user 0.000s	sys 0.002s
I20260709 12:17:28.236135 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:28.198611 26568 consensus_meta.cc:287] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.852s	user 0.010s	sys 0.006s
W20260709 12:17:28.203118 26878 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.746s	user 0.013s	sys 0.001s
I20260709 12:17:28.205474 26742 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:28.208714 22748 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:17:28.146893 26708 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:28.191169 26944 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:17:28.141083 26631 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.201313 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.250509 22899 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 13: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:28.254400 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:28.245659 26641 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.001s
I20260709 12:17:28.198046 26844 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:28.114430 26659 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:28.248054 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 400833us
I20260709 12:17:28.238505 22745 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:28.183914 26872 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:28.258453 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.260178 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.260712 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:28.234628 26864 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:28.311131 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:28.247619 26899 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:28.246266 26878 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:28.146549 26838 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:28.310844 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.315428 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:28.313390 22748 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
W20260709 12:17:28.261719 26666 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.414s	user 0.017s	sys 0.000s
I20260709 12:17:28.319911 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.322878 22899 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:17:28.319783 22818 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:17:28.327340 22745 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:17:28.320621 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 54252.1us
I20260709 12:17:28.259271 26897 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.332464 26801 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:28.328251 22824 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:28.340240 22825 raft_consensus.cc:2393] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 13: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:28.338085 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:28.258951 26742 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.343674 22899 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:28.344147 22899 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:28.338438 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:28.217420 26919 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 12:17:28.264482 26568 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.338217 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:28.347450 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:28.264941 26494 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:28.343993 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 988) took 1057 ms. Trace:
I20260709 12:17:28.294811 26948 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:28.349035 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:28.349721 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:28.345031 22899 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:28.320258 26847 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:28.353596 22717 leader_election.cc:336] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.507s (SENT)
I20260709 12:17:28.353374 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:28.356122 22899 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:28.239409 26893 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:28.357796 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.335994 26900 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.360328 22825 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:28.362212 22822 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:28.360011 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:28.366847 22717 leader_election.cc:336] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.511s (SENT)
I20260709 12:17:28.369145 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.346596 26708 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:28.343006 26921 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.359284 26494 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:28.374272 26893 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.361155 26736 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:28.364100 26809 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.354449 22895 rpcz_store.cc:276] 0709 12:17:27.286246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.286435 (+   189us) service_pool.cc:224] Handling call
0709 12:17:27.286871 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.781801 (+494930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.781840 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.782434 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.923482 (+141048us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:27.923535 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.923635 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:28.343723 (+420088us) raft_consensus.cc:1685] finished
0709 12:17:28.343754 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.343922 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1349,"raft.queue_time_us":246492,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":1491,"thread_start_us":561130,"threads_started":2,"wal-append.queue_time_us":163084}
I20260709 12:17:28.389890 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.390643 22895 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:28.391430 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.376845 26920 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:28.377671 26659 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.265301 26641 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:28.380390 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:28.380627 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.381868 22827 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
W20260709 12:17:28.382161 22717 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.101s (SENT)
I20260709 12:17:28.355716 26864 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:28.405850 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:28.406304 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.358753 26811 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:28.357885 26840 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:28.380522 26776 consensus_meta.cc:287] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.785s	user 0.013s	sys 0.002s
I20260709 12:17:28.410677 26862 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.397441 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:28.411755 22900 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:17:28.412132 22900 pending_rounds.cc:85] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 5
I20260709 12:17:28.412360 22900 pending_rounds.cc:107] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:17:28.412595 22900 raft_consensus.cc:2889] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:28.390013 26708 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:28.347164 26897 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:28.414029 26871 consensus_meta.cc:287] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.113s	user 0.013s	sys 0.001s
I20260709 12:17:28.385541 26910 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:28.355072 26568 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:28.416278 26897 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.392856 26736 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:28.404309 26641 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:28.351276 26742 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:28.371286 26900 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:28.385975 26921 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:28.438383 26782 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:28.439072 26782 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:28.440069 26782 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:28.441200 26782 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:28.443027 26840 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:28.444530 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.410238 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:28.366456 26847 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:28.414119 26708 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:28.417284 26568 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:28.363195 26948 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:28.402269 26872 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:28.358388 26870 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 12:17:28.394449 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:28.404045 26682 consensus_meta.cc:287] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.004s
I20260709 12:17:28.419582 22899 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 6. (term mismatch)
I20260709 12:17:28.420176 26868 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:28.423029 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:28.470022 22821 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:28.396505 26809 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:28.428742 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 48556us
I20260709 12:17:28.489750 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 994) took 1160 ms. Trace:
I20260709 12:17:28.490893 26809 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:28.491547 26809 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:28.447539 22825 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:28.405215 26864 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:28.493500 26864 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:28.494148 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.495123 22825 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:28.490231 22894 rpcz_store.cc:276] 0709 12:17:27.329596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.467652 (+138056us) service_pool.cc:224] Handling call
0709 12:17:27.468184 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.096009 (+627825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:28.489476 (+393467us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540057bcd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:28.489682 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441941376}
I20260709 12:17:28.497611 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.498304 22894 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:28.454777 26959 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260709 12:17:28.455827 26964 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:17:28.500870 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.424635 26871 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.502377 26494 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:28.502107 22894 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:28.503029 26809 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:17:28.502568 26871 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:28.504654 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.505470 26809 consensus_queue.cc:1243] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:28.423041 26916 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:28.409288 26811 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:28.421319 26736 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.467655 22899 pending_rounds.cc:85] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 5
I20260709 12:17:28.506992 26811 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:28.507368 22899 pending_rounds.cc:107] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 14.6
I20260709 12:17:28.507707 22899 raft_consensus.cc:2889] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:28.510239 22899 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:17:28.510591 22899 pending_rounds.cc:85] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 5
I20260709 12:17:28.469652 26682 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:28.505666 22898 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:28.516983 26682 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:28.477819 22824 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:28.479296 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.479707 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.481813 22901 raft_consensus.cc:2410] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:17:28.475970 26631 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:28.521517 26631 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:28.524066 26631 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:28.487601 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.525106 22826 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:28.456568 26847 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.424845 22895 raft_consensus.cc:2368] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14.
I20260709 12:17:28.487246 26742 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:28.506847 26916 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.527266 26916 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:28.527815 26933 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.528455 26933 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:28.517706 23689 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:28.511996 22899 pending_rounds.cc:107] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:17:28.531468 22899 raft_consensus.cc:2889] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:28.533947 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:28.534204 26908 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.849s	user 0.003s	sys 0.000s
W20260709 12:17:28.514743 26957 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:17:28.552806 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 857) took 1580 ms. Trace:
I20260709 12:17:28.555226 22744 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:28.537108 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.538695 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:28.538877 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.540300 22824 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:28.553335 22751 rpcz_store.cc:276] 0709 12:17:26.971987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.972134 (+   147us) service_pool.cc:224] Handling call
0709 12:17:26.972602 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:26.987234 (+ 14632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:26.987270 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.000153 (+ 12883us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.391928 (+391775us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:27.391991 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.392133 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:28.533199 (+1141066us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:28.552387 (+ 19188us) raft_consensus.cc:1685] finished
0709 12:17:28.552417 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.552731 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12765,"raft.queue_time_us":58524,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":5704,"spinlock_wait_cycles":22411008,"thread_start_us":297359,"threads_started":1,"wal-append.queue_time_us":567308}
I20260709 12:17:28.541244 26864 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:28.541508 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:28.543541 22749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 853) took 1643 ms (client timeout 1677 ms). Trace:
I20260709 12:17:28.543910 26809 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:28.545039 26870 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.547686 22821 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:28.547924 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.575225 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:28.506763 26871 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:28.559351 22749 rpcz_store.cc:269] 0709 12:17:26.900277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.916896 (+ 16619us) service_pool.cc:224] Handling call
0709 12:17:28.543260 (+1626364us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54001e91d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:28.543448 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404241792}
I20260709 12:17:28.576217 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.578357 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:28.579197 22821 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:28.556713 22822 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:28.565826 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.569518 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.569684 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:28.580842 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:28.557674 26844 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.581048 22824 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:28.565100 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:28.571637 26864 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:28.572225 22893 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:28.559418 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:28.593662 22818 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:28.575768 22825 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:28.579986 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:28.583125 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:28.586625 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:28.591939 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.591766 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.573165 26762 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:28.572973 26868 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.605293 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.605592 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.598322 26866 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:28.610987 26682 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:28.573390 26809 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:28.623262 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.606487 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.606635 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:28.624604 22818 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:28.618916 26871 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:28.625656 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:28.626648 22818 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:28.596119 26872 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:28.626080 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:28.633826 26921 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:28.619410 26762 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.634774 26762 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:28.634518 26927 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:28.636472 26952 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.637092 26952 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:28.640432 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.640950 26809 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:28.641937 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.643116 26568 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:28.643361 26948 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:28.643769 26568 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.644294 26568 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:28.646216 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.647835 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.649233 22896 raft_consensus.cc:2410] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 17 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:28.650628 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:28.642277 26809 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:28.652298 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:28.653654 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:28.655961 22818 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:17:28.656829 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.657137 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:28.658982 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.660879 22825 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:28.661361 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.663856 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.666253 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.667270 23659 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:28.669099 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.669946 23659 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:28.672382 23659 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:28.619596 26901 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:28.673911 26881 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:28.655115 26736 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:17:28.674763 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:28.676347 22818 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:28.677958 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.674638 26881 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.694110 26811 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:28.679380 22896 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:28.627982 26868 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:28.599342 26844 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:28.591861 26870 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:28.646593 26872 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:28.710147 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.681398 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:28.712512 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:28.682097 26921 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:28.682845 26914 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:28.683132 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.683917 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.684540 26922 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:28.686944 26952 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:28.627730 26866 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:28.689481 26916 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:28.691143 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.695909 26948 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:28.700866 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48634.3us
I20260709 12:17:28.706264 26892 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:28.708773 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.624118 26742 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:17:28.716135 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:28.720516 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.717525 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.700263 26881 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:28.741932 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.701288 22824 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:28.712095 26872 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:28.788657 23659 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:28.789597 22893 raft_consensus.cc:2393] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:28.789776 22896 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:28.790702 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:28.743781 26886 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:28.732261 26922 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.804502 26904 raft_consensus.cc:2764] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:17:28.807292 23685 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
W20260709 12:17:28.807785 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 91747.9us
I20260709 12:17:28.808789 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:28.808856 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:28.810770 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.811486 22896 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:28.812413 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:28.816251 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:28.818315 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:28.785413 26946 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.814172 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:28.822700 22896 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:28.746153 26631 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:17:28.797307 26665 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:28.824036 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:28.830963 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:28.779603 26948 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:28.805979 26922 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:28.858012 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:28.848556 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 219715us
I20260709 12:17:28.815088 26886 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:28.870988 23695 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:17:28.863158 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:28.826287 26631 consensus_queue.cc:1243] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:28.826440 26954 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:28.847174 26723 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:28.875409 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:28.846508 26914 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:28.849669 26736 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:28.887267 23695 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:28.862704 26920 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.890687 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:28.891513 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.826192 26946 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:28.878695 26954 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:28.905354 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:28.908419 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.947772 22901 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:28.888687 26736 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.889480 26864 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:28.878842 26075 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:17:28.890594 26723 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:28.853294 26866 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:28.879065 26919 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:17:28.939471 26854 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:28.943873 26954 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:28.975792 26736 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:29.001616 26977 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:17:29.002140 26976 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:17:29.003024 26815 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:29.003508 26815 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:29.003950 26723 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:29.004504 26815 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:29.006009 26815 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:29.008601 26948 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:29.009435 26973 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:17:29.015677 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:29.016157 22901 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:28.986414 26946 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:29.016460 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 126629us
I20260709 12:17:28.940915 26762 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:29.001644 26971 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 12:17:29.003080 26972 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:17:28.897138 26920 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:29.009829 26844 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:29.031633 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 997) took 1632 ms. Trace:
I20260709 12:17:29.032881 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1424) took 2369 ms. Trace:
I20260709 12:17:29.049214 22892 rpcz_store.cc:276] 0709 12:17:26.663775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.663950 (+   175us) service_pool.cc:224] Handling call
0709 12:17:26.664202 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:27.977400 (+1313198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.032568 (+1055168us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540039c1d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:29.032760 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3017790208}
I20260709 12:17:29.035835 22896 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:29.009882 26916 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:29.047701 22900 rpcz_store.cc:276] 0709 12:17:27.398989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.478674 (+ 79685us) service_pool.cc:224] Handling call
0709 12:17:27.479388 (+   714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.413046 (+933658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.031275 (+618229us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b5400317c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:29.031538 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143201664}
I20260709 12:17:29.058202 23672 raft_consensus.cc:2368] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14.
I20260709 12:17:29.061549 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:29.062434 23659 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:29.040042 26868 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:29.073943 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:29.074749 23659 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:29.063514 26844 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:29.025938 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:29.084084 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:29.087162 23689 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:29.088553 26986 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:29.089231 26986 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:29.080483 26808 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:29.091238 26808 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:29.092146 26986 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:29.011727 26886 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:29.100498 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 74643.6us
I20260709 12:17:29.104417 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:29.103091 26986 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:17:29.110208 26975 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:17:29.117010 23689 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:29.114204 26922 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:29.117547 26980 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260709 12:17:29.121707 22819 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:29.085240 26844 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:29.152082 26954 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:29.171136 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:29.173148 22899 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:17:29.196609 22899 pending_rounds.cc:85] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 6
I20260709 12:17:29.196738 22749 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:29.146377 26917 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.196942 22899 pending_rounds.cc:107] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:17:29.176263 26949 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:29.201552 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:29.202150 22899 raft_consensus.cc:2889] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:29.204037 22749 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:29.174449 26986 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:29.173573 26854 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:29.185714 26708 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:29.210932 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:29.211748 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 204566us
I20260709 12:17:29.239423 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:29.234715 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 263997us
I20260709 12:17:29.242600 22748 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:29.211233 26986 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:29.244503 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:29.245795 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:29.179872 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 77597.2us
I20260709 12:17:29.247162 22748 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:29.247448 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:29.249492 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:29.194519 26844 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:29.223531 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:29.252373 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:29.253270 22745 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:29.253285 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 75081.4us
I20260709 12:17:29.255069 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:29.256295 23659 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:29.255721 26864 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:29.263475 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:29.264298 22717 leader_election.cc:400] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14.
I20260709 12:17:29.264824 22717 leader_election.cc:403] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:29.267640 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:29.269521 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:29.267930 26872 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:29.274112 26995 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.272491 26864 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:29.274842 26995 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:29.275174 26840 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:29.268712 26708 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:29.206815 26917 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:29.263634 26916 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:29.269136 26762 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:29.268915 26809 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:29.256945 26494 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:17:29.260130 26981 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:29.222565 26816 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:29.270287 26892 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 12:17:29.300186 26984 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
I20260709 12:17:29.310722 26989 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.286684 22749 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:29.331265 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:29.339396 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 75258.9us
I20260709 12:17:29.346568 22753 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:29.339792 22745 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:29.357344 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:29.314313 26916 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:29.366819 26872 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:29.368326 26872 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:29.369022 26872 consensus_queue.cc:1243] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:29.304385 26992 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:29.346840 26993 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14.
I20260709 12:17:29.307406 26762 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:29.343698 26816 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:29.287659 26920 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:29.314682 26981 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:29.371158 27005 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:29.382030 26985 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:17:29.383718 26568 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.739s	user 0.016s	sys 0.000s
I20260709 12:17:29.384043 26900 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:29.384332 26568 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:29.386505 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 794) took 1743 ms. Trace:
I20260709 12:17:29.388806 22899 rpcz_store.cc:276] 0709 12:17:27.642924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.532490 (+889566us) service_pool.cc:224] Handling call
0709 12:17:28.532843 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.204356 (+671513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.386247 (+181891us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54006eb254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:29.386441 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465493376}
I20260709 12:17:29.376451 26762 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:29.403769 22745 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:17:29.409597 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 140165us
I20260709 12:17:29.386771 26981 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:29.411741 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.382063 26917 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:29.413982 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 155681us
W20260709 12:17:29.415529 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.291282 26854 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:29.426496 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:29.424021 23493 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:29.431528 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:29.432312 22895 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:17:29.432955 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:29.357679 26989 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:29.406441 26922 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:29.449708 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.386977 26736 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:29.529425 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.432669 26900 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.417024 26933 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:29.396318 27005 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:29.464738 26840 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:29.429114 26954 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:29.558620 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:29.541710 26900 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:29.575682 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 229028us
I20260709 12:17:29.560508 26816 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:29.582149 26864 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:29.582336 22865 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:29.589756 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.592077 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:29.593070 22825 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:29.597671 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:29.601614 26998 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 12:17:29.603655 22820 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1047) took 2487 ms (client timeout 2213 ms). Trace:
W20260709 12:17:29.604110 22820 rpcz_store.cc:269] 0709 12:17:27.119452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.119692 (+   240us) service_pool.cc:224] Handling call
0709 12:17:29.603398 (+2483706us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400300f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:29.603548 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3101428480}
I20260709 12:17:29.602463 26900 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:29.605444 26900 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.605995 26900 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:29.611620 26986 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:29.613436 26900 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:29.613243 26809 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:29.582543 26933 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:29.584597 26922 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.615598 26900 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.585028 27003 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:29.589123 26840 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:29.595942 26866 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:29.624672 26900 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:29.613790 26986 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:29.632071 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:29.599730 26568 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:29.597585 26920 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:17:29.616477 26809 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:29.632893 26866 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:29.607052 27002 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:17:29.625481 27003 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.623793 26933 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:29.599895 26864 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:29.667580 26989 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:29.668751 26900 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:29.648990 26881 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.850s	user 0.016s	sys 0.000s
I20260709 12:17:29.671224 26881 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:29.672828 26844 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:29.668855 26933 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:29.647971 26866 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:29.674881 26736 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:29.675740 26736 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.676288 26736 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:29.625831 26922 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:29.679852 26863 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:29.680836 26922 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:29.682623 26808 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.001s
I20260709 12:17:29.683221 26808 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:29.648016 26762 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:29.656486 27003 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:29.694468 26809 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:29.696116 26809 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:29.646128 26840 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:29.700775 26840 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:29.703663 27004 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:17:29.705340 27006 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:17:29.708345 27005 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:29.711364 27001 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:29.681411 26881 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:29.728178 26981 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:29.735077 26864 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:29.736932 26844 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:29.739524 26981 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:29.801609 27003 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:29.804502 27003 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:29.851428 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 266372us
I20260709 12:17:29.857192 22746 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:29.858739 22752 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:29.857182 22751 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:29.637857 22825 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:29.945616 22899 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:17:29.964310 23493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.010s	sys 0.025s
W20260709 12:17:29.965031 23493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.011s	sys 0.025s
W20260709 12:17:29.965690 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 541763us
I20260709 12:17:29.969450 23493 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:29.973394 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:29.979627 23495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.023s	sys 0.037s
W20260709 12:17:29.979835 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 374680us
W20260709 12:17:29.980616 23495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.024s	sys 0.037s
W20260709 12:17:29.981138 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.047478 22717 leader_election.cc:336] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.508s (SENT)
I20260709 12:17:30.048432 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:30.061218 26736 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:30.065150 26762 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:30.065817 26762 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:30.066279 26762 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:30.067744 26736 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:30.069015 26736 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:30.070168 26808 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:30.071311 26808 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:30.072264 26808 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:30.079655 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 97042.4us
W20260709 12:17:30.090682 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 112160us
I20260709 12:17:30.099520 26791 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:30.102684 27003 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.102926 26854 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:30.103264 27000 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.103907 27003 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:30.107101 27005 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:30.107998 26811 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:30.108186 27005 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:30.109030 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 944) took 1281 ms. Trace:
I20260709 12:17:30.113351 26844 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.113660 27010 raft_consensus.cc:3055] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:30.113745 26881 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:30.114162 27010 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:30.118599 26881 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:30.122336 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:30.109709 23685 rpcz_store.cc:276] 0709 12:17:28.827633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.827813 (+   180us) service_pool.cc:224] Handling call
0709 12:17:28.828213 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.882473 (+ 54260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:28.882526 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:28.882594 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:28.882645 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.108309 (+1225664us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b54002904d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:30.108388 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.108702 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124041088}
I20260709 12:17:30.133402 26946 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:30.125828 26808 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:30.104283 26854 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:30.139384 26920 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:30.099185 26866 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:30.104281 27000 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:30.145473 22893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1438) took 1560 ms (client timeout 1508 ms). Trace:
W20260709 12:17:30.136082 22865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.007s	sys 0.006s
W20260709 12:17:30.157405 22865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.009s	sys 0.006s
I20260709 12:17:30.150381 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 779) took 2577 ms. Trace:
I20260709 12:17:30.152467 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 965) took 2378 ms. Trace:
W20260709 12:17:30.150840 22823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.025s
I20260709 12:17:30.165400 22894 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:30.156904 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.165176 27008 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:30.153859 22893 rpcz_store.cc:269] 0709 12:17:28.584931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.622641 (+ 37710us) service_pool.cc:224] Handling call
0709 12:17:30.144778 (+1522137us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b540057bcd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:30.145186 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136818560}
W20260709 12:17:30.166371 22823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.011s	sys 0.027s
I20260709 12:17:30.147156 26844 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:30.176687 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:17:30.179709 27019 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.002s
I20260709 12:17:30.186654 27014 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.186383 27008 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:30.187814 27014 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:30.191247 27008 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:30.191423 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:30.191582 27014 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:30.192494 22901 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:30.201093 26870 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:30.200815 27010 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:30.201851 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:30.210551 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 951) took 2449 ms. Trace:
I20260709 12:17:30.205965 26881 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:30.216048 26854 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:30.216977 27005 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:30.217077 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.204777 27003 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:30.224375 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1092) took 2560 ms. Trace:
I20260709 12:17:30.234056 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:30.221611 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.208496 27010 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:30.237272 22825 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:30.218413 26866 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:30.159168 22897 rpcz_store.cc:276] 0709 12:17:27.562347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.256838 (+694491us) service_pool.cc:224] Handling call
0709 12:17:28.257238 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:28.261843 (+  4605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:28.261881 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:28.262461 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:17:30.131339 (+1868878us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b18001e8e60. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1
0709 12:17:30.132529 (+  1190us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:30.132723 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.135939 (+  3216us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:30.136767 (+   828us) raft_consensus.cc:1685] finished
0709 12:17:30.136841 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.139893 (+  3052us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28073,"raft.queue_time_us":54388,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":11898,"spinlock_wait_cycles":2708352,"thread_start_us":36652,"threads_started":1,"wal-append.queue_time_us":85451,"wal-append.run_cpu_time_us":2062,"wal-append.run_wall_time_us":1002071}
I20260709 12:17:30.235432 22744 rpcz_store.cc:276] 0709 12:17:27.663864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.687470 (+ 23606us) service_pool.cc:224] Handling call
0709 12:17:28.554921 (+867451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.555871 (+   950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.223622 (+1667751us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54001e78d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:30.224060 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1993913216}
I20260709 12:17:30.255527 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:30.257443 26736 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:30.258219 26736 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:30.224578 26995 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:30.242479 27014 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:30.259930 26736 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:30.159389 22750 rpcz_store.cc:276] 0709 12:17:27.773250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.823179 (+ 49929us) service_pool.cc:224] Handling call
0709 12:17:27.823602 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.055927 (+232325us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:28.080833 (+ 24906us) log.cc:844] Serialized 14 byte log entry
0709 12:17:28.368966 (+288133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:28.369026 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:28.369076 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.112176 (+1743100us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54001e6ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:30.119421 (+  7245us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.152050 (+ 32629us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16269,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":99,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":533621120,"thread_start_us":287673,"threads_started":1,"wal-append.queue_time_us":326547,"wal-append.run_cpu_time_us":1511,"wal-append.run_wall_time_us":1059151}
I20260709 12:17:30.218668 23656 rpcz_store.cc:276] 0709 12:17:27.715013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.715258 (+   245us) service_pool.cc:224] Handling call
0709 12:17:27.715832 (+   574us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:17:28.040959 (+325127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:28.041001 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:17:28.065388 (+ 24387us) log.cc:844] Serialized 78 byte log entry
0709 12:17:28.278135 (+212747us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:28.278210 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.112679 (+1834469us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b5400080554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:30.126510 (+ 13831us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:30.135090 (+  8580us) raft_consensus.cc:1685] finished
0709 12:17:30.135696 (+   606us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.164627 (+ 28931us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11622,"raft.queue_time_us":86852,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":4174,"spinlock_wait_cycles":403405056,"thread_start_us":329797,"threads_started":2,"wal-append.queue_time_us":339164,"wal-append.run_cpu_time_us":3383,"wal-append.run_wall_time_us":1137374}
W20260709 12:17:30.267640 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.268558 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.269066 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 796) took 1671 ms. Trace:
I20260709 12:17:30.269634 22896 rpcz_store.cc:276] 0709 12:17:28.597344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.823406 (+226062us) service_pool.cc:224] Handling call
0709 12:17:29.035390 (+211984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.050902 (+ 15512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.268513 (+1217611us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54002fe4d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:30.268850 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486746496}
I20260709 12:17:30.270644 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.272505 26844 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:30.253545 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:30.279680 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 137878us
W20260709 12:17:30.281437 23672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 930) took 1625 ms (client timeout 1714 ms). Trace:
I20260709 12:17:30.281924 26863 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:17:30.283519 26791 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:30.285133 26863 raft_consensus.cc:3055] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:30.285588 26863 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:30.289887 22893 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:30.290819 22894 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:30.295528 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.300154 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.301632 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1053) took 2048 ms. Trace:
I20260709 12:17:30.301807 26919 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.302198 22827 rpcz_store.cc:276] 0709 12:17:28.253498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.254955 (+  1457us) service_pool.cc:224] Handling call
0709 12:17:28.319654 (+ 64699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.405500 (+ 85846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.301014 (+1895514us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b54005d8c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:30.301391 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142560512}
I20260709 12:17:30.302641 26919 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:30.305225 26914 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.305945 26919 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:30.314265 22894 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:30.305989 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 873) took 1142 ms. Trace:
I20260709 12:17:30.315959 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:30.315891 22751 rpcz_store.cc:276] 0709 12:17:29.163742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.164360 (+   618us) service_pool.cc:224] Handling call
0709 12:17:29.164771 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.859904 (+695133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.305458 (+445554us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54000a9454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:30.305821 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590130048}
I20260709 12:17:30.317310 27014 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:30.318992 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:30.321195 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 119595us
I20260709 12:17:30.323513 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:30.266456 26568 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:30.305995 26914 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:30.306190 22895 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.779s	user 0.021s	sys 0.012s
W20260709 12:17:30.282289 23672 rpcz_store.cc:269] 0709 12:17:28.655926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.656107 (+   181us) service_pool.cc:224] Handling call
0709 12:17:30.280768 (+1624661us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400291dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:30.281168 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754388736}
I20260709 12:17:30.327529 26568 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:30.359083 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:30.360320 22744 raft_consensus.cc:2410] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:30.331581 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:30.354332 22895 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:30.366284 27003 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:30.367276 27003 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:30.372781 26762 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:30.375523 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:30.377252 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:30.378630 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:30.379789 22749 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 10: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:17:30.387939 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.394903 26494 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:30.348838 26863 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:30.395059 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 145021us
I20260709 12:17:30.409701 22753 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:30.410369 22745 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:30.365785 27022 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:17:30.399834 27003 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:30.431391 22750 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:30.425269 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:30.428794 22825 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:30.416816 22901 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:30.463045 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:30.467501 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 158555us
I20260709 12:17:30.437215 27000 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:30.481814 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.486483 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:30.499202 22749 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:30.499595 22825 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:30.502028 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 143261us
I20260709 12:17:30.517287 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.518380 22819 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
W20260709 12:17:30.522984 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.527004 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.528175 23659 raft_consensus.cc:2410] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:30.531867 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.539458 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:30.540788 23679 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:30.549137 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.550632 22825 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:30.546331 22749 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:30.559809 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.560592 22745 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:30.568214 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.571106 26568 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:30.571185 22749 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:30.573457 26568 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:30.571682 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:30.576084 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.567308 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:30.580204 26847 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.580363 22745 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:30.581019 26847 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:30.585671 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.560982 26914 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:30.587517 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:30.591950 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.591986 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:30.594157 23695 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:30.593457 26762 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:30.594941 26840 consensus_queue.cc:1175] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:30.597527 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 876) took 1416 ms. Trace:
I20260709 12:17:30.598016 22746 rpcz_store.cc:276] 0709 12:17:29.180931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.181241 (+   310us) service_pool.cc:224] Handling call
0709 12:17:29.181730 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.858633 (+676903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.577642 (+719009us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54001e87d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:30.597444 (+ 19802us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550880128}
I20260709 12:17:30.598821 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 874) took 1434 ms. Trace:
I20260709 12:17:30.589016 23656 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:30.603087 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:30.607106 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.599474 22752 rpcz_store.cc:276] 0709 12:17:29.164062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.164985 (+   923us) service_pool.cc:224] Handling call
0709 12:17:29.165266 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.859575 (+694309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.598436 (+738861us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54000a8054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:30.598685 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592834944}
I20260709 12:17:30.616971 22892 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:30.610581 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.625046 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:30.629786 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:30.633471 22823 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:30.635305 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.638916 23672 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:30.642426 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.648950 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:30.652185 26809 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.919s	user 0.016s	sys 0.008s
I20260709 12:17:30.652941 26809 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.653513 26809 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:30.654865 26949 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:17:30.655606 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.655226 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.657133 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.657248 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:30.658231 22818 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:30.659574 22819 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:30.659312 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.660629 22826 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:30.661584 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:30.663280 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.665419 26847 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:30.666175 26847 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:30.667680 26809 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:30.668438 26847 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:30.672114 23493 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:30.673804 27010 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:17:30.675424 26791 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:30.676435 27010 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:17:30.677060 26791 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:30.677387 27010 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:30.677513 26791 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:30.677868 27010 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:30.678584 26791 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:30.678988 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:30.675122 26866 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 12:17:30.680162 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 48990.1us
I20260709 12:17:30.680357 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:30.680598 26866 consensus_queue.cc:1243] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:30.680024 26791 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:30.682029 27010 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:30.684000 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:30.685366 27010 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:30.686020 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:30.699518 22825 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:30.669538 26809 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:30.690760 22753 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:30.695619 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:30.707973 22827 raft_consensus.cc:2368] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11.
I20260709 12:17:30.672648 26847 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:30.698009 22901 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:30.708866 23679 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:30.658618 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.649912 23659 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:30.705493 23682 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:30.707407 22899 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:30.711575 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:30.713285 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:30.708575 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:30.718369 23695 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
W20260709 12:17:30.723799 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 73219.3us
I20260709 12:17:30.723018 26809 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:30.773667 26809 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:30.775125 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.775252 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:30.776357 22823 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:30.777961 23685 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:30.724627 22824 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:30.727239 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.726541 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:30.791638 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 71058.9us
I20260709 12:17:30.792559 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:30.794747 27011 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:30.796464 27013 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:30.797046 27013 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:30.797343 26995 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:30.797873 26995 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.798282 26995 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:30.807564 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.727751 26844 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:30.847929 27044 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.848982 27044 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:30.849860 27017 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:30.852903 27044 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:30.853598 27047 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.858148 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.859225 23682 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:30.798252 27013 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:30.862216 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:30.862990 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.863564 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:30.865307 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.834822 26809 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:30.867059 27017 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:30.871274 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:30.867969 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:30.877184 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:30.878685 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:30.880067 22825 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:30.878701 26943 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:30.897684 22899 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:30.897935 26943 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:30.897347 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:30.899354 23679 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:30.897223 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:30.860600 27013 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:30.892290 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55420.6us
I20260709 12:17:30.897217 22822 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:17:30.903903 22897 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:30.907969 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.900161 22896 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:30.908068 26914 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:30.915372 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:30.917971 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.917388 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.920329 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:30.923885 22893 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:30.923964 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:30.925079 22895 raft_consensus.cc:2368] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11.
I20260709 12:17:30.925045 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:30.926132 22900 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:30.926635 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:30.927551 22895 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:30.928753 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:30.929586 22895 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 7.
I20260709 12:17:30.930711 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:30.931387 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:30.932428 22824 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 8.
I20260709 12:17:30.932605 26809 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:30.899355 26943 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:30.932363 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:30.920987 22897 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:30.854512 27047 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:30.931047 22894 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:30.925118 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:30.951290 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:30.951696 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:30.952256 22748 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:17:30.934928 26943 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:30.955842 22893 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:30.957321 26809 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:30.959267 22895 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:30.963455 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.964852 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:30.965471 23695 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:30.966743 23695 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:17:30.990959 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.990871 22900 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
W20260709 12:17:30.990831 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.992298 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.950697 22899 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:31.000483 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:31.003304 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44161.4us
I20260709 12:17:31.015503 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.019311 22900 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 12:17:31.025708 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 163849us
I20260709 12:17:31.027643 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.024293 22896 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:31.027905 22894 pending_rounds.cc:85] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 4
I20260709 12:17:31.008054 26809 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:31.052335 22751 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:31.028807 22894 pending_rounds.cc:107] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 12:17:31.055934 22894 raft_consensus.cc:2889] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:31.060837 22895 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:31.064307 22898 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:17:31.069919 23695 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:30.926024 27017 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:31.083235 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 290742us
I20260709 12:17:31.087471 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:31.090022 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 49340.1us
I20260709 12:17:31.097712 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:31.103935 22865 leader_election.cc:400] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14.
I20260709 12:17:31.104539 22865 leader_election.cc:403] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:31.105566 26959 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14.
I20260709 12:17:31.115963 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:31.120203 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.134701 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.158418 22748 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:31.165999 23679 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:31.169143 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:31.170143 22751 raft_consensus.cc:2376] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15. Re-sending same reply.
I20260709 12:17:31.139020 26914 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:31.172601 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.096565 26809 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:31.186537 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:31.135629 26995 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:31.201977 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:31.204896 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:31.204734 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.207378 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.208871 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:31.202064 22749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.008s	sys 0.025s
W20260709 12:17:31.213505 22749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.009s	sys 0.025s
I20260709 12:17:31.221376 23679 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:31.223206 22746 raft_consensus.cc:2368] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13.
I20260709 12:17:31.232597 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.184760 27011 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:31.239555 22751 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
W20260709 12:17:31.247246 22752 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.009s	sys 0.018s
W20260709 12:17:31.248020 22752 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.010s	sys 0.019s
I20260709 12:17:31.259222 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.261667 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:31.262251 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 134354us
W20260709 12:17:31.250356 26791 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.002s
I20260709 12:17:31.267055 22751 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:17:31.274823 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:31.275571 23679 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:31.219388 26914 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:31.274279 27011 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:31.279979 26914 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:31.280691 26914 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:31.280964 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:31.313436 27003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.008s	sys 0.008s
W20260709 12:17:31.314232 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 206410us
I20260709 12:17:31.254539 27053 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:17:31.319144 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 173786us
W20260709 12:17:31.315572 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.321552 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.321689 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.318434 23656 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
W20260709 12:17:31.324555 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 158871us
I20260709 12:17:31.249874 26844 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:31.332471 23679 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:31.334717 22748 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:31.338020 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.341795 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.342250 23672 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:17:31.315092 27003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.008s	sys 0.008s
I20260709 12:17:31.263360 26666 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.199s
I20260709 12:17:31.353365 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.355948 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:31.360963 27037 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.826s	user 0.000s	sys 0.003s
W20260709 12:17:31.366641 27045 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.489s	user 0.001s	sys 0.002s
I20260709 12:17:31.368853 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.369694 22753 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:31.371605 22899 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: []
W20260709 12:17:31.372236 27038 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.845s	user 0.002s	sys 0.000s
I20260709 12:17:31.374603 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 889) took 1009 ms. Trace:
I20260709 12:17:31.375069 22744 rpcz_store.cc:276] 0709 12:17:30.370727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.379566 (+  8839us) service_pool.cc:224] Handling call
0709 12:17:30.425533 (+ 45967us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:30.441003 (+ 15470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:30.441081 (+    78us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:30.442343 (+  1262us) log.cc:844] Serialized 52 byte log entry
0709 12:17:30.489331 (+ 46988us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:30.612918 (+123587us) log.cc:844] Serialized 14 byte log entry
0709 12:17:30.613294 (+   376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.613395 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:31.371282 (+757887us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:31.374245 (+  2963us) raft_consensus.cc:1685] finished
0709 12:17:31.374359 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.374535 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86799,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":11952,"raft.queue_time_us":9686,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":17608,"spinlock_wait_cycles":76061952,"thread_start_us":151013,"threads_started":2,"wal-append.queue_time_us":84388}
I20260709 12:17:31.378350 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 921) took 1136 ms. Trace:
I20260709 12:17:31.378834 23685 rpcz_store.cc:276] 0709 12:17:30.241719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.246961 (+  5242us) service_pool.cc:224] Handling call
0709 12:17:31.378165 (+1131204us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b5400462b54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:31.378287 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922678144}
I20260709 12:17:31.379453 26995 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:31.383423 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.384262 22753 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:31.384444 27047 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:31.385170 27047 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:31.385790 27047 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:31.386286 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.387135 22753 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:31.387777 26809 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:31.388047 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.389324 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.391384 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.393201 23679 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:31.399492 22748 raft_consensus.cc:2410] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 12:17:31.399121 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 50684.9us
I20260709 12:17:31.398679 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:31.405447 22896 raft_consensus.cc:1217] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Deduplicated request from leader. Original: 8.4->[10.5-16.8]   Dedup: 12.6->[14.7-16.8]
I20260709 12:17:31.406194 22896 pending_rounds.cc:85] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 6
I20260709 12:17:31.406524 22896 pending_rounds.cc:107] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:17:31.406831 22896 raft_consensus.cc:2889] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:31.423804 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:31.425212 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:31.430778 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 93511us
W20260709 12:17:31.426980 26999 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.599s	user 0.024s	sys 0.007s
I20260709 12:17:31.436367 22753 raft_consensus.cc:2410] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:17:31.432034 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:31.440872 26666 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:17:31.446027 27051 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.466028 27051 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:31.468245 27051 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:31.452906 22748 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:31.459578 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.471787 22745 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 12:17:31.439535 26999 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.802s	user 0.025s	sys 0.007s
I20260709 12:17:31.473106 23659 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
W20260709 12:17:31.442577 23494 connection.cc:256] RPC call timeout handler was delayed by -1.0157424779997655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:17:31.475672 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.478271 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 69329.8us
I20260709 12:17:31.481981 22753 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:17:31.443153 26809 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:31.489398 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:31.497896 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 106360us
I20260709 12:17:31.453008 27066 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:31.460742 27047 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:31.510251 22748 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:17:31.510957 22748 pending_rounds.cc:85] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 5
I20260709 12:17:31.511264 22748 pending_rounds.cc:107] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:17:31.511559 22748 raft_consensus.cc:2889] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:31.507093 27051 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:31.524578 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.526857 23689 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:31.532053 27079 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:31.454077 26844 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:31.530722 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 925) took 1040 ms. Trace:
I20260709 12:17:31.539254 23689 rpcz_store.cc:276] 0709 12:17:30.490130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.500430 (+ 10300us) service_pool.cc:224] Handling call
0709 12:17:31.524249 (+1023819us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b58002c3a98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:17:31.530504 (+  6255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5412736}
I20260709 12:17:31.526460 27051 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.558956 22745 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:31.573232 22745 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:17:31.573699 22745 pending_rounds.cc:85] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 6
I20260709 12:17:31.573945 22745 pending_rounds.cc:107] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:17:31.574293 22745 raft_consensus.cc:2889] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:31.556051 27051 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:31.603175 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 102739us
I20260709 12:17:31.601687 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:31.608430 22864 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:31.614065 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 95625.5us
W20260709 12:17:31.619225 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.619304 22864 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:31.626859 22571 catalog_manager.cc:5697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:31.629204 22571 catalog_manager.cc:5697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:31.631036 26809 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:31.631513 26809 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.631875 26809 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:31.633503 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 64685.2us
I20260709 12:17:31.634606 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:31.635008 22864 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:31.623430 27044 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:31.636534 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:31.636726 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:31.637609 27052 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:31.639663 26943 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.685s	user 0.014s	sys 0.002s
I20260709 12:17:31.641162 26494 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:31.647430 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:31.644722 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:31.621011 27057 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:31.659629 26901 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:31.667099 26901 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:31.667326 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:31.667583 26901 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:31.641186 27078 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:17:31.672353 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 53727.7us
I20260709 12:17:31.680836 26943 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:17:31.681180 27083 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:17:31.681821 27048 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:31.662703 26946 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:31.699227 26946 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:31.642326 22571 catalog_manager.cc:5697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 9 to 13, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 13 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:31.700570 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.700742 22571 catalog_manager.cc:5697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:31.702021 22746 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:17:31.708583 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.723313 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 80849.2us
I20260709 12:17:31.730497 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1104) took 1063 ms. Trace:
I20260709 12:17:31.731117 22746 rpcz_store.cc:276] 0709 12:17:30.667684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.380741 (+713057us) service_pool.cc:224] Handling call
0709 12:17:31.700324 (+319583us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:17:31.730410 (+ 30086us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20886912}
I20260709 12:17:31.735579 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:31.698398 26863 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:31.754712 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 979) took 1269 ms. Trace:
W20260709 12:17:31.764773 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.766207 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.773041 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.776420 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1002) took 1588 ms. Trace:
I20260709 12:17:31.777024 22892 rpcz_store.cc:276] 0709 12:17:30.188473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.188773 (+   300us) service_pool.cc:224] Handling call
0709 12:17:30.613367 (+424594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.619975 (+  6608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.758309 (+1138334us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54000ee2d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:31.776332 (+ 18023us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944235776}
I20260709 12:17:31.781458 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.790287 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.734669 27003 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:31.796656 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.733963 27079 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:31.797135 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:31.796010 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:31.799722 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:31.800956 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 162270us
I20260709 12:17:31.795761 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:31.805060 23672 raft_consensus.cc:2410] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:17:31.780128 27014 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:31.823004 23695 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:31.823639 23695 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:31.829836 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:31.831002 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1445) took 1011 ms. Trace:
I20260709 12:17:31.831396 22901 rpcz_store.cc:276] 0709 12:17:30.820037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.820277 (+   240us) service_pool.cc:224] Handling call
0709 12:17:31.829626 (+1009349us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b58001e3398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:17:31.830918 (+  1292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501504}
I20260709 12:17:31.844054 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 982) took 1243 ms. Trace:
W20260709 12:17:31.835904 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 499960us
I20260709 12:17:31.850824 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:31.842532 26840 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:31.854151 27079 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:31.855326 26840 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.855775 26840 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:31.858636 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:31.854413 22571 catalog_manager.cc:5697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:31.868211 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:31.867954 26809 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:31.869007 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 105794us
I20260709 12:17:31.844496 22752 rpcz_store.cc:276] 0709 12:17:30.603506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.620068 (+ 16562us) service_pool.cc:224] Handling call
0709 12:17:30.628130 (+  8062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.628535 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:31.248644 (+620109us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.835845 (+587201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.835913 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:31.843783 (+  7870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.843868 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.843999 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":388104,"prepare.queue_time_us":79233,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"thread_start_us":731606,"threads_started":2,"wal-append.queue_time_us":248338}
I20260709 12:17:31.843923 27053 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:31.890831 26762 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:17:31.893580 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 226312us
I20260709 12:17:31.875558 23695 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:31.868908 27066 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:17:31.896376 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 150483us
I20260709 12:17:31.883673 27057 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:31.907763 23695 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:31.897593 26844 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:31.907116 27034 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 1.376s	user 0.004s	sys 0.001s
W20260709 12:17:31.920414 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 184973us
I20260709 12:17:31.923168 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:31.930941 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 62908.1us
W20260709 12:17:31.932971 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 87551.1us
W20260709 12:17:31.912358 27089 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:17:31.907640 26946 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:31.943974 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:31.945053 22717 leader_election.cc:400] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11.
I20260709 12:17:31.958434 22717 leader_election.cc:403] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:17:31.945832 27101 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:31.949170 27066 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:31.950698 26844 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:31.987754 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 68045.8us
I20260709 12:17:31.955739 27091 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:31.983913 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.984033 27085 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.984539 27095 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.985285 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:31.990283 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:31.998155 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:31.996755 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 62951.3us
I20260709 12:17:31.996030 22752 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
W20260709 12:17:31.999858 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 76740us
I20260709 12:17:31.989533 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:31.999482 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:32.003404 27053 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.006067 22824 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:32.007665 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:32.010608 26844 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:31.942392 26901 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:32.012007 26809 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:32.013459 26901 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:32.013123 22571 catalog_manager.cc:5697] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:17:32.017146 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.018133 22820 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:32.019292 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.020992 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.021842 22825 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:32.022581 27101 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:32.024979 27101 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:32.025585 27067 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11.
I20260709 12:17:32.026664 27085 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.026966 27095 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:32.029037 27085 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:31.975344 27059 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.030529 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 92891.7us
I20260709 12:17:32.030292 27059 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:32.033056 27059 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:32.033680 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:31.998390 27057 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:32.034708 26863 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:32.007085 22745 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:32.036886 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 896) took 1319 ms. Trace:
I20260709 12:17:32.039897 22753 rpcz_store.cc:276] 0709 12:17:30.683136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.485563 (+802427us) service_pool.cc:224] Handling call
0709 12:17:31.501168 (+ 15605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.506654 (+  5486us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:17:31.521229 (+ 14575us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.940509 (+419280us) log.cc:844] Serialized 14 byte log entry
0709 12:17:32.002380 (+ 61871us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:32.002437 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:32.002490 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.002552 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.002720 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":340687,"prepare.queue_time_us":6464,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":86,"raft.queue_time_us":297013,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":10460,"thread_start_us":118626,"threads_started":2,"wal-append.queue_time_us":213410}
W20260709 12:17:32.051407 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 52022.5us
I20260709 12:17:32.053730 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:32.054675 23695 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:17:32.055254 23695 pending_rounds.cc:85] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 8
I20260709 12:17:32.055493 23695 pending_rounds.cc:107] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:17:32.055786 23695 raft_consensus.cc:2889] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:32.058420 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:32.059042 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.038805 27066 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:32.082681 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 81886.8us
I20260709 12:17:32.050271 27048 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:32.030186 27095 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:32.084877 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 95425us
I20260709 12:17:32.086609 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:32.057085 26995 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:32.090999 26871 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:17:32.094386 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.090623 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:32.097502 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:32.100885 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:32.087247 27102 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:32.102589 27095 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:32.088918 26995 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.118214 26995 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:32.102487 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:32.016657 22571 catalog_manager.cc:5697] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 6 to 7, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 7 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:32.127096 22746 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:32.127362 27002 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:32.133384 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 898) took 1412 ms. Trace:
I20260709 12:17:32.134110 22748 rpcz_store.cc:276] 0709 12:17:30.720527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.520499 (+799972us) service_pool.cc:224] Handling call
0709 12:17:31.538884 (+ 18385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:31.859699 (+320815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.859746 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:31.875371 (+ 15625us) log.cc:844] Serialized 26 byte log entry
0709 12:17:32.047572 (+172201us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:32.047617 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.047759 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.132998 (+ 85239us) raft_consensus.cc:1685] finished
0709 12:17:32.133037 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.133286 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":323166,"raft.queue_time_us":348296,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5440,"thread_start_us":129762,"threads_started":1,"wal-append.queue_time_us":185796}
W20260709 12:17:32.136441 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.137679 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:32.102690 27047 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:17:32.139814 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.140311 27047 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:32.140591 22825 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:32.141897 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:32.143466 22823 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:32.143256 27053 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:32.144534 27105 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:32.090126 27048 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:32.146080 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:32.146265 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:32.127206 27066 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.152909 27067 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:32.153492 27067 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:32.154502 27067 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.152441 22745 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:32.125878 22571 catalog_manager.cc:5697] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:32.122704 23493 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:32.165831 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 50550.5us
W20260709 12:17:32.117017 27051 consensus_meta.cc:287] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.003s
W20260709 12:17:32.168709 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 66314.6us
W20260709 12:17:32.172974 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 50380.4us
I20260709 12:17:32.120249 27102 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.176916 27113 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:32.177114 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:32.187924 23695 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:32.175078 26863 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:32.178186 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:32.179733 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:32.193217 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 55653.8us
I20260709 12:17:32.193552 22821 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:32.191690 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.194092 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:32.102429 27044 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:17:32.198172 23493 leader_election.cc:400] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13.
I20260709 12:17:32.200014 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:32.202499 23493 leader_election.cc:403] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:17:32.216903 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:32.194270 27102 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:32.227869 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:32.146471 27048 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:32.201349 26863 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:32.206187 27044 consensus_queue.cc:1243] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:32.193569 27113 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.172436 27051 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:32.172464 22571 catalog_manager.cc:5697] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 12, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 12 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:32.235179 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 65487.2us
I20260709 12:17:32.240227 26916 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:32.239656 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:32.260978 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:32.241014 27002 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:17:32.242971 27113 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:32.265137 22826 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:32.268752 22896 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:32.257784 23695 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:32.261643 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:32.271319 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:32.267071 22791 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:32.243188 27047 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:32.284126 22821 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:32.289467 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:32.290750 22899 raft_consensus.cc:2410] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:17:32.267729 26916 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.294282 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:32.267202 27059 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:32.302556 23685 pending_rounds.cc:85] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 5
I20260709 12:17:32.304983 23685 pending_rounds.cc:107] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:17:32.237135 26995 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.285431 26959 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:32.311230 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:32.313879 26995 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:32.315166 27092 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.465s	user 0.003s	sys 0.000s
I20260709 12:17:32.294534 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:32.270576 27095 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:32.305972 26952 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.282231 27002 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:32.287051 26666 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:17:32.307869 22571 catalog_manager.cc:5697] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:17:32.309350 26948 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:32.311228 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:32.311442 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 58540.9us
I20260709 12:17:32.313328 26959 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:32.270491 27057 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13.
I20260709 12:17:32.316072 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:32.316377 22892 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:32.305341 23685 raft_consensus.cc:2889] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:32.286873 27050 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:17:32.317425 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 50448.4us
I20260709 12:17:32.322889 26952 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:32.328076 27111 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 12:17:32.329423 27118 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:17:32.343209 27059 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:32.334890 26840 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:32.291224 27093 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:32.294273 26916 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:32.520440 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:32.318984 27095 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.491623 26959 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:32.421312 27002 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.493713 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:32.546591 22821 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: []
W20260709 12:17:32.547012 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 53397.4us
W20260709 12:17:32.547964 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.549338 22864 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:32.500211 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 200939us
I20260709 12:17:32.502380 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:32.550289 23494 connection.cc:256] RPC call timeout handler was delayed by -1.3871708349997789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 12:17:32.516039 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.508189 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.286665 27055 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 12:17:32.537768 26927 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.540663 26952 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:32.498549 27050 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:32.414767 26863 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.500931 27085 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:17:32.543398 22571 catalog_manager.cc:5697] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:32.552129 22819 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:32.552800 22751 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:32.540844 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:32.544684 27095 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:32.520753 27093 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:32.568828 22827 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:17:32.569757 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:32.551795 27002 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:32.568369 23494 connection.cc:256] RPC call timeout handler was delayed by -1.241838191999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 12:17:32.572217 23494 connection.cc:256] RPC call timeout handler was delayed by -1.2283381919999101s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 12:17:32.572741 23494 connection.cc:256] RPC call timeout handler was delayed by -1.2076381919998767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 12:17:32.562307 27067 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:32.519706 26995 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:17:32.557080 27048 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:17:32.573359 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 274768us
I20260709 12:17:32.560820 27050 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:32.563114 27003 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:32.576001 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:32.598832 22821 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:32.598949 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:32.579560 23494 connection.cc:256] RPC call timeout handler was delayed by -1.1545381919997908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 12:17:32.580689 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:32.584908 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.569130 27093 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:32.587306 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:32.586715 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:32.607684 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.580294 27067 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.560645 26927 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:32.625739 27094 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.768s	user 0.000s	sys 0.002s
W20260709 12:17:32.627468 27133 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:17:32.601799 27051 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:32.602928 26954 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.632401 27124 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:17:32.633040 27122 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:17:32.659931 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:32.619884 27127 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.655637 27128 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 12:17:32.573642 27005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.171s	user 0.011s	sys 0.031s
I20260709 12:17:32.646705 22827 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:32.649472 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:32.587196 27101 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:32.631209 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 90515.3us
I20260709 12:17:32.673830 22717 leader_election.cc:400] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11.
I20260709 12:17:32.648682 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:32.644692 26871 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:32.603022 27011 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.642747 27067 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:32.619356 27090 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:32.666326 22821 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:32.644059 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:32.660321 27130 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:17:32.676101 22826 raft_consensus.cc:2376] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8. Re-sending same reply.
I20260709 12:17:32.684984 22819 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:17:32.675191 27005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.012s	sys 0.032s
I20260709 12:17:32.575172 27102 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.689623 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.693323 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:32.693946 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:32.694931 22826 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:32.682331 26871 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:32.659534 27048 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:17:32.686242 27011 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.702024 27011 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:32.659155 22571 catalog_manager.cc:5697] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 8 to 12, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 12 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:32.703950 22571 catalog_manager.cc:5697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.705819 22571 catalog_manager.cc:5697] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 9 to 10, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 10 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:17:32.707664 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:32.714474 22753 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:32.709199 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:32.693532 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 44927.7us
I20260709 12:17:32.693132 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:32.712471 23659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 934) took 1999 ms (client timeout 1939 ms). Trace:
I20260709 12:17:32.661717 27044 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 12:17:32.717188 23659 rpcz_store.cc:269] 0709 12:17:30.712997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.715187 (+  2190us) service_pool.cc:224] Handling call
0709 12:17:32.712334 (+1997147us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b540073b254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:32.712418 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223757696}
I20260709 12:17:32.685022 27051 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:32.721915 22819 raft_consensus.cc:2368] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13.
I20260709 12:17:32.722518 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.667323 26954 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.728940 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:32.729805 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:32.732913 22821 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:32.672019 27127 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:32.752427 27127 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:32.713114 27059 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:32.706925 27090 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:32.727972 26840 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:32.756484 27095 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:32.756672 27113 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.758467 22822 raft_consensus.cc:2368] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14.
I20260709 12:17:32.738435 26927 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:32.740288 26871 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.760216 22752 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:32.761530 26871 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:32.741361 22571 catalog_manager.cc:5697] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 9 to 12, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 12 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:17:32.743151 26708 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:32.762665 26708 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:32.746973 27010 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.763001 27134 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.279s	user 0.004s	sys 0.000s
I20260709 12:17:32.763389 27010 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.641239 22564 maintenance_manager.cc:643] P cca02bb097e24340a2d738fc4f06877d: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.505s	user 0.173s	sys 0.097s Metrics: {"bytes_written":29576,"cfile_init":1,"dirs.queue_time_us":244527,"dirs.run_cpu_time_us":756,"dirs.run_wall_time_us":3379,"drs_written":1,"lbm_read_time_us":457,"lbm_reads_lt_1ms":4,"lbm_write_time_us":194648,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":21,"peak_mem_usage":0,"rows_written":63,"thread_start_us":276558,"threads_started":2,"wal-append.queue_time_us":66547}
I20260709 12:17:32.765921 22571 catalog_manager.cc:5697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:17:32.766999 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:32.769174 22565 maintenance_manager.cc:419] P cca02bb097e24340a2d738fc4f06877d: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7498 bytes on disk
I20260709 12:17:32.768479 22571 catalog_manager.cc:5697] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 4 to 9, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 9 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:32.752923 26954 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:32.727766 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:32.774200 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:32.731038 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:32.765985 27010 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:32.785331 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 277337us
I20260709 12:17:32.786197 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:32.786056 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 65971.8us
I20260709 12:17:32.787007 22744 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:32.724457 27101 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:32.719719 27131 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:32.795740 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:32.796519 22564 maintenance_manager.cc:643] P cca02bb097e24340a2d738fc4f06877d: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.025s	user 0.000s	sys 0.002s Metrics: {"cfile_init":1,"lbm_read_time_us":349,"lbm_reads_lt_1ms":4}
I20260709 12:17:32.798398 27002 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:32.799604 27095 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:32.800722 27002 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:32.802896 27131 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.803629 27131 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:32.721463 27052 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:17:31.755312 22749 rpcz_store.cc:276] 0709 12:17:30.487172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.578701 (+ 91529us) service_pool.cc:224] Handling call
0709 12:17:30.611141 (+ 32440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.627923 (+ 16782us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:30.628334 (+   411us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.317268 (+688934us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.754013 (+436745us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b180013e5e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf1694a40 00007fadf168f4e4 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287 00007fadf479a208
0709 12:17:31.754217 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.754307 (+    90us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:31.754360 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.754447 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.754632 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":432091,"prepare.queue_time_us":86354,"prepare.run_cpu_time_us":36661,"prepare.run_wall_time_us":100491,"raft.queue_time_us":117297,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":6317,"spinlock_wait_cycles":4626304,"thread_start_us":678169,"threads_started":2,"wal-append.queue_time_us":715468}
I20260709 12:17:32.810413 22823 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:17:32.811045 22823 pending_rounds.cc:85] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 5
I20260709 12:17:32.816721 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 977) took 2442 ms. Trace:
I20260709 12:17:32.817159 22747 rpcz_store.cc:276] 0709 12:17:30.374653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.486657 (+112004us) service_pool.cc:224] Handling call
0709 12:17:30.502667 (+ 16010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.428180 (+925513us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:31.452059 (+ 23879us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.534509 (+ 82450us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b18002f29c0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:17:31.875259 (+340750us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.875339 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:31.883472 (+  8133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.816350 (+932878us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b54001e7dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:32.816400 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.816542 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293995,"prepare.queue_time_us":10880,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":339753,"spinlock_wait_cycles":2090247296,"thread_start_us":30991,"threads_started":1,"wal-append.queue_time_us":172393,"wal-append.run_cpu_time_us":1452,"wal-append.run_wall_time_us":1001459}
W20260709 12:17:32.819380 22744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1124) took 1781 ms (client timeout 2239 ms). Trace:
W20260709 12:17:32.819921 22744 rpcz_store.cc:269] 0709 12:17:31.006877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.377364 (+370487us) service_pool.cc:224] Handling call
0709 12:17:32.786035 (+1408671us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:17:32.787675 (+  1640us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28332800}
I20260709 12:17:32.801550 22571 catalog_manager.cc:5697] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 6 to 12, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 12 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.811299 22823 pending_rounds.cc:107] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:17:32.826512 22823 raft_consensus.cc:2889] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:32.829247 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:32.763120 26708 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.833925 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:32.839686 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 108691us
I20260709 12:17:32.841670 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:32.842976 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:32.843665 22744 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:32.842450 22747 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:32.847597 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:32.791494 27090 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:32.793411 27101 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:32.802922 26954 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:32.848953 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:32.842891 27066 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:32.867904 22827 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:32.843534 27107 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.847116 27051 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:32.859498 27059 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:17:32.879264 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.880661 22753 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:32.862021 27101 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:32.879642 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:32.844234 26927 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:17:32.862468 26954 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:32.870143 27066 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:32.860142 26916 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:32.894068 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:32.884124 26871 raft_consensus.cc:2764] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:17:32.883438 27059 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:32.891621 26954 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:32.892767 27066 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:32.921837 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:32.926383 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 149999us
I20260709 12:17:32.883674 27093 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.927091 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:32.930299 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 124427us
I20260709 12:17:32.910854 27059 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:32.913928 26995 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:17:32.948185 27135 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:17:32.948534 26995 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:32.949194 23674 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:32.949775 27113 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:32.949129 26995 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:17:32.951174 22791 connection.cc:256] RPC call timeout handler was delayed by -3.2899843840000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
I20260709 12:17:32.887997 27107 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:32.911312 27140 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:17:32.957158 22791 connection.cc:256] RPC call timeout handler was delayed by -2.3809945919999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 12:17:32.958177 22791 connection.cc:256] RPC call timeout handler was delayed by -2.3071945920000871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 12:17:32.958846 22791 connection.cc:256] RPC call timeout handler was delayed by -1.5133945919999405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26940000000000003s for a response
W20260709 12:17:32.959503 22791 connection.cc:256] RPC call timeout handler was delayed by -1.0822945919999256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3173s for a response
I20260709 12:17:32.963131 22894 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:17:32.969681 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:32.917285 27050 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:32.970530 22899 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:32.963826 22894 pending_rounds.cc:85] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 7
I20260709 12:17:32.973935 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:32.974148 22894 pending_rounds.cc:107] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:17:32.974676 22894 raft_consensus.cc:2889] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:32.976593 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 822) took 1861 ms. Trace:
I20260709 12:17:32.977581 22892 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:17:32.977665 23494 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.536s (SENT) [suppressed 26 similar messages]
I20260709 12:17:32.979224 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:32.982378 23695 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:32.977412 22895 rpcz_store.cc:276] 0709 12:17:31.114780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.115020 (+   240us) service_pool.cc:224] Handling call
0709 12:17:31.115443 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:31.115953 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.115983 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:31.116614 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 12:17:31.306228 (+189614us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:31.756955 (+450727us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b180018ece0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:32.561140 (+804185us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b180018ece0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf81773c7 00007fadf47899a7 00007fadf47990bf 00007fadf4799038
0709 12:17:32.894962 (+333822us) log.cc:844] Serialized 14 byte log entry
0709 12:17:32.976252 (+ 81290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.976350 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.976399 (+    49us) raft_consensus.cc:1685] finished
0709 12:17:32.976411 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.976536 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24075,"prepare.queue_time_us":52952,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":226,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":1862,"spinlock_wait_cycles":158093440,"thread_start_us":564719,"threads_started":3,"wal-append.queue_time_us":235586,"wal-append.run_cpu_time_us":2372,"wal-append.run_wall_time_us":1081751}
I20260709 12:17:32.968204 27102 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:32.976436 26847 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:33.005239 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 78234us
W20260709 12:17:33.003484 23494 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.551s (SENT)
I20260709 12:17:33.003423 27113 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:33.012571 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:33.013542 23660 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
W20260709 12:17:33.015183 27139 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 12:17:33.015827 23494 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.574s (SENT)
W20260709 12:17:33.016189 27138 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:17:33.016331 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:33.017755 23494 leader_election.cc:336] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.633s (SENT)
I20260709 12:17:33.019183 27052 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:33.029410 23674 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 12:17:33.029548 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:33.035648 23493 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:33.038148 22824 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:33.039014 27150 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:33.041117 23494 leader_election.cc:336] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.677s (SENT)
W20260709 12:17:33.041344 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 62222.9us
I20260709 12:17:33.045409 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:33.069401 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:33.030934 27102 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:33.044054 27105 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:17:33.081240 27140 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:33.100252 26916 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:33.099557 27102 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:33.105020 27150 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:33.106110 27113 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:17:33.129580 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 87089.7us
I20260709 12:17:33.130618 27067 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:33.133709 27131 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:33.149936 27067 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:33.150555 27144 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:17:33.146284 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:33.107748 26708 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:33.168445 26708 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:33.127413 27093 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:33.157115 27113 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:17:33.169863 27113 consensus_queue.cc:1243] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:33.169994 26995 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:33.166594 26959 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.605s	user 0.004s	sys 0.009s
I20260709 12:17:33.172700 26959 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:33.175333 27140 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:33.179092 26959 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:33.184800 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:33.187141 27149 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:17:33.187495 27102 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:33.189024 27147 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:33.189659 27147 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.190061 27147 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:33.192307 27131 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:33.193292 27143 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:17:33.197260 27107 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:33.198182 27050 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:33.135285 27152 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:33.199122 27050 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:33.203464 27093 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:17:33.205480 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 59305.1us
I20260709 12:17:33.186414 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:33.216410 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:33.220729 22751 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:33.229066 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 153118us
I20260709 12:17:33.231667 22750 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:33.232615 26995 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:33.229128 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:33.237295 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:33.157151 27085 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:17:33.227263 27150 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:33.219841 27050 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:33.231010 27152 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:17:33.266391 27014 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:33.267027 27014 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:33.274950 26881 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.275079 26916 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.275770 26901 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:33.275556 26881 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:33.276453 26901 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:33.278083 26881 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:33.277987 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:33.278362 23656 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:33.278761 23685 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:33.279146 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:33.283414 27125 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.663s	user 0.000s	sys 0.003s
I20260709 12:17:33.283885 27053 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:33.284114 22892 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:33.284456 27053 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:33.279515 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:33.256156 27150 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:33.286757 27150 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:33.275771 26916 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:33.287257 22751 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:33.288882 26916 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:33.285434 27053 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:33.286214 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:33.290601 22899 raft_consensus.cc:2393] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 15: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:33.291550 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:33.253173 26863 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.293377 26863 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:33.296078 26863 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:33.299396 27101 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:33.302237 27101 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:33.303393 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:33.304579 22897 raft_consensus.cc:2393] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:33.306136 23660 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:33.320869 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:33.323366 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:33.311496 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:33.322696 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 65111.8us
I20260709 12:17:33.238826 26995 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:33.334100 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:33.282270 27147 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:33.338968 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:33.339031 22899 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:33.339752 23689 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:33.340157 23685 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:33.342685 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:33.343672 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:33.342803 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:33.345572 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:33.346184 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:33.353505 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:33.334910 26995 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:33.391635 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 49058.7us
W20260709 12:17:33.446744 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 135347us
I20260709 12:17:33.447050 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:33.392611 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:33.448298 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:33.333596 27047 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:17:33.393282 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:33.355288 26901 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:33.399691 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:33.402804 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:33.453853 22823 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:33.409018 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:33.423317 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:33.455152 22825 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:33.338009 27098 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:17:33.341840 27093 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:17:33.342010 26916 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:17:33.424914 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:33.342134 27079 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:17:33.427466 27053 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:33.427774 22896 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:33.428675 22899 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:17:33.428673 22864 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:33.483853 22899 pending_rounds.cc:85] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 7
I20260709 12:17:33.484251 22899 pending_rounds.cc:107] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:17:33.484592 22899 raft_consensus.cc:2889] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:33.429399 27126 log.cc:927] Time spent T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.946s	user 0.002s	sys 0.000s
W20260709 12:17:33.429598 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 81087.1us
I20260709 12:17:33.342068 27085 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:33.394910 27109 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:33.429687 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:33.431154 22898 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:17:33.431416 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:33.465550 26854 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:33.435115 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:33.333809 26568 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:33.445712 23660 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:33.428676 22900 pending_rounds.cc:85] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 6
I20260709 12:17:33.506105 22822 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:33.506493 22900 pending_rounds.cc:107] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:17:33.507086 22900 raft_consensus.cc:2889] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:33.456377 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:33.453269 22821 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:33.459076 22753 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:33.462958 22751 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:33.437397 27147 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:33.449633 26954 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.503s	user 0.014s	sys 0.007s
W20260709 12:17:33.457414 27066 consensus_meta.cc:287] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.015s
I20260709 12:17:33.470721 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1136) took 1155 ms. Trace:
W20260709 12:17:33.515290 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 86695.2us
I20260709 12:17:33.515962 22746 rpcz_store.cc:276] 0709 12:17:32.314844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.315414 (+   570us) service_pool.cc:224] Handling call
0709 12:17:33.408782 (+1093368us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:17:33.470622 (+ 61840us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4089088}
I20260709 12:17:33.516510 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:33.517164 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:33.517794 22746 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:33.469660 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:33.475116 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:33.475879 22744 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:17:33.518764 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:33.454725 26762 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:33.486637 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:33.488041 22750 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:17:33.489137 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1135) took 1177 ms. Trace:
I20260709 12:17:33.490310 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:33.526377 22824 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:33.526530 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 76026.6us
I20260709 12:17:33.487190 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:33.432065 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:33.510627 22894 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 10: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:17:33.510175 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 53889.5us
W20260709 12:17:33.510185 27073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.926s	user 0.018s	sys 0.019s
I20260709 12:17:33.525921 22745 rpcz_store.cc:276] 0709 12:17:32.312266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.315745 (+  3479us) service_pool.cc:224] Handling call
0709 12:17:33.424728 (+1108983us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:17:33.489077 (+ 64349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3527552}
I20260709 12:17:33.527938 22827 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:33.452100 26995 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:33.519240 22820 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:33.517735 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:33.540242 22751 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:17:33.520623 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:33.520946 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 51435.5us
I20260709 12:17:33.512786 27107 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:33.561513 27107 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:33.562935 27107 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:33.454299 26871 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:33.527411 22746 raft_consensus.cc:2410] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:17:33.464423 27059 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:33.515441 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:33.494498 27085 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:33.531658 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.538057 22747 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:33.504721 26901 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:33.525243 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:33.549492 27014 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:33.510341 26568 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:33.524765 26762 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.529786 26959 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:33.551676 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:33.552564 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:33.529676 27073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.962s	user 0.019s	sys 0.019s
I20260709 12:17:33.528330 27113 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:17:33.612061 27059 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:33.557026 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:33.520548 26954 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:33.557864 27155 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:33.616557 22750 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 8: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:33.581872 27085 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:33.572362 22825 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:33.574944 22822 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:33.587980 22894 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:33.564831 27107 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:33.592782 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:33.594257 23682 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:17:33.595435 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 68151.9us
I20260709 12:17:33.596158 26959 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:33.603785 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 86575.3us
I20260709 12:17:33.529699 27066 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:33.631652 22864 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:33.631925 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:33.604892 22901 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:33.632711 23682 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:17:33.633016 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:33.595613 26762 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:33.607002 27021 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.006s	sys 0.007s
I20260709 12:17:33.608807 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:33.610248 23685 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 12:17:33.614411 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 62866.9us
I20260709 12:17:33.613653 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:33.620576 27002 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:33.605378 27047 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:33.634215 26892 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:33.634303 22864 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:33.637099 22751 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:33.666272 22820 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:33.589740 26568 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:33.583540 27000 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:17:33.651897 22824 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:33.637338 26959 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:33.625267 27155 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:33.619149 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:33.695509 22899 raft_consensus.cc:606] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:33.696025 22899 raft_consensus.cc:614] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:33.697644 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:33.638957 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 46517.3us
W20260709 12:17:33.644908 27021 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.006s	sys 0.008s
W20260709 12:17:33.660821 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 52087.5us
I20260709 12:17:33.673776 22819 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:33.644877 27005 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:33.682242 23659 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:33.685654 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:33.689548 23685 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:33.717303 22751 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:33.690227 23682 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:33.713819 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:33.719235 23660 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:33.719142 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:33.665154 26901 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:33.670097 26949 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:33.729039 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:33.667886 27002 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:33.650695 27011 consensus_queue.cc:1059] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:17:33.649000 27109 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:17:33.734441 22751 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:33.745661 23682 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:33.657712 27158 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:17:33.758242 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:33.760638 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:33.764612 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:33.773239 23660 raft_consensus.cc:2410] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:17:33.718092 27051 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:33.784763 23494 leader_election.cc:400] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13.
W20260709 12:17:33.786242 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 253440us
I20260709 12:17:33.736126 27149 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:33.789624 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:33.790822 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:33.795750 22822 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:33.791646 22751 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:33.792328 22827 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:17:33.785943 27167 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:17:33.693092 27150 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:33.784229 27093 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:33.736141 27050 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:33.809828 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:33.736383 27170 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:17:33.798380 22751 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:33.810608 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:33.691064 26494 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:17:33.783406 27051 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.751899 27005 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:33.728338 27059 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:17:33.805516 22750 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:33.806990 23682 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:33.757068 26954 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:33.810104 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:33.820832 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:33.820648 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 186376us
I20260709 12:17:33.822311 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:33.779593 27055 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:33.817536 22827 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:33.822552 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:33.753216 26901 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:33.794490 27149 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:33.840449 22825 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:33.835306 22751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba57a7932934f629e6ed95148994535"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:41468
I20260709 12:17:33.842885 22751 raft_consensus.cc:606] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:33.846558 23682 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:33.786864 27113 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:17:33.787305 27105 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:17:33.779891 27091 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:17:33.810043 27050 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:33.829166 27051 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:33.869894 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 47466.4us
I20260709 12:17:33.870296 27047 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:33.896020 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:33.816648 27147 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:17:33.902225 22823 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:33.847862 27073 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:33.913972 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:33.917966 23689 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:33.877214 27050 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:33.924573 23679 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:17:33.876334 27014 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:33.902639 23493 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:33.939885 23695 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:33.942143 22825 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:33.912245 26494 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:33.936093 22864 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:33.923841 27047 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.953464 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:33.957052 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 100222us
W20260709 12:17:33.958761 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 155868us
W20260709 12:17:33.965969 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.938602 26863 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:33.973716 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:33.988888 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:46530
W20260709 12:17:33.956741 27175 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:17:33.844609 27155 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:33.876995 27002 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:33.937217 27073 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:33.960614 26494 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.012917 27073 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:34.013593 27073 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:34.013890 26494 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:33.958657 27055 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.958360 27005 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:34.014976 27055 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.017485 27055 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:34.018091 26863 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:34.019174 27174 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:17:34.019228 27150 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:34.019109 26863 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:34.021246 27178 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:17:34.025862 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:34.031062 22822 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
W20260709 12:17:34.040215 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 66629.3us
I20260709 12:17:34.044682 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:34.014465 27073 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:17:34.062420 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:33.991852 27093 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:17:34.043479 27157 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:34.049021 27090 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:17:34.148833 22793 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.17.249.254:41671, user_credentials={real_user=slave}} blocked reactor thread for 58484.2us
I20260709 12:17:34.149690 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:34.048368 27055 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:17:34.090348 26949 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:34.242285 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:34.247721 27154 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:17:34.250936 27057 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:34.251497 27057 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:34.252511 27057 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.254024 27057 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:34.254683 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:34.242594 26762 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.002s
W20260709 12:17:34.071302 27171 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.315s	user 0.002s	sys 0.000s
I20260709 12:17:34.062397 27184 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:34.161516 27163 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:17:34.162269 27093 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:34.169145 27183 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:34.171996 27190 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:34.183403 26901 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:34.197973 22827 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
W20260709 12:17:34.210114 26959 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.501s	user 0.014s	sys 0.000s
I20260709 12:17:34.151451 27157 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:34.220177 27144 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.198s	user 0.001s	sys 0.002s
I20260709 12:17:34.233033 27180 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:34.236059 27149 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:34.062083 26954 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:34.237299 23682 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:34.071417 27185 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:34.239172 23685 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
W20260709 12:17:34.373948 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 386694us
W20260709 12:17:34.151940 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 48807.1us
I20260709 12:17:34.262404 23672 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:17:34.198485 22852 heartbeater.cc:646] Failed to heartbeat to 127.17.249.254:41671 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.249.254:41671 timed out after 15.000s (SENT)
I20260709 12:17:34.265651 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:34.239269 27053 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.000s
W20260709 12:17:34.282500 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 240232us
W20260709 12:17:34.278833 26568 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.001s
I20260709 12:17:34.266084 27059 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:17:34.270879 27194 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:34.388739 22752 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
W20260709 12:17:34.284117 26995 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.728s	user 0.014s	sys 0.000s
I20260709 12:17:34.389447 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:34.282034 27190 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:34.279342 26916 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.263016 27152 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:34.382946 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 341603us
I20260709 12:17:34.363449 27180 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:34.268136 26762 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.277143 26708 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
W20260709 12:17:34.384505 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 118918us
W20260709 12:17:34.400449 23660 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.008s
I20260709 12:17:34.407439 22821 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:34.281706 27014 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:34.278316 27184 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.391700 27150 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:34.334291 26959 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:34.407435 23660 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.011s	sys 0.008s
I20260709 12:17:34.284790 27051 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.387686 27194 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:34.395514 27149 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:34.411581 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:34.440142 23659 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:34.285235 27183 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.402271 27005 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.401019 27185 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:34.456168 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:34.459110 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 58556.5us
I20260709 12:17:34.460352 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:34.467144 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 67331.6us
I20260709 12:17:34.468274 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:34.394670 27091 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:17:34.392483 26568 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:34.395648 26995 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.511330 22791 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:34.511940 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 51723.2us
I20260709 12:17:34.546537 23494 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:34.406411 26881 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:34.480199 27172 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.805s	user 0.000s	sys 0.005s
W20260709 12:17:34.509899 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 99963.7us
I20260709 12:17:34.551664 26881 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:34.404748 27152 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:34.402521 26916 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:34.517838 22899 raft_consensus.cc:606] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:34.416579 27014 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.522133 27214 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:34.558913 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1403) took 2360 ms. Trace:
I20260709 12:17:34.521266 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1026) took 1044 ms. Trace:
I20260709 12:17:34.451855 27021 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.533411 22748 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:34.464056 27005 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.571669 26762 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:34.512959 26892 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:34.482944 27204 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:34.404663 27157 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.540269 27051 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:34.414012 27053 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:17:34.548388 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:34.555305 22899 raft_consensus.cc:614] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:34.478685 27162 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:34.561111 27152 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:34.561703 27066 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:34.563319 26916 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:34.555090 27091 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:34.565659 27014 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:34.567514 27208 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:17:34.569257 27183 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:34.570868 27184 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:34.571633 27185 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:34.573869 26959 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:34.519194 27059 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:17:34.514775 27180 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:34.616537 26568 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:34.576169 27192 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:17:34.576363 27107 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.005s
I20260709 12:17:34.577468 27160 raft_consensus.cc:3055] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:17:34.578044 27085 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.932s	user 0.014s	sys 0.000s
W20260709 12:17:34.613647 27047 consensus_meta.cc:287] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.004s
W20260709 12:17:34.582829 27050 consensus_meta.cc:287] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.631s	user 0.003s	sys 0.006s
I20260709 12:17:34.554452 27194 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:34.513465 27113 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:17:34.591533 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 80296.6us
I20260709 12:17:34.587479 22895 rpcz_store.cc:276] 0709 12:17:33.476585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.476852 (+   267us) service_pool.cc:224] Handling call
0709 12:17:33.477280 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:33.489005 (+ 11725us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:33.724808 (+235803us) spinlock_profiling.cc:243] Waited 8.58 ms on lock 0x7b1800248380. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf81773c7 00007fadf47899a7 00007fadf47990bf 00007fadf4799038
0709 12:17:33.870279 (+145471us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.282464 (+412185us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:34.306534 (+ 24070us) log.cc:844] Serialized 26 byte log entry
0709 12:17:34.306820 (+   286us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:34.516787 (+209967us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.517689 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.517780 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.520922 (+  3142us) raft_consensus.cc:1685] finished
0709 12:17:34.520959 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.521170 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":299228,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":113,"raft.queue_time_us":198080,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":15361,"spinlock_wait_cycles":21082368,"thread_start_us":762418,"threads_started":4,"wal-append.queue_time_us":182305}
I20260709 12:17:34.586398 22818 rpcz_store.cc:276] 0709 12:17:32.192673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.192847 (+   174us) service_pool.cc:224] Handling call
0709 12:17:32.218455 (+ 25608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:32.232546 (+ 14091us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:32.270232 (+ 37686us) log.cc:844] Serialized 14 byte log entry
0709 12:17:33.412337 (+1142105us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b18004080a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:17:33.811697 (+399360us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.024052 (+212355us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:34.046586 (+ 22534us) log.cc:844] Serialized 26 byte log entry
0709 12:17:34.046760 (+   174us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:34.046815 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.047591 (+   776us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.282854 (+235263us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:34.553176 (+270322us) raft_consensus.cc:1685] finished
0709 12:17:34.553206 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.553361 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55244,"prepare.queue_time_us":317448,"prepare.run_cpu_time_us":151,"prepare.run_wall_time_us":10091,"raft.queue_time_us":146696,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":3092,"spinlock_wait_cycles":25216000,"thread_start_us":551434,"threads_started":3,"wal-append.queue_time_us":1404829}
W20260709 12:17:34.602452 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47869.6us
I20260709 12:17:34.559875 27220 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:17:34.634572 27192 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:34.601639 26892 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.607944 27157 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:34.611092 27091 raft_consensus.cc:697] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:34.659744 27203 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:17:34.660193 27091 consensus_queue.cc:237] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.661170 27203 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:34.661643 27203 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:34.607654 26762 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:34.554193 27212 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:34.663552 27212 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.663961 27212 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:34.665340 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 700) took 1317 ms. Trace:
I20260709 12:17:34.665879 22819 rpcz_store.cc:276] 0709 12:17:33.347467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.529268 (+181801us) service_pool.cc:224] Handling call
0709 12:17:33.667068 (+137800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.716546 (+ 49478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.665068 (+948522us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54007a1550. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:34.665260 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315987328}
I20260709 12:17:34.667658 27179 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:34.640496 27050 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:34.668143 27179 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:34.670145 27050 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:34.609011 27152 consensus_queue.cc:1059] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:17:34.638099 27085 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.675393 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 975) took 1640 ms. Trace:
I20260709 12:17:34.638185 27047 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:34.677794 22826 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 15: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:34.678056 27053 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:34.678098 26892 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:34.680902 27212 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.605312 27150 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:34.555951 26995 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:34.595649 27021 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.662528 27203 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:34.682855 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:34.683606 22899 raft_consensus.cc:606] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:34.684039 22899 raft_consensus.cc:614] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:34.685772 27021 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:34.675393 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1140) took 1213 ms. Trace:
I20260709 12:17:34.687197 27150 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.687920 26881 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:34.691345 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:34.692711 27212 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:34.693409 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:17:34.633910 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.603344 27204 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:34.697471 27210 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:17:34.614063 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 65805.9us
I20260709 12:17:34.701145 23494 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:34.702659 27191 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:34.703338 27191 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:34.703824 27005 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:34.704409 27191 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:34.704743 27223 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:34.706110 27191 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:34.654120 27214 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:34.636479 27160 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:34.707903 27160 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.709168 27160 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.709367 27152 raft_consensus.cc:3055] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:34.709849 27152 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:34.709977 27173 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.924s	user 0.002s	sys 0.000s
I20260709 12:17:34.640491 27180 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:34.711378 26871 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:34.712028 26871 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.714239 26871 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:34.672917 27194 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:34.715024 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:34.716441 27152 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.717986 27152 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:34.657399 27093 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:17:34.719179 27093 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:17:34.718870 27192 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:34.719560 27093 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:34.720448 27093 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:34.721593 27093 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:34.675868 23674 rpcz_store.cc:276] 0709 12:17:33.035217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.048732 (+ 13515us) service_pool.cc:224] Handling call
0709 12:17:33.082403 (+ 33671us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:33.163747 (+ 81344us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:33.230398 (+ 66651us) log.cc:844] Serialized 14 byte log entry
0709 12:17:33.566994 (+336596us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:33.586860 (+ 19866us) log.cc:844] Serialized 52 byte log entry
0709 12:17:33.588399 (+  1539us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:33.589378 (+   979us) log.cc:844] Serialized 14 byte log entry
0709 12:17:33.667570 (+ 78192us) log.cc:844] Serialized 14 byte log entry
0709 12:17:33.667929 (+   359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.668059 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.249520 (+581461us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b1800164080. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:34.255157 (+  5637us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b1800164080. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1692522 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:34.672198 (+417041us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b1800164080. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:34.675173 (+  2975us) raft_consensus.cc:1685] finished
0709 12:17:34.675195 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.675330 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82082,"prepare.queue_time_us":72176,"prepare.run_cpu_time_us":641,"prepare.run_wall_time_us":2855,"raft.queue_time_us":125271,"raft.run_cpu_time_us":550,"raft.run_wall_time_us":28260,"spinlock_wait_cycles":51030016,"thread_start_us":384844,"threads_started":2,"wal-append.queue_time_us":421469}
I20260709 12:17:34.655526 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:34.686513 22749 rpcz_store.cc:276] 0709 12:17:33.461761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.547244 (+ 85483us) service_pool.cc:224] Handling call
0709 12:17:33.547756 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:33.548278 (+   522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.548314 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:33.548942 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 12:17:33.625025 (+ 76083us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:33.625327 (+   302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.625474 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.671158 (+1045684us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b240051d268. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15189c4 00007fadf1516acb 00007fadf16d1dc9 00007fadf16d1a55 00007fadf16d0fb0 00007fadf4347488 00007fadf4347be8 00007fadf431f398 00007fadf431a76a 00007fadf4319bb6
0709 12:17:34.675023 (+  3865us) raft_consensus.cc:1685] finished
0709 12:17:34.675049 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.675324 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17350,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":87357312,"thread_start_us":70122,"threads_started":1,"wal-append.queue_time_us":172204}
I20260709 12:17:34.643561 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:34.728518 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:34.728772 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:34.729475 22899 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:34.729786 22895 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 12:17:34.733130 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 89624.8us
I20260709 12:17:34.733621 27010 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:34.734059 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:34.736729 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:34.740628 22898 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:34.732761 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:34.741606 22894 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:17:34.739624 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 84173.6us
I20260709 12:17:34.742544 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:34.743927 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:34.745729 22892 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:34.748739 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:34.743906 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:34.720337 27192 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:34.750586 22898 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:34.751143 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:34.734061 27010 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.727506 27204 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:34.762105 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:34.774994 22896 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:34.744081 27101 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:34.743989 27214 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:34.783979 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:34.788017 22898 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:34.784900 22897 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: []
W20260709 12:17:34.788625 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.750377 27059 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:34.784245 22899 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:34.835310 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:34.791039 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:34.792456 27212 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:34.795166 27021 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:34.798106 27170 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:34.799350 22901 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:34.799190 22898 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:34.804193 26494 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:17:34.804605 27057 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.550s	user 0.015s	sys 0.003s
I20260709 12:17:34.807511 27011 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:34.783838 27055 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:34.779258 27107 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:17:34.808429 27191 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:34.813771 22894 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:17:34.816939 22892 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
W20260709 12:17:34.817735 22826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 697) took 1472 ms (client timeout 1749 ms). Trace:
I20260709 12:17:34.831000 26863 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:34.870344 22826 rpcz_store.cc:269] 0709 12:17:33.345004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.345319 (+   315us) service_pool.cc:224] Handling call
0709 12:17:34.817490 (+1472171us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001266d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:34.817656 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3061885824}
I20260709 12:17:34.817826 22820 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:34.821307 27085 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:34.847404 27101 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:34.825029 27105 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:17:34.826542 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:34.772672 27177 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.831s	user 0.005s	sys 0.000s
I20260709 12:17:34.828797 26847 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:34.773797 27010 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:34.768952 27113 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:34.839154 22899 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:34.787321 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:34.848029 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 57092.1us
I20260709 12:17:34.862380 27021 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.778748 26568 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:34.865000 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:34.927029 22751 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:34.836542 27204 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:34.767906 27196 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:17:34.930248 27204 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.934628 27204 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:34.872552 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.934701 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:34.935892 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.936837 27185 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:34.937443 27185 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:34.874469 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:34.939633 22894 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:34.940006 27101 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.822393 27179 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:34.875371 26863 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.942801 27179 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:34.939996 27185 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:34.874675 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:34.860275 27220 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:34.858709 27059 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:34.948117 27059 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.878074 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:34.949183 22901 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:34.951155 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1138) took 1490 ms. Trace:
I20260709 12:17:34.866139 27011 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:34.953310 27011 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.954305 27011 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:34.955761 22897 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:17:34.956920 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.873512 27191 consensus_queue.cc:1243] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:34.885288 26847 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.959666 23674 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:17:34.857115 27212 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:34.873507 27057 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:34.961181 27190 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:34.961694 27057 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:34.962204 27212 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:34.962438 27190 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:34.894645 22749 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:34.898684 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1405) took 1110 ms. Trace:
I20260709 12:17:34.900337 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 994) took 1445 ms. Trace:
I20260709 12:17:34.970152 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:34.870888 27055 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.976089 27055 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:34.960947 26847 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:34.977955 26863 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:34.980458 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:34.981614 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:34.982947 27053 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:34.983491 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:34.984061 22749 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:34.984679 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:34.983515 27053 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:34.985818 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:34.926419 26881 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:34.986393 22746 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:34.929347 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:34.986759 26881 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:34.878022 27105 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:34.963580 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:34.924638 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 137480us
I20260709 12:17:34.963707 22894 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:34.963707 22898 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:34.951570 22745 rpcz_store.cc:276] 0709 12:17:33.461200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.530343 (+ 69143us) service_pool.cc:224] Handling call
0709 12:17:33.549939 (+ 19596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:33.550365 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.550402 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:33.550959 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:17:33.707837 (+156878us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:33.862055 (+154218us) log.cc:844] Serialized 14 byte log entry
0709 12:17:33.864610 (+  2555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.865267 (+   657us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.947035 (+1081768us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b18001bc6a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:34.950872 (+  3837us) raft_consensus.cc:1685] finished
0709 12:17:34.950970 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.951097 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1664,"prepare.queue_time_us":237834,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":25786,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":12763,"spinlock_wait_cycles":39415552,"thread_start_us":265840,"threads_started":2,"wal-append.queue_time_us":336912}
I20260709 12:17:35.016196 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:35.018344 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.972505 27057 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:34.984784 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:35.021762 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:34.926200 22752 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:34.987730 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:34.987900 27220 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.988865 27053 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:34.982970 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:34.989545 27050 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:35.027665 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:34.991143 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:34.855948 22900 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
W20260709 12:17:34.993428 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.970537 22820 rpcz_store.cc:276] 0709 12:17:33.788689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.796533 (+  7844us) service_pool.cc:224] Handling call
0709 12:17:34.817639 (+1021106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.871368 (+ 53729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.898429 (+ 27061us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001266d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:34.898605 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2347449728}
W20260709 12:17:35.014367 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 245734us
I20260709 12:17:34.970685 22748 rpcz_store.cc:276] 0709 12:17:33.455427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.455594 (+   167us) service_pool.cc:224] Handling call
0709 12:17:33.478187 (+ 22593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.591455 (+1113268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.900080 (+308625us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400192dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:34.900275 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2401567488}
I20260709 12:17:35.033159 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:35.033596 22895 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:35.020357 22899 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:35.026332 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:35.022840 22744 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:34.987164 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:35.035494 22750 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:35.038983 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:35.039424 22753 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:35.044603 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:35.088182 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:35.012797 27055 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:35.102260 22894 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
W20260709 12:17:35.121816 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.126685 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 73418.6us
I20260709 12:17:35.029752 26847 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:35.145480 22899 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 12:17:35.146692 22900 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:35.148234 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:35.167399 22749 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:35.168238 22746 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:35.168864 22900 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:17:35.164319 22897 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:17:35.173689 22898 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:35.176851 22752 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
W20260709 12:17:35.183010 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 132883us
I20260709 12:17:35.193485 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:35.209188 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:35.040056 26892 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:35.210635 22900 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:35.192699 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:35.038110 27005 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:35.211755 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:35.221019 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:35.221922 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:35.222344 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:35.091332 27047 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:35.225679 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:35.051846 27185 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:35.088040 27053 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:35.023339 26995 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 12:17:35.242837 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:35.229770 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:35.231694 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:35.233098 22823 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:17:35.245946 22747 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:17:35.035465 27220 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:35.243573 22826 raft_consensus.cc:2376] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14. Re-sending same reply.
I20260709 12:17:35.255105 23674 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 12:17:35.255502 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:35.256120 22826 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:35.220548 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:35.257085 23679 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:35.250008 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:35.258635 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:35.258997 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:35.221040 27149 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.756s	user 0.014s	sys 0.000s
I20260709 12:17:35.259393 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:35.268235 22824 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:35.269636 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:35.274710 22818 raft_consensus.cc:2410] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:35.277189 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:35.277803 22823 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:35.127025 27223 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:17:35.278859 22826 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:17:35.286592 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:35.287308 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.242928 27194 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:35.287895 27194 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:35.299062 27214 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:35.300262 27214 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:35.304178 27021 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:35.168102 26494 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:17:35.312218 22823 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:35.243192 27091 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.233379 27195 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:35.309583 22827 raft_consensus.cc:2410] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:17:35.321022 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:35.319036 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:35.315527 22745 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
W20260709 12:17:35.275578 27152 consensus_meta.cc:287] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.557s	user 0.003s	sys 0.012s
I20260709 12:17:35.165385 27055 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:35.232856 26892 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:35.314651 27113 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:17:35.332623 27180 consensus_meta.cc:287] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.003s
I20260709 12:17:35.238740 27005 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:35.322366 27196 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:35.243544 27185 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:35.359074 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:35.342443 27175 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:17:35.212044 27105 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:35.351183 27227 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:17:35.346449 27203 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:35.420262 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.421099 22895 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:35.422634 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:35.356678 27113 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:35.342908 27091 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:35.359617 27196 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:35.443738 23689 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:17:35.307293 26881 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:35.423308 27158 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:35.376583 27180 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:35.473176 22790 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.007s	sys 0.021s
W20260709 12:17:35.448431 27229 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:17:35.347693 27195 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:35.477308 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 582205us
I20260709 12:17:35.479377 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:35.483919 22895 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:35.504739 26892 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:35.506362 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.510160 23689 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:17:35.513543 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.514957 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.516610 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.517314 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.510661 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 296055us
W20260709 12:17:35.519160 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.520946 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:35.527617 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:35.522651 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:35.480633 27150 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:17:35.523239 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.528474 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:35.540249 27005 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:35.509905 26847 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:35.480805 27158 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:35.517536 27113 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:35.533557 27150 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:35.487041 27180 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:35.611689 27105 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:35.612982 27155 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.613454 22748 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:35.613785 27155 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:35.594473 23679 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:35.595760 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:35.605839 22819 raft_consensus.cc:2410] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:35.601352 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:35.575981 27220 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:35.576278 27091 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:35.578037 27226 log.cc:927] Time spent T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:17:35.583204 27066 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.625953 27066 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:35.603574 27228 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 12:17:35.626999 26871 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:35.608071 27113 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:35.627691 26871 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:35.628156 27066 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:35.584144 26847 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:35.585613 27185 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:35.586026 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.552512 27204 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.000s
I20260709 12:17:35.629916 27204 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:35.522046 27196 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:35.550240 27010 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.662s	user 0.012s	sys 0.000s
W20260709 12:17:35.631224 27011 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.677s	user 0.015s	sys 0.001s
W20260709 12:17:35.545842 27059 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.008s	sys 0.007s
I20260709 12:17:35.623586 22821 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
W20260709 12:17:35.569525 22750 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.000s
W20260709 12:17:35.608664 27231 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:17:35.636642 22750 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:35.637357 22753 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:17:35.633497 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.010s	sys 0.007s
I20260709 12:17:35.603914 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:35.639065 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.010s	sys 0.007s
I20260709 12:17:35.634233 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:35.639456 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 582850us
I20260709 12:17:35.607735 23656 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:17:35.640352 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:35.590654 27190 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.002s
W20260709 12:17:35.592967 27160 consensus_meta.cc:287] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.883s	user 0.007s	sys 0.007s
W20260709 12:17:35.592062 27179 consensus_meta.cc:287] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.002s
W20260709 12:17:35.642536 23494 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.053s	sys 0.089s
W20260709 12:17:35.593647 27093 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.872s	user 0.016s	sys 0.000s
I20260709 12:17:35.644822 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:35.631448 27010 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:35.668133 22820 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:17:35.666967 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:35.602967 27191 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:35.596988 26948 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:35.653105 22892 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:35.595700 27195 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:35.644084 26949 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.676535 26949 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:35.676409 27191 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:35.671993 26948 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:35.679111 26708 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:35.679908 26948 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:35.681110 26948 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:35.681473 23685 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:17:35.629027 26871 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:35.647886 27011 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.683240 26871 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:35.683465 27011 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:35.674374 27179 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:35.594310 27158 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:35.596324 27055 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:35.608867 27180 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:35.685921 27155 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:35.686160 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1419) took 1281 ms. Trace:
I20260709 12:17:35.656790 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:35.686931 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:35.638729 27059 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.008s	sys 0.008s
I20260709 12:17:35.650465 22825 raft_consensus.cc:2410] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:17:35.670357 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:35.672853 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:35.683930 27204 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:35.607604 27150 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:35.689944 22819 raft_consensus.cc:2410] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:17:35.690469 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:35.686538 22822 rpcz_store.cc:276] 0709 12:17:34.404747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.404912 (+   165us) service_pool.cc:224] Handling call
0709 12:17:34.405375 (+   463us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:34.405926 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:34.405971 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:34.711929 (+305958us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b18002f6140. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a
0709 12:17:34.713145 (+  1216us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b2c0017bc48. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:17:34.713854 (+   709us) log.cc:844] Serialized 52 byte log entry
0709 12:17:35.169303 (+455449us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:35.169337 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.169405 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:35.685939 (+516534us) raft_consensus.cc:1685] finished
0709 12:17:35.685960 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.686103 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7517,"raft.queue_time_us":1156,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":10443,"spinlock_wait_cycles":9558656,"thread_start_us":455036,"threads_started":1,"wal-append.queue_time_us":633722}
I20260709 12:17:35.691994 22827 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:35.699602 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 177006us
W20260709 12:17:35.658612 23494 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.053s	sys 0.089s
W20260709 12:17:35.700466 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 791284us
I20260709 12:17:35.701738 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:35.704142 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.704408 22819 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:17:35.673375 27220 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:35.710300 22820 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:17:35.710875 22820 pending_rounds.cc:85] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 7
I20260709 12:17:35.711172 22820 pending_rounds.cc:107] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:17:35.711485 22820 raft_consensus.cc:2889] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:35.706627 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:35.705053 22819 pending_rounds.cc:85] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 6
I20260709 12:17:35.712491 22819 pending_rounds.cc:107] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:17:35.712800 22819 raft_consensus.cc:2889] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:35.714916 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:35.720211 22864 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:35.722677 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:35.734133 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:35.735363 22750 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:35.736671 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:35.705652 27204 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:35.707696 27224 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:35.742725 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:35.708971 27150 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:35.687175 27190 consensus_queue.cc:1059] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:17:35.692965 27152 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:17:35.794806 22827 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:17:35.752075 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:35.715891 27230 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:17:35.790300 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:35.790886 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:35.791363 22753 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 12: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:35.725374 27244 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:35.712853 27179 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:17:35.713308 27059 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:35.790527 27245 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.778990 26708 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:35.746371 27204 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:35.803547 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51624us
I20260709 12:17:35.826603 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:35.827778 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:35.828611 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:35.829567 22748 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:35.737612 27066 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:17:35.788702 27191 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:35.842273 23672 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:17:35.842816 23672 pending_rounds.cc:85] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 6
I20260709 12:17:35.748209 26949 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:35.807559 27246 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:35.844537 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:35.843452 23672 pending_rounds.cc:107] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:17:35.843580 23656 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:17:35.846621 23672 raft_consensus.cc:2889] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:35.846406 23659 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:35.802196 27244 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:35.850909 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:35.851378 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:35.851742 22827 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:35.852547 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:35.852666 22895 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
W20260709 12:17:35.852229 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.850594 22790 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:35.853868 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:35.854655 22827 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:35.855229 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:35.830634 27245 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:35.851904 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:35.731894 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 435321us
I20260709 12:17:35.831413 27204 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:35.884303 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.828691 27224 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:35.874810 22827 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:17:35.889931 22827 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:35.856423 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:35.878038 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.878985 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:35.872088 26995 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.005s	sys 0.006s
W20260709 12:17:35.881227 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.831063 27059 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:35.892941 22895 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:35.845932 27246 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.845161 27220 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:35.855777 26708 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:35.855232 27244 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:35.899060 26995 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.006s	sys 0.006s
I20260709 12:17:35.873878 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:35.915321 27247 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:35.921929 27194 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:35.924549 27245 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:35.932371 27059 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:35.912513 27246 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:35.902340 27249 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:35.940251 27249 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:35.940652 27249 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:35.947077 27220 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:35.948338 27220 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:35.951195 22899 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:17:35.955226 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:35.956861 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.958814 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 47095.7us
I20260709 12:17:35.910668 27224 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:35.871555 27180 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:17:35.975776 22898 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:17:35.980158 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:35.983762 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:35.950502 27253 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:17:35.972052 26916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.002s	sys 0.024s
W20260709 12:17:36.008203 26916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.003s	sys 0.025s
I20260709 12:17:36.008432 27224 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.002182 22823 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:36.002696 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:36.010845 22745 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:36.011132 22897 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:36.012466 22824 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:17:36.012866 22824 pending_rounds.cc:85] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 8
I20260709 12:17:36.013087 22824 pending_rounds.cc:107] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:17:36.013331 22824 raft_consensus.cc:2889] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:35.987385 27047 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.009s	sys 0.027s
I20260709 12:17:35.949946 27158 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:17:35.994503 27113 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.039438 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:36.021944 27047 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.009s	sys 0.027s
I20260709 12:17:35.967970 26708 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:36.010869 27011 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:36.046839 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:36.047945 22900 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
W20260709 12:17:36.044755 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.023833 26948 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.058251 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:36.055562 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.057502 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:36.060025 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.055202 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:36.060954 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:36.061837 22827 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:36.062951 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:36.063498 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.073457 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:36.073788 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:36.074903 22827 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:36.076066 22748 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:36.076344 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.042611 27047 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:36.043627 27253 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:36.023737 27066 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:17:36.083725 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.042691 27055 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:17:36.090297 27055 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:36.090721 27055 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:36.091645 27055 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:36.092406 27047 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:36.092957 27055 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:36.095204 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.096448 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 963) took 1176 ms. Trace:
I20260709 12:17:36.096967 23685 rpcz_store.cc:276] 0709 12:17:34.920506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.921290 (+   784us) service_pool.cc:224] Handling call
0709 12:17:34.921798 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.681980 (+760182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.096112 (+414132us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400462b54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:36.096362 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1746349952}
I20260709 12:17:36.100080 27203 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:36.100674 27203 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:36.104163 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:36.078538 27021 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:36.105123 27021 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:36.105537 27021 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:36.113602 26949 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:36.049600 27113 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.114148 26949 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:36.115890 27113 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:36.119915 27010 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:36.072654 27011 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:36.082173 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:36.089264 27233 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.104019 27253 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:36.075325 26494 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:36.082864 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:36.125125 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.125432 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:36.128149 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:36.126663 27259 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.145176 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:36.084286 26916 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:36.126341 27002 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:36.101838 27203 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.076081 26948 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:36.168345 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:36.172292 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.141237 27011 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:36.175171 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:36.175904 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.177697 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.144423 27113 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:36.182595 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:36.183538 22827 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:36.185986 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.187016 23685 raft_consensus.cc:2410] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 12:17:36.200685 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.205107 23685 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:36.207866 22827 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:17:36.139492 27233 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:36.208230 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:36.162503 27085 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:17:36.174755 27010 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:36.214289 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:36.202122 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 57063.3us
I20260709 12:17:36.223029 22750 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:36.170418 26916 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.161141 27259 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:36.206043 27066 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:36.184227 27113 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.249131 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:36.238320 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.252717 23679 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:36.215629 27203 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:36.167214 26949 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:36.301551 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 227605us
I20260709 12:17:36.206713 27245 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:17:36.203390 27250 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:17:36.316480 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.211053 26568 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:17:36.312307 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.317217 23660 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:36.232226 26881 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:36.248507 27066 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.235291 27085 consensus_queue.cc:1243] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:36.337430 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.311769 23493 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:36.329399 22820 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:36.248188 27105 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.229671 27010 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:36.221861 26847 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 12:17:36.324153 26949 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:36.334978 27250 raft_consensus.cc:3055] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:36.335376 27185 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:17:36.335899 27113 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:36.336126 27107 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.248370 27191 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.346067 23494 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.312848 27091 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.351029 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.328159 27155 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:36.325827 26881 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:36.366291 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.340950 27066 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:36.343708 27230 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:36.337543 27196 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:36.315672 26954 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:17:36.348552 27160 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:36.377075 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:36.385239 27195 raft_consensus.cc:3055] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:36.374650 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:36.453724 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 79168.7us
W20260709 12:17:36.387463 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:36.373814 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 136301us
I20260709 12:17:36.454866 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:36.311755 27011 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.364661 27250 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:17:36.449783 27204 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.002s
W20260709 12:17:36.397018 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.434245 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:36.355975 27105 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:36.383893 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 714) took 1147 ms. Trace:
W20260709 12:17:36.444427 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 67430.5us
I20260709 12:17:36.377876 27191 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:36.447860 26916 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:36.391561 27276 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:36.385947 27255 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.389523 26881 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:36.451144 27160 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.451294 27214 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:36.451161 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.383389 27113 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:36.453814 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:36.467571 27272 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
I20260709 12:17:36.376276 27155 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:36.461645 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:36.440410 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 209845us
I20260709 12:17:36.392938 27230 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:36.462612 27246 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.004s
I20260709 12:17:36.469892 22824 rpcz_store.cc:276] 0709 12:17:35.236067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.269052 (+ 32985us) service_pool.cc:224] Handling call
0709 12:17:36.012048 (+742996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:36.013725 (+  1677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.383606 (+369881us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54007a1050. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:36.383808 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597140864}
I20260709 12:17:36.374965 27107 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:36.450385 27179 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:36.386307 27091 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.452840 27195 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:36.486811 27257 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:17:36.465067 27152 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:36.480923 22900 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:36.482766 22899 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:36.467128 26948 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:36.472563 27224 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:36.479903 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.476945 27160 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:36.511826 26954 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:17:36.497617 27246 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:36.513134 27271 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:17:36.514705 27010 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:36.473289 27204 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:36.495658 27260 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:36.556264 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 76458us
W20260709 12:17:36.519124 27244 consensus_meta.cc:287] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.006s
I20260709 12:17:36.497846 27261 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:36.554960 27270 log.cc:927] Time spent T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 12:17:36.559156 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:36.568147 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:36.550158 27275 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.154s	user 0.001s	sys 0.001s
I20260709 12:17:36.555867 26948 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:36.571076 26948 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:36.495306 27085 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
W20260709 12:17:36.571560 27285 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:36.559842 27245 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:36.555502 27101 raft_consensus.cc:3055] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:17:36.574057 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 139986us
I20260709 12:17:36.559937 26954 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:36.574584 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1103) took 1056 ms. Trace:
I20260709 12:17:36.578562 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.586395 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:36.586810 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 107469us
I20260709 12:17:36.587260 22750 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:36.588181 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:36.595820 22823 rpcz_store.cc:276] 0709 12:17:35.518235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.603615 (+ 85380us) service_pool.cc:224] Handling call
0709 12:17:36.574341 (+970726us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400301454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:36.574500 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761709952}
W20260709 12:17:36.629915 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 157099us
I20260709 12:17:36.632716 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:36.607757 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:36.657317 22752 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:17:36.657413 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 49742.4us
I20260709 12:17:36.657886 22747 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
W20260709 12:17:36.658702 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 80261.9us
I20260709 12:17:36.663244 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:36.664320 27113 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:36.667250 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:36.589262 26847 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:36.668459 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:36.576648 27247 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:36.678731 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:36.682055 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:36.565670 27244 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:36.690318 27021 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.004s
I20260709 12:17:36.477391 27255 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:36.676314 27195 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:36.691973 27246 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:36.692164 27195 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:36.692605 27244 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:36.693122 26948 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:36.693397 22895 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:36.683566 26708 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.694268 26708 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:36.695533 27107 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:36.696445 27055 consensus_meta.cc:287] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.004s
I20260709 12:17:36.696659 26708 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:36.697116 27055 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:36.697707 27055 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:36.483084 27214 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.700299 27255 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:36.701473 27233 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:36.702287 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:36.676676 27250 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:36.684402 27249 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.743s	user 0.013s	sys 0.000s
I20260709 12:17:36.684913 27281 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:36.591316 27101 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:36.607775 27282 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:36.687413 26954 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:36.688938 27191 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:36.709309 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.561543 27260 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:36.727321 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.590230 27259 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:36.567493 27261 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.700613 27214 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:36.722477 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:36.743191 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:36.745728 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.677999 27113 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:36.660086 27245 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:36.710031 27247 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:36.766301 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.769943 22826 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:36.764837 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:36.741926 26847 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:36.784104 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:36.702065 27093 consensus_queue.cc:1175] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" responder_term: 10 status { last_received { term: 9 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:36.747308 27185 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:36.745002 27107 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.791069 22899 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:36.793910 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:36.794926 22896 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:36.797035 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.803706 27304 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:36.806420 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:36.712633 27021 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:36.810904 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 152733us
I20260709 12:17:36.767280 27113 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:36.817262 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:36.783377 27191 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:36.816888 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:36.820019 22791 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:36.788815 27281 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:36.793066 26847 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.753647 27244 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:17:36.792162 27105 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:36.583514 27155 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:36.792649 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 214696us
I20260709 12:17:36.835937 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:36.811323 27282 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:36.742455 27249 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.839082 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:36.813160 27304 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.856487 22823 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:36.806564 27245 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:36.856067 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.862619 23660 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:36.805302 27294 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:36.824918 27191 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.857579 23679 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:17:36.870761 23679 pending_rounds.cc:85] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 5
I20260709 12:17:36.871166 23679 pending_rounds.cc:107] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:17:36.871454 23679 raft_consensus.cc:2889] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:36.855824 27055 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:36.819475 27185 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:17:36.813405 27107 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.846458 27246 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:36.863245 22827 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:36.825263 27113 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:36.791829 27066 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:36.841049 26847 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:36.874994 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:36.848481 27203 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:17:36.707428 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 115790us
I20260709 12:17:36.885908 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.889432 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.893822 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:36.866044 27204 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:36.892437 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.875473 27191 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:36.877028 27155 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:36.862762 27304 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:36.893496 23656 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:36.894671 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.902347 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.904582 23674 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:36.904909 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:36.893034 27203 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.907523 27203 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:36.884109 27290 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.911550 27290 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:36.923861 22896 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:17:36.928957 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:36.928850 27203 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.877045 27294 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:36.931876 27203 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:36.932602 27203 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:36.933351 23682 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:36.933738 27203 raft_consensus.cc:3055] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:36.934132 27203 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:36.934964 27203 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:36.936101 27203 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:36.900772 22819 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:36.947142 22895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:36.948066 22895 raft_consensus.cc:606] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:36.948472 22895 raft_consensus.cc:614] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:36.878118 27282 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:17:36.884959 27246 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:36.959277 27246 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:36.932838 27294 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:36.966614 26949 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.003s
I20260709 12:17:36.971061 23685 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:36.973318 27250 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:36.988477 26494 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:36.989058 26494 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:36.989451 26494 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:17:36.990005 27268 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.642s	user 0.011s	sys 0.000s
I20260709 12:17:36.895985 27255 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:36.994148 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 99531us
I20260709 12:17:36.974085 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:36.976094 27269 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.616s	user 0.001s	sys 0.002s
W20260709 12:17:36.976882 27286 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 12:17:36.978999 27152 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:36.983172 27293 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:36.985601 27059 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:36.816735 27101 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:36.998220 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:36.990513 27093 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:37.030959 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:37.038034 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.036028 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:37.039479 22823 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:37.041121 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.041847 26949 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:37.042312 26949 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:37.031093 27011 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.034s
I20260709 12:17:37.042470 27293 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:37.043303 27011 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.000s	sys 0.034s
W20260709 12:17:37.042294 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 44164.6us
I20260709 12:17:37.044755 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:37.045758 27011 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:37.046875 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:37.051424 22895 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:36.877315 27289 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.148s
I20260709 12:17:36.877446 27281 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 12:17:36.849805 27247 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:36.986212 27066 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:36.897614 27276 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:37.047701 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:37.054855 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:37.059620 22747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:41468
I20260709 12:17:37.061599 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 715) took 1825 ms. Trace:
I20260709 12:17:37.054674 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:37.004626 27180 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.071398 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 851) took 1220 ms. Trace:
I20260709 12:17:36.997589 27158 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:37.003382 27194 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:37.030282 27224 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:17:37.048563 27196 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.000s
I20260709 12:17:37.076725 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:37.155314 23689 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:17:37.030972 27248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.000s	sys 0.017s
I20260709 12:17:37.087430 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:37.080363 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:37.092137 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:37.035326 27093 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:37.086133 22892 rpcz_store.cc:276] 0709 12:17:35.850663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.850824 (+   161us) service_pool.cc:224] Handling call
0709 12:17:35.851160 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.905630 (+ 54470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.905683 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.906327 (+   644us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.169584 (+263257us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:36.230337 (+ 60753us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.237020 (+  6683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.307499 (+ 70479us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b54004f1ad4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:36.307576 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.964521 (+656945us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b180001d380. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:37.071136 (+106615us) raft_consensus.cc:1685] finished
0709 12:17:37.071160 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.071315 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7735,"prepare.queue_time_us":29247,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":42008,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":52262,"spinlock_wait_cycles":137680000,"thread_start_us":187298,"threads_started":1,"wal-append.queue_time_us":366684}
W20260709 12:17:37.104045 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 49350.6us
I20260709 12:17:37.052677 27011 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:37.107409 27261 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:37.057631 26949 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:37.115772 27249 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:37.070411 27152 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:37.104765 27085 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:17:37.128258 27255 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:37.081460 27294 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.081254 27010 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:37.037351 27214 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:17:37.138659 27107 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:37.143146 27260 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:37.061089 27101 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:37.161405 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1426) took 1367 ms. Trace:
I20260709 12:17:37.080194 22818 rpcz_store.cc:276] 0709 12:17:35.236349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.344878 (+108529us) service_pool.cc:224] Handling call
0709 12:17:35.345364 (+   486us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:35.716549 (+371185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.716598 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:35.747889 (+ 31291us) log.cc:844] Serialized 52 byte log entry
0709 12:17:36.132079 (+384190us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:36.367864 (+235785us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.371185 (+  3321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.371271 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.916087 (+544816us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b18000602e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1692522 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:36.989297 (+ 73210us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:37.061219 (+ 71922us) raft_consensus.cc:1685] finished
0709 12:17:37.061253 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.061483 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107125,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":55,"raft.queue_time_us":17541,"raft.run_cpu_time_us":468,"raft.run_wall_time_us":17370,"spinlock_wait_cycles":12302080,"thread_start_us":848287,"threads_started":3,"wal-append.queue_time_us":455128}
W20260709 12:17:37.166720 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 74712.4us
I20260709 12:17:37.167591 22821 raft_consensus.cc:2410] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:36.969482 27160 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:37.181751 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:37.183296 22747 raft_consensus.cc:606] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:37.183842 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:37.175690 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:17:37.171213 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 331613us
I20260709 12:17:37.248605 27011 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:37.187914 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:37.304060 22900 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:37.102245 27194 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.097887 27297 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:37.157752 27300 raft_consensus.cc:3055] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:17:37.168236 27223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.051s	sys 0.081s
I20260709 12:17:37.239741 22895 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:37.244480 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:37.179952 22823 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:37.341615 22753 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:37.251869 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.287794 26949 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:37.244695 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:37.258072 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 440823us
I20260709 12:17:37.181991 27158 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:37.105216 27180 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:37.264217 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:37.352034 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:37.279315 22822 rpcz_store.cc:276] 0709 12:17:35.794230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.794394 (+   164us) service_pool.cc:224] Handling call
0709 12:17:35.794854 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.798504 (+  3650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.798549 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.840660 (+ 42111us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.131551 (+290891us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:36.131641 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.131826 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.975410 (+843584us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:37.160933 (+185523us) raft_consensus.cc:1685] finished
0709 12:17:37.160965 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.161310 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11870,"raft.queue_time_us":3339,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":1458,"spinlock_wait_cycles":11860352,"thread_start_us":230883,"threads_started":1,"wal-append.queue_time_us":428698}
I20260709 12:17:37.290890 22747 raft_consensus.cc:614] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:37.290190 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.291055 22892 raft_consensus.cc:2368] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
W20260709 12:17:37.295653 22744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.008s	sys 0.007s
W20260709 12:17:37.354591 22744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.008s	sys 0.008s
I20260709 12:17:37.298519 23494 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:37.355927 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 57508.6us
I20260709 12:17:37.185779 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:37.292366 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:37.260061 27255 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.331306 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:37.249743 27224 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:37.333700 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 158087us
I20260709 12:17:37.366355 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:37.268900 27085 consensus_queue.cc:1243] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:37.339514 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:37.124207 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.273681 27303 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:37.384498 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 53355.3us
I20260709 12:17:37.325577 27194 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:37.396733 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:37.349740 26881 consensus_meta.cc:287] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.866s	user 0.010s	sys 0.003s
W20260709 12:17:37.371729 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 186114us
W20260709 12:17:37.370337 27220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.000s	sys 0.044s
I20260709 12:17:37.376823 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:37.192269 27253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.010s	sys 0.027s
I20260709 12:17:37.325779 27292 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.408759 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:37.362680 27214 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:37.340946 27300 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:37.286453 27294 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:37.292989 27010 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:37.423687 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46967.3us
W20260709 12:17:37.346972 27223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.052s	sys 0.082s
I20260709 12:17:37.267071 27276 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:37.370110 27158 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.346946 27233 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:37.347654 27249 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:37.426731 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:37.358444 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:37.378530 26954 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:37.349246 27113 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:37.349493 27297 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:37.474565 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 110395us
I20260709 12:17:37.534883 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:37.379640 27255 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:37.383675 27107 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:37.544649 27249 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:37.551836 27107 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.552469 27107 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:37.556249 26494 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.566s	user 0.013s	sys 0.000s
W20260709 12:17:37.556725 26847 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.000s
I20260709 12:17:37.546721 27301 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:37.403921 27261 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 12:17:37.420356 26916 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:37.558703 26916 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:37.559437 26916 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:37.556154 27010 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:37.395747 27224 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:37.380882 27179 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:17:37.449828 27220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.001s	sys 0.050s
I20260709 12:17:37.532485 27260 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.565258 27260 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:37.565526 27113 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:37.565779 27179 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:37.419582 26881 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:37.567561 27260 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:37.568073 27233 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:37.566398 27179 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:37.426867 27254 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:37.536779 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:37.557284 26847 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:37.533682 22752 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
W20260709 12:17:37.579979 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 171338us
W20260709 12:17:37.582190 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 223826us
I20260709 12:17:37.460691 27214 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.396036 26708 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:37.554033 27249 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:37.459435 27196 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:17:37.463960 27253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.010s	sys 0.030s
I20260709 12:17:37.591486 23689 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
W20260709 12:17:37.592252 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 55652.8us
I20260709 12:17:37.649950 22791 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:37.557329 27300 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:37.449162 22753 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:37.554634 27107 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:37.494004 27310 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.494374 27195 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:37.418622 26892 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.166s
I20260709 12:17:37.541326 27158 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:37.591562 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:37.630410 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:37.713550 22824 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:17:37.636672 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:37.636843 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0277014260000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
I20260709 12:17:37.715420 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:37.622978 26954 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:37.642820 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:37.605756 27224 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:37.557204 26494 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:37.594735 27214 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:37.659813 22896 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 17: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:17:37.676045 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.683703 23660 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:37.680518 23679 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:37.651767 22791 leader_election.cc:400] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:37.745589 22791 leader_election.cc:403] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:17:37.634748 27113 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:37.586609 27261 raft_consensus.cc:2764] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:17:37.418038 27304 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:37.769496 26708 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:37.770072 27304 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:37.770140 26708 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:37.769955 27318 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:17:37.772717 26708 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:37.774430 27295 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:37.595901 27091 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:37.584532 27093 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:37.583531 27260 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:17:37.738808 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:37.635088 27254 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:37.396422 27303 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:37.756219 27113 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.699317 27010 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:17:37.755689 27311 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:37.717504 27195 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:37.765609 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 113980us
I20260709 12:17:37.762131 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:37.775442 26708 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:37.870399 27331 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:17:37.778524 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:37.779399 27291 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.780109 26954 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:37.725191 27160 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:37.784170 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1168) took 1195 ms. Trace:
I20260709 12:17:37.895116 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:37.919976 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:37.784934 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:37.920631 22892 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:37.725778 27310 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:37.785776 27224 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:37.786051 27180 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:37.793699 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:37.796028 27203 consensus_meta.cc:287] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.859s	user 0.010s	sys 0.004s
W20260709 12:17:37.797566 27250 consensus_meta.cc:287] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.810s	user 0.009s	sys 0.004s
I20260709 12:17:37.796898 27230 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:37.938251 26949 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.559s	user 0.005s	sys 0.004s
I20260709 12:17:37.880060 27303 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:37.852000 27295 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:37.939155 27230 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:37.940737 27295 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:37.588977 27292 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:37.800590 23685 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:37.870414 26708 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:37.723794 27150 consensus_queue.cc:1175] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" responder_term: 10 status { last_received { term: 10 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 10 index: 7 } }
I20260709 12:17:37.745198 27300 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:37.942770 27254 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:37.943570 26708 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:37.798755 27314 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:17:37.946985 27294 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:37.762748 27289 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:17:37.948493 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 354534us
W20260709 12:17:37.949433 27315 log.cc:927] Time spent T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 12:17:37.698298 27196 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:37.719926 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:37.824761 27246 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.865s	user 0.008s	sys 0.004s
I20260709 12:17:37.805863 27328 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11.
I20260709 12:17:37.810153 26881 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:37.870281 26948 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:37.776657 22824 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:17:37.871903 27316 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:17:37.872926 27309 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:37.861028 27298 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:37.865681 27220 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:17:37.920667 22895 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:17:37.979027 27091 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.895941 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:37.980631 27330 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.927286 22752 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:37.865540 27311 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:37.935654 27310 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:37.936252 27224 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:37.725968 27107 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:37.949167 27289 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:37.832592 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:37.949719 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:37.881064 27155 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.926s	user 0.010s	sys 0.001s
I20260709 12:17:37.950546 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1126) took 1115 ms. Trace:
I20260709 12:17:37.862311 27113 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:37.876327 27306 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 12:17:37.954176 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:37.957643 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.874972 27195 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:37.961048 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:37.970667 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:37.976822 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 385334us
I20260709 12:17:37.986491 27246 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:38.045580 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:37.948621 26494 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.018085 27233 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:37.959753 27093 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.977595 26708 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:37.991626 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:38.052026 22824 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:38.052387 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:37.992375 26948 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:37.992431 26847 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:37.920101 22744 rpcz_store.cc:276] 0709 12:17:36.588520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.588667 (+   147us) service_pool.cc:224] Handling call
0709 12:17:36.658901 (+ 70234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:37.355129 (+696228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:37.355188 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:37.394420 (+ 39232us) log.cc:844] Serialized 26 byte log entry
0709 12:17:37.581671 (+187251us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:37.581710 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.581787 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.783899 (+202112us) raft_consensus.cc:1685] finished
0709 12:17:37.783927 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.784095 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":268945,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":134,"thread_start_us":776955,"threads_started":2,"wal-append.queue_time_us":309984}
I20260709 12:17:38.033222 26881 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:17:38.027400 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 77757.7us
I20260709 12:17:38.026638 23659 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:38.030566 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1005) took 1206 ms. Trace:
I20260709 12:17:38.059504 22899 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:38.033766 22748 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:38.029971 22825 rpcz_store.cc:276] 0709 12:17:36.835178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.836534 (+  1356us) service_pool.cc:224] Handling call
0709 12:17:36.836950 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:36.837417 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:36.873198 (+ 35781us) log.cc:844] Serialized 14 byte log entry
0709 12:17:37.500535 (+627337us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:37.524525 (+ 23990us) log.cc:844] Serialized 26 byte log entry
0709 12:17:37.524709 (+   184us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:37.619428 (+ 94719us) log.cc:844] Serialized 14 byte log entry
0709 12:17:37.619676 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.619760 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.950173 (+330413us) raft_consensus.cc:1685] finished
0709 12:17:37.950200 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.950440 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3650,"prepare.queue_time_us":398479,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":108,"raft.queue_time_us":32952,"raft.run_cpu_time_us":613,"raft.run_wall_time_us":76005,"thread_start_us":679169,"threads_started":3,"wal-append.queue_time_us":687308}
W20260709 12:17:38.036432 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.038290 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:37.957309 27291 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:38.059552 26881 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.064966 26881 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:38.048552 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:38.068691 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:38.034320 27091 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:38.032399 26916 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:38.048167 27194 consensus_meta.cc:287] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.629s	user 0.012s	sys 0.000s
W20260709 12:17:38.042128 27191 consensus_meta.cc:287] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.056s	user 0.015s	sys 0.000s
I20260709 12:17:37.895572 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:38.060024 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.023777 27330 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.065750 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.108361 22825 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:38.108668 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.067005 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.044502 27107 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:38.055445 27298 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:38.058072 26708 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:38.146562 26708 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:38.150516 27010 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.077194 27282 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:38.151674 27010 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:38.066082 27311 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:38.153527 27311 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:38.153868 27303 consensus_queue.cc:1175] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a89a4b420ea9496aab55475fc38bb6f7" responder_term: 14 status { last_received { term: 14 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 14 index: 7 } }
I20260709 12:17:38.087329 27339 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:38.072511 27085 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:38.088126 27290 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:37.874701 27312 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.448s	user 0.000s	sys 0.001s
I20260709 12:17:38.097262 23689 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:38.092628 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.095274 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.071825 27328 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.196552 23659 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 11: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:38.101262 27246 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:38.058257 27093 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.103202 26948 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:38.104171 27180 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.204135 27180 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:38.104632 27101 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.803s	user 0.008s	sys 0.004s
I20260709 12:17:38.099401 27191 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:38.105784 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.073704 27319 log.cc:927] Time spent T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.215s	user 0.001s	sys 0.001s
I20260709 12:17:38.112010 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:38.206483 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 130611us
W20260709 12:17:38.207754 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.112030 22824 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:38.113032 22894 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:38.059955 23672 rpcz_store.cc:276] 0709 12:17:36.823788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.825197 (+  1409us) service_pool.cc:224] Handling call
0709 12:17:36.825617 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:36.825933 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:17:37.310255 (+484322us) log.cc:844] Serialized 14 byte log entry
0709 12:17:38.030158 (+719903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:38.030219 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:38.030268 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.030340 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.030501 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":244,"prepare.queue_time_us":593339,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":3558,"raft.queue_time_us":138412,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":1162302,"threads_started":3,"wal-append.queue_time_us":435397}
I20260709 12:17:38.118441 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:38.209673 22898 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:38.120316 26916 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:38.120792 27342 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:17:38.106307 27194 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.123605 22893 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:17:38.124223 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:38.126017 27299 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.783s	user 0.002s	sys 0.000s
I20260709 12:17:38.092325 27337 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:17:38.230868 27195 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:38.128204 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.233027 22825 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 10: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:38.234023 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.234501 27158 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:38.131491 27196 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:38.136184 27291 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:38.235972 23682 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:38.139111 27179 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:38.142115 23679 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:38.236725 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:38.143646 27224 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:38.144724 27327 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:17:38.159825 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:38.167790 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 55760.3us
I20260709 12:17:38.240432 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:38.241305 27101 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:38.124164 27336 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:17:38.241953 27101 consensus_queue.cc:1243] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:38.068660 26847 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:17:38.190826 22895 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 8.
I20260709 12:17:38.122067 27107 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.243862 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.244524 22826 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:38.245422 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.208195 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:38.209913 22897 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:38.166922 27339 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:38.247089 27339 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:38.189899 27085 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.222592 22894 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:17:38.245954 22826 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:38.224426 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.226102 22901 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:38.211372 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.254151 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:38.254861 22897 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:38.255035 23679 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:38.255220 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:38.255586 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:38.241434 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:38.256569 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:38.257575 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:38.258414 22826 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:38.229799 27191 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.261037 22825 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 15: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:38.261832 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:38.262472 22894 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:38.268438 23494 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:38.269934 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.266479 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.270761 22826 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
W20260709 12:17:38.271862 27343 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:17:38.272397 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.273554 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:38.274034 22826 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:38.266232 26948 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:38.275506 26948 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:38.275925 26948 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:38.277937 27347 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:17:38.271220 22825 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:38.279675 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1009) took 1351 ms. Trace:
I20260709 12:17:38.279904 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.280890 27260 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.281116 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.281447 27260 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:38.281750 27093 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.282226 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.257982 27085 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:38.283594 27260 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:38.283824 27194 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.284410 22825 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:38.284718 22819 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:38.202143 27328 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:38.291370 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 50001us
I20260709 12:17:38.292044 27248 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:38.292785 27248 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:38.293006 27328 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:38.293598 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:38.293752 27248 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:38.294617 27214 consensus_meta.cc:287] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.001s
I20260709 12:17:38.267107 26916 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.295162 27214 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:38.295470 22896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1057) took 1251 ms (client timeout 1615 ms). Trace:
I20260709 12:17:38.295565 26916 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:38.296105 22896 rpcz_store.cc:269] 0709 12:17:37.044464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.047448 (+  2984us) service_pool.cc:224] Handling call
0709 12:17:38.295279 (+1247831us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54000ee2d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:38.295409 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335606656}
I20260709 12:17:38.297463 27214 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:38.298332 22820 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:38.130503 27289 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.298671 26916 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:38.264634 27291 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:38.299670 27291 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.300077 27291 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:38.302460 27324 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.682s	user 0.003s	sys 0.000s
I20260709 12:17:38.264406 27224 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:17:38.302675 27297 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.302451 27195 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:38.304561 27330 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:38.305099 22748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 1025) took 1719 ms (client timeout 2110 ms). Trace:
W20260709 12:17:38.305631 22748 rpcz_store.cc:269] 0709 12:17:36.585829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.585994 (+   165us) service_pool.cc:224] Handling call
0709 12:17:38.299929 (+1713935us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54004704d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:38.305026 (+  5097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3303121152}
I20260709 12:17:38.307302 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:38.308312 22819 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:38.265015 26847 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:38.309430 26847 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:38.310600 26847 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.311367 27309 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:38.312232 27309 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:38.312630 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.316507 22824 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 10.
I20260709 12:17:38.286666 27180 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:38.225018 27246 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.311532 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:38.285760 27091 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:38.317358 22826 raft_consensus.cc:2410] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:38.280320 23695 rpcz_store.cc:276] 0709 12:17:36.927838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.927972 (+   134us) service_pool.cc:224] Handling call
0709 12:17:36.928336 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:36.992847 (+ 64511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:36.992881 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:36.993428 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:17:37.274152 (+280724us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:37.274222 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.274348 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:38.279405 (+1005057us) raft_consensus.cc:1685] finished
0709 12:17:38.279432 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.279601 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64109,"raft.queue_time_us":64927,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"thread_start_us":280311,"threads_started":1,"wal-append.queue_time_us":812653}
I20260709 12:17:38.325524 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:38.323871 27344 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:17:38.319341 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:38.328864 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 60510.5us
I20260709 12:17:38.327135 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:38.326251 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.331269 22897 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:38.328521 22895 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:38.332041 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.332906 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:38.333719 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:38.335580 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.331468 23695 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 9.
I20260709 12:17:38.338285 26494 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:38.338862 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:38.339126 22901 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:17:38.339541 23695 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:38.338582 27338 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:38.342315 22895 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:17:38.326864 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.344667 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.347904 22896 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:38.350703 22825 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 15: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:38.354904 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.355994 22897 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:38.351979 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:38.325096 27011 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.981s	user 0.009s	sys 0.005s
I20260709 12:17:38.269516 26954 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:38.366132 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.361644 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:38.367540 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.367717 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:38.369683 27085 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:38.407637 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46084.9us
I20260709 12:17:38.223594 27298 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 12:17:38.381371 23695 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:38.387128 22892 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:38.394879 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.436646 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.357139 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:38.399569 27345 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.388111 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:38.438097 23672 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:38.382952 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:38.356359 27293 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:38.405840 22894 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
W20260709 12:17:38.450826 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.429714 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:38.324771 27246 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.436993 22895 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:38.438433 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.459394 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.460430 22895 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:38.460831 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.440784 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:38.377707 27325 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:38.469385 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.380627 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:38.443744 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 86717.6us
W20260709 12:17:38.462244 22821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1108) took 2919 ms (client timeout 1920 ms). Trace:
I20260709 12:17:38.463322 22818 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:38.463629 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.467397 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.400745 27091 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:38.470335 22893 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
W20260709 12:17:38.472479 22821 rpcz_store.cc:269] 0709 12:17:35.530008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.644287 (+114279us) service_pool.cc:224] Handling call
0709 12:17:38.446424 (+2802137us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54006cb454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:38.449656 (+  3232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3402761088}
I20260709 12:17:38.476323 22895 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
W20260709 12:17:38.476994 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 96470.5us
I20260709 12:17:38.431838 27290 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:38.362339 27297 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:17:38.486037 22896 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:38.479053 23656 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:17:38.479401 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.487656 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:38.377084 27276 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:17:38.481937 22826 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:38.383383 26954 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:38.482141 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.375528 27011 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:38.484459 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.452438 27059 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:38.449643 27293 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:17:38.481088 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 51484us
I20260709 12:17:38.469702 27325 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.475222 27345 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.550369 27325 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:38.550611 26954 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:38.523994 27260 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:38.552245 27260 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:38.552455 27345 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:38.553438 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:38.555019 22895 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:38.555109 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:38.556521 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.555233 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:38.502285 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.560115 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:38.560778 22826 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:38.560380 22821 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 11: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:38.512322 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.563856 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:38.495213 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.490196 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:38.568820 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:38.569980 22746 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 10: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:38.579407 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:38.580824 27335 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:38.581882 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:38.550482 22893 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:38.585793 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:38.586676 22897 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:38.585886 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:38.591063 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:38.596333 22821 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 12:17:38.485172 27230 consensus_meta.cc:287] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.005s
I20260709 12:17:38.621932 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:38.621657 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:38.613349 27107 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:38.565966 27247 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:38.610704 27298 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:38.583863 27297 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:38.623644 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.489367 27338 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:38.596705 27326 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:38.582968 27059 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.490206 27180 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:38.661278 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:38.641999 22827 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:38.485703 27289 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.643417 23672 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
W20260709 12:17:38.502385 27346 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:17:38.552369 27021 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:38.619879 27287 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:38.648327 23674 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:38.643887 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:38.544811 27085 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:38.519202 27010 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.543197 27066 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.661994 27297 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:38.624356 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45113us
I20260709 12:17:38.661437 27326 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:38.699927 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:38.686501 27180 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:38.656948 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:38.656993 22897 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:17:38.583276 27293 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.700642 27066 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.704370 27253 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:17:38.704864 27066 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.484193 27158 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:38.621644 26494 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:38.609807 26892 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:38.518581 27290 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:38.654350 27224 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:17:38.701586 27195 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:17:38.520275 27113 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.518877 27155 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 12:17:38.484762 27091 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:38.647635 27300 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:17:38.663309 27059 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:38.649168 27330 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:17:38.646867 27191 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:38.699647 27326 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.698580 27297 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:38.666181 23695 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:38.691123 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:38.518270 26881 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:38.701597 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:38.712157 22751 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:17:38.651856 27107 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:38.702358 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45495.4us
I20260709 12:17:38.673887 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:38.659622 27338 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:38.656371 22864 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:38.609745 26948 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:38.641394 27291 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.734907 22825 raft_consensus.cc:2368] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12.
I20260709 12:17:38.651978 27053 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:17:38.707144 27290 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:38.741192 22751 pending_rounds.cc:85] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 6
I20260709 12:17:38.779310 22751 pending_rounds.cc:107] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:17:38.662711 27203 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.690210 26949 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:38.680617 27246 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:38.745270 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:38.791142 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45949.4us
W20260709 12:17:38.791728 27339 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.003s
I20260709 12:17:38.792035 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:38.792255 27339 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:38.793825 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:38.751417 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 95126us
I20260709 12:17:38.796010 27091 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:38.754232 27214 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:38.673199 27289 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:38.797060 27214 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:38.797685 27214 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:38.745936 27191 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:38.793838 27328 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:38.802268 27328 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.779691 22751 raft_consensus.cc:2889] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:38.796648 27091 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:38.750422 27338 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:38.754979 27330 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:38.756385 27281 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:17:38.786255 27255 consensus_meta.cc:287] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.240s	user 0.009s	sys 0.007s
I20260709 12:17:38.772976 27113 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.758762 27300 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:38.777776 27298 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:38.794610 27339 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.701905 27180 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.797107 27085 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:38.803438 27328 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:38.825052 27330 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:38.827138 27292 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:38.832409 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1012) took 1656 ms. Trace:
I20260709 12:17:39.013959 23674 rpcz_store.cc:276] 0709 12:17:37.176234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.176438 (+   204us) service_pool.cc:224] Handling call
0709 12:17:37.193753 (+ 17315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.683561 (+1489808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.832094 (+148533us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54002ff8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:38.832334 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3344622848}
I20260709 12:17:38.833623 26948 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:38.835525 27352 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:38.835937 27291 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.800812 27191 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:38.814152 27309 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:39.049475 27309 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.838286 27059 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:38.836526 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 976) took 1213 ms. Trace:
I20260709 12:17:39.051311 23682 rpcz_store.cc:276] 0709 12:17:37.623589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.623777 (+   188us) service_pool.cc:224] Handling call
0709 12:17:37.628731 (+  4954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.236445 (+607714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.836293 (+599848us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54003755d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:38.836461 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395915520}
I20260709 12:17:39.053678 27059 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:38.841133 27325 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:38.849735 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1438) took 1099 ms. Trace:
I20260709 12:17:39.054904 22818 rpcz_store.cc:276] 0709 12:17:37.750663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.763353 (+ 12690us) service_pool.cc:224] Handling call
0709 12:17:37.763683 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.479225 (+715542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.849499 (+370274us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54005d8754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:38.849653 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608420608}
I20260709 12:17:38.803882 27203 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:38.856227 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1133) took 1216 ms. Trace:
I20260709 12:17:39.056911 27325 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:38.857515 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.804215 27107 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:39.060093 27107 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.060683 27107 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:38.809623 27230 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:39.063150 27230 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:39.065721 27230 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:39.067330 23672 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:39.024456 26847 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.068758 26847 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:39.057472 22823 rpcz_store.cc:276] 0709 12:17:37.640289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.640920 (+   631us) service_pool.cc:224] Handling call
0709 12:17:38.446692 (+805772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.447210 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:38.447256 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:38.447336 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:38.447396 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.447487 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.855949 (+408462us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54006cb450. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:38.856131 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3885,"raft.queue_time_us":3476,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":13125,"spinlock_wait_cycles":1852134144}
I20260709 12:17:39.072094 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1136) took 1427 ms. Trace:
I20260709 12:17:39.072665 27291 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.073472 26708 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:39.073360 27291 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:39.073899 26708 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:39.073966 27107 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:38.823043 27255 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:39.075099 22822 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:39.074927 26708 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:39.076261 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1132) took 1439 ms. Trace:
I20260709 12:17:39.076618 22822 rpcz_store.cc:276] 0709 12:17:37.638863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.639225 (+   362us) service_pool.cc:224] Handling call
0709 12:17:37.639710 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.075488 (+1435778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.076041 (+   553us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54005523d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:39.076207 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3300614528}
W20260709 12:17:39.009130 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 374329us
I20260709 12:17:39.079598 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:39.080052 23493 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:39.081486 27338 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:38.833405 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1055) took 1789 ms. Trace:
I20260709 12:17:39.082726 23656 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:39.083451 26948 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:39.082504 22899 rpcz_store.cc:276] 0709 12:17:37.043836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.061619 (+ 17783us) service_pool.cc:224] Handling call
0709 12:17:37.062023 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.060149 (+998126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.833150 (+773001us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54001937d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:38.833337 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2293434240}
I20260709 12:17:38.865844 26954 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:39.098711 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1437) took 1452 ms. Trace:
I20260709 12:17:39.105096 22827 rpcz_store.cc:276] 0709 12:17:37.646447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.713850 (+ 67403us) service_pool.cc:224] Handling call
0709 12:17:39.098490 (+1384640us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54002d9e54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:39.098635 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828266368}
I20260709 12:17:39.105638 27291 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:39.072618 22820 rpcz_store.cc:276] 0709 12:17:37.644376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.644516 (+   140us) service_pool.cc:224] Handling call
0709 12:17:37.644793 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:38.298759 (+653966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.071813 (+773054us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54007a3354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:39.072022 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502382720}
W20260709 12:17:39.028167 27353 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.348s	user 0.000s	sys 0.002s
I20260709 12:17:39.099946 26881 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:39.110353 27289 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:39.076335 26708 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:39.028136 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 437172us
I20260709 12:17:39.035352 27055 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:39.039814 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1010) took 1967 ms. Trace:
I20260709 12:17:39.119624 23685 rpcz_store.cc:276] 0709 12:17:37.072473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.072624 (+   151us) service_pool.cc:224] Handling call
0709 12:17:37.072946 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.941761 (+868815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.039505 (+1097744us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b5400080554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:39.039741 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1672710016}
I20260709 12:17:39.072743 22823 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: []
W20260709 12:17:39.020191 27340 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.822s	user 0.000s	sys 0.010s
W20260709 12:17:39.019243 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 375402us
I20260709 12:17:39.106541 22827 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:39.131275 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:39.132120 23685 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:39.133035 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:39.133710 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:39.135581 27361 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:39.135850 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:39.136176 27361 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:39.136595 26954 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:39.097064 27260 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:39.137390 23679 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:39.138134 27260 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:39.138330 27361 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:39.133939 27325 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:17:39.139537 27255 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:39.113431 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:39.115151 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:39.141014 23695 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:39.115720 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:39.014904 27155 consensus_queue.cc:1243] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:39.000385 26916 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.104164 27293 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:39.133631 23685 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:39.163122 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:39.095405 26847 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:39.119429 27055 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:39.042138 27085 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:39.146454 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:39.147063 27203 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:39.131915 27191 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:17:39.152055 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:39.153294 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:39.144531 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:39.043490 27011 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:39.161945 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:39.129192 23659 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:39.242379 23682 raft_consensus.cc:2410] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:17:39.171612 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:39.172044 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:39.243381 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 71464.4us
I20260709 12:17:39.161923 27292 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:39.203967 23695 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:39.239269 23689 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:17:39.240402 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 83280.3us
I20260709 12:17:39.169243 27291 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:39.112339 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:39.174561 22719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.017s
W20260709 12:17:39.254433 22719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.009s	sys 0.017s
I20260709 12:17:39.120612 27214 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:39.169925 27113 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:39.271636 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:39.290915 23659 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:39.177351 27230 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:39.168843 27289 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.091s
W20260709 12:17:39.293172 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 148752us
W20260709 12:17:39.296057 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 183812us
I20260709 12:17:39.272055 27191 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:39.167914 27255 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:17:39.300205 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:39.315738 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:39.291601 22749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.004s	sys 0.025s
W20260709 12:17:39.317413 22749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.005s	sys 0.025s
I20260709 12:17:39.170863 26916 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:39.304169 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:39.304791 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:39.174849 27107 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.118s
W20260709 12:17:39.301187 22790 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.194:36669 timed out after 2.110s (SENT) [suppressed 6 similar messages]
I20260709 12:17:39.311708 22824 pending_rounds.cc:85] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 5
I20260709 12:17:39.271430 27203 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:39.342850 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:39.348518 22824 pending_rounds.cc:107] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:17:39.343294 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.344214 22746 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:39.344378 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.344964 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:39.350898 22750 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:39.345943 22753 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:39.316639 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:39.352295 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:39.253791 27291 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:39.288276 27319 log.cc:927] Time spent T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:17:39.348922 22824 raft_consensus.cc:2889] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:39.357110 22744 raft_consensus.cc:2368] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13.
W20260709 12:17:39.357169 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 52510.5us
I20260709 12:17:39.358669 23494 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:39.361722 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 57686us
I20260709 12:17:39.362536 22748 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:39.289038 27292 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:39.362676 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:39.340248 27367 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:39.368887 26916 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:39.368516 27191 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:39.314392 26847 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:17:39.361282 27289 consensus_queue.cc:1243] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:17:39.346629 27311 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.027s	sys 0.095s
I20260709 12:17:39.271667 27250 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:17:39.303469 27230 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:39.371300 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.409251 22752 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:39.371513 27085 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:39.372711 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.373548 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 981) took 1737 ms. Trace:
I20260709 12:17:39.371527 27361 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:39.375450 27368 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:39.376116 27246 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:39.302416 27113 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:39.362118 27291 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:39.356292 27203 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:39.371040 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:39.387171 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.306648 27011 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:39.432525 27011 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:39.433070 27011 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:39.434695 27055 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:39.441334 23659 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:39.398000 27223 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:39.393436 22753 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:39.401850 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:39.371039 26568 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:39.399741 27367 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:39.321607 27253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.004s	sys 0.021s
I20260709 12:17:39.407686 22746 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:17:39.414112 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51530.1us
I20260709 12:17:39.358116 27281 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:17:39.450624 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 79658.9us
I20260709 12:17:39.478711 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.479841 22746 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:39.481046 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.420840 22745 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 15: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:39.412334 27230 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:39.421787 27363 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:17:39.407775 27311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.027s	sys 0.095s
I20260709 12:17:39.425140 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.426029 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.427569 22749 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:39.384191 27325 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:17:39.475244 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:39.412629 23660 rpcz_store.cc:276] 0709 12:17:37.636322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.126502 (+490180us) service_pool.cc:224] Handling call
0709 12:17:38.126952 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:38.182885 (+ 55933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:38.182920 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:38.183611 (+   691us) log.cc:844] Serialized 26 byte log entry
0709 12:17:38.840307 (+656696us) spinlock_profiling.cc:243] Waited 8.34 ms on lock 0x7b180021b680. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:17:39.153991 (+313684us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:39.154028 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.154100 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:39.373256 (+219156us) raft_consensus.cc:1685] finished
0709 12:17:39.373275 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:39.373483 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55005,"raft.queue_time_us":55374,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":7109,"spinlock_wait_cycles":19183488,"thread_start_us":313475,"threads_started":1,"wal-append.queue_time_us":1187967}
I20260709 12:17:39.516837 22751 raft_consensus.cc:2368] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15.
I20260709 12:17:39.411137 27150 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.478776 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:39.523667 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.526652 22744 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:39.484361 27253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.004s	sys 0.022s
I20260709 12:17:39.528904 23659 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:39.532018 23659 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:39.487037 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.472426 27055 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:39.485117 27247 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.833s	user 0.007s	sys 0.009s
W20260709 12:17:39.531524 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56364.9us
I20260709 12:17:39.560969 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:39.472661 27335 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:17:39.532145 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 53489.3us
I20260709 12:17:39.533175 22746 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
W20260709 12:17:39.535175 27300 consensus_meta.cc:287] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.006s
I20260709 12:17:39.471835 26494 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:39.442104 27338 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:39.472498 27301 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:39.537722 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1448) took 1153 ms. Trace:
I20260709 12:17:39.611105 22818 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: []
W20260709 12:17:39.612901 22826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.003s	sys 0.017s
W20260709 12:17:39.613394 22826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.003s	sys 0.017s
I20260709 12:17:39.613152 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:39.525132 27363 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.619549 22900 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:17:39.621354 22897 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:39.595145 22819 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:39.477113 27203 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:39.529577 26568 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:39.483501 27367 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:39.560468 27309 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:39.614605 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:39.592357 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.611366 22823 rpcz_store.cc:276] 0709 12:17:38.384728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.136716 (+751988us) service_pool.cc:224] Handling call
0709 12:17:39.137043 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.137284 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:17:39.137591 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 12:17:39.537396 (+399805us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:39.537446 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:39.537486 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.537548 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:39.537669 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3092,"prepare.queue_time_us":641,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":3235,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":12271,"thread_start_us":396336,"threads_started":1}
I20260709 12:17:39.617123 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:39.635020 22746 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:39.635299 22895 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 11: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:39.590821 27224 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:39.618137 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:39.559998 27325 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:39.515292 27366 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:17:39.625803 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:39.530912 27281 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:39.630079 22892 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:17:39.596164 27330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.004s	sys 0.015s
I20260709 12:17:39.636845 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1441) took 1857 ms. Trace:
I20260709 12:17:39.637814 22893 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:39.650069 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.639153 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:39.646972 22826 rpcz_store.cc:276] 0709 12:17:37.780289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.595956 (+815667us) service_pool.cc:224] Handling call
0709 12:17:38.651676 (+ 55720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.651978 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:39.012402 (+360424us) log.cc:844] Serialized 14 byte log entry
0709 12:17:39.631286 (+618884us) log.cc:844] Serialized 14 byte log entry
0709 12:17:39.636455 (+  5169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:39.636520 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:39.636575 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.636653 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:39.636783 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15095,"prepare.queue_time_us":382924,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":15825,"spinlock_wait_cycles":17075072,"thread_start_us":944602,"threads_started":2}
I20260709 12:17:39.598886 27300 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:39.530835 27150 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:39.643078 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:39.643656 22894 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:17:39.590370 27335 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:39.444785 27368 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:39.571399 27292 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:39.659545 23682 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:39.645259 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:39.663646 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 731) took 1476 ms. Trace:
I20260709 12:17:39.664086 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:39.664458 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:39.664925 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.666121 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.748194 22749 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:39.748597 22744 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:39.749647 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.749954 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:39.651299 27330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.004s	sys 0.015s
W20260709 12:17:39.669441 22866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.058s
W20260709 12:17:39.790320 22866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.008s	sys 0.058s
I20260709 12:17:39.669576 26916 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:39.670044 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.670466 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1445) took 1565 ms. Trace:
I20260709 12:17:39.804936 22821 rpcz_store.cc:276] 0709 12:17:38.104779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.621297 (+516518us) service_pool.cc:224] Handling call
0709 12:17:38.657721 (+ 36424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:38.668001 (+ 10280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:38.668035 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:38.691499 (+ 23464us) log.cc:844] Serialized 52 byte log entry
0709 12:17:39.179727 (+488228us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:39.179792 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.179912 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:39.670191 (+490279us) raft_consensus.cc:1685] finished
0709 12:17:39.670224 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:39.670401 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4393,"raft.queue_time_us":18830,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9727,"thread_start_us":403373,"threads_started":1,"wal-append.queue_time_us":793515}
I20260709 12:17:39.642357 27224 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:39.624580 27363 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:39.673537 27101 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:39.679801 27289 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.679399 27281 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:39.811559 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 459360us
I20260709 12:17:39.623023 27190 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:39.682879 22822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.015s	sys 0.055s
W20260709 12:17:39.819254 22822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.015s	sys 0.055s
I20260709 12:17:39.789577 22744 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:39.636410 27311 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.709579 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:39.824445 23672 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:39.826064 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:39.827395 22897 raft_consensus.cc:2393] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 15: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:39.621076 26847 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:39.711078 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:39.711988 23679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.018s	sys 0.026s
W20260709 12:17:39.828406 23679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.019s	sys 0.027s
I20260709 12:17:39.642589 27325 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:39.648095 27293 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:39.715152 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 71923.5us
I20260709 12:17:39.812161 27224 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:39.654716 27375 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:17:39.729569 22893 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:17:39.732904 27091 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:17:39.740410 27150 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:39.720029 27010 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:39.706957 27309 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.746596 22818 rpcz_store.cc:276] 0709 12:17:38.187863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.056332 (+868469us) service_pool.cc:224] Handling call
0709 12:17:39.056717 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.617748 (+561031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.663361 (+ 45613us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400300f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:39.663574 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274471296}
W20260709 12:17:39.746892 23685 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.015s	sys 0.020s
W20260709 12:17:39.854436 23685 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.015s	sys 0.020s
I20260709 12:17:39.667199 26568 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:39.668758 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:39.855161 22865 leader_election.cc:400] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12.
I20260709 12:17:39.744481 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:39.855533 22865 leader_election.cc:403] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:17:39.751116 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 449932us
I20260709 12:17:39.626197 27301 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:39.754647 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.760624 27214 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:39.802157 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:39.806318 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:39.807616 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:39.816197 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:39.820586 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:39.684633 23689 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:39.822115 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:39.828411 22826 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:39.832347 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.720243 22753 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:39.803979 26916 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:39.838239 22898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a35aee871f0b41e48335c0260a873076"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:39.905933 22898 raft_consensus.cc:606] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:39.889832 22901 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:39.841913 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:39.812175 27101 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:39.823845 26708 consensus_meta.cc:287] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.006s
I20260709 12:17:39.813632 27253 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:39.833709 27325 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:39.822886 27289 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:39.919103 22748 raft_consensus.cc:2410] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:17:39.919478 22827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.029s	sys 0.032s
W20260709 12:17:39.919931 22827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.029s	sys 0.033s
W20260709 12:17:39.865173 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 120816us
I20260709 12:17:39.920121 22751 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:39.826857 27190 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:39.891162 22894 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:39.839380 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:39.877892 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:39.924464 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:39.912519 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.863770 27180 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.914463 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:39.845230 26954 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:17:39.845232 27091 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:39.918005 27253 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:39.862161 22790 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:39.937127 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 75024.8us
I20260709 12:17:39.833928 26892 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:17:39.836393 27311 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:39.853889 27293 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 12:17:39.909433 27354 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:17:39.927510 23672 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:39.750531 22749 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:39.929069 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:39.930349 22826 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:39.878492 27107 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:39.840184 26847 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:39.939316 22790 leader_election.cc:400] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15.
I20260709 12:17:39.940678 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:39.850739 27010 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:39.880336 27296 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:17:39.923471 27246 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:39.972839 22745 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:39.879016 27309 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:39.962203 22894 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:39.853467 27382 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:17:39.968039 22790 leader_election.cc:403] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:39.968647 22818 raft_consensus.cc:2410] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:17:39.956965 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:39.978619 22826 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 15: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:39.996795 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:39.998265 22821 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:40.003206 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:40.004307 22818 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:39.947033 27368 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:39.928416 27011 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:40.015365 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:40.016896 22818 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
W20260709 12:17:40.019786 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.016925 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.022629 22826 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: [12.6-13.7]
I20260709 12:17:40.023505 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1452) took 1583 ms. Trace:
I20260709 12:17:40.023890 22826 rpcz_store.cc:276] 0709 12:17:38.439734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.021835 (+1582101us) service_pool.cc:224] Handling call
0709 12:17:40.022241 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:40.023198 (+   957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.023435 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.025851 22826 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:39.934363 27180 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:40.031745 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:40.048964 22746 raft_consensus.cc:2410] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:17:40.055263 22821 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:17:40.046756 27386 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.259s	user 0.000s	sys 0.002s
I20260709 12:17:39.970904 27107 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:40.021608 27246 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12.
W20260709 12:17:40.117272 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 262548us
W20260709 12:17:40.078922 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 240805us
W20260709 12:17:40.067360 27328 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.027s	user 0.013s	sys 0.001s
I20260709 12:17:39.965777 27101 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:40.241367 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:40.086282 27385 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.284s	user 0.000s	sys 0.002s
I20260709 12:17:40.245307 22825 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:17:40.249326 22745 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
W20260709 12:17:40.094440 27354 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:17:40.260670 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:40.276119 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 337321us
I20260709 12:17:40.276576 23672 raft_consensus.cc:2410] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:17:40.277129 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.011s	sys 0.011s
W20260709 12:17:40.279345 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.012s	sys 0.012s
W20260709 12:17:40.281328 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.237311 27214 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:40.015257 27091 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:40.274991 27381 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.450s	user 0.000s	sys 0.002s
I20260709 12:17:40.291499 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:40.256249 27311 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.287225 22790 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:40.079506 27394 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.228s
I20260709 12:17:40.305923 22790 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:40.084270 27010 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:40.295819 27085 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:17:40.295100 27214 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.335027 27214 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:40.318749 27311 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:40.270221 27328 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:40.315596 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:40.311645 27091 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:17:40.347960 27383 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.437s	user 0.000s	sys 0.001s
I20260709 12:17:40.348150 27328 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:40.347291 27335 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:40.350359 27393 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:17:40.350757 27335 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:40.352677 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1451) took 1947 ms. Trace:
I20260709 12:17:40.353331 27330 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:40.345468 27190 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:40.354360 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1140) took 2096 ms. Trace:
I20260709 12:17:40.355688 27011 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:40.357594 27387 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:17:40.357302 26916 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:40.315940 26892 consensus_queue.cc:1243] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:40.359918 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 739) took 2028 ms. Trace:
I20260709 12:17:40.349153 27328 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:40.360466 26892 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:40.359295 22819 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 733) took 2160 ms (client timeout 2202 ms). Trace:
W20260709 12:17:40.364282 22819 rpcz_store.cc:269] 0709 12:17:38.199408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.312386 (+112978us) service_pool.cc:224] Handling call
0709 12:17:40.359120 (+2046734us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54005d8c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:40.359234 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2947624320}
W20260709 12:17:40.365748 27230 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.833s	user 0.012s	sys 0.000s
I20260709 12:17:40.327912 27290 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:40.367496 27326 raft_consensus.cc:2764] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:17:40.331521 27195 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:40.368206 27195 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:40.353176 22824 rpcz_store.cc:276] 0709 12:17:38.404916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.285041 (+880125us) service_pool.cc:224] Handling call
0709 12:17:39.311402 (+ 26361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:39.374349 (+ 62947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:39.374378 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:39.374982 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 12:17:39.778726 (+403744us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:39.788950 (+ 10224us) log.cc:844] Serialized 14 byte log entry
0709 12:17:39.803138 (+ 14188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.803226 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:40.352390 (+549164us) raft_consensus.cc:1685] finished
0709 12:17:40.352418 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.352598 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11377,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":14094,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":2577,"thread_start_us":402689,"threads_started":1,"wal-append.queue_time_us":631902}
I20260709 12:17:40.369019 27195 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:40.344251 27224 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:40.354743 22820 rpcz_store.cc:276] 0709 12:17:38.257891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.107783 (+849892us) service_pool.cc:224] Handling call
0709 12:17:39.108168 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:39.108647 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:39.108679 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:39.109213 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:17:39.597544 (+488331us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:39.597605 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.597681 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:40.354151 (+756470us) raft_consensus.cc:1685] finished
0709 12:17:40.354175 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.354305 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17312,"raft.queue_time_us":4099,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12484,"thread_start_us":487258,"threads_started":1,"wal-append.queue_time_us":715207}
W20260709 12:17:40.376612 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 60896.8us
I20260709 12:17:40.378286 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:17:40.334329 27055 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.775s	user 0.008s	sys 0.002s
W20260709 12:17:40.341763 27203 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.001s
I20260709 12:17:40.384586 22819 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:17:40.347239 27384 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:17:40.309115 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:40.360457 22827 rpcz_store.cc:276] 0709 12:17:38.331897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.130296 (+798399us) service_pool.cc:224] Handling call
0709 12:17:39.130630 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:39.134776 (+  4146us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:17:39.146865 (+ 12089us) log.cc:844] Serialized 14 byte log entry
0709 12:17:39.920998 (+774133us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:39.941695 (+ 20697us) log.cc:844] Serialized 26 byte log entry
0709 12:17:39.941918 (+   223us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:39.942325 (+   407us) log.cc:844] Serialized 14 byte log entry
0709 12:17:40.309122 (+366797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.309279 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:40.359649 (+ 50370us) raft_consensus.cc:1685] finished
0709 12:17:40.359678 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.359845 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":873,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":6321,"raft.queue_time_us":448270,"raft.run_cpu_time_us":637,"raft.run_wall_time_us":35850,"spinlock_wait_cycles":5504,"thread_start_us":1140160,"threads_started":2,"wal-append.queue_time_us":932287}
W20260709 12:17:40.389674 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 80655.3us
I20260709 12:17:40.391887 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:40.393445 23660 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
W20260709 12:17:40.387326 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 491604us
I20260709 12:17:40.389556 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:40.397219 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:40.398100 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:40.402140 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:40.346210 27107 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:40.362707 26892 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:40.376367 27301 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.366303 27230 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:40.390666 27328 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:40.395265 27311 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:40.394987 27289 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.404208 27326 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:40.403844 27066 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:40.400884 27395 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:40.390337 27203 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:40.560797 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.410940 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 488976us
W20260709 12:17:40.601346 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 345983us
I20260709 12:17:40.431980 26847 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:40.456874 27180 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.756152 22864 leader_election.cc:400] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13.
I20260709 12:17:40.756862 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:40.759202 27293 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:17:40.759930 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1449) took 2374 ms. Trace:
I20260709 12:17:40.760141 27293 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:40.760618 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 998) took 1102 ms. Trace:
I20260709 12:17:40.761199 22864 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:40.761440 23660 rpcz_store.cc:276] 0709 12:17:39.658368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.664142 (+  5774us) service_pool.cc:224] Handling call
0709 12:17:40.759909 (+1095767us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54000a4454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:40.760243 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1484899712}
I20260709 12:17:40.408798 27253 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:40.455889 27260 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.317s	user 0.011s	sys 0.006s
I20260709 12:17:40.436558 27309 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:40.428790 27311 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:40.486717 27224 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:40.658310 27325 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.731s	user 0.014s	sys 0.000s
I20260709 12:17:40.775437 26847 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.775238 27325 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:40.776091 27365 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:40.776607 26847 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:40.777200 27365 consensus_queue.cc:1243] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:17:40.476445 27291 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.999s	user 0.008s	sys 0.005s
I20260709 12:17:40.775125 22744 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:40.778607 27291 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:40.779225 27113 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.781029 26847 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:40.482919 27230 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:40.438870 27326 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.783850 27326 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:40.762468 27293 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:40.423086 27328 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.782474 27291 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:40.787253 27328 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:40.786598 27325 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:40.788843 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.790480 27309 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:17:40.791805 27378 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.881s	user 0.004s	sys 0.000s
I20260709 12:17:40.792272 27309 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:40.792802 27253 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:40.793440 27253 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.793926 27253 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:40.793983 27224 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:17:40.794817 27224 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:40.796581 27224 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:40.798610 27224 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:40.799672 26847 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:40.802601 27338 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.489969 27250 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:40.412014 27190 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:40.412160 27330 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:40.484234 27369 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.773s	user 0.008s	sys 0.009s
W20260709 12:17:40.491580 27392 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.238s	user 0.002s	sys 0.000s
I20260709 12:17:40.412042 27396 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.336s
W20260709 12:17:40.481567 27367 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.836s	user 0.009s	sys 0.004s
I20260709 12:17:40.445593 27395 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.742818 27420 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:40.815271 27420 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:40.815974 27367 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:40.510200 27363 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.688s	user 0.012s	sys 0.003s
W20260709 12:17:40.739488 27345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.005s	sys 0.005s
W20260709 12:17:40.819022 27345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.006s	sys 0.006s
I20260709 12:17:40.819059 27395 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:40.743717 22748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1192) took 1357 ms (client timeout 1651 ms). Trace:
W20260709 12:17:40.820765 22748 rpcz_store.cc:269] 0709 12:17:39.386588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.386769 (+   181us) service_pool.cc:224] Handling call
0709 12:17:40.742879 (+1356110us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54001e73d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:40.743391 (+   512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125734656}
I20260709 12:17:40.732949 27419 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:40.742476 27366 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.747105 22747 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:17:40.748188 22823 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:40.469059 27203 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:40.825356 27396 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:40.763118 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1138) took 2498 ms. Trace:
I20260709 12:17:40.748867 27368 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:40.826282 27396 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:40.818519 27363 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:40.827226 27368 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:40.829172 27396 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:40.829756 27363 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:40.768256 27397 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:40.831027 22749 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:40.825367 27296 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:17:40.835319 27366 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:40.826352 22822 rpcz_store.cc:276] 0709 12:17:38.251024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.077488 (+826464us) service_pool.cc:224] Handling call
0709 12:17:39.077858 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:39.078196 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:39.078223 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:39.078726 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:17:39.819746 (+741020us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:39.819802 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.819888 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:40.582403 (+762515us) raft_consensus.cc:1685] finished
0709 12:17:40.725891 (+143488us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.749247 (+ 23356us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":970,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"thread_start_us":732519,"threads_started":1,"wal-append.queue_time_us":886254}
I20260709 12:17:40.835901 27338 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:40.837127 22748 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:40.837523 27328 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:40.838194 27366 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.838581 27420 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.832090 27397 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:40.839082 27338 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.764317 23493 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:40.839543 27397 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:40.772503 27425 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:17:40.774113 27311 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:40.839851 27250 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:40.782742 22744 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:40.840276 27328 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.843075 27367 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:40.844854 27397 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:40.846827 27397 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:40.805053 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 1055) took 1117 ms. Trace:
I20260709 12:17:40.406322 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:40.804014 27382 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:40.760488 22825 rpcz_store.cc:276] 0709 12:17:38.385070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.153058 (+767988us) service_pool.cc:224] Handling call
0709 12:17:39.153345 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.273102 (+1119757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.759060 (+485958us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54005528d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:40.759641 (+   581us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2510419840}
I20260709 12:17:40.799001 26708 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.812755 27260 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:40.807621 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 1051) took 1083 ms. Trace:
I20260709 12:17:40.813133 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 1050) took 1148 ms. Trace:
I20260709 12:17:40.824229 22747 pending_rounds.cc:85] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 6
I20260709 12:17:40.830114 27368 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:40.772697 27417 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:40.847692 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 121503us
W20260709 12:17:40.770510 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.799070 27291 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:40.841787 27250 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:40.849840 22746 rpcz_store.cc:276] 0709 12:17:39.667391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.824842 (+157451us) service_pool.cc:224] Handling call
0709 12:17:40.784842 (+960000us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54000a8554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:40.785187 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314168576}
I20260709 12:17:40.857183 22745 rpcz_store.cc:276] 0709 12:17:39.664780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.668433 (+  3653us) service_pool.cc:224] Handling call
0709 12:17:40.704025 (+1035592us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54001e82d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:40.747696 (+ 43671us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269780736}
I20260709 12:17:40.857357 22751 rpcz_store.cc:276] 0709 12:17:39.664382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.664625 (+   243us) service_pool.cc:224] Handling call
0709 12:17:40.812663 (+1148038us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54001e7dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:40.812917 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395858816}
I20260709 12:17:40.851438 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 1047) took 1202 ms. Trace:
I20260709 12:17:40.857743 22747 pending_rounds.cc:107] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:17:40.862910 26708 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:40.863845 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 100004us
I20260709 12:17:40.865988 27400 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:17:40.860953 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 453302us
W20260709 12:17:40.844857 27214 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.509s	user 0.016s	sys 0.013s
I20260709 12:17:40.866816 22747 raft_consensus.cc:2889] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:40.856245 27260 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:40.867319 22753 rpcz_store.cc:276] 0709 12:17:39.649435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.649736 (+   301us) service_pool.cc:224] Handling call
0709 12:17:40.850742 (+1201006us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b5400192dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:40.851254 (+   512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158961024}
I20260709 12:17:40.864609 27291 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:40.875032 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.871711 22867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.003s	sys 0.012s
I20260709 12:17:40.878037 27223 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.881914 27223 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:40.878131 27417 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:40.885123 27101 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:40.888607 27328 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:40.889295 27328 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:40.889887 27328 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:40.889938 27368 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:40.891757 27368 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:40.892307 27368 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:40.892168 27291 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:40.893932 27291 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:40.882316 26892 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:40.883862 27250 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:40.881963 27260 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:40.894852 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1078) took 1072 ms. Trace:
I20260709 12:17:40.903950 22751 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:40.826669 27419 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:40.886515 27417 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.893975 27368 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:40.900686 22896 rpcz_store.cc:276] 0709 12:17:39.822088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.822250 (+   162us) service_pool.cc:224] Handling call
0709 12:17:39.822670 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.969325 (+146655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:39.969363 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:39.969411 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:39.969443 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.894200 (+924757us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400a83ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:40.894271 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.894539 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336637824}
W20260709 12:17:40.910094 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.909008 27195 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:40.907509 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1033) took 1613 ms. Trace:
I20260709 12:17:40.895583 27214 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:40.902917 27400 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.923460 27400 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:40.911121 27190 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.909250 27363 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:40.929457 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:40.939288 27260 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:40.941706 26494 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:40.944658 27417 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:40.946705 27361 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:40.947196 27361 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:40.947999 27363 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:40.948580 27361 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:40.949829 27361 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:40.952483 27400 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:40.944281 26494 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:17:40.914580 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:40.925190 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:40.937705 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:40.958595 27289 consensus_queue.cc:1059] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:40.971124 22898 raft_consensus.cc:2393] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:40.971968 27289 raft_consensus.cc:3055] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:40.972522 27394 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:40.973295 27394 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.973770 27394 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:40.974186 22753 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 10: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:40.964084 22576 catalog_manager.cc:5697] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 10 to 12, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 12 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:40.967985 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 55524.9us
I20260709 12:17:40.966928 27223 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.972697 27289 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:40.938390 27190 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:40.988073 27230 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.972872 27391 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.914284 23685 rpcz_store.cc:276] 0709 12:17:39.156689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.168454 (+ 11765us) service_pool.cc:224] Handling call
0709 12:17:39.168788 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.169068 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:17:39.854833 (+685765us) log.cc:844] Serialized 14 byte log entry
0709 12:17:40.602079 (+747246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:40.733697 (+131618us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:40.736693 (+  2996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.740687 (+  3994us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.769522 (+ 28835us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5233,"prepare.queue_time_us":205026,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":83975,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":119,"thread_start_us":1426560,"threads_started":3,"wal-append.queue_time_us":555001}
I20260709 12:17:40.980023 27363 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:40.996025 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:40.999066 26494 consensus_queue.cc:1243] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:40.998775 23659 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:41.002995 26892 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.037823 23659 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:41.037935 27296 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:41.039005 22897 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:17:41.039269 27345 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:41.039841 27345 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:41.039945 27214 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:41.039121 27296 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:41.042245 27253 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:41.043133 27296 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:41.043318 27010 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:41.044788 27253 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:41.045993 26892 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:41.041146 27345 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:41.029362 27391 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:41.029564 27230 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:41.051986 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:41.080737 27391 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:41.080953 27230 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:41.059088 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:41.082038 27345 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:41.082755 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:41.083588 22746 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:41.061805 26881 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.087007 27417 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:41.087209 26881 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:41.087607 27311 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:41.088500 27419 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:41.090093 26881 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:41.090234 27311 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:41.065591 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:41.068475 22899 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:41.091285 22748 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:41.092352 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:41.093089 22748 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:41.068717 27289 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:41.070127 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.072966 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.074034 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.075060 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.076299 22900 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:17:41.078024 22897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:17:41.064610 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:41.069178 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1052) took 1404 ms. Trace:
W20260709 12:17:41.105756 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.101220 22747 rpcz_store.cc:276] 0709 12:17:39.665162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.823886 (+158724us) service_pool.cc:224] Handling call
0709 12:17:40.745701 (+921815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.873751 (+128050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.054153 (+180402us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54001e73d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:41.069082 (+ 14929us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098980608}
I20260709 12:17:41.112386 27419 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:17:41.117904 27085 consensus_meta.cc:287] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.007s
I20260709 12:17:41.118846 27085 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15.
I20260709 12:17:41.035866 26494 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:41.123158 22894 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:17:41.124974 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:41.131136 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:41.140288 22895 raft_consensus.cc:2410] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:17:41.141153 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.141719 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.141749 22746 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:41.135546 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:41.137030 22823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 747) took 1499 ms (client timeout 1570 ms). Trace:
I20260709 12:17:41.151765 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:41.152894 22751 raft_consensus.cc:2410] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:17:41.154884 26494 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:41.155572 27289 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:41.157372 26494 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:41.123183 27190 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:41.160406 27190 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:41.162858 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1036) took 1747 ms. Trace:
W20260709 12:17:41.163318 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 158441us
I20260709 12:17:41.168735 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:41.169129 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:41.169575 22822 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:41.170169 22821 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:41.170920 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:41.175124 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:41.175868 22894 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:41.176215 26708 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:41.179807 22826 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:17:41.182082 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:41.183633 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:41.187489 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:41.188607 22827 raft_consensus.cc:2410] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:17:41.188228 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:41.145648 22823 rpcz_store.cc:269] 0709 12:17:39.617413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.638455 (+ 21042us) service_pool.cc:224] Handling call
0709 12:17:41.103180 (+1464725us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54005d8254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:41.116896 (+ 13716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012282624}
I20260709 12:17:41.169270 26892 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:41.147954 22748 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
W20260709 12:17:41.198016 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 53318.9us
I20260709 12:17:41.197387 22818 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:41.201999 27203 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:41.207716 22748 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:41.208933 26708 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:41.210372 26708 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:41.210755 26708 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:41.199472 27195 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:17:41.227591 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.229079 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.230191 23682 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:41.230032 22901 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:41.232626 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:41.241957 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.242558 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.247490 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 59633.4us
I20260709 12:17:41.249742 22894 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:41.251891 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:41.253281 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.253451 27291 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:41.254102 27291 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:41.254555 27291 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:41.254755 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:41.258502 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:41.258708 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.258953 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:41.253564 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.259557 27250 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.261118 22748 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:41.260944 27250 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:41.262164 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:41.262707 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:41.163347 22752 rpcz_store.cc:276] 0709 12:17:39.415697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.416014 (+   317us) service_pool.cc:224] Handling call
0709 12:17:39.472153 (+ 56139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.743120 (+270967us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:17:39.760333 (+ 17213us) log.cc:844] Serialized 14 byte log entry
0709 12:17:40.066268 (+305935us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:40.066357 (+    89us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:40.066430 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.135119 (+1068689us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400069354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:41.139644 (+  4525us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.162666 (+ 23022us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17075,"prepare.queue_time_us":17582,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":4792,"raft.queue_time_us":921,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":9815,"spinlock_wait_cycles":622414080,"thread_start_us":305365,"threads_started":1,"wal-append.queue_time_us":675248}
I20260709 12:17:41.249284 27394 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:41.265410 27391 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.266125 27391 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:41.267585 27394 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:41.268409 27391 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:41.268445 22825 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:41.272212 27395 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:41.274482 27395 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:41.274603 22745 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:41.278054 23682 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:17:41.292557 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 284720us
I20260709 12:17:41.279028 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.279714 22827 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:17:41.280359 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.280786 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:41.281086 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1152) took 1422 ms. Trace:
I20260709 12:17:41.281509 27400 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:41.282526 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:41.283653 27417 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:41.286828 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.191620 27326 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:41.287144 27338 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:41.253145 23659 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:17:41.288136 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.248579 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:41.278160 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:41.293547 22822 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:41.298055 23659 pending_rounds.cc:85] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 6
I20260709 12:17:41.298486 23659 pending_rounds.cc:107] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:17:41.302980 23659 raft_consensus.cc:2889] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:41.304670 22744 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:41.306214 22746 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:41.305431 26916 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:41.307855 27325 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:41.308231 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:41.309456 22825 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:41.315349 27368 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:41.319489 27250 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:41.296540 27417 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:41.320943 27417 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:41.322253 27417 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:41.323697 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:41.247071 26708 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:41.326992 26708 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:41.327275 27337 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.327994 27337 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:41.330258 27337 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:41.333427 22819 raft_consensus.cc:2368] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11.
I20260709 12:17:41.295073 22821 rpcz_store.cc:276] 0709 12:17:39.858169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.056457 (+198288us) service_pool.cc:224] Handling call
0709 12:17:41.119801 (+1063344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.170850 (+ 51049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.280837 (+109987us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54005d8250. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:41.280998 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2351426432}
I20260709 12:17:41.341528 22900 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:41.342567 22820 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 15: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:41.217180 27361 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:17:41.338667 22749 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:41.302073 23660 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
W20260709 12:17:41.347944 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.348588 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.296852 27400 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:41.358271 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.297168 27338 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:41.360019 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.363579 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.363629 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.366336 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:41.372036 26948 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.372953 26948 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:41.375469 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.376356 22746 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:17:41.376751 23679 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:17:41.377782 27010 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.378610 27010 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:41.379730 27403 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:41.381292 27010 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:41.389107 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1035) took 1867 ms. Trace:
I20260709 12:17:41.363948 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:41.365607 22576 catalog_manager.cc:5697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 8 to 10, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 10 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:41.388273 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:41.398936 22744 raft_consensus.cc:2410] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:17:41.402112 22897 raft_consensus.cc:606] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:41.402545 22897 raft_consensus.cc:614] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:41.389628 23659 rpcz_store.cc:276] 0709 12:17:39.521536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.521730 (+   194us) service_pool.cc:224] Handling call
0709 12:17:39.528778 (+  7048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.954969 (+426191us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4c00278300. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf2a4ba20 00007fadf2a5ca29 00007fadf2a22644 00007fadf2a49f2d 00007fadf2a49b93 00007fadf477a18b 00007fadf477acb5 00007fadf4775f30 00007fadf47777de 00007fadf4781b49 00007fadf4782416
0709 12:17:40.995866 (+1040897us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b54005fc420. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46fd06f 00007fadf4775f60 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62
0709 12:17:41.347561 (+351695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.389018 (+ 41457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67937408}
I20260709 12:17:41.418143 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:41.420411 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.401909 27419 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:41.416843 27293 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.444525 22752 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
W20260709 12:17:41.447996 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.459666 27403 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.460800 27403 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:41.463241 27338 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:41.465062 27338 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:41.465415 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:41.466917 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.468032 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:41.445153 22752 pending_rounds.cc:85] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 9
I20260709 12:17:41.483094 22752 pending_rounds.cc:107] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:17:41.483448 22752 raft_consensus.cc:2889] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:41.483209 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:41.438864 27419 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:41.494611 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 51811.7us
W20260709 12:17:41.488219 27328 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.597s	user 0.015s	sys 0.003s
I20260709 12:17:41.512873 22750 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:41.506595 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.513495 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:41.513186 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 322131us
I20260709 12:17:41.519047 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:41.520190 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:41.501102 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 12:17:41.528435 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.530865 27325 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.541817 22820 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:41.493258 27293 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:41.502209 27419 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:41.546576 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:41.524148 27328 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:41.590427 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:41.523538 27400 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:41.603004 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 204649us
I20260709 12:17:41.606551 22826 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:17:41.610085 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 110289us
I20260709 12:17:41.587317 27326 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:41.608793 22821 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 9.
I20260709 12:17:41.575173 27325 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:41.602141 27291 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:41.631107 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:41.603052 27290 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:17:41.633191 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 113007us
I20260709 12:17:41.646519 27250 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:17:41.649976 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.651244 23656 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:41.649664 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:41.655685 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.620393 27230 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:41.654485 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:41.631107 27337 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.662479 23679 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:41.655637 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.639317 26494 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 12:17:41.660549 27289 consensus_meta.cc:287] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.011s
I20260709 12:17:41.669580 26568 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:41.677774 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 62413us
I20260709 12:17:41.689671 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:41.689441 26568 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:41.690223 22790 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:41.690605 27439 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:17:41.691727 27230 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:41.696483 27325 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:41.698856 27291 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:41.699486 27260 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:41.700937 22900 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:41.680408 26954 raft_consensus.cc:3055] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:17:41.737813 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 59496.1us
I20260709 12:17:41.713366 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:41.746112 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55938.5us
W20260709 12:17:41.755319 27438 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:17:41.756798 23695 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:41.756798 23682 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:41.757869 27195 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:41.759554 22896 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:41.763823 27325 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:41.766945 27325 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.676047 27337 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:41.735646 26954 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:41.769176 26954 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:41.675477 27290 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:41.773789 27290 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:41.776573 27403 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:41.778280 27293 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:41.767472 27325 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:41.739742 27010 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 12:17:41.788110 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 74833.3us
I20260709 12:17:41.770215 27337 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:41.781674 27328 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:41.797183 22790 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:41.795763 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:41.770635 26954 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:41.758711 27195 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:41.802644 22865 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:41.813891 27449 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:41.814502 22576 catalog_manager.cc:5697] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 6 to 8, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 8 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:41.815052 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:41.815377 27450 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:41.820353 27394 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:41.833325 22897 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:17:41.833484 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:41.843609 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.844619 23682 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:41.845714 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:41.846535 23685 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:41.847164 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.848497 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.849475 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.860324 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.837127 22576 catalog_manager.cc:5697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 6 to 8, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 8 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:17:41.858892 22892 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:17:41.821185 27394 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:41.867861 22901 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:41.869433 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.870034 27394 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:41.870730 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 123537us
I20260709 12:17:41.873162 27230 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:41.873960 27230 consensus_queue.cc:1243] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:41.875289 26948 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:41.876293 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:41.879200 27230 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:41.879835 27230 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:41.880936 27230 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:41.814550 27449 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:41.860445 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:41.847430 27328 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:41.831908 27337 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:17:41.862629 26708 consensus_meta.cc:287] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.007s
I20260709 12:17:41.888293 23660 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:41.887578 27328 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:17:41.895752 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.879216 27400 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:41.905634 27441 log.cc:927] Time spent T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260709 12:17:41.909416 26892 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:41.887283 27449 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:41.918934 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:41.919729 23660 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:41.924124 27420 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.925145 27010 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:41.931283 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.912119 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:41.932521 23679 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:41.890942 27337 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.924990 27420 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:41.916924 26568 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:41.933991 27010 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:41.900640 27328 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:41.933559 22576 catalog_manager.cc:5697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:41.937382 22576 catalog_manager.cc:5697] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 2 to 12. New cstate: current_term: 12 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:41.939945 22576 catalog_manager.cc:5697] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 5 to 10, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 10 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:41.942718 27337 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:41.926939 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:41.950078 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 206887us
W20260709 12:17:41.978864 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.949221 22576 catalog_manager.cc:5697] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 11 to 13, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 13 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:41.981405 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 185033us
I20260709 12:17:41.984470 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:41.978251 23656 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:41.952817 26892 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:41.994987 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:41.995365 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:41.993486 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.998915 22899 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:17:41.999102 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:41.992663 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:42.033236 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.003471 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:42.003839 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.002875 22894 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:42.023572 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:42.033176 22898 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:42.000531 23660 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:17:41.994004 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 67243.4us
I20260709 12:17:41.993405 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:42.035096 22895 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:42.035405 22753 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:42.032829 22892 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
W20260709 12:17:42.003238 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.996631 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:42.004063 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.038074 22901 raft_consensus.cc:2393] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 15: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:42.032508 22899 pending_rounds.cc:85] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 5
I20260709 12:17:42.043200 22899 pending_rounds.cc:107] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:17:42.043478 22899 raft_consensus.cc:2889] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:42.001710 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.045235 23682 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:41.992542 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:42.005002 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:42.052327 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.055511 23679 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:42.052353 22745 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:17:42.057581 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:42.059455 23695 raft_consensus.cc:2410] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:42.050872 22893 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:41.999775 27293 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:41.998700 27010 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:41.994256 27368 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.050222 27394 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:42.027915 26892 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:41.997375 26494 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:41.944840 27195 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.085067 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:42.085600 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:42.086015 22825 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:42.086346 22753 raft_consensus.cc:2376] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12. Re-sending same reply.
I20260709 12:17:42.089946 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:42.092288 22819 raft_consensus.cc:2368] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:41.997002 27420 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:42.072576 22826 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:42.073087 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:42.075508 27326 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:42.073163 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:42.080808 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:42.097440 22751 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:42.097225 27326 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.097862 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:42.098217 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:42.098817 22824 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:42.099052 22752 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:42.082279 22900 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:17:42.099735 23682 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:42.007467 26916 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:17:42.106761 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:42.083256 22791 connection.cc:256] RPC call timeout handler was delayed by -1.3575543279998783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 12:17:42.113328 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:42.113765 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:42.119539 22825 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:42.123855 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:42.124914 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.131974 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:42.128247 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:42.133402 22746 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:42.134742 22820 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:17:42.132754 22751 raft_consensus.cc:2376] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11. Re-sending same reply.
I20260709 12:17:42.139354 23672 raft_consensus.cc:2410] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:17:42.118073 27394 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:42.084988 26708 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:17:42.117468 27010 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:17:42.143359 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 53279.9us
I20260709 12:17:42.117067 26954 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:42.160917 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:42.147635 22826 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:42.128394 27420 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.109419 27391 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:17:42.108068 27368 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.107508 26494 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:42.109658 27325 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:42.173902 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:42.163488 27419 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.578s	user 0.015s	sys 0.000s
I20260709 12:17:42.169651 22746 pending_rounds.cc:85] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 6
I20260709 12:17:42.170310 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:42.139863 27326 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:42.173243 22825 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:42.172544 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:42.174437 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.147408 27260 raft_consensus.cc:2764] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:17:42.168503 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.178797 22746 pending_rounds.cc:107] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:17:42.183723 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:42.184755 22746 raft_consensus.cc:2889] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:42.185961 22826 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:42.164810 26954 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:42.188452 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.197568 22744 raft_consensus.cc:2410] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:42.217475 23679 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: [13.7-17.9]
I20260709 12:17:42.215008 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:42.183662 27290 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:42.189271 26708 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.222059 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.225605 22825 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:42.190151 26954 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:42.186590 27345 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.168447 27449 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:42.161087 26892 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:42.249063 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 76584.9us
I20260709 12:17:42.193527 22894 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:42.177143 27420 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.192425 27361 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:42.174952 27395 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:17:42.249053 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:42.232144 27417 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.902s	user 0.005s	sys 0.011s
I20260709 12:17:42.256007 23494 leader_election.cc:400] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11.
I20260709 12:17:42.256505 23494 leader_election.cc:403] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:17:42.221345 27291 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.258293 22820 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:17:42.223266 27289 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:42.232663 27290 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:42.270993 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:42.273783 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.276175 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:42.183420 27419 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.277081 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:42.283239 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:42.286768 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 121299us
W20260709 12:17:42.294166 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 209441us
I20260709 12:17:42.259059 27260 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:42.296886 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:42.305680 22900 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:42.307319 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:42.309437 22791 connection.cc:256] RPC call timeout handler was delayed by -1.2378394709999156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 12:17:42.273419 26892 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:42.317572 23659 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 16: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:42.250995 26708 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.277578 27290 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:42.287465 27417 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:42.255880 27345 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:42.293659 27361 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:42.347072 22894 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:42.334254 23685 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:42.267354 27291 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.317008 27195 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:42.371567 22820 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:17:42.381731 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:42.354646 27400 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11.
I20260709 12:17:42.357359 27010 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.397414 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:42.390403 27455 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:17:42.363446 26948 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:17:42.404451 22820 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:17:42.389637 27391 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:17:42.409691 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.407949 27391 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.413549 27391 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:42.414862 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.416395 27345 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:42.416570 22752 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:42.417230 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:42.418941 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:42.395143 27394 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:42.397929 27395 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:42.397761 27260 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:42.395313 27289 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:42.398485 27368 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:42.445638 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:42.447268 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:42.385473 27195 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.393370 27328 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:42.405532 27325 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:42.456425 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:42.455113 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.390604 27010 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.467888 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:42.452843 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 115205us
I20260709 12:17:42.442377 27230 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:42.526314 22752 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
W20260709 12:17:42.453503 27456 log.cc:927] Time spent T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:17:42.475525 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:42.411056 26494 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:42.484408 27420 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:42.488974 27291 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:42.499475 27289 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:42.501154 27260 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:42.502049 27328 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:42.502183 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 60469.2us
W20260709 12:17:42.503355 27458 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:17:42.504159 27449 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:42.504340 22826 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:42.506619 27419 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:42.556717 22749 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:42.515466 26708 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:42.429286 27474 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.442122 27468 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.448268 27462 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:17:42.519181 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 110488us
I20260709 12:17:42.448040 27466 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:17:42.527961 22753 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:42.527449 22745 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:42.539043 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:42.537375 23689 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:42.543323 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:42.548234 22864 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.572562 23679 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:42.572957 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:42.530061 27457 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:17:42.554659 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:42.448433 27395 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:42.565989 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:42.454125 27326 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:17:42.573658 22745 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:42.578481 22821 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:42.579629 23672 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
W20260709 12:17:42.577175 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50712.1us
I20260709 12:17:42.576472 23659 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
W20260709 12:17:42.580796 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 159954us
I20260709 12:17:42.584293 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:42.538254 27345 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:17:42.585515 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:42.563742 27394 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.542423 27391 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:42.600445 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 52327.3us
I20260709 12:17:42.601944 27471 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:42.602430 27471 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.602883 27391 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:42.594364 27010 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:42.604929 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:42.605602 22753 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:42.607502 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:42.563810 27328 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:42.608466 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.608309 27328 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:42.609699 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:42.610483 27328 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:42.594976 23685 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:42.610986 27250 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:42.596015 27475 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:42.611701 27250 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:42.612151 27475 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:42.612617 27345 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:42.612727 23695 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:42.613075 27345 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:42.614223 27471 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:42.614460 27345 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:42.616199 27345 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:42.614501 27475 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:42.620440 22753 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:42.624280 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:42.625283 26954 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:42.627759 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.629700 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:42.630897 22747 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 15: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:42.575161 27468 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:42.631942 27345 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:42.633723 27468 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:42.635602 27345 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:42.637480 27345 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:42.648984 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 1012) took 1008 ms. Trace:
W20260709 12:17:42.678501 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 52242.8us
W20260709 12:17:42.650218 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 66009.5us
I20260709 12:17:42.680570 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:42.576268 26708 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.679065 23689 rpcz_store.cc:276] 0709 12:17:41.640519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.640675 (+   156us) service_pool.cc:224] Handling call
0709 12:17:42.648729 (+1008054us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b5400706f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:42.648895 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396185344}
I20260709 12:17:42.684940 22745 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:42.696678 27476 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:17:42.699177 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 113827us
I20260709 12:17:42.687635 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:42.683637 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:42.707365 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:42.723966 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.722774 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:42.738287 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 54771.4us
I20260709 12:17:42.739547 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:42.736779 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.749105 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.748761 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:42.688021 26494 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:42.723505 27476 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.766075 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.567524 27474 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.770231 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:42.761818 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:42.760093 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.722925 27464 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:42.701920 27462 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:42.740970 27293 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:42.780889 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.781127 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.781489 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:42.781950 22898 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:42.748816 27417 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:42.805754 27417 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.806244 27417 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:42.807533 27195 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:42.784348 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:42.773234 27476 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:42.779515 27462 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.786052 22750 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:17:42.786830 23695 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:42.822695 22750 pending_rounds.cc:85] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 7
I20260709 12:17:42.823902 22750 pending_rounds.cc:107] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:17:42.787026 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.824270 22750 raft_consensus.cc:2889] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:42.791064 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:42.769690 27450 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:42.766492 27368 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:42.792268 26954 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:42.829950 22826 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
W20260709 12:17:42.830941 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46733.6us
I20260709 12:17:42.792922 27474 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:42.798950 27470 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:42.799701 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:42.836757 23689 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:42.836849 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:42.800005 22900 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:42.751518 27250 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:42.752919 27395 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.682271 27394 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.779059 27293 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.802131 27483 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:42.804965 27337 consensus_meta.cc:287] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.758s	user 0.008s	sys 0.004s
I20260709 12:17:42.812286 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.814388 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.702898 26708 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.789533 27463 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:42.812793 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:42.827159 27368 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.827234 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:42.856135 23679 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:42.821626 27291 raft_consensus.cc:2764] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
W20260709 12:17:42.835870 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 48926.8us
I20260709 12:17:42.780121 27326 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:42.761816 27468 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:17:42.860344 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 48163.1us
I20260709 12:17:42.836360 27470 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.823117 27328 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:42.828394 27462 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:42.833592 27457 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:17:42.827086 27010 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:42.834215 27403 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:42.847980 27484 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:42.821514 27230 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:42.825287 23685 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:42.850625 23660 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:17:42.850826 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:42.896875 23689 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:42.852229 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:42.899129 23682 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 15: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:42.842576 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:42.899848 23695 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:42.833583 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:42.834522 27195 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:42.839390 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:42.903863 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 64587.8us
W20260709 12:17:42.863055 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.838150 27450 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:42.846948 27293 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:42.827822 27290 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.858559 27368 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:42.859980 27468 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.855248 27483 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.870816 27289 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:42.859714 27326 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.879036 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:42.884567 27394 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:42.887079 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.821825 27464 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:42.888837 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 52111.3us
I20260709 12:17:42.846621 27482 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:17:42.891769 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:42.892633 26892 consensus_meta.cc:287] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.004s
I20260709 12:17:42.893005 27466 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:42.926976 27466 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.926728 27195 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:42.927668 27466 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:42.866302 27470 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:42.931883 27488 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:17:42.895673 27403 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:42.933799 27450 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:42.904130 27485 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 12:17:42.917830 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48143.9us
I20260709 12:17:42.935453 27485 consensus_queue.cc:1243] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:42.935695 22900 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:42.936827 22717 leader_election.cc:400] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:42.937268 22717 leader_election.cc:403] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:42.937530 27230 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:42.914566 27010 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:42.939011 27474 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:42.915941 27471 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:42.938210 27291 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:42.914616 26916 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:42.938014 27289 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:42.941592 27471 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:42.942126 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.932191 27469 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:42.923497 27468 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:42.942885 27469 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:42.938879 27010 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:42.943434 27469 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:42.944010 27010 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:42.945443 26916 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:42.918550 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:42.946288 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:42.854472 27337 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:42.947289 22901 raft_consensus.cc:2368] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:42.949083 27337 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:42.949970 22895 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 11: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:42.942368 27289 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:42.956875 27485 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:42.921000 27326 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:42.956970 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:42.959470 22896 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:42.931524 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:42.960495 22893 raft_consensus.cc:2368] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:42.961089 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:42.961216 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:42.961922 22746 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:42.962275 22745 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 11: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:42.936874 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.964151 26948 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.965052 26948 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:42.961761 27195 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:42.970504 27195 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:42.971634 27195 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:42.972635 27395 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:42.938030 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:42.977239 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:42.980049 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.981081 22895 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:42.981137 27260 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:42.981287 27482 raft_consensus.cc:2764] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:17:42.983215 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:42.984130 22893 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:42.969323 22576 catalog_manager.cc:5697] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 5 to 8, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 8 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.005016 22576 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 9 to 11, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 11 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.010448 22576 catalog_manager.cc:5697] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 6 to 10, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 10 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.015043 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:43.015508 27464 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:43.016469 22571 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 131) took 21316 ms (client timeout 15000 ms). Trace:
I20260709 12:17:43.021008 23695 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:43.022315 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.023627 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:43.026295 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:43.026698 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 168950us
I20260709 12:17:43.027184 22892 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:43.028687 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:43.028890 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:43.029806 27482 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:43.029986 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:43.030282 27482 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:43.030716 27482 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:43.030644 27485 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:43.031675 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:43.032608 27291 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:43.033808 27291 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:43.037503 27483 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:43.039673 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.040499 23695 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 9.
I20260709 12:17:43.048656 22746 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:42.996814 27484 raft_consensus.cc:697] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:43.061861 22898 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:17:43.072021 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.073266 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.069176 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:43.074582 22864 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:43.076051 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.076776 23695 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:43.032629 27485 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:43.049796 27472 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:43.043440 26916 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:43.086712 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.140856 22746 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 15: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:43.088420 27403 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:43.087213 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:43.087139 27484 consensus_queue.cc:237] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:43.137841 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.135504 27472 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:43.162881 27472 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:43.167064 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 83786.8us
I20260709 12:17:43.169044 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:43.080755 27485 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:43.175148 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:43.175405 27485 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:43.179193 26708 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:43.181986 27417 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:43.183744 27472 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:43.185171 27417 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:43.185416 27468 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:43.175977 22892 raft_consensus.cc:2376] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13. Re-sending same reply.
I20260709 12:17:43.186331 27419 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:43.186333 27472 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:43.187316 27419 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:43.188721 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:43.189818 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.190629 22897 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 8.
I20260709 12:17:43.192049 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.193902 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.057473 27494 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.165s
W20260709 12:17:43.175805 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 98715.3us
I20260709 12:17:43.201296 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:43.202662 27493 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:17:43.204630 27480 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:17:43.069170 27290 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:43.219875 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:43.220639 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 51738.4us
I20260709 12:17:43.221177 22899 raft_consensus.cc:2410] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:17:43.216729 22896 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:43.206462 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:43.224484 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.078706 27448 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:43.225307 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 196679us
I20260709 12:17:43.190649 27419 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:43.218266 22745 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 9.
I20260709 12:17:43.237159 27448 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:43.217352 26948 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:43.219070 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.216926 27470 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:43.215674 27462 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:43.242813 27470 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:43.244426 27462 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:43.239744 27448 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:43.209270 27325 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:43.245834 27325 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:43.016969 22571 rpcz_store.cc:269] 0709 12:17:21.700150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.700455 (+   305us) service_pool.cc:224] Handling call
0709 12:17:43.016188 (+21315733us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:33.666233 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:33.875449 (+209216us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:33.903820 (+ 28371us) write_op.cc:435] Acquired schema lock
0709 12:17:33.919860 (+ 16040us) tablet.cc:662] Decoding operations
0709 12:17:34.249388 (+329528us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:34.249497 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:34.249528 (+    31us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:17:34.392165 (+142637us) tablet.cc:701] Row locks acquired
0709 12:17:34.406614 (+ 14449us) write_op.cc:260] PREPARE: finished
0709 12:17:34.461337 (+ 54723us) write_op.cc:270] Start()
0709 12:17:34.484696 (+ 23359us) write_op.cc:276] Timestamp: P: 1783599454440869 usec, L: 0
0709 12:17:34.513019 (+ 28323us) op_driver.cc:348] REPLICATION: starting
0709 12:17:34.583956 (+ 70937us) log.cc:844] Serialized 7187 byte log entry
0709 12:17:35.542890 (+958934us) op_driver.cc:464] REPLICATION: finished
0709 12:17:36.217827 (+674937us) write_op.cc:301] APPLY: starting
0709 12:17:36.232837 (+ 15010us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:37.553116 (+1320279us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:37.553237 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:37.884616 (+331379us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:37.885168 (+   552us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0709 12:17:37.885238 (+    70us) write_op.cc:312] APPLY: finished
0709 12:17:37.885915 (+   677us) log.cc:844] Serialized 163 byte log entry
0709 12:17:38.177445 (+291530us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:38.198307 (+ 20862us) write_op.cc:454] Released schema lock
0709 12:17:38.198406 (+    99us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:38.199025 (+   619us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:38.199064 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":78672,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":619708,"apply.run_cpu_time_us":65533,"apply.run_wall_time_us":1992600,"cfile_cache_hit":70,"cfile_cache_hit_bytes":73220,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":1,"lbm_read_time_us":36260,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":5,"num_ops":18,"prepare.queue_time_us":310011,"prepare.run_cpu_time_us":29048,"prepare.run_wall_time_us":1006738,"raft.queue_time_us":658172,"raft.run_cpu_time_us":74303,"raft.run_wall_time_us":570041,"replication_time_us":986405,"thread_start_us":1329373,"threads_started":5,"wal-append.queue_time_us":504638,"wal-append.run_cpu_time_us":29459,"wal-append.run_wall_time_us":2537976}]]}
I20260709 12:17:43.248107 27325 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:43.192564 27461 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:43.251462 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.252676 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.079028 27361 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:17:43.254046 22745 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:43.252424 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:43.257248 22901 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:43.260499 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.261165 22818 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:17:43.260496 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.265024 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:43.265971 22892 raft_consensus.cc:2376] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15. Re-sending same reply.
W20260709 12:17:43.268478 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 62244.5us
I20260709 12:17:43.269198 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:43.264031 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 75394.4us
I20260709 12:17:43.271116 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:43.273947 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.276870 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.252401 26494 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.277619 22819 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:43.251992 27474 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:43.284092 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.285070 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.278995 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.277477 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.258772 27494 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:43.255584 27345 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:43.292644 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.296368 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:43.296939 22818 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:43.289553 22824 raft_consensus.cc:2376] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15. Re-sending same reply.
I20260709 12:17:43.293817 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:43.286315 22823 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:43.258627 27461 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:43.301376 22749 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:43.285000 22820 raft_consensus.cc:2376] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13. Re-sending same reply.
I20260709 12:17:43.299872 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:43.269886 27361 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:43.307683 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.318135 22749 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:43.331581 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.332342 22746 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:43.262326 27493 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:17:43.290875 27483 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:43.299865 27345 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:43.329558 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:43.278550 27476 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:43.344313 22895 raft_consensus.cc:2410] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:17:43.345078 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.346453 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:43.337435 27230 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:43.354579 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:43.306802 27494 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:43.356391 27361 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:43.358661 22893 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:43.317514 27492 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:43.348093 27483 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:43.290596 27495 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:17:43.338016 27499 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:17:43.343745 27345 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:43.362535 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:43.296765 26494 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:43.305804 27250 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:17:43.347394 27368 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:43.387017 23656 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:43.359941 27484 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:43.401823 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:43.386698 27477 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:43.399379 27250 consensus_queue.cc:1243] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:43.408771 26892 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:17:43.416868 27463 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.560s	user 0.012s	sys 0.003s
I20260709 12:17:43.406699 27230 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:43.431716 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 69946.4us
I20260709 12:17:43.432129 22745 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
W20260709 12:17:43.432502 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 77356.3us
I20260709 12:17:43.356391 27494 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:43.452529 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:43.454274 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.437517 23493 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:43.410667 27492 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:43.456033 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:43.418367 27468 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:43.460198 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 236751us
I20260709 12:17:43.458681 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:43.465698 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:43.466591 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:43.450608 27463 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:43.475941 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:43.483646 22894 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:17:43.483783 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.484629 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.422256 27493 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:17:43.457386 27492 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.485680 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.461161 26892 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:43.485378 22827 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:17:43.513921 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:43.514174 27498 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.500s	user 0.005s	sys 0.000s
I20260709 12:17:43.473971 27450 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:43.474601 27417 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:17:43.491524 27502 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:17:43.494352 27482 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:43.495422 27293 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.575s	user 0.014s	sys 0.001s
I20260709 12:17:43.526945 27293 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:43.496706 27474 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.495877 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.529464 27474 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:43.498607 22901 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:43.424217 27469 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:43.530934 27464 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:43.531339 22750 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:43.471330 27471 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:43.532056 27471 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.532528 27471 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:43.415640 27461 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:43.477280 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.535928 27368 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:43.505493 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.507649 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.540532 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.540803 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.541313 22821 raft_consensus.cc:2376] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14. Re-sending same reply.
I20260709 12:17:43.541612 22820 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:43.542065 22717 leader_election.cc:400] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:43.542443 22717 leader_election.cc:403] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:43.486531 22747 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:17:43.510334 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.543936 23660 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:43.471477 27477 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:17:43.544948 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.468801 27483 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:43.547129 27501 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:17:43.548965 26892 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:43.516271 27450 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:43.488672 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.510334 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.563795 22825 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:43.520396 27417 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.526094 26494 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:43.526328 27466 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.005s
I20260709 12:17:43.527405 27476 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:43.469951 27419 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:43.587411 22753 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:43.512260 27492 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:43.502075 26916 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:43.542647 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.588829 23659 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:43.556789 22900 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:43.560812 27469 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:43.569705 22898 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 12:17:43.596285 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:43.570143 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.597524 23660 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:43.599318 22821 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 15: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:43.573822 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:43.550750 27495 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:43.594419 26916 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:17:43.569706 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 103207us
I20260709 12:17:43.591050 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:43.572052 27328 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.703s	user 0.013s	sys 0.006s
I20260709 12:17:43.566727 27450 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:43.614374 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.529469 27293 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:43.606189 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:43.572189 27417 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:43.625564 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51865.6us
I20260709 12:17:43.629591 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:43.630993 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.631723 23659 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:43.545003 27468 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:17:43.644220 23695 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 18. Current term is 19. Ops: []
I20260709 12:17:43.577498 27368 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:43.633255 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:43.656448 22900 pending_rounds.cc:85] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 4
I20260709 12:17:43.665015 22900 pending_rounds.cc:107] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:43.661943 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.665657 22900 raft_consensus.cc:2889] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:43.673041 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:43.673853 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.674180 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:43.674902 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 45392.3us
I20260709 12:17:43.676640 22818 raft_consensus.cc:2410] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:17:43.677029 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.627799 27469 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:43.662025 27260 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:43.691852 22745 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:43.692736 23679 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:17:43.675729 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.605587 27495 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:43.681290 22748 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:17:43.681335 23672 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:43.679278 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:43.702260 22899 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:43.626405 27328 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:43.687754 22897 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: [13.7-17.9]
I20260709 12:17:43.688087 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.705957 23659 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:43.661890 27477 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.680177 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:43.694193 23660 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 9: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:43.577980 27466 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:43.695703 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:43.697196 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:43.728888 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.729444 22896 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:43.698753 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.731074 23689 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 15: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:43.653872 27361 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.677095 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:43.712095 27461 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:43.713174 26892 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:17:43.703387 27326 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.736s	user 0.014s	sys 0.000s
I20260709 12:17:43.715325 27482 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:43.719926 27495 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:43.725363 23656 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:43.730093 22827 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:43.575062 27230 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:43.682530 27419 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:43.688253 27448 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:43.766734 27419 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:43.769161 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.771384 22819 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:43.773315 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:43.777644 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 106315us
I20260709 12:17:43.742013 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.779193 23672 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:43.779047 27515 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:43.780186 27520 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.112s	user 0.000s	sys 0.003s
I20260709 12:17:43.778566 22790 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:43.782549 27517 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:17:43.783490 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.784533 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.785280 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.755832 27326 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:43.787992 27326 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:43.789721 22790 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:43.791790 27466 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:43.792104 27511 log.cc:927] Time spent T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:17:43.792445 27513 raft_consensus.cc:2764] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:17:43.792637 27328 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:43.793951 27328 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:43.794354 27328 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:43.734244 27469 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:43.786505 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.801347 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.802125 23672 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:43.789835 22823 raft_consensus.cc:2368] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15.
I20260709 12:17:43.805142 22899 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:17:43.805586 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.727830 26948 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:17:43.809726 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 132700us
I20260709 12:17:43.742833 26892 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.774596 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.753754 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.807283 23689 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:43.770105 22826 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 15: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:43.808728 22820 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
W20260709 12:17:43.811965 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 137880us
I20260709 12:17:43.813740 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:43.769872 27419 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:43.778304 27345 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:43.735131 27477 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:43.762709 27368 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:43.851833 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:43.864315 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.865253 22826 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:43.869520 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:43.870194 22818 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:43.871483 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:43.872292 23689 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:43.740659 27361 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:43.880877 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50095.2us
I20260709 12:17:43.859009 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.859072 22895 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:43.829142 26892 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:43.789950 27474 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:43.855630 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.829035 27493 raft_consensus.cc:2764] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:17:43.845590 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:43.916695 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:43.987757 23656 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:43.882097 23674 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:17:43.855031 27515 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:43.987926 22749 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:43.941792 23672 raft_consensus.cc:1240] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:43.991456 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:43.849472 27325 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 12:17:43.916307 27485 consensus_meta.cc:287] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.740s	user 0.003s	sys 0.012s
I20260709 12:17:43.844362 26948 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:43.917724 23685 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:43.852367 27465 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:43.912808 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:43.736819 26916 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:43.915674 22899 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:43.798414 27469 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:43.903184 27468 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:43.863931 27337 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.853956 27495 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:43.974334 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:44.008862 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:43.844723 27403 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:17:43.917724 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:43.992887 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:44.018409 23679 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:44.017529 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:43.994859 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:43.996578 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:44.009925 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:44.019464 23682 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:17:43.999312 22895 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:17:44.017529 22892 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:43.915704 27361 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:44.015501 22827 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:44.023527 23689 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:44.023056 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:44.016338 22818 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:44.019033 23674 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:44.025484 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 107867us
I20260709 12:17:44.029440 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:44.031347 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:44.027431 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 355263us
I20260709 12:17:44.034438 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:44.036774 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:44.039772 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.031070 27289 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:17:44.041934 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:44.036094 27260 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:17:44.042577 22897 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:17:44.043406 27482 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:44.043816 27482 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.044265 27482 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:44.044893 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:44.046906 27361 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:44.021639 27337 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:44.047204 27474 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:44.048442 27448 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:44.048810 27337 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:44.048888 27448 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.049396 27448 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:44.025300 27462 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:44.051100 27462 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:44.051566 27462 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:44.051249 27500 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:44.040791 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:44.054247 27477 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:44.047310 27361 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.054809 27361 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:44.003638 27505 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 12:17:44.055272 27471 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260709 12:17:44.055753 27471 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.025306 26916 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:44.057878 27471 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:44.042656 22820 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:44.021646 27468 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:44.060676 27468 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:43.997327 27515 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.062177 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:44.062883 22894 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:44.043900 22897 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 18 index: 7. (index mismatch)
I20260709 12:17:44.065424 22893 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:17:44.072115 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.880290 27328 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:44.040743 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:44.076855 22826 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
W20260709 12:17:44.077723 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44061.5us
W20260709 12:17:44.079934 22824 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 12:17:44.081315 22820 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:17:44.080338 22824 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:44.085106 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:44.085721 22824 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:44.086294 27477 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:44.082473 27419 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:17:44.089011 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:44.089409 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:44.089059 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:44.089246 23682 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:44.094903 23679 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
W20260709 12:17:44.095666 22825 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.002s
I20260709 12:17:44.096488 22825 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:44.086452 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:44.097620 22824 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:44.099320 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:44.000005 27485 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:44.103426 27325 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.104115 27325 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:44.104866 27485 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:44.105784 22822 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:44.088470 26494 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.106747 26494 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:44.109294 26494 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:44.110806 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:44.116492 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:44.063774 27515 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:44.117313 22821 raft_consensus.cc:2376] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18. Re-sending same reply.
I20260709 12:17:44.106475 27325 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:44.134989 22824 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:44.088213 26954 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.088359 27471 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:44.155041 22749 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:44.123139 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:44.159178 22745 raft_consensus.cc:2368] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15.
I20260709 12:17:44.097594 27505 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:44.156389 22820 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:17:44.157040 22826 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:44.146453 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:44.096221 27419 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:44.084425 27337 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:17:44.063902 27450 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.122174 27464 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.183261 22751 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:44.182009 22750 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:44.178869 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:44.155192 27345 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:44.157694 27471 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:44.215646 22820 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:44.224260 23660 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:44.229283 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.120339 27524 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:17:44.242352 22824 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:17:44.242671 22892 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:44.162708 26954 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:44.230465 27492 consensus_meta.cc:287] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.001s
I20260709 12:17:44.231227 27471 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:44.259604 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 214766us
I20260709 12:17:44.261108 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:44.120553 26948 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:44.218716 27464 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:44.265596 23494 leader_election.cc:336] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.570s (SENT)
W20260709 12:17:44.278613 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 249217us
I20260709 12:17:44.264302 27492 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:44.264586 27293 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.277177 27512 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:17:44.284699 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:44.316442 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:44.317662 23679 raft_consensus.cc:2368] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18.
I20260709 12:17:44.323832 27448 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:44.328294 27464 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:44.329905 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:44.331341 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:44.288314 26954 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:44.297796 27395 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:44.244058 27419 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.300611 27492 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:44.300976 22898 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:44.301863 27293 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:44.303553 27531 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:17:44.367069 22746 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:44.366755 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:44.368005 22818 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:44.336723 27523 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:44.303841 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:44.383029 23685 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:44.306528 22751 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:17:44.311792 22824 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:17:44.339916 22864 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:44.284832 27500 consensus_queue.cc:1243] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:44.341786 22745 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:17:44.347544 22820 raft_consensus.cc:2368] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18.
I20260709 12:17:44.413575 26954 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:44.357661 23674 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:44.353796 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:44.416309 27468 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.417336 27483 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:17:44.367177 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:44.417999 27483 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:44.418332 22752 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:44.419880 27289 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.373427 27195 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:44.374231 27505 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.420689 27505 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:44.420486 27289 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:44.374578 27293 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:44.372913 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 111899us
I20260709 12:17:44.382112 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:44.424026 27289 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:44.425069 27465 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:44.425598 27465 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:44.426498 27417 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.002s
I20260709 12:17:44.426939 27417 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:44.429039 27417 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:44.422406 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:44.432753 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:44.433987 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:44.360236 27395 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:44.435216 27395 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:44.436415 27395 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:44.439236 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 173662us
W20260709 12:17:44.440635 23494 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.587s (SENT) [suppressed 28 similar messages]
I20260709 12:17:44.381677 27462 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.382117 27515 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 12:17:44.394169 27368 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 12:17:44.453181 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:44.277681 27361 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:44.394624 27450 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:44.395013 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:44.455889 22818 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:44.365443 27464 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:44.402885 22824 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:17:44.410980 27492 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:44.363695 22790 leader_election.cc:400] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15.
I20260709 12:17:44.460384 22790 leader_election.cc:403] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:17:44.417110 27468 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:44.464469 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:44.464841 22819 raft_consensus.cc:2410] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:17:44.465736 22827 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 15: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:44.363019 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:44.419252 27483 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.364193 27448 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:44.432818 27326 raft_consensus.cc:2764] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:17:44.433694 27195 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:17:44.384780 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44994.7us
I20260709 12:17:44.377252 26892 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.452412 27485 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:44.386497 22865 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:44.460459 22752 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:44.462170 23685 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:44.439252 27328 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:44.467155 22745 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
W20260709 12:17:44.468801 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 105309us
W20260709 12:17:44.483609 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 120710us
I20260709 12:17:44.474121 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:44.481614 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:44.456215 27466 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:44.383222 27523 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:44.459657 27368 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:44.491472 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:44.485642 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:44.464190 27492 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.473488 27500 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:44.513036 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:44.520285 22749 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:44.514292 22896 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:44.459224 27471 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:44.463825 27482 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:44.474678 27495 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:17:44.472626 27507 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:17:44.480831 27535 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:44.503685 27538 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:44.545290 22749 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:44.501899 27492 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:44.510617 27469 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:17:44.541905 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50535us
I20260709 12:17:44.528842 27448 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.546275 27466 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.549369 27326 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:44.564616 22752 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:44.514606 27345 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:17:44.575842 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:44.576566 22752 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:44.563458 27466 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.583235 27466 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:44.590843 27462 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:44.591648 23493 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:44.561542 27535 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:44.595487 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:44.595227 27542 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:17:44.597811 27539 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:17:44.605482 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1101) took 1145 ms. Trace:
I20260709 12:17:44.605932 22893 rpcz_store.cc:276] 0709 12:17:43.460323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.475694 (+ 15371us) service_pool.cc:224] Handling call
0709 12:17:44.605233 (+1129539us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54001937d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:44.605384 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231224064}
I20260709 12:17:44.602478 27417 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:44.611521 27417 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.611954 27417 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:44.599918 27419 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:44.613969 27419 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.614405 27419 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:44.573531 27469 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:44.568948 27538 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:44.625523 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 140007us
I20260709 12:17:44.566473 27448 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:44.627686 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 74527.8us
W20260709 12:17:44.618474 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 61127.9us
I20260709 12:17:44.626901 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:44.631563 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:44.632403 23685 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 10: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:44.631009 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:44.637562 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:44.638164 23672 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:44.639240 23685 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:44.640933 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:44.642930 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:44.643548 23685 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:44.647053 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:44.648818 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.649470 23659 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 12:17:44.651866 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:44.617648 27469 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:44.656104 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:44.637897 27289 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:44.665233 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:44.666975 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:44.681577 23685 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:44.673622 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:44.689041 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 302663us
I20260709 12:17:44.690490 27463 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:17:44.691489 27552 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:17:44.691447 27463 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:44.692548 22865 leader_election.cc:400] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18.
I20260709 12:17:44.692915 22865 leader_election.cc:403] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:17:44.693303 27250 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:44.693534 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:44.693658 27463 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:44.694234 27463 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:44.656842 27474 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:44.695549 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 770) took 1012 ms. Trace:
I20260709 12:17:44.705351 22819 rpcz_store.cc:276] 0709 12:17:43.678633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.774330 (+ 95697us) service_pool.cc:224] Handling call
0709 12:17:44.690662 (+916332us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54002e8954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:44.690820 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491091712}
I20260709 12:17:44.700206 23672 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:44.656407 27361 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:44.719820 22752 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:44.673604 27468 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:44.723891 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:44.723138 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 217622us
I20260709 12:17:44.728730 22818 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:44.703999 27493 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:44.704890 26892 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:44.777606 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 336983us
W20260709 12:17:44.778079 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 78811.3us
I20260709 12:17:44.714056 27464 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18.
I20260709 12:17:44.779428 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:44.779418 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:44.785000 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:44.724325 27524 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.695318 27513 consensus_queue.cc:1059] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:17:44.797610 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:44.721771 27250 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:44.802227 22899 raft_consensus.cc:2376] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15. Re-sending same reply.
I20260709 12:17:44.803038 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:44.803602 22818 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:17:44.714359 27477 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:44.801061 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:44.807443 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:44.796541 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:44.808291 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 82554us
I20260709 12:17:44.809407 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:44.810621 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:44.811434 23672 raft_consensus.cc:2368] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15.
I20260709 12:17:44.812369 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:44.812743 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1062) took 1031 ms. Trace:
I20260709 12:17:44.813338 23659 rpcz_store.cc:276] 0709 12:17:43.781176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.784721 (+  3545us) service_pool.cc:224] Handling call
0709 12:17:43.785109 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:44.650394 (+865285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:44.812501 (+162107us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b5400375d54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:44.812689 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986975488}
I20260709 12:17:44.813874 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:44.814087 22822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1479) took 1554 ms (client timeout 1767 ms). Trace:
I20260709 12:17:44.814873 22897 raft_consensus.cc:2368] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:44.815369 22893 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:17:44.814545 22822 rpcz_store.cc:269] 0709 12:17:43.259982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.260126 (+   144us) service_pool.cc:224] Handling call
0709 12:17:44.813928 (+1553802us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b54007a2454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:44.814030 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1941618560}
I20260709 12:17:44.817165 22791 leader_election.cc:400] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15.
I20260709 12:17:44.817157 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:44.817569 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:44.818182 23659 raft_consensus.cc:2368] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10.
I20260709 12:17:44.773247 27403 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:44.818677 23672 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:44.817754 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:44.821987 22752 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:44.772927 27361 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.822642 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:44.825206 22900 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:17:44.715709 27465 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.730592 27289 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:44.819164 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:44.828059 27289 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:44.704387 27538 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.731258 27461 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:17:44.795547 27471 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:44.798480 27468 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:44.804684 27250 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.844681 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:44.855588 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:44.846539 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:44.847290 22752 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:44.857023 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:44.823378 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:44.810559 27477 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:44.819957 27539 raft_consensus.cc:2764] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:17:44.804647 27507 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:17:44.865185 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 44518us
I20260709 12:17:44.821465 27493 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:44.860957 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:44.863462 27548 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:17:44.867722 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:44.868366 22901 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:44.821584 27403 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:44.870293 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:44.871263 22822 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:44.870750 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:44.840256 27368 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:44.872778 22752 raft_consensus.cc:2368] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10.
I20260709 12:17:44.877236 22901 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:17:44.777393 27463 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:44.880082 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 100794us
I20260709 12:17:44.881882 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:44.882817 22899 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:44.714527 27535 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:44.841461 26892 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:17:44.867409 27293 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:44.859401 27250 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:44.888171 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:44.885756 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:44.806658 27524 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.847280 27326 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:17:44.848815 27361 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:44.893569 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:44.894455 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:44.875320 27471 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:44.889205 26916 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.908721 22899 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 10.
I20260709 12:17:44.866245 27468 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:44.917536 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:44.897523 26954 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:44.884469 27368 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:44.870673 27507 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:44.908115 27326 consensus_queue.cc:1243] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 15.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:17:44.938696 27558 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:17:44.938946 27195 raft_consensus.cc:3055] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:44.939352 27195 raft_consensus.cc:740] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:44.940239 27195 consensus_queue.cc:260] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:44.941220 27368 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:44.942373 27513 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:44.942566 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 779) took 1032 ms. Trace:
I20260709 12:17:44.942966 22827 rpcz_store.cc:276] 0709 12:17:43.910307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.088641 (+178334us) service_pool.cc:224] Handling call
0709 12:17:44.942351 (+853710us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54007a1554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:44.942504 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860439936}
I20260709 12:17:44.944870 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:44.945749 22898 raft_consensus.cc:2410] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:17:44.918845 27403 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:44.947533 27560 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:17:44.948289 22897 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:44.948611 27403 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:44.950313 22821 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:44.898350 27477 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.950863 27493 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:44.951756 27477 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:44.952765 22892 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:44.954083 27230 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:44.954360 22892 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:44.909749 27471 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.914927 27448 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:44.922987 27555 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:17:44.941530 27195 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:44.954619 27230 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:44.972685 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:44.960505 27395 consensus_meta.cc:287] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.001s
I20260709 12:17:44.976526 27419 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:44.979700 27230 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:44.982044 27419 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:44.983180 23674 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 15: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:17:44.983642 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 95499.3us
I20260709 12:17:44.919147 26916 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:45.000185 26916 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:44.986557 27559 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:17:44.987288 27561 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:17:45.000604 27557 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:44.987922 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:45.002090 22751 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:44.988400 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1171) took 1466 ms. Trace:
I20260709 12:17:44.988930 27515 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:45.079984 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:44.989898 27524 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:44.991845 27507 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:44.963874 26954 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:44.966812 27471 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:44.994767 27468 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:44.997219 27328 consensus_meta.cc:287] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.002s
I20260709 12:17:44.975257 27522 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 12:17:45.003290 22825 rpcz_store.cc:276] 0709 12:17:43.522185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.099572 (+577387us) service_pool.cc:224] Handling call
0709 12:17:44.100017 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:44.125102 (+ 25085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:44.125146 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:44.161959 (+ 36813us) log.cc:844] Serialized 26 byte log entry
0709 12:17:44.468014 (+306055us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:44.480847 (+ 12833us) log.cc:844] Serialized 14 byte log entry
0709 12:17:44.481100 (+   253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:44.481159 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:44.957791 (+476632us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b1800079120. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:44.987991 (+ 30200us) raft_consensus.cc:1685] finished
0709 12:17:44.988161 (+   170us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:44.988326 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12119,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":44554,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":13290,"spinlock_wait_cycles":9879296,"thread_start_us":232867,"threads_started":1,"wal-append.queue_time_us":325682}
I20260709 12:17:44.962018 27361 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:44.956610 27492 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:45.001839 27563 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:45.113183 22751 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:45.115054 27474 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:45.115708 23493 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:45.097295 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 300861us
W20260709 12:17:45.099815 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.104842 22823 raft_consensus.cc:2410] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:45.093417 27507 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.098644 27419 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:17:45.137750 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 152562us
I20260709 12:17:45.139112 23494 leader_election.cc:400] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15.
I20260709 12:17:45.139509 23494 leader_election.cc:403] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:45.107563 27563 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:45.128268 27361 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:45.133811 27293 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:45.137454 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:45.135428 27550 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.016s	sys 0.010s
I20260709 12:17:45.127302 27513 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:45.149658 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 256114us
I20260709 12:17:45.155269 22864 leader_election.cc:400] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10.
I20260709 12:17:45.133239 27524 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:45.142165 27417 consensus_meta.cc:287] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.003s
I20260709 12:17:45.164139 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:45.116462 27474 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:45.161363 22864 leader_election.cc:403] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:17:45.166410 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:45.140741 27507 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:45.171167 27578 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:45.180958 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:45.170903 27417 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:45.172000 27570 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.172498 27448 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15.
I20260709 12:17:45.172869 27524 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:45.165843 27361 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:45.154721 27505 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.004s
I20260709 12:17:45.147981 27419 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:45.151552 27563 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:45.190434 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:45.191949 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:45.201565 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:45.149701 27468 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:17:45.195032 27337 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:45.204154 27579 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10.
I20260709 12:17:45.204730 27466 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:45.212777 27419 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:45.215384 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:45.240970 22819 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:45.205600 23682 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:17:45.211233 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 72317us
I20260709 12:17:45.213910 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1175) took 1611 ms. Trace:
I20260709 12:17:45.221120 22827 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:45.242676 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:45.242534 22821 rpcz_store.cc:276] 0709 12:17:43.603105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.158190 (+555085us) service_pool.cc:224] Handling call
0709 12:17:44.950105 (+791915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:44.950771 (+   666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.213677 (+262906us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b54007a1550. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:45.213838 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820518656}
I20260709 12:17:45.225937 22892 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: [12.7-14.8]
W20260709 12:17:45.198163 27500 consensus_meta.cc:287] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.672s	user 0.013s	sys 0.001s
I20260709 12:17:45.227694 23685 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
W20260709 12:17:45.204746 27568 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:17:45.205520 27567 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:17:45.245422 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:45.180280 27513 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.195487 27512 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:45.219087 27482 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:45.218236 27566 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 12:17:45.250046 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:45.154503 26954 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:45.252242 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:45.253240 27476 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:45.214820 27507 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:45.198122 27469 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:45.215497 27578 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:45.274370 27578 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:45.276896 27534 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:17:45.260596 27579 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.199572 27570 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:45.281158 27529 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:45.253587 27500 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15.
I20260709 12:17:45.282747 27570 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:45.253399 27368 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:45.268977 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:45.248555 27484 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:17:45.266562 27448 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:17:45.254165 27293 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:45.279999 27579 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:45.283540 22825 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:45.269482 22744 raft_consensus.cc:2368] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15.
I20260709 12:17:45.213131 27505 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:45.259850 27535 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.272675 27524 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:45.244663 27337 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:45.289110 22819 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:45.298463 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:45.316013 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 51602us
I20260709 12:17:45.316471 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:45.317237 22749 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:45.318132 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:45.318233 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:45.320904 22749 raft_consensus.cc:2410] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:45.322212 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:45.287532 27368 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:45.287781 27570 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:45.323688 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 133519us
I20260709 12:17:45.331998 22826 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 12: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:45.334092 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:45.324729 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:45.287024 27448 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:45.287230 27469 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:45.259903 27513 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:45.328922 27579 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:45.331090 27417 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:45.342916 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:45.303292 27483 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:45.343626 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:45.345885 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:45.350035 27513 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:45.351356 27368 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:45.351819 27469 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:45.352150 27337 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:45.318904 27535 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:45.343631 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:45.359611 27505 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:45.331947 27476 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:45.344743 27570 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:45.326190 27492 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:45.346418 27250 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:45.414675 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:45.416482 27250 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:45.366384 27450 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:45.417230 27230 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:45.417959 22901 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:45.367399 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:45.345978 27293 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:45.368515 27417 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:17:45.370486 26948 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:45.371235 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:45.420616 26948 consensus_queue.cc:1243] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:17:45.371840 27589 log.cc:927] Time spent T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.065s	user 0.003s	sys 0.000s
I20260709 12:17:45.420687 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:45.421552 22894 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:45.371349 27448 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:45.424340 27419 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:45.432372 27419 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:45.372726 27541 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:17:45.347148 27468 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:17:45.374995 27325 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:17:45.401865 27535 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:45.405767 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 62198.7us
I20260709 12:17:45.425138 27476 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.372220 27574 raft_consensus.cc:2764] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:17:45.429625 27450 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:45.288115 27361 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:45.372465 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:45.439456 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:45.450312 22894 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:17:45.454658 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 82258us
I20260709 12:17:45.461583 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:45.463560 22825 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 7. (term mismatch)
I20260709 12:17:45.464058 22825 pending_rounds.cc:85] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 6
I20260709 12:17:45.464279 22825 pending_rounds.cc:107] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:17:45.464500 22825 raft_consensus.cc:2889] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:45.458935 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:45.464805 22825 pending_rounds.cc:107] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:17:45.465080 22825 raft_consensus.cc:2889] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:45.465263 22825 pending_rounds.cc:107] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:17:45.465440 22825 raft_consensus.cc:2889] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:45.471467 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:45.472500 22827 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:45.475201 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:45.475482 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:45.476496 22819 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:45.465957 26954 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:45.491228 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.492183 27580 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:45.493691 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:45.494668 22822 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:45.495558 27541 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:45.495443 27523 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:45.497045 27523 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:45.497136 27570 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:45.498660 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:45.499992 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:45.507037 27450 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:45.495620 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:45.511854 22822 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:17:45.488502 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:45.446574 27476 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:45.449431 27289 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:17:45.579707 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.592918 22822 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
W20260709 12:17:45.582494 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 94109.1us
I20260709 12:17:45.582319 27539 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:45.598435 23494 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:45.608505 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:45.612413 27539 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:45.613648 22822 raft_consensus.cc:1217] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[11.7-15.9]   Dedup: 11.7->[14.8-15.9]
I20260709 12:17:45.613402 22827 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:45.614274 22822 pending_rounds.cc:85] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 7
I20260709 12:17:45.614712 22822 pending_rounds.cc:107] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:17:45.615048 22822 raft_consensus.cc:2889] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:45.619952 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 174538us
I20260709 12:17:45.624020 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:45.605095 27492 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:45.520556 27471 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:45.608939 27448 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:45.627281 22748 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:45.630390 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:45.605660 27574 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:17:45.667065 27468 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:17:45.672083 27594 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:45.667128 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:45.673774 22898 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 13. Current term is 14. Ops: []
W20260709 12:17:45.673637 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.677186 22827 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:45.625972 27538 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:45.679651 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:45.682440 22827 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:45.685165 22827 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:17:45.623601 27563 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:45.680154 27595 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.241s	user 0.001s	sys 0.008s
I20260709 12:17:45.693498 22827 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:45.629647 27492 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:45.714116 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.634691 27580 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:17:45.715071 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:45.757980 23689 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:45.719738 27563 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:45.759678 26494 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:45.760193 26494 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:45.761210 26494 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:45.762420 26494 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:45.721020 27471 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:45.764570 27463 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:45.685014 27541 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:17:45.722347 22750 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
W20260709 12:17:45.722543 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:45.723554 27597 log.cc:927] Time spent T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:17:45.719769 27492 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:45.724061 27593 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:17:45.725212 27600 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:17:45.726258 27598 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:17:45.728708 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:45.729777 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:45.687506 27538 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:45.735597 27419 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:45.685128 27448 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:45.797084 23660 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:45.804122 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:45.806710 23656 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:45.810681 23682 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:45.810456 27580 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:45.812312 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:45.814157 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:45.818054 27465 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:45.820865 27514 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:45.821359 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:45.821558 27514 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:45.824542 27514 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:45.827883 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:45.829984 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:45.832605 27250 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:45.833606 22819 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:45.833454 27250 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:45.835053 27514 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:45.836519 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:45.838287 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:45.839087 27417 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:45.839834 27471 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:45.846560 22823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1172) took 2295 ms (client timeout 2795 ms). Trace:
W20260709 12:17:45.847115 22823 rpcz_store.cc:269] 0709 12:17:43.551064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.858638 (+307574us) service_pool.cc:224] Handling call
0709 12:17:45.846309 (+1987671us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54005d9154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:45.846493 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2660634368}
I20260709 12:17:45.847605 27567 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:45.848186 27567 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:45.848505 22820 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:17:45.848919 22820 pending_rounds.cc:85] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 6
I20260709 12:17:45.849153 22820 pending_rounds.cc:107] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:17:45.849699 22820 raft_consensus.cc:2889] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:45.849128 27567 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:45.910737 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 106722us
I20260709 12:17:45.927677 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1184) took 1607 ms. Trace:
I20260709 12:17:45.927891 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:45.929376 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1110) took 1980 ms. Trace:
I20260709 12:17:45.930019 22896 rpcz_store.cc:276] 0709 12:17:43.949045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.949440 (+   395us) service_pool.cc:224] Handling call
0709 12:17:45.853747 (+1904307us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b540057f154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:45.929290 (+ 75543us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199920384}
I20260709 12:17:45.932871 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:45.936008 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1070) took 1137 ms. Trace:
I20260709 12:17:45.936915 23685 rpcz_store.cc:276] 0709 12:17:44.798999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.799104 (+   105us) service_pool.cc:224] Handling call
0709 12:17:44.799375 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:45.247964 (+448589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.862196 (+614232us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540073b754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:45.935918 (+ 73722us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984536832}
I20260709 12:17:45.939618 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:45.932204 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:45.947212 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:45.928548 22826 rpcz_store.cc:276] 0709 12:17:44.320546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.381844 (+ 61298us) service_pool.cc:224] Handling call
0709 12:17:45.862918 (+1481074us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54007a2e54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:45.927612 (+ 64694us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077162368}
I20260709 12:17:45.957904 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:45.951715 22790 leader_election.cc:400] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15.
I20260709 12:17:45.965670 22790 leader_election.cc:403] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:45.967581 22893 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:45.800629 26954 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:45.955533 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:45.982395 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:45.803041 27600 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:45.949167 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:45.966953 22864 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:45.997892 22751 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:45.979241 22897 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
W20260709 12:17:45.947613 27230 consensus_meta.cc:287] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.530s	user 0.013s	sys 0.005s
I20260709 12:17:46.002269 22895 raft_consensus.cc:2410] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:17:46.015403 22825 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 12:17:45.973569 27450 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:46.017094 22825 pending_rounds.cc:85] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 6
I20260709 12:17:46.026150 22825 pending_rounds.cc:107] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:17:46.026567 22825 raft_consensus.cc:2889] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:46.027040 22825 pending_rounds.cc:107] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:17:46.027325 22825 raft_consensus.cc:2889] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:45.973536 27474 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:17:46.035356 22898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1112) took 1189 ms. Trace:
I20260709 12:17:46.036140 22898 rpcz_store.cc:276] 0709 12:17:44.846484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.946419 (+ 99935us) service_pool.cc:224] Handling call
0709 12:17:44.946719 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:45.676133 (+729414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.034962 (+358829us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54003593d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:46.035260 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671440256}
I20260709 12:17:45.950302 27514 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:17:45.999871 27568 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:17:46.024565 22893 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:45.950405 27567 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:45.800895 27448 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:45.981739 27195 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15.
I20260709 12:17:46.007189 26948 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:17:45.947346 27541 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:46.017325 27361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.027s	sys 0.071s
I20260709 12:17:46.017354 27494 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:17:46.055962 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:46.067339 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:46.013139 27523 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:46.058549 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:46.016507 27476 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:46.067894 22896 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:46.070431 22893 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:17:46.073787 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:46.064499 27361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.027s	sys 0.071s
I20260709 12:17:46.065896 27557 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.078176 27494 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:46.059554 27492 raft_consensus.cc:2764] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:17:46.035552 27469 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:17:46.086117 27250 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:46.087596 22893 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:17:46.100668 22893 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:17:46.081166 27610 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.070132 27523 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.107802 22894 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:17:46.069227 27541 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:46.092177 22896 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:46.085330 27494 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:46.094380 27230 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:46.103185 27394 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.123142 22894 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:17:46.106000 27485 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.133319 22896 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:46.131294 27448 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:46.116779 27523 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:46.096050 27557 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:46.117973 27538 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:46.116668 27610 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:46.152318 27610 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:46.134829 27394 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:46.155472 27609 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:46.155619 27394 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:46.138393 27485 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:46.133700 27230 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:46.159358 27494 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:46.161065 27494 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:46.162062 27230 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:46.079222 27600 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:46.136719 27561 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:46.145646 27368 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:17:46.180671 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 233533us
W20260709 12:17:46.178701 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 180376us
I20260709 12:17:46.190591 22865 leader_election.cc:400] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18.
I20260709 12:17:46.200881 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:46.165246 27468 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:46.176152 27230 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.228132 22865 leader_election.cc:400] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 9 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10.
I20260709 12:17:46.200017 27485 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:46.236783 27461 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:46.236968 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:46.237569 27461 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:46.238623 27461 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:46.215122 27345 consensus_queue.cc:1059] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:17:46.243633 27345 raft_consensus.cc:3055] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:46.245355 27345 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:17:46.245579 27612 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:17:46.246222 27345 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:46.235488 27230 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:46.247704 27345 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:46.249106 27230 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:46.251894 27557 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:46.265488 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:46.270318 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 323086us
I20260709 12:17:46.199656 27561 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:46.284199 23695 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:17:46.285987 22821 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:17:46.289405 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:46.290333 22821 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:46.298998 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:46.300721 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.302825 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:46.305231 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:46.300082 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 183854us
I20260709 12:17:46.308043 22746 raft_consensus.cc:2393] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:46.308559 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:46.309530 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.310091 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:46.320255 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:46.332518 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:46.333455 23656 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:17:46.337682 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.339684 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:46.340866 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.340766 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:46.341253 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.332993 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.350770 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.353926 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:46.356438 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.360179 22751 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:46.308087 27616 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.370007 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:46.370718 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.264511 27523 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:46.299361 27260 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:17:46.380614 22745 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:46.388058 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:46.393627 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:46.395637 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:46.396411 22896 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:46.397490 22819 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:46.398754 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.399530 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:46.353163 27394 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:17:46.406620 22894 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:17:46.410979 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.391901 27485 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.362936 26948 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:17:46.387913 27541 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:46.424875 22717 leader_election.cc:400] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:17:46.417848 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:46.411949 23659 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:46.430328 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:46.426134 22894 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:17:46.435557 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:46.436527 22896 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:17:46.439051 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:46.440930 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.389350 27494 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:17:46.443948 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.447382 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.449297 23689 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:46.394410 26954 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:17:46.458110 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:46.459595 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:46.420792 27492 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:46.464495 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:46.424070 26948 consensus_queue.cc:1243] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:46.468279 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:46.431031 27610 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:46.445181 27513 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:46.472590 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:46.664477 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.477692 27513 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:46.722684 27513 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:46.729363 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 256850us
I20260709 12:17:46.552119 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:46.503032 27538 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:17:46.549255 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.733028 23659 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:17:46.445617 27615 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:17:46.388324 27616 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:46.504038 27623 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.474190 27260 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:46.550591 27620 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.470933 27492 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:46.447310 27578 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:46.572080 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1186) took 2231 ms. Trace:
I20260709 12:17:46.432705 27485 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:46.693220 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 233663us
I20260709 12:17:46.677311 27523 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:46.694502 22818 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1189) took 1879 ms (client timeout 1882 ms). Trace:
W20260709 12:17:46.695556 23679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 1080) took 1530 ms (client timeout 1757 ms). Trace:
I20260709 12:17:46.701675 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:46.776859 23679 rpcz_store.cc:269] 0709 12:17:45.165368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.166106 (+   738us) service_pool.cc:224] Handling call
0709 12:17:46.553391 (+1387285us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54001ffed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:46.695452 (+142061us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114452736}
W20260709 12:17:46.777385 22749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1264) took 1354 ms (client timeout 1560 ms). Trace:
I20260709 12:17:46.698418 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:46.712615 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:46.685591 27567 consensus_meta.cc:287] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.622s	user 0.014s	sys 0.001s
I20260709 12:17:46.748020 22820 rpcz_store.cc:276] 0709 12:17:44.327252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.413806 (+ 86554us) service_pool.cc:224] Handling call
0709 12:17:45.848128 (+1434322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:45.850413 (+  2285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.558437 (+708024us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54005d9150. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:46.558661 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3297533696}
W20260709 12:17:46.777812 22749 rpcz_store.cc:269] 0709 12:17:45.423463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.423653 (+   190us) service_pool.cc:224] Handling call
0709 12:17:46.701453 (+1277800us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:17:46.777311 (+ 75858us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15985536}
W20260709 12:17:46.776041 22818 rpcz_store.cc:269] 0709 12:17:44.814671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.842101 (+ 27430us) service_pool.cc:224] Handling call
0709 12:17:46.556530 (+1714429us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400301954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:46.694434 (+137904us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867421056}
I20260709 12:17:46.728880 27610 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:46.733055 27538 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:46.800221 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 102008us
I20260709 12:17:46.801244 22818 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:46.804229 27610 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:46.807126 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:46.808971 22818 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:46.809311 22819 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:17:46.810703 22818 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:17:46.812397 22818 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:46.812955 27567 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:46.813535 27567 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:46.813743 22818 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:17:46.816877 27463 consensus_meta.cc:287] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.052s	user 0.014s	sys 0.008s
I20260709 12:17:46.817255 27469 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:46.818553 22892 raft_consensus.cc:2410] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:46.820736 27485 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:46.797739 27563 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:46.795277 27345 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.547s	user 0.013s	sys 0.008s
I20260709 12:17:46.807250 27523 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:46.822921 27563 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:46.810864 27492 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:46.825321 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:46.798293 27634 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.065s	user 0.003s	sys 0.000s
I20260709 12:17:46.826472 27563 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:46.827224 27563 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:46.828167 22898 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:17:46.828591 27596 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 1.154s	user 0.004s	sys 0.000s
I20260709 12:17:46.828696 27610 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:46.830219 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1078) took 1668 ms. Trace:
I20260709 12:17:46.831244 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:46.832126 27631 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:17:46.830623 23672 rpcz_store.cc:276] 0709 12:17:45.161547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.161741 (+   194us) service_pool.cc:224] Handling call
0709 12:17:45.162057 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.162323 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:45.162349 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.185679 (+ 23330us) log.cc:844] Serialized 26 byte log entry
0709 12:17:45.452758 (+267079us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:45.452803 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.452914 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:46.827920 (+1375006us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:46.829904 (+  1984us) raft_consensus.cc:1685] finished
0709 12:17:46.829926 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:46.830158 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4366592,"thread_start_us":205752,"threads_started":1,"wal-append.queue_time_us":410777}
I20260709 12:17:46.814613 27567 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:46.837651 22822 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:46.838020 27567 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:46.839419 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:46.840988 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:46.842859 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:46.843551 22894 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:46.844030 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 795) took 1375 ms. Trace:
I20260709 12:17:46.844465 22825 rpcz_store.cc:276] 0709 12:17:45.468531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.502457 (+ 33926us) service_pool.cc:224] Handling call
0709 12:17:45.502745 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:46.028227 (+525482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.843777 (+815550us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b5400300f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:46.843973 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177813888}
I20260709 12:17:46.847939 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:46.848436 27616 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:46.861658 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.864848 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:46.851516 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.743005 27260 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:46.788452 27626 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:17:46.890884 23685 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:46.916258 22897 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:46.795991 27538 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:46.815083 27644 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:17:46.795634 27570 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:17:46.922116 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 57430.4us
I20260709 12:17:46.921332 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:46.928285 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:46.898274 27485 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.940049 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:46.941812 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:46.892556 27616 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:46.935739 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 240779us
I20260709 12:17:46.904786 27260 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:46.778151 27620 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:46.926860 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 195649us
I20260709 12:17:46.911134 27250 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.918088 27492 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:17:46.950475 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1536) took 2139 ms. Trace:
I20260709 12:17:46.918387 27461 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:46.917586 27523 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:46.922511 27463 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.753468 27623 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:46.955265 22901 rpcz_store.cc:276] 0709 12:17:44.811107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.878041 (+ 66934us) service_pool.cc:224] Handling call
0709 12:17:44.887816 (+  9775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:45.418476 (+530660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.950203 (+1531727us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b540082c8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:46.950413 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218624768}
I20260709 12:17:46.938169 27535 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:46.962044 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:46.971789 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.977212 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 943) took 1368 ms. Trace:
I20260709 12:17:46.951794 27570 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.987739 27535 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:46.988054 27570 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:46.960981 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:46.990345 22825 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:46.978998 22894 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:46.992622 22901 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:17:46.993166 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.979636 22893 rpcz_store.cc:276] 0709 12:17:45.609771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.101353 (+491582us) service_pool.cc:224] Handling call
0709 12:17:46.101627 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:46.101952 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:46.101977 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:46.107288 (+  5311us) log.cc:844] Serialized 26 byte log entry
0709 12:17:46.394404 (+287116us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:46.394470 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.394544 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:46.976950 (+582406us) raft_consensus.cc:1685] finished
0709 12:17:46.976972 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:46.977145 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":1817,"thread_start_us":259986,"threads_started":1,"wal-append.queue_time_us":354927}
I20260709 12:17:46.965337 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:46.983639 27361 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.987130 27325 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:46.957166 27345 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:46.963266 27514 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:47.018976 22820 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:47.020906 27325 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:46.951244 27485 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:47.042553 22825 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:46.957381 27250 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:47.068956 27485 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:47.070477 27620 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.075676 22745 raft_consensus.cc:1217] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[12.7-16.9]   Dedup: 12.7->[14.8-16.9]
I20260709 12:17:46.969259 27523 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:46.974936 27463 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:46.964250 27461 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:47.084338 22745 pending_rounds.cc:85] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 7
I20260709 12:17:47.094807 22745 pending_rounds.cc:107] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:17:47.095151 22745 raft_consensus.cc:2889] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:47.097688 22747 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:47.050849 26892 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.033427 27417 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:17:47.041551 27293 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 12:17:47.121325 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.033910 27541 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:17:47.027567 27361 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:47.076285 27513 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:47.135017 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 343564us
I20260709 12:17:47.130558 27417 consensus_queue.cc:1243] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:17:47.138864 22864 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.143661 27579 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:47.143923 27570 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:47.144726 27523 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.097790 27620 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:17:47.146999 27250 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.107296 27535 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.124977 26892 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:47.159654 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:47.165915 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 132680us
I20260709 12:17:47.172566 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:47.173574 23672 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 15: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:47.152562 27461 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.137251 27485 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:47.154825 27463 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.156296 26892 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:47.158309 27361 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:47.194564 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 252839us
I20260709 12:17:47.196187 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:47.177774 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.191584 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:47.167171 27535 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:17:47.167326 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 90700.6us
I20260709 12:17:47.200069 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:47.201331 23674 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:47.203543 23695 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:17:47.206318 22717 leader_election.cc:336] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.659s (SENT)
I20260709 12:17:47.209774 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.212891 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.165282 27642 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:17:47.222303 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:47.261266 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:47.263545 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 95868us
I20260709 12:17:47.262926 27325 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:47.265226 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.208343 27615 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:47.216857 26892 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:17:47.260435 27613 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:17:47.198969 27485 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:47.215160 27649 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:47.275135 23494 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.258610 27535 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.220237 27463 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:47.275797 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:47.237344 27650 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:47.263100 27523 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:47.280409 27600 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:47.295356 27600 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.295760 27600 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:47.274714 27325 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:47.296625 27325 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:47.297138 23656 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:17:47.263408 27361 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:17:47.263535 27667 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:17:47.298491 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:47.304903 27621 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.914s	user 0.000s	sys 0.001s
W20260709 12:17:47.301014 27591 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.995s	user 0.004s	sys 0.005s
W20260709 12:17:47.305624 27648 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:17:47.305234 27667 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:47.262883 27647 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:17:47.308887 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1190) took 1073 ms. Trace:
W20260709 12:17:47.329481 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 52779.7us
I20260709 12:17:47.329854 22822 rpcz_store.cc:276] 0709 12:17:46.235257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.235451 (+   194us) service_pool.cc:224] Handling call
0709 12:17:47.308699 (+1073248us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54007a3354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:47.308823 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264822528}
I20260709 12:17:47.331362 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.332403 22822 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:47.310933 22825 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:47.335958 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.337653 22897 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:47.315382 27663 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:47.308005 27535 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:47.310212 27625 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:17:47.319964 23659 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:47.371129 23659 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:47.325359 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.371500 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.372116 22819 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:47.373483 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.372150 22752 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
W20260709 12:17:47.328347 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 53282.1us
I20260709 12:17:47.308167 27523 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:47.316260 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1503) took 1521 ms. Trace:
I20260709 12:17:47.319703 27513 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:47.314388 27615 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:47.340131 27463 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:47.337801 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:47.320904 27667 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:47.361109 27654 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:47.310755 27649 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:47.341311 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:47.319183 27666 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:47.338136 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:47.298741 27325 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:47.323828 27604 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 1.567s	user 0.003s	sys 0.000s
I20260709 12:17:47.394552 27463 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:47.417157 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1123) took 2174 ms. Trace:
I20260709 12:17:47.340901 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.417642 22900 rpcz_store.cc:276] 0709 12:17:45.242325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.442594 (+200269us) service_pool.cc:224] Handling call
0709 12:17:45.450045 (+  7451us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:45.450546 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.450581 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:45.463711 (+ 13130us) log.cc:844] Serialized 52 byte log entry
0709 12:17:45.611953 (+148242us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:45.612004 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.612079 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.323060 (+1710981us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:47.416711 (+ 93651us) raft_consensus.cc:1685] finished
0709 12:17:47.416741 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.417077 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":13666,"spinlock_wait_cycles":17848064,"thread_start_us":118040,"threads_started":1,"wal-append.queue_time_us":215794}
I20260709 12:17:47.419430 27522 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:17:47.419610 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 78821us
I20260709 12:17:47.368870 27535 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:47.370292 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.420728 22744 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:47.421054 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.421782 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.422292 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:47.443678 22895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1524) took 2659 ms (client timeout 1659 ms). Trace:
I20260709 12:17:47.379451 22827 rpcz_store.cc:276] 0709 12:17:45.795025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.805728 (+ 10703us) service_pool.cc:224] Handling call
0709 12:17:45.807183 (+  1455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.957396 (+150213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.957433 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.957954 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:17:46.176895 (+218941us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:46.176964 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.177073 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.304186 (+1127113us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:47.315921 (+ 11735us) raft_consensus.cc:1685] finished
0709 12:17:47.315961 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.316189 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148855,"raft.queue_time_us":149692,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":14645,"spinlock_wait_cycles":4030720,"thread_start_us":165417,"threads_started":1,"wal-append.queue_time_us":349360}
I20260709 12:17:47.382864 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.377851 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:47.464066 22819 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:17:47.464247 22748 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:47.384435 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.386466 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:47.326443 27403 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:47.466462 22819 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:17:47.466938 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 80572us
I20260709 12:17:47.378053 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:47.294414 27541 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
W20260709 12:17:47.468058 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 90125.3us
W20260709 12:17:47.411093 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.468572 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.328758 27600 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:47.465754 22895 rpcz_store.cc:269] 0709 12:17:44.784234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.784716 (+   482us) service_pool.cc:224] Handling call
0709 12:17:47.439816 (+2655100us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540072fe54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:47.443572 (+  3756us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2774802304}
I20260709 12:17:47.471685 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.376511 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:47.474865 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.027s	sys 0.019s
W20260709 12:17:47.475270 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.027s	sys 0.019s
I20260709 12:17:47.422477 22744 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:47.376945 27664 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:17:47.439694 27535 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:47.380111 22894 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
W20260709 12:17:47.443010 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.445677 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1101) took 2189 ms. Trace:
I20260709 12:17:47.381351 27523 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:47.305677 27538 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:47.315033 27623 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:47.370580 27650 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:17:47.324316 27260 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:47.462496 27522 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:47.431172 27666 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:17:47.438964 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 97750.8us
I20260709 12:17:47.496399 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:47.437114 27654 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:47.424723 27615 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:47.429759 27667 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.445012 27649 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:47.395475 27513 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.309871 27485 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:47.482537 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:47.485235 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.418471 27463 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.487521 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:47.486827 22753 rpcz_store.cc:276] 0709 12:17:45.256432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.264341 (+  7909us) service_pool.cc:224] Handling call
0709 12:17:45.264703 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.265070 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.265099 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.270186 (+  5087us) log.cc:844] Serialized 26 byte log entry
0709 12:17:46.117407 (+847221us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800180a60. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:17:46.284502 (+167095us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:46.284540 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.284600 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.445246 (+1160646us) raft_consensus.cc:1685] finished
0709 12:17:47.445280 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.445571 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8733,"raft.queue_time_us":124,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3698,"spinlock_wait_cycles":23995648,"thread_start_us":166906,"threads_started":1,"wal-append.queue_time_us":1882707}
I20260709 12:17:47.472839 26948 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:47.466656 27403 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:47.499884 27345 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:47.483771 27541 consensus_queue.cc:1243] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:17:47.479967 27500 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.479314 26892 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:47.484352 26954 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:47.510732 22821 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:17:47.514256 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.503602 27610 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:47.513974 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.518038 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.499948 27666 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:47.541131 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.504333 27522 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:47.504010 27669 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:17:47.513036 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.519212 27485 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:47.548956 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:47.501945 27668 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:17:47.514098 27250 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:47.504341 27469 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:17:47.551927 27326 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:17:47.543838 26892 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.560442 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.510423 27513 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:47.551074 27567 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:47.518033 27535 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:17:47.560418 26948 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:47.559338 27260 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:47.557639 27522 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:47.574874 27670 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:47.545547 27500 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:47.558156 27538 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:47.556305 27250 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.571024 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.555328 27676 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:17:47.567535 26892 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:47.567330 26954 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 12:17:47.609886 27673 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:17:47.604169 27676 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:47.598814 27567 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:47.604941 27600 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:47.564429 27403 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:47.611429 27567 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:47.587455 27463 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:47.560190 27570 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 12:17:47.624943 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 54023.8us
I20260709 12:17:47.610586 27676 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:47.617708 26948 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:47.634644 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:47.638487 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:47.615743 27250 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:47.642997 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:47.650651 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:47.652182 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:47.652956 22894 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:47.634748 27567 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:47.652555 27570 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:47.650553 27394 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:47.639894 27681 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:47.672626 27570 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.669821 27654 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:47.683432 27468 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:47.684072 27468 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:47.686250 26892 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:47.688014 27513 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:47.689566 27485 raft_consensus.cc:3055] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:47.690100 27485 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:47.647797 27538 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:17:47.691135 27538 consensus_queue.cc:1243] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:47.691139 27485 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:47.692809 27650 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.693111 27485 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:47.693449 27650 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:47.643808 27463 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:47.698834 27463 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:47.699612 26948 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:47.701110 27570 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:17:47.703476 27677 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:17:47.651356 27683 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:17:47.712262 22748 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:47.673421 27394 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.711716 27683 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:47.714939 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.718822 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:47.721889 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.723068 22748 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 12: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:47.689607 26892 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.715329 27394 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:47.716351 27500 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:47.715535 27683 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:17:47.744814 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 94261.7us
I20260709 12:17:47.763049 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1270) took 1351 ms. Trace:
I20260709 12:17:47.763522 22751 rpcz_store.cc:276] 0709 12:17:46.411790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.411989 (+   199us) service_pool.cc:224] Handling call
0709 12:17:46.412488 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:46.412777 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:46.431532 (+ 18755us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.704110 (+1272578us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b18003a0e40. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:17:47.761197 (+ 57087us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:47.761255 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:47.762622 (+  1367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.762699 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.762986 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18562,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":3206,"raft.queue_time_us":107,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":2133,"spinlock_wait_cycles":6422784,"thread_start_us":56842,"threads_started":1}
I20260709 12:17:47.768385 27523 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:47.769884 22898 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:17:47.769675 27570 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:47.773216 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:47.774526 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.774941 27417 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.775490 27417 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:47.775476 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:47.777804 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.778074 27463 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:47.778818 27345 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:47.779289 27345 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.779606 27345 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:47.779950 27681 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.780507 27681 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:47.781243 27463 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:47.782217 27463 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:47.783468 27650 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:47.784029 27650 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:47.787576 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 802) took 1454 ms. Trace:
I20260709 12:17:47.788069 22820 rpcz_store.cc:276] 0709 12:17:46.332678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.783514 (+450836us) service_pool.cc:224] Handling call
0709 12:17:46.800598 (+ 17084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:47.031370 (+230772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.787295 (+755925us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54007a1054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:47.787501 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501653248}
I20260709 12:17:47.789059 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.790915 27325 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.791579 27687 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:17:47.792024 27638 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.795s	user 0.000s	sys 0.004s
I20260709 12:17:47.795147 27668 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:47.795801 27668 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:47.798681 27345 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:47.801420 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:47.766610 27567 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:47.807510 27561 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.809288 27570 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:47.778662 27661 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.516s	user 0.000s	sys 0.003s
I20260709 12:17:47.815708 22746 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:47.817433 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:47.830636 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.832044 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.833244 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.834378 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.835222 22748 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:47.835434 22746 raft_consensus.cc:2410] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 12:17:47.801625 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 50177.6us
I20260709 12:17:47.818289 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:47.818569 22818 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:47.836817 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:47.818459 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.820274 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.820374 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.813757 27468 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:47.827878 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:47.837288 22820 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:47.843118 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:47.814867 27417 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.815016 27681 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.843847 22898 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:47.844213 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:47.798285 27668 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.846092 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:47.846277 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:47.840912 23679 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:47.829298 27685 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.856531 23685 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:47.791601 27325 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:47.836089 27670 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:17:47.829432 27647 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:47.880074 27647 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:47.881949 27345 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:47.859081 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:47.883989 22898 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:47.864470 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:47.885121 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:47.866027 22748 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:17:47.869324 27688 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:47.851011 27483 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:17:47.875945 27664 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:47.876971 27325 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:47.878448 22892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1122) took 2653 ms (client timeout 1867 ms). Trace:
I20260709 12:17:47.882375 27647 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:47.810525 27666 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:47.885430 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:47.897042 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:47.928396 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:47.891127 22820 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:47.907812 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:47.910382 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:47.914023 27642 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:47.849208 27523 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:47.892030 22745 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:47.919101 22826 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:47.918992 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.935075 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.917856 22865 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.919751 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:47.916992 22892 rpcz_store.cc:269] 0709 12:17:45.224843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.245079 (+ 20236us) service_pool.cc:224] Handling call
0709 12:17:47.878221 (+2633142us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54004ed754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:47.878368 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3595293056}
I20260709 12:17:47.924759 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:47.930058 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:47.939136 22823 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:47.940697 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.941349 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.943845 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.893769 27688 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.949563 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:47.950336 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 86548.2us
I20260709 12:17:47.938741 27485 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:47.957252 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:47.958081 22820 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
W20260709 12:17:47.954470 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 100124us
I20260709 12:17:47.955312 22819 raft_consensus.cc:2410] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:17:47.908954 27664 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:47.959738 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:47.923537 27195 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.923235 27500 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:47.989621 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:47.994118 22898 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:47.998055 22894 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 17: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:48.001787 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:48.004287 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:48.005179 23685 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:47.953370 27687 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:47.957540 27682 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:47.958762 27688 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:48.012003 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.923837 27250 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:48.017642 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.975986 26954 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:47.975175 27485 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.015587 22898 pending_rounds.cc:85] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 6
I20260709 12:17:48.018585 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:48.013110 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:48.026685 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:47.924217 27463 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:17:47.883176 27685 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:48.030478 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:48.036516 27403 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:48.087705 23685 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:48.092722 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:48.003818 27417 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:48.083290 22748 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:48.086225 23660 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 10.
I20260709 12:17:48.083985 22898 pending_rounds.cc:107] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 10.7
W20260709 12:17:48.084388 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 66861.8us
I20260709 12:17:47.948313 27642 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:47.997011 27500 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:48.099361 22898 raft_consensus.cc:2889] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:48.111865 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:47.999385 27541 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:17:48.100234 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:47.994956 27195 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:48.104332 27691 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:17:48.104628 27468 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:48.020954 27682 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:48.036598 27250 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:48.042563 26948 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:17:48.028220 27570 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:48.106381 27417 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:48.109812 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:48.082432 27485 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:48.115901 22826 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
W20260709 12:17:48.122494 27698 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:17:48.013499 27394 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:48.085726 27483 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.090611 27325 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:47.999650 27676 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:48.167104 22822 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20. Ops: [17.9-19.10]
I20260709 12:17:48.168041 27642 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:48.112833 27610 consensus_meta.cc:287] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.000s
I20260709 12:17:48.125236 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:48.169023 27610 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:48.027469 27522 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:48.153160 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:48.081521 26954 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:48.158923 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:48.124279 27670 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:48.168174 27676 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:48.150595 22827 raft_consensus.cc:2410] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 12:17:48.152201 27690 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.298s	user 0.000s	sys 0.002s
I20260709 12:17:48.126715 27682 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:17:48.233275 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 74482.3us
I20260709 12:17:48.241076 22749 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:48.107524 27683 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:48.164530 27541 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:48.087972 27664 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:48.227505 27522 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.168005 27567 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:48.232396 27670 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.169234 27685 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:48.169780 27483 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:48.273113 22823 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 12:17:48.277889 27694 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:17:48.280941 27666 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:48.282064 27666 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:17:48.283764 27697 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:17:48.258460 27522 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:48.270175 27670 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:48.273694 27664 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:48.255812 27541 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:48.307335 22749 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
W20260709 12:17:48.306493 27702 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:17:48.328192 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:48.331478 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:48.323477 27701 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:17:48.338587 22899 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:48.308375 27666 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:17:48.328308 27361 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:48.331512 27195 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:48.338145 27500 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:48.372426 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.355756 27669 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:17:48.377290 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 128597us
I20260709 12:17:48.344940 27711 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.382040 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:48.384578 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 370239us
I20260709 12:17:48.348217 27541 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:48.390703 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:48.391018 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:48.376160 27706 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:17:48.393386 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:48.388028 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:48.363085 27394 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:48.362968 26954 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:48.415526 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:48.379557 27666 consensus_queue.cc:1243] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:17:48.358672 27668 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:17:48.387337 27669 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:48.400187 26892 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:48.445925 22895 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:48.473629 22748 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:48.366173 27522 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:48.443547 27713 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.479938 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:48.485524 27713 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:48.486497 27719 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:48.486994 27719 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.487334 27719 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:48.488230 27713 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:48.470028 27708 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:48.393752 27711 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:48.446832 27495 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:48.516201 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:48.517426 22748 raft_consensus.cc:2410] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:17:48.476935 27689 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:48.497236 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:48.532641 22750 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:48.529599 22864 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:48.538280 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 137405us
I20260709 12:17:48.495864 27403 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:48.544507 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:48.543246 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:48.549530 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:48.551373 22748 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:48.536737 27689 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:48.542585 27461 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:17:48.566747 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 233131us
I20260709 12:17:48.522253 27495 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:48.570322 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:48.541195 27714 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:17:48.588429 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:48.588474 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:48.591234 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:48.591964 23679 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:48.592947 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:48.593614 23660 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:48.594508 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:48.595167 22751 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:48.595927 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:48.596817 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:48.597628 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:48.598196 22748 raft_consensus.cc:2393] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:48.555074 27403 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:48.537968 27669 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:48.619944 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.624851 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:48.620102 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:48.621743 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:48.623175 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:48.621657 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:48.626191 23679 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:48.584607 27643 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:48.629782 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:48.630492 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:48.620652 27688 consensus_meta.cc:287] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.574s	user 0.013s	sys 0.000s
I20260709 12:17:48.621186 27394 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:48.644634 22899 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:48.638991 27461 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:48.651911 27461 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:48.652926 27461 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:48.636629 27494 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:48.653991 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:48.654152 27494 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.654296 27461 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:48.655731 27557 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:48.656070 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:48.657075 27328 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:48.657567 27328 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.657701 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 959) took 1011 ms. Trace:
I20260709 12:17:48.658025 27328 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:48.637528 27689 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:48.658241 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:48.660995 27557 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:48.663151 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:48.666518 22750 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:48.658205 22896 rpcz_store.cc:276] 0709 12:17:47.646040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.646186 (+   146us) service_pool.cc:224] Handling call
0709 12:17:47.651813 (+  5627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:47.652167 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:47.652195 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:48.359258 (+707063us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b2c001e6a18. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:17:48.359842 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 12:17:48.526054 (+166212us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:48.526116 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.526209 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.657388 (+131179us) raft_consensus.cc:1685] finished
0709 12:17:48.657409 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.657636 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5095,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":4089,"spinlock_wait_cycles":10216192,"thread_start_us":165820,"threads_started":1,"wal-append.queue_time_us":260246}
I20260709 12:17:48.678253 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:48.637243 27728 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:48.692581 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.695395 27676 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:17:48.695828 27730 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:17:48.696388 27676 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:48.697014 27676 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:48.698026 27722 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:17:48.702000 27710 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.256s	user 0.001s	sys 0.001s
I20260709 12:17:48.702409 27676 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:48.701725 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:48.704174 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1049) took 1532 ms. Trace:
I20260709 12:17:48.704742 23689 rpcz_store.cc:276] 0709 12:17:47.171655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.171790 (+   135us) service_pool.cc:224] Handling call
0709 12:17:47.191113 (+ 19323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:47.259780 (+ 68667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:47.259823 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:47.266414 (+  6591us) log.cc:844] Serialized 26 byte log entry
0709 12:17:48.085042 (+818628us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b18003a1080. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:17:48.325705 (+240663us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:48.325742 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.325828 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.701282 (+375454us) spinlock_profiling.cc:243] Waited 97.7 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:48.703853 (+  2571us) raft_consensus.cc:1685] finished
0709 12:17:48.703885 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.704099 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69170,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":22142,"spinlock_wait_cycles":257589248,"thread_start_us":300297,"threads_started":2,"wal-append.queue_time_us":1086389}
I20260709 12:17:48.706900 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:48.665391 27669 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:48.666457 27494 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:48.716514 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:48.682013 27500 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:48.692376 27557 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:48.762063 27557 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:48.764878 27557 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:48.765681 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:48.766379 22748 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:48.680512 27195 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:48.767292 27195 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:48.691828 26948 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:48.641378 27688 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:48.760659 27403 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:48.666167 27394 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:48.718255 27655 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:17:48.841041 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:48.844843 27522 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:48.847148 27688 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:48.858755 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:48.879896 22750 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:17:48.839689 27195 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:48.889925 22750 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
W20260709 12:17:48.861196 27726 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:17:48.936182 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 957) took 1291 ms. Trace:
I20260709 12:17:48.936630 22900 rpcz_store.cc:276] 0709 12:17:47.645292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.645439 (+   147us) service_pool.cc:224] Handling call
0709 12:17:47.652681 (+  7242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:47.652992 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:47.653019 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:48.040179 (+387160us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b2c001e6a18. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:17:48.040704 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:17:48.521564 (+480860us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:48.521604 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.521671 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.935837 (+414166us) raft_consensus.cc:1685] finished
0709 12:17:48.935865 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.936111 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16770,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":30565,"spinlock_wait_cycles":8796928,"thread_start_us":480452,"threads_started":1,"wal-append.queue_time_us":529947}
I20260709 12:17:48.938102 27417 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:48.947738 27485 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.004s
I20260709 12:17:48.948544 27485 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:48.956635 27682 consensus_meta.cc:287] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.004s
W20260709 12:17:48.958334 27670 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.005s
I20260709 12:17:48.958904 27670 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:48.961809 27670 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:48.967068 27557 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:48.892716 27394 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:48.893904 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:48.713093 27728 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:48.874315 27724 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:17:48.893795 26892 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:48.876861 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 160698us
I20260709 12:17:48.921710 27683 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:48.921862 27719 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:48.927551 27718 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:17:48.903419 27711 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:48.835206 27731 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:49.027328 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 457116us
I20260709 12:17:49.038441 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:49.029157 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:48.957310 27682 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:49.046315 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:49.031867 27655 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.034564 27394 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.051705 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:49.064517 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:49.065342 22865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.021s	sys 0.047s
W20260709 12:17:49.065749 22865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.021s	sys 0.047s
I20260709 12:17:49.065897 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:49.066067 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 672711us
I20260709 12:17:49.055433 27500 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:17:49.060786 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:49.061326 22750 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
W20260709 12:17:49.063017 22864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.021s	sys 0.046s
I20260709 12:17:49.068770 22750 pending_rounds.cc:85] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 8
W20260709 12:17:49.069064 22864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.021s	sys 0.046s
I20260709 12:17:49.052232 23494 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:49.069108 22750 pending_rounds.cc:107] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:17:49.067379 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:49.071142 22750 raft_consensus.cc:2889] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:49.072191 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:49.049084 27711 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:49.048473 27688 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:49.083485 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:49.062922 27567 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.067404 27676 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:49.067262 27326 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:17:49.112411 22827 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 812) took 1193 ms (client timeout 1571 ms). Trace:
W20260709 12:17:49.112897 22827 rpcz_store.cc:269] 0709 12:17:47.918598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.918736 (+   138us) service_pool.cc:224] Handling call
0709 12:17:49.108995 (+1190259us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54000f14d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:49.112327 (+  3332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497014016}
I20260709 12:17:49.118994 22827 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:49.075007 27403 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.122826 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:49.043831 27731 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:49.132076 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:49.126868 22750 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:17:49.078684 27711 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:49.083774 27557 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:17:49.081221 27739 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:17:49.100837 27729 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:49.083623 27688 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:49.115219 27676 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.140848 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:49.160952 22820 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:17:49.161196 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:49.142740 22898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1144) took 1257 ms. Trace:
I20260709 12:17:49.162549 22750 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:49.115837 27485 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:49.067971 27394 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.077248 27522 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:17:49.123198 27195 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.130728 27723 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:49.162268 22898 rpcz_store.cc:276] 0709 12:17:47.885605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.011278 (+125673us) service_pool.cc:224] Handling call
0709 12:17:48.015323 (+  4045us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:17:48.120027 (+104704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:48.120061 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:17:48.120991 (+   930us) log.cc:844] Serialized 78 byte log entry
0709 12:17:48.514221 (+393230us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:48.514288 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.514398 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:49.142427 (+628029us) raft_consensus.cc:1685] finished
0709 12:17:49.142455 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.142663 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1906,"raft.queue_time_us":126,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":4996,"thread_start_us":268035,"threads_started":1,"wal-append.queue_time_us":609942}
I20260709 12:17:49.136595 27513 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.066639 27655 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:49.143997 27711 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:49.103641 27742 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:17:49.125649 27567 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:49.164605 27688 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:49.167112 27676 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:49.131762 27403 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:49.166265 27195 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.177703 27736 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:49.187765 27328 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.002s
I20260709 12:17:49.212904 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:49.224746 22824 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:49.186897 27739 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:49.210528 27719 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:49.178123 27513 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:49.243861 22820 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:49.233364 27681 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:17:49.260605 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 194769us
I20260709 12:17:49.239297 27328 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.252919 27682 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:49.269888 27746 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:49.270664 27746 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:49.273453 27746 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.274094 27328 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.275271 27731 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:49.275177 27745 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:17:49.276351 27744 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:17:49.276763 27745 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:49.279598 27745 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.279829 27513 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:49.282855 27195 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.283468 27655 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:49.284092 27394 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:49.287384 27747 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:17:49.288638 27494 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.531s	user 0.002s	sys 0.008s
I20260709 12:17:49.289463 27523 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:49.289892 27523 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:49.257800 27728 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:49.233845 27736 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:49.294174 27736 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:49.296041 27403 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:49.245626 27739 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:49.296542 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 815) took 1375 ms. Trace:
I20260709 12:17:49.297250 22823 rpcz_store.cc:276] 0709 12:17:47.921142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.952582 (+ 31440us) service_pool.cc:224] Handling call
0709 12:17:47.953097 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:48.278366 (+325269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.296062 (+1017696us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54007a3854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:49.296418 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729184512}
I20260709 12:17:49.298568 27739 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:49.300118 27740 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:17:49.300343 27567 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:49.301389 27743 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:17:49.303591 27669 consensus_meta.cc:287] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.003s
I20260709 12:17:49.309032 27688 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.315656 27483 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:49.316059 27461 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.001s
I20260709 12:17:49.289124 27494 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.298910 27523 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:49.324746 22749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1285) took 1634 ms (client timeout 1555 ms). Trace:
W20260709 12:17:49.325311 22749 rpcz_store.cc:269] 0709 12:17:47.690589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.713931 (+ 23342us) service_pool.cc:224] Handling call
0709 12:17:49.324487 (+1610556us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54001e6ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:49.324650 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1197294464}
I20260709 12:17:49.326941 27669 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:49.327688 27669 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:49.328807 23659 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:49.335289 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 231562us
I20260709 12:17:49.335520 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 816) took 1414 ms. Trace:
I20260709 12:17:49.336027 22826 rpcz_store.cc:276] 0709 12:17:47.921370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.943440 (+ 22070us) service_pool.cc:224] Handling call
0709 12:17:49.335305 (+1391865us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54005528d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:49.335451 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393080704}
W20260709 12:17:49.336392 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 72359.1us
I20260709 12:17:49.340906 22823 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:17:49.343783 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:49.345090 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:49.345875 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:49.346835 22899 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:17:49.347697 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.348657 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:49.349443 22899 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:17:49.346113 22896 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:49.350008 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:49.360004 22826 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:49.352336 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:49.363278 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:49.363754 22899 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:49.362635 22900 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:49.362249 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:49.353716 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:49.367545 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:49.369709 27676 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.370198 27723 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:49.371239 27723 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:17:49.372478 27723 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:49.372916 27723 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:49.373370 27723 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:49.373803 27711 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:49.351469 27683 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:49.375380 27748 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:17:49.375931 27748 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:49.377125 27748 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:49.375151 27683 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.381470 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:49.382263 22893 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:49.384101 27753 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:49.338855 27755 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:49.350845 27461 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:49.391840 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:49.392943 27753 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:49.393134 27683 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.394325 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:49.394125 27753 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:49.395211 22825 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:49.395808 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:49.396268 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:49.397006 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:49.397289 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:49.395092 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:49.397890 22827 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:49.397106 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:49.398670 22823 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:49.399243 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 813) took 1480 ms. Trace:
I20260709 12:17:49.399634 22822 rpcz_store.cc:276] 0709 12:17:47.918980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.919105 (+   125us) service_pool.cc:224] Handling call
0709 12:17:47.947169 (+ 28064us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:48.167586 (+220417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.399018 (+1231432us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400791154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:49.399196 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505031424}
I20260709 12:17:49.400909 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:49.402415 27676 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.401013 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:49.398226 22820 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:49.398141 22825 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:49.379590 27748 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:49.408390 22819 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:49.391669 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:49.403282 27755 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:49.411952 27711 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:49.416540 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 163648us
I20260709 12:17:49.428411 23689 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:49.428620 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.429469 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:49.430207 23685 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:49.431203 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 168928us
W20260709 12:17:49.434116 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.435276 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:49.387221 27669 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.443086 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:49.417423 22899 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:49.436862 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:49.436966 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:49.440542 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:49.446641 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:49.448804 22749 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:49.440438 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:49.450397 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:49.451350 23682 raft_consensus.cc:2393] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:49.453502 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.453929 23695 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:49.454553 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:49.450965 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:49.457188 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:49.446447 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.458307 23679 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:49.454561 23672 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:49.458316 22899 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:49.461321 22893 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:49.462872 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:49.467523 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.476949 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:49.478425 23672 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:49.480453 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:49.480893 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:49.466699 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:49.429777 27494 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.486697 22864 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:49.486245 23685 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:49.489035 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:49.437959 27325 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:49.436852 27463 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:49.446938 27682 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.405963 27461 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:49.479876 27739 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:49.506542 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.507498 23679 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:49.466686 27756 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:49.500653 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.485971 27676 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:49.493213 23682 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:49.505376 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.514624 23689 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
W20260709 12:17:49.514925 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 147431us
I20260709 12:17:49.486027 27687 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:49.488581 27394 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:49.490175 27731 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:49.525395 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.532459 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:49.531648 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:49.534168 23685 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:49.535214 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:49.524026 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:49.512049 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:49.536316 23682 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:49.500325 27688 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.541177 23672 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 11.
I20260709 12:17:49.483630 27683 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:49.518220 27676 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.504076 27325 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.545636 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.541028 27753 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:49.547514 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.517570 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:49.518180 27746 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:49.541646 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.554157 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:49.556746 22745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 1095) took 1743 ms (client timeout 1824 ms). Trace:
I20260709 12:17:49.584530 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:49.584978 23695 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:49.585865 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:17:49.584229 22745 rpcz_store.cc:269] 0709 12:17:47.813256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.827552 (+ 14296us) service_pool.cc:224] Handling call
0709 12:17:49.556485 (+1728933us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b5400192dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:49.556664 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105366912}
I20260709 12:17:49.558677 23672 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:49.559691 23682 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:49.566166 23685 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
W20260709 12:17:49.574645 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 57139.6us
I20260709 12:17:49.588881 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:49.502121 27463 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:49.505235 27682 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:49.594383 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:49.595342 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.595839 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.595934 23685 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:17:49.597225 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.597338 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:49.607528 27770 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:49.611102 23674 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:49.607682 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:49.613505 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:49.614058 23656 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:49.552783 27494 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:49.526298 27669 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 18.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:17:49.571756 27676 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:49.615103 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:49.548148 27394 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:49.632879 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:49.619617 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1142) took 1767 ms. Trace:
I20260709 12:17:49.635473 22897 rpcz_store.cc:276] 0709 12:17:47.852701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.855289 (+  2588us) service_pool.cc:224] Handling call
0709 12:17:47.855604 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:47.855946 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:47.855965 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:47.864325 (+  8360us) log.cc:844] Serialized 26 byte log entry
0709 12:17:49.568967 (+1704642us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b18000bd700. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:17:49.597293 (+ 28326us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:49.597337 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.597431 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:49.618061 (+ 20630us) raft_consensus.cc:1685] finished
0709 12:17:49.618088 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.619533 (+  1445us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4298,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":50245504,"thread_start_us":28099,"threads_started":1,"wal-append.queue_time_us":1734930}
I20260709 12:17:49.617452 23674 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:17:49.581986 27753 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:49.638589 27753 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:49.592010 27666 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:17:49.582762 27746 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:49.518718 27756 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:49.539862 27731 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:49.639542 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:49.643464 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:49.659648 22745 raft_consensus.cc:2376] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13. Re-sending same reply.
W20260709 12:17:49.660194 22791 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.679s (SENT)
I20260709 12:17:49.660878 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:49.614945 27345 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:17:49.552754 27403 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:17:49.537243 27687 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:49.648842 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:49.615722 27683 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:49.624224 27494 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:49.654052 27746 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:49.657931 27729 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:49.628551 27567 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:49.634295 27328 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:49.660511 27739 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:49.650053 27557 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:17:49.680945 27668 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.081s	user 0.007s	sys 0.007s
I20260709 12:17:49.628232 27513 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:49.648240 27719 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:49.668115 27485 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:17:49.665764 27768 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:49.729094 27768 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:49.730386 27682 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:49.732928 27687 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.734648 27755 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:49.688902 27729 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:49.736378 27729 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:49.736881 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:49.689802 27567 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.739233 27567 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:49.730505 27768 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:49.668946 27666 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:49.747264 27666 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:49.673233 27688 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:49.751394 27688 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:49.752599 27688 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:49.755338 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.700968 27557 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:49.714052 27763 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:17:49.701360 27668 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.007s	sys 0.007s
I20260709 12:17:49.767953 27557 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.715798 27683 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:49.718580 27394 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:49.769984 27746 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:49.719394 27513 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.720564 27463 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:49.722831 27723 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.774986 27739 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:49.776939 27723 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:49.777045 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:49.777585 23679 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:49.727085 27719 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.728036 27461 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:49.684996 27494 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:49.785576 27746 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.775030 27513 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:49.749943 27666 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:49.781803 27719 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:49.820570 23679 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:17:49.827142 27731 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:49.831676 27771 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:17:49.835204 27620 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:17:49.835701 27620 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:49.836581 27620 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:49.852766 27717 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.367s	user 0.000s	sys 0.007s
I20260709 12:17:49.849581 27753 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.854748 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 818) took 1933 ms. Trace:
I20260709 12:17:49.855470 22821 rpcz_store.cc:276] 0709 12:17:47.921761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.107602 (+185841us) service_pool.cc:224] Handling call
0709 12:17:48.107964 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:48.108319 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:48.108361 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:48.118429 (+ 10068us) log.cc:844] Serialized 52 byte log entry
0709 12:17:48.381535 (+263106us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:48.415488 (+ 33953us) log.cc:844] Serialized 14 byte log entry
0709 12:17:48.442949 (+ 27461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.443055 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:49.852170 (+1409115us) spinlock_profiling.cc:243] Waited 95.2 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:49.854214 (+  2044us) raft_consensus.cc:1685] finished
0709 12:17:49.854366 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.854647 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27953,"prepare.queue_time_us":21025,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":22299,"raft.queue_time_us":1151,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":30489,"spinlock_wait_cycles":218896768,"thread_start_us":150612,"threads_started":1,"wal-append.queue_time_us":327730}
I20260709 12:17:49.860702 27495 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:49.863544 27325 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:49.872411 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:49.862478 27756 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:49.886121 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 270970us
I20260709 12:17:49.889551 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:49.890213 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 275149us
I20260709 12:17:49.853720 27719 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:49.903730 23660 raft_consensus.cc:2410] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:17:49.904116 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:49.923357 27778 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:17:49.926224 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:49.938979 22895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1138) took 2095 ms (client timeout 1679 ms). Trace:
W20260709 12:17:49.939685 22895 rpcz_store.cc:269] 0709 12:17:47.843640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.843867 (+   227us) service_pool.cc:224] Handling call
0709 12:17:49.938627 (+2094760us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540014f5d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:49.938858 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220177792}
I20260709 12:17:49.948016 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:49.951217 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:49.936156 27748 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:49.930235 27776 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:17:49.953473 27417 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:49.971189 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:49.971298 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:49.972572 22823 raft_consensus.cc:2393] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:49.975181 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:49.975957 22822 raft_consensus.cc:2368] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:17:49.945904 27494 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:49.954015 27748 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.979406 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:49.955202 27723 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:17:49.969122 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:49.981727 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.984876 22825 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:17:49.986400 23494 leader_election.cc:400] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:17:49.987071 23494 leader_election.cc:403] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:17:49.976696 27776 consensus_queue.cc:1243] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:17:49.993060 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:49.993817 22818 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:49.980844 27748 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:49.958663 27676 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:49.983659 27666 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:50.006188 27719 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:50.007848 27729 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:50.008478 27494 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:50.012034 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1132) took 1349 ms. Trace:
I20260709 12:17:50.028179 22751 rpcz_store.cc:276] 0709 12:17:48.662277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.662460 (+   183us) service_pool.cc:224] Handling call
0709 12:17:49.556676 (+894216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:49.556957 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:49.556996 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:49.557056 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:49.557101 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.557176 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.011801 (+454625us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b5400192dd0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:50.011964 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2004616960}
I20260709 12:17:50.016918 27676 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:50.003561 27776 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 18.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:17:50.024343 22818 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:49.994998 27723 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:17:49.990628 27753 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:50.034188 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:50.026693 26954 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:50.067817 27780 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:17:50.068559 27780 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:50.069725 27780 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:50.076915 27523 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:46.838042 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:50.020192 27513 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:50.084149 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1124) took 1695 ms. Trace:
W20260709 12:17:50.084571 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.057461 27325 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:50.093348 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1125) took 1692 ms. Trace:
I20260709 12:17:50.084851 22744 rpcz_store.cc:276] 0709 12:17:48.392188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.392383 (+   195us) service_pool.cc:224] Handling call
0709 12:17:48.392775 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.393044 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:17:48.555495 (+162451us) log.cc:844] Serialized 14 byte log entry
0709 12:17:50.083571 (+1528076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:50.083661 (+    90us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:50.083734 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.083856 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.084055 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1251897,"prepare.queue_time_us":181431,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"thread_start_us":424994,"threads_started":2,"wal-append.queue_time_us":509949}
I20260709 12:17:50.103144 27780 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:50.108232 27618 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:50.108911 27618 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.111202 27618 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:50.117612 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:50.118593 22822 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 13: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:50.080192 26954 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:50.102377 27325 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:50.149295 27325 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:50.154500 22821 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:17:50.155732 27772 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:17:50.156183 27772 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:50.157100 27772 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.7, Last appended by leader: 7, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:50.158371 27772 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:50.118597 27748 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:50.174549 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1109) took 1594 ms. Trace:
I20260709 12:17:50.178836 22753 rpcz_store.cc:276] 0709 12:17:48.580038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.580211 (+   173us) service_pool.cc:224] Handling call
0709 12:17:48.580505 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.580707 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:17:49.061855 (+481148us) log.cc:844] Serialized 14 byte log entry
0709 12:17:50.174073 (+1112218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:50.174143 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:50.174204 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.174295 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.174470 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":839600,"prepare.queue_time_us":52794,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":839731,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":1137,"thread_start_us":752721,"threads_started":3,"wal-append.queue_time_us":297689}
I20260709 12:17:50.175361 27482 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:50.183526 27482 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:50.193888 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:50.200903 22823 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 15: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:50.194911 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1104) took 1652 ms. Trace:
I20260709 12:17:50.228266 22752 rpcz_store.cc:276] 0709 12:17:48.542262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.542448 (+   186us) service_pool.cc:224] Handling call
0709 12:17:48.545891 (+  3443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.546158 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:17:48.599528 (+ 53370us) log.cc:844] Serialized 14 byte log entry
0709 12:17:50.079654 (+1480126us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b1800318160. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf1694a40 00007fadf168f4e4 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287 00007fadf479a208
0709 12:17:50.080200 (+   546us) log.cc:844] Serialized 14 byte log entry
0709 12:17:50.194443 (+114243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:50.194503 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:50.194565 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.194666 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.194836 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24417,"prepare.queue_time_us":78012,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":3494,"raft.queue_time_us":1481171,"spinlock_wait_cycles":16972288,"thread_start_us":151942,"threads_started":2}
I20260709 12:17:50.237655 27513 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:50.195549 27618 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:50.248405 27618 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:50.251338 27567 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.003s
I20260709 12:17:50.251889 27567 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:50.254009 27797 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:50.193723 27729 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:50.254727 27797 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.257031 27797 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:50.258142 27785 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:17:50.095494 22747 rpcz_store.cc:276] 0709 12:17:48.400933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.401135 (+   202us) service_pool.cc:224] Handling call
0709 12:17:48.401554 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.401819 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:48.559054 (+157235us) log.cc:844] Serialized 14 byte log entry
0709 12:17:50.092948 (+1533894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:50.093011 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:50.093061 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.093132 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.093285 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1054683,"prepare.queue_time_us":183490,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":1045860,"thread_start_us":602082,"threads_started":2,"wal-append.queue_time_us":617310}
W20260709 12:17:50.275180 27786 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:17:50.279975 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:50.281545 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:50.279016 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:50.282961 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:50.284492 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:50.286228 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:50.289482 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:50.282454 22745 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:50.290288 22751 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:50.290838 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:50.291528 22745 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:50.293407 22823 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:17:50.294973 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:50.299835 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:50.254212 27567 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:50.306744 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:50.313668 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:50.323242 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:50.323954 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:50.326476 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:50.330593 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:50.324167 22752 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:50.335613 22820 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:50.338752 22744 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:50.344031 23659 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:50.311415 27557 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:50.340755 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.327373 27468 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:50.348747 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.346752 22745 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:17:50.339226 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:50.352281 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:50.353140 22745 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:17:50.359782 22752 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:50.360340 22752 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:50.376067 22820 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:17:50.377424 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:50.378557 22744 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:17:50.377581 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:50.338896 27796 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:50.335831 27797 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 12:17:50.394558 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 505066us
I20260709 12:17:50.395356 27345 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:50.395936 27345 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.398075 27345 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:50.399384 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:50.384344 22821 raft_consensus.cc:2368] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15.
I20260709 12:17:50.384063 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:50.386307 27779 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:50.356374 27468 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.410666 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:50.411018 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:50.411851 22749 raft_consensus.cc:2368] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:17:50.411945 22825 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:50.402961 22820 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:50.402580 22745 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
W20260709 12:17:50.405380 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.414186 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:50.407164 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:50.406607 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.398660 27689 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.407745 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:50.414412 22825 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:50.418830 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:50.417027 22818 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:50.419512 22751 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:50.416925 22745 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:17:50.399124 27774 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:17:50.433322 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:50.433647 22892 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:50.410022 22752 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.422253 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 973) took 1056 ms. Trace:
W20260709 12:17:50.422657 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:50.406896 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 67803.3us
I20260709 12:17:50.434283 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:50.424942 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:50.430475 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:50.434736 22752 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:50.436339 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:50.437747 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:50.436017 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:50.439625 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:50.446527 22896 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:17:50.447384 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:50.448766 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:50.442114 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:50.434830 22900 rpcz_store.cc:276] 0709 12:17:49.367079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.367350 (+   271us) service_pool.cc:224] Handling call
0709 12:17:49.392311 (+ 24961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:49.392565 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:17:49.596730 (+204165us) log.cc:844] Serialized 14 byte log entry
0709 12:17:49.781766 (+185036us) log.cc:844] Serialized 14 byte log entry
0709 12:17:50.251972 (+470206us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b1800286a80. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1
0709 12:17:50.253493 (+  1521us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b1800286a80. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:50.318258 (+ 64765us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b1800286a80. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf1694a40 00007fadf168f4e4 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287 00007fadf479a208
0709 12:17:50.318811 (+   553us) log.cc:844] Serialized 14 byte log entry
0709 12:17:50.421743 (+102932us) log.cc:844] Serialized 14 byte log entry
0709 12:17:50.421922 (+   179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:50.421961 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:17:50.422009 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.422081 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.422193 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":725371,"prepare.queue_time_us":219779,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":148,"raft.queue_time_us":649125,"raft.run_cpu_time_us":579,"raft.run_wall_time_us":29104,"spinlock_wait_cycles":25494144,"thread_start_us":338671,"threads_started":2,"wal-append.queue_time_us":212507}
I20260709 12:17:50.399709 27795 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:50.460533 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:50.453723 23659 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:17:50.455152 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:50.455474 22820 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:50.463295 23659 pending_rounds.cc:85] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 7
I20260709 12:17:50.442867 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:50.456651 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:50.464569 22894 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:50.362195 27557 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.455986 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:50.465768 23689 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:50.466053 23660 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:50.441349 27671 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.955s	user 0.026s	sys 0.034s
I20260709 12:17:50.467741 22825 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:50.468743 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:50.469564 23672 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:50.463635 23659 pending_rounds.cc:107] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:17:50.471112 23659 raft_consensus.cc:2889] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:50.473373 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:50.473734 23493 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:50.474212 23679 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 13: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:50.475234 23689 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:50.477772 27770 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:50.448217 27685 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:17:50.478816 27685 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:50.479771 27403 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:50.479900 27738 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.480443 27403 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:50.480563 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:50.481035 27403 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:50.480671 27738 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:50.481482 27715 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:50.482681 23674 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:17:50.483711 27293 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:17:50.479821 27685 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:50.487357 27650 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:17:50.487502 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 88240.4us
I20260709 12:17:50.491029 27579 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:50.492054 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:50.493680 23695 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:17:50.494072 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:50.495220 22892 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: []
W20260709 12:17:50.495422 27793 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:17:50.496356 27643 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:50.496964 27643 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.497961 27687 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:50.499228 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:50.500399 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:50.502825 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:50.504503 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:50.448086 27797 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.447862 27739 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.439576 27494 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:17:50.520112 22744 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:50.455039 27780 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:50.532835 23656 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:50.520965 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:50.539136 23674 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
W20260709 12:17:50.471977 27671 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.986s	user 0.026s	sys 0.034s
I20260709 12:17:50.521518 23672 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:50.439813 27757 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.516788 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:50.546077 23689 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:50.516393 23493 leader_election.cc:400] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:17:50.516990 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:50.517879 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1051) took 3283 ms. Trace:
I20260709 12:17:50.548046 23659 rpcz_store.cc:276] 0709 12:17:47.189054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.189225 (+   171us) service_pool.cc:224] Handling call
0709 12:17:47.189618 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:47.319830 (+130212us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b54005fce20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f6dc0 00007fadf47811c0 00007fadf4782231 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c
0709 12:17:48.365864 (+1046034us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54005fce20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46fd06f 00007fadf4775f60 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62
0709 12:17:49.328424 (+962560us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b54005fce20. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46fc520 00007fadf4775f70 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62
0709 12:17:50.343519 (+1015095us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b580015b0d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46db0aa 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4
0709 12:17:50.471765 (+128246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.472047 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922385536}
I20260709 12:17:50.457890 27680 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:50.510502 22894 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:50.550863 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:50.534282 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:50.466773 27795 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:50.528923 22822 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:50.428428 27689 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.501016 27468 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:50.562996 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.583896 23660 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:50.580984 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:50.547099 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:50.459528 27326 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:17:50.583993 23493 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:50.521992 27650 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.549036 27250 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.592383 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:50.599931 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 52943.9us
I20260709 12:17:50.604732 22752 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:50.606038 22894 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:50.607059 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:50.587844 27774 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:17:50.612246 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:50.612471 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 162312us
I20260709 12:17:50.616979 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:50.609104 27523 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.528s	user 0.015s	sys 0.008s
I20260709 12:17:50.516530 27794 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:17:50.697127 22895 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
W20260709 12:17:50.624204 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.529219 27797 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.700201 27797 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:50.700959 27797 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:50.701311 27797 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:50.606899 27293 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:50.702997 27403 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.704304 27777 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.704769 22747 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:17:50.704943 27777 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:50.533561 27739 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:50.587467 27345 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:17:50.707223 27345 consensus_queue.cc:1243] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:50.707434 27523 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:50.588151 27687 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:17:50.702191 27797 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:50.710146 27797 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:50.589071 27795 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:50.711460 27803 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:50.608620 27643 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:50.625211 27541 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:17:50.587764 27757 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:50.656351 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 191799us
I20260709 12:17:50.607749 27650 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:50.609845 27250 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:50.655350 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 211832us
I20260709 12:17:50.651434 27713 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:17:50.687001 22898 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:50.651208 27680 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:17:50.680111 27676 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.620406 22790 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:50.719851 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:50.730916 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:50.747489 22894 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:50.747663 22893 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:50.731824 22822 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:50.734365 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:50.719630 27772 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.000s
I20260709 12:17:50.749665 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:50.759600 22893 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:50.760689 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:50.768026 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:50.762661 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 142308us
I20260709 12:17:50.770030 22790 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:50.772702 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.773725 23660 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:50.773991 27688 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:50.774832 27688 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:50.776010 27688 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.777175 22790 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:50.787600 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:50.789690 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:50.790666 22898 raft_consensus.cc:2368] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15.
I20260709 12:17:50.762032 27807 raft_consensus.cc:2764] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:17:50.792017 27403 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:50.792335 27807 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:50.793880 27715 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:50.793991 27807 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:50.796762 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:50.819094 22898 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 12:17:50.820749 22898 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:17:50.822222 22898 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:50.777791 27494 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:50.786164 27666 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.786144 27567 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:50.777454 27557 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:50.838954 22894 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:50.847208 22898 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:50.816056 27689 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:50.769078 27676 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:50.789337 27483 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:17:50.830961 27797 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:50.830724 27494 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:50.795311 27682 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 12:17:50.899031 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 121917us
I20260709 12:17:50.851526 27806 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:50.862792 27687 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:50.879649 27557 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:50.880734 27468 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:17:50.824534 27812 consensus_queue.cc:1059] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 12:17:50.880034 27567 raft_consensus.cc:697] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:17:50.912127 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 81994us
I20260709 12:17:50.890296 27650 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:50.860746 27666 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:50.908589 27494 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:50.916906 27797 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:50.938470 27796 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.932883 27557 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:50.919253 27687 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:50.968590 27794 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:50.976989 27794 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:50.930874 27816 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:17:50.972534 27796 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:50.983016 27676 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:50.983769 27666 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:50.978814 27739 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:50.985282 27797 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:50.983013 27796 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:50.994880 27794 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:50.996325 27794 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:50.997618 27807 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:50.998327 27795 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:51.000358 27795 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:51.052207 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 288992us
W20260709 12:17:51.058765 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:51.084805 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:51.080623 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 172971us
I20260709 12:17:51.096205 27557 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:50.977622 27567 consensus_queue.cc:237] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:51.080183 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 283324us
I20260709 12:17:51.102934 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:51.103637 27835 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:17:51.060019 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:51.063863 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:51.092777 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.062201 22745 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
W20260709 12:17:51.066679 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 247416us
I20260709 12:17:51.071329 27468 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 12:17:51.147125 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.078091 27483 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.982604 27687 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:51.158509 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 99017.4us
I20260709 12:17:51.161564 27796 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:51.162758 27796 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:51.167439 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:51.070021 27250 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:51.182049 27688 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.182335 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:51.183259 27688 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:51.184356 27468 raft_consensus.cc:2764] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:17:51.183688 22747 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
W20260709 12:17:51.188161 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 84938us
I20260709 12:17:51.195941 27828 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:51.196344 27837 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:51.196753 27828 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:51.197100 27482 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:51.197702 27837 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:51.196362 27833 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:17:51.198772 27828 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:51.202310 27833 raft_consensus.cc:3055] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:51.196676 27830 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:51.189663 27468 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:17:51.186579 27688 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:51.215061 27830 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:51.217964 27830 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:51.208093 27671 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:51.221042 27468 consensus_queue.cc:1243] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:51.222210 27795 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:51.222769 27795 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:51.208716 27833 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:51.224710 27795 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:51.206061 27827 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 12:17:51.226850 27836 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:17:51.227762 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:51.232391 27618 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:51.234462 27807 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:51.235891 27620 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:51.221798 27671 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:51.224798 27833 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:51.252296 27837 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:51.252965 27795 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:51.260425 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.260612 27738 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:51.267582 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:51.271003 27250 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.250406 27483 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:51.289075 27250 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:51.291501 27829 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:51.292003 27250 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:51.292294 27829 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:51.293476 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.295046 22892 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 15: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:51.299707 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:51.300740 27753 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:51.301401 27777 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:51.302583 23656 raft_consensus.cc:2410] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:17:51.303280 27801 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.784s	user 0.015s	sys 0.000s
I20260709 12:17:51.304630 27833 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:51.307013 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56876.9us
I20260709 12:17:51.319205 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1301) took 2065 ms. Trace:
I20260709 12:17:51.319561 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:51.319960 27671 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:51.322309 22747 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:51.310956 27738 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:51.327471 27738 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:51.329855 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:51.330907 22749 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:51.333837 27806 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:51.334949 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:51.336351 22744 raft_consensus.cc:2410] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:17:51.337733 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:51.338590 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.294492 27829 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:51.377792 27829 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:51.385149 27738 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:51.414409 27832 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.415417 27832 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:51.416636 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:51.418383 22744 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:17:51.421434 27483 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:51.410949 27688 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:17:51.424983 27495 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.426193 26954 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:51.427328 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.438090 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:51.439471 27682 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:51.440325 22896 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:17:51.432515 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.448189 27293 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:51.481158 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.481819 22896 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:51.484227 22897 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
W20260709 12:17:51.484476 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46580.5us
I20260709 12:17:51.460875 27682 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:51.487272 22895 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:17:51.488337 27495 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:51.491284 22899 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:51.496934 27748 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:51.500396 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:51.501695 27832 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:51.503372 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:51.319836 22750 rpcz_store.cc:276] 0709 12:17:49.253877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.254061 (+   184us) service_pool.cc:224] Handling call
0709 12:17:49.254500 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:50.172426 (+917926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:50.172458 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:50.172936 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 12:17:50.315100 (+142164us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:50.315141 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.315213 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:51.272378 (+957165us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:51.318443 (+ 46065us) raft_consensus.cc:1685] finished
0709 12:17:51.318472 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.318975 (+   503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":856989,"raft.queue_time_us":975636,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":3763,"spinlock_wait_cycles":6146304,"thread_start_us":219393,"threads_started":2,"wal-append.queue_time_us":255101}
I20260709 12:17:51.507570 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:51.508714 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 233525us
I20260709 12:17:51.510255 27495 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:51.512372 27822 raft_consensus.cc:3055] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:51.512166 27682 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:51.513144 27798 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:51.514302 26954 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:51.515898 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.516376 27775 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:51.517704 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1317) took 1020 ms. Trace:
I20260709 12:17:51.519243 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.520160 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.521289 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.524952 27757 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:51.529274 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1524) took 1118 ms. Trace:
W20260709 12:17:51.541260 27842 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:17:51.534574 27494 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.589s	user 0.014s	sys 0.013s
I20260709 12:17:51.577029 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:51.583681 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:51.535113 23660 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:51.586520 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 985) took 1072 ms. Trace:
I20260709 12:17:51.586763 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:51.589102 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:51.547886 27772 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.590920 27748 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.591799 22575 catalog_manager.cc:5697] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 10 to 15, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 15 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:17:51.594615 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:51.599556 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:51.603209 22864 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:51.605253 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:51.606454 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.673233 23656 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:17:51.608742 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:51.617415 22749 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:51.620296 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:51.616077 22745 rpcz_store.cc:276] 0709 12:17:50.497583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.498612 (+  1029us) service_pool.cc:224] Handling call
0709 12:17:50.498917 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:51.149192 (+650275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.517379 (+368187us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54004056d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:51.517634 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293121920}
I20260709 12:17:51.630568 27775 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:51.617360 26954 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.617447 22822 rpcz_store.cc:276] 0709 12:17:50.410129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.410284 (+   155us) service_pool.cc:224] Handling call
0709 12:17:51.528657 (+1118373us) spinlock_profiling.cc:243] Waited 83 ms on lock 0x7b54000f19d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:51.528927 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190890368}
I20260709 12:17:51.630949 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.463227 27293 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:51.680593 22896 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:17:51.632792 22820 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:17:51.615316 27822 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:51.650486 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:51.696398 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 93516.3us
I20260709 12:17:51.685245 26954 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:51.688095 27495 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:51.692490 27671 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:51.703661 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:51.652845 27494 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:51.657805 22901 rpcz_store.cc:276] 0709 12:17:50.513785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.514983 (+  1198us) service_pool.cc:224] Handling call
0709 12:17:50.515393 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:50.515698 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:51.383325 (+867627us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b180039b6e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf81773c7 00007fadf47899a7 00007fadf47990bf
0709 12:17:51.383616 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 12:17:51.422168 (+ 38552us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b180039b6e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1692557 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:51.585806 (+163638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:51.585919 (+   113us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:51.585996 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.586086 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.586287 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3743,"prepare.queue_time_us":311082,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":8799,"raft.queue_time_us":23190,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":21872896,"thread_start_us":413062,"threads_started":2,"wal-append.queue_time_us":270163}
I20260709 12:17:51.720649 22823 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 13: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:51.707464 27757 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:51.725486 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:51.731323 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 142408us
I20260709 12:17:51.732198 27822 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:51.735229 27682 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:51.738286 27494 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:51.746134 23659 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:51.748685 22825 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:51.710518 27772 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:51.750955 27557 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:51.714747 27748 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:51.713670 27671 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:51.768637 27822 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:51.768668 27671 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:51.760346 22864 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:51.744133 27757 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.767096 27557 raft_consensus.cc:3055] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:17:51.761885 22717 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.790s (SENT) [suppressed 8 similar messages]
I20260709 12:17:51.774488 27775 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:51.751410 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:51.780507 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:51.804347 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.786530 22901 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:17:51.787561 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.804898 23660 raft_consensus.cc:2410] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:17:51.789501 27828 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.749490 27293 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:51.791976 23672 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 12:17:51.793283 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 216477us
I20260709 12:17:51.799299 27796 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:51.803076 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:51.811744 23659 raft_consensus.cc:2410] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:17:51.816000 22790 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:51.815618 22575 catalog_manager.cc:5697] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:51.817057 27293 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:51.818390 27772 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:51.777133 27557 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:51.818933 27325 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.819617 27325 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:51.819940 27557 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:51.821171 27557 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:51.821959 27325 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:51.818646 27620 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:17:51.823036 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:51.777930 27757 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:51.824952 22818 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:17:51.803300 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:51.809811 27796 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:51.827668 27845 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.002s
I20260709 12:17:51.828131 27796 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:51.830648 27796 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:51.836680 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:51.830154 27828 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:51.839042 27832 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:51.840036 27828 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:51.841210 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:51.842061 22895 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:51.844342 22575 catalog_manager.cc:5697] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 10 to 14, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 14 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.824250 22899 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:17:51.847733 22575 catalog_manager.cc:5697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 8 to 14, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 14 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:17:51.850059 22790 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:51.851715 27828 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:51.855623 27688 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:17:51.857360 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:51.859735 27828 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:51.860229 27828 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:51.860680 27828 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:17:51.868098 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 52791.4us
I20260709 12:17:51.877916 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:51.879374 22575 catalog_manager.cc:5697] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:51.883857 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:51.883303 22575 catalog_manager.cc:5697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 7 to 14, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 14 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.886145 23659 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 10. Current term is 11. Ops: [8.6-10.7]
W20260709 12:17:51.886479 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 141001us
I20260709 12:17:51.888954 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:51.889184 27523 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:51.892010 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 55428.1us
I20260709 12:17:51.893405 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:51.813268 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.880193 23493 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:51.896718 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:51.903437 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 131810us
I20260709 12:17:51.900650 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:51.910068 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:51.903434 27688 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:17:51.903903 27494 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:17:51.839854 27748 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:51.916436 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.904109 27325 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:51.898427 27832 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:51.922375 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:51.919109 27620 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:51.934760 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:51.935988 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55899.4us
I20260709 12:17:51.928577 27620 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:51.927680 27685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.031s	sys 0.019s
I20260709 12:17:51.937071 23493 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:51.923839 27833 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.928735 27494 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:51.886684 22575 catalog_manager.cc:5697] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 9 to 11, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 11 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
W20260709 12:17:51.943559 27685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.333s	user 0.032s	sys 0.020s
I20260709 12:17:51.942983 27620 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:17:51.978452 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50125.5us
I20260709 12:17:52.003988 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:51.983589 27845 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:17:51.971393 27494 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.941819 27757 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:51.989684 27325 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:51.939318 27671 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:52.017462 27494 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:52.013115 27833 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:52.056932 23695 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:52.063923 27794 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:52.074637 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 317591us
I20260709 12:17:52.064616 22575 catalog_manager.cc:5697] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 6 to 14, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 14 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
W20260709 12:17:52.091734 22576 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57362 (request call id 56) took 36074 ms (client timeout 15000 ms). Trace:
I20260709 12:17:52.091210 22575 catalog_manager.cc:5697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:17:52.093835 27250 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:52.093442 22575 catalog_manager.cc:5697] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:52.096751 22575 catalog_manager.cc:5697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:17:52.081321 27794 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:52.094472 27250 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:52.101760 27794 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:52.101622 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:52.101975 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:52.098627 22575 catalog_manager.cc:5697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
W20260709 12:17:52.094416 27860 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
I20260709 12:17:52.102900 22892 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:17:52.113929 22895 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:17:52.127044 22575 catalog_manager.cc:5697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:52.100504 27250 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:52.120800 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 232265us
I20260709 12:17:52.139304 27293 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:52.208961 27620 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:52.210265 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 285917us
I20260709 12:17:52.211089 27757 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:52.092234 22576 rpcz_store.cc:269] 0709 12:17:16.007681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.007989 (+   308us) service_pool.cc:224] Handling call
0709 12:17:52.077424 (+36069435us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:43.499473 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:43.500186 (+   713us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:43.500239 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:17:43.500257 (+    18us) tablet.cc:662] Decoding operations
0709 12:17:43.501462 (+  1205us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:43.501568 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:43.501604 (+    36us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:17:43.518125 (+ 16521us) tablet.cc:701] Row locks acquired
0709 12:17:43.564815 (+ 46690us) write_op.cc:260] PREPARE: finished
0709 12:17:43.606405 (+ 41590us) write_op.cc:270] Start()
0709 12:17:43.677907 (+ 71502us) write_op.cc:276] Timestamp: P: 1783599463590073 usec, L: 0
0709 12:17:43.695050 (+ 17143us) op_driver.cc:348] REPLICATION: starting
0709 12:17:43.881605 (+186555us) log.cc:844] Serialized 4454 byte log entry
0709 12:17:44.563518 (+681913us) op_driver.cc:464] REPLICATION: finished
0709 12:17:44.961960 (+398442us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf16750ac 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf81b5ef0
0709 12:17:45.239919 (+277959us) write_op.cc:301] APPLY: starting
0709 12:17:45.240025 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:45.751720 (+511695us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:45.751773 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:46.234280 (+482507us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:46.234700 (+   420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 12:17:46.273953 (+ 39253us) write_op.cc:312] APPLY: finished
0709 12:17:46.296368 (+ 22415us) log.cc:844] Serialized 104 byte log entry
0709 12:17:46.463735 (+167367us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:46.676561 (+212826us) write_op.cc:454] Released schema lock
0709 12:17:46.676687 (+   126us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:46.777731 (+101044us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:46.783203 (+  5472us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5869566,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":670000,"apply.run_cpu_time_us":78998,"apply.run_wall_time_us":1481642,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50151,"num_ops":11,"prepare.queue_time_us":145299,"prepare.run_cpu_time_us":65595,"prepare.run_wall_time_us":823882,"raft.queue_time_us":173706,"raft.run_cpu_time_us":27742,"raft.run_wall_time_us":607582,"replication_time_us":865948,"spinlock_wait_cycles":9981824,"thread_start_us":1025576,"threads_started":5,"wal-append.queue_time_us":770735,"wal-append.run_cpu_time_us":31800,"wal-append.run_wall_time_us":2177438}]]}
I20260709 12:17:52.211826 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:52.140105 27777 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:52.145751 27748 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:52.218575 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46786us
W20260709 12:17:52.231057 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 81053.1us
I20260709 12:17:52.227617 22575 catalog_manager.cc:5697] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 9 to 14, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 14 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:17:52.243927 23660 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:17:52.250679 23659 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:52.220867 27325 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.266692 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:52.274073 27858 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:17:52.274986 27858 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:52.248193 27523 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:52.267513 23682 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:17:52.277365 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:52.267679 27849 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 12:17:52.269943 22575 catalog_manager.cc:5697] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 4 to 11, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 11 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.239048 27748 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:52.280825 27671 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:52.305740 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.299414 22575 catalog_manager.cc:5697] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 1 to 13. New cstate: current_term: 13 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.295034 27250 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:52.293044 27620 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:52.272272 27757 consensus_queue.cc:1059] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:17:52.300472 27833 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:52.302243 27858 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:52.278230 27325 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:52.337548 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 125968us
I20260709 12:17:52.286607 27523 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:52.331290 27796 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:52.359104 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:52.373690 22748 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:52.367040 23674 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:17:52.363335 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:17:52.377955 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.379403 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 439299us
W20260709 12:17:52.358600 27856 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:17:52.416006 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.356479 27682 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.596s	user 0.015s	sys 0.000s
W20260709 12:17:52.382407 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.406489 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 179120us
W20260709 12:17:52.422466 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.419721 22575 catalog_manager.cc:5697] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 9 to 11, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 11 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:17:52.364207 27293 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:52.359787 27757 raft_consensus.cc:3055] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:52.436229 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:52.361110 27858 raft_consensus.cc:697] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:52.362634 27325 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:52.447089 27870 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:17:52.447726 27870 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:52.448127 27870 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:52.449956 27858 consensus_queue.cc:237] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:52.453722 27325 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:52.454531 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:52.455734 27620 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:52.457468 27620 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:52.458005 27620 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:52.458405 27620 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:52.358717 27828 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:52.424434 27865 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:52.463927 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.408816 27796 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:52.442929 27682 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.508030 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:52.509065 22901 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:52.508680 22748 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:17:52.437851 27757 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:52.519057 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:17:52.537842 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 174663us
I20260709 12:17:52.538944 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.535704 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.536134 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:52.539731 22818 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:52.542949 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:52.547755 22823 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:17:52.557785 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 135543us
I20260709 12:17:52.543421 27748 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:52.542512 27777 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:52.525553 27682 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:52.580425 22820 raft_consensus.cc:2393] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:52.576462 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:17:52.588030 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 66382.5us
I20260709 12:17:52.517791 27865 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:52.592020 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:52.594683 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 71677.8us
I20260709 12:17:52.597182 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:52.585125 27777 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:52.593283 27877 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.611423 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:52.605950 27567 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.617748 27567 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:52.621031 27567 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:52.603633 27495 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:17:52.629733 22864 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:52.630347 22901 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:17:52.651314 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:52.661010 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.661623 27878 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.662321 27878 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:52.663986 27882 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:52.664628 27882 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:52.665777 27882 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:52.667416 27867 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:17:52.667759 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:52.669581 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:52.670953 27538 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 12:17:52.672062 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 108830us
I20260709 12:17:52.661274 27796 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:52.662360 27877 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:52.641309 26954 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.918s	user 0.016s	sys 0.001s
I20260709 12:17:52.687953 26954 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:52.690160 26954 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:52.682026 27828 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:52.680688 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.691834 22825 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:17:52.611045 27871 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:17:52.696484 27865 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:52.681901 22892 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:17:52.632095 27685 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 12:17:52.685905 27872 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:17:52.687322 27877 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:52.658687 27874 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:17:52.716511 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 86862.6us
W20260709 12:17:52.700630 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 89531.9us
I20260709 12:17:52.679220 27863 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:52.723963 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 113547us
I20260709 12:17:52.704843 27796 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:52.713863 27874 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:52.735831 27880 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:17:52.740984 22898 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:52.733893 27874 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:52.750730 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.753099 27878 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:52.741861 27796 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:52.758270 27796 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:52.765748 27494 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.705s	user 0.012s	sys 0.001s
I20260709 12:17:52.766511 27870 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:52.769193 27885 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:52.775542 27870 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:52.771941 27891 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:17:52.778569 22825 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:17:52.766311 27494 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:52.762483 27873 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:52.789232 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:52.793771 27841 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.527s	user 0.000s	sys 0.006s
I20260709 12:17:52.795409 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.796213 22819 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:17:52.796058 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.783471 27682 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:52.806617 22822 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:52.808820 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.809418 22819 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:52.813378 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.819344 22825 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:52.820923 27620 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:52.798075 27873 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.817878 27777 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:52.818135 22823 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:17:52.824690 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.827919 22825 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:52.840318 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:52.840458 27620 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:52.842222 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:52.842975 27494 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:52.843044 27858 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:52.824753 27873 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:52.856283 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.857547 22823 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:52.858695 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.861442 27885 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:52.866932 27523 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:52.879576 27864 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.425s	user 0.000s	sys 0.003s
I20260709 12:17:52.881805 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1158) took 1243 ms. Trace:
I20260709 12:17:52.882215 23685 rpcz_store.cc:276] 0709 12:17:51.638096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.683380 (+ 45284us) service_pool.cc:224] Handling call
0709 12:17:51.748931 (+ 65551us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b58002c3a98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:17:51.749206 (+   275us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:51.750018 (+   812us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:51.971877 (+221859us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.291648 (+319771us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:52.324506 (+ 32858us) log.cc:844] Serialized 52 byte log entry
0709 12:17:52.342992 (+ 18486us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:52.343044 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.343133 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:52.879230 (+536097us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b2400519488. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15189c4 00007fadf1516acb 00007fadf16d1dc9 00007fadf16d1a55 00007fadf16d109d 00007fadf430310e 00007fadf431a88c 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221
0709 12:17:52.881388 (+  2158us) raft_consensus.cc:1685] finished
0709 12:17:52.881413 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.881600 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9312,"prepare.queue_time_us":291407,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":58417,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":218,"spinlock_wait_cycles":133140224,"thread_start_us":498066,"threads_started":2,"wal-append.queue_time_us":457650}
W20260709 12:17:52.850713 27250 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.006s
W20260709 12:17:52.896494 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 54339.7us
I20260709 12:17:52.897770 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:52.903040 22819 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:52.901959 27892 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.902884 27523 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:52.904099 27892 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:52.904930 27523 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.905210 27863 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:52.905406 27523 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:52.910641 27777 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:52.911401 27892 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:52.912781 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.917528 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.918016 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.919713 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.926420 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:52.927799 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:52.926932 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:52.932644 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:52.934154 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:52.938032 22896 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:52.940171 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:52.941277 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:52.941705 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:52.941991 22748 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:52.942339 22745 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:52.945429 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:52.946198 22900 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:17:52.947247 27893 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.948001 27893 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:52.948385 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:52.948922 27877 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:52.949607 27877 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:52.950207 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:52.951573 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:52.950544 27893 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:52.953415 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:52.954311 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:52.949101 22750 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:52.951848 27877 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:52.938026 27878 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:52.957996 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:52.967664 22899 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:17:52.964447 22748 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:52.924065 27833 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.971496 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.967713 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:52.965301 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.972124 22821 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:52.916990 27874 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:52.977429 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:52.972481 22822 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:52.972434 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.983072 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.983240 22819 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:52.984193 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:52.984696 22825 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:52.985564 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:52.990290 23685 raft_consensus.cc:2410] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:52.992614 22824 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:17:52.970708 27878 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.001202 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:52.999785 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.997648 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:53.002131 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.003343 27770 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.003971 27770 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:53.006079 22747 raft_consensus.cc:2368] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16.
I20260709 12:17:53.008558 22744 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:53.009805 27770 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:53.010834 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.003371 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:53.012126 22745 raft_consensus.cc:2410] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:17:53.014398 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:52.983850 27325 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:17:52.980953 27671 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:53.026485 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:52.988652 27833 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:53.014971 27878 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:53.025218 27671 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:53.018601 22865 connection.cc:256] RPC call timeout handler was delayed by -2.0343564039999364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 12:17:53.038335 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:53.037542 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:53.045469 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:53.034986 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:53.060911 22822 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:17:53.065687 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:53.059984 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:53.045991 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:53.038949 22749 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:53.072237 22750 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:17:53.060683 22819 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:53.070405 22894 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:53.041384 22752 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:17:53.043608 22825 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:53.058205 22896 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:53.037343 22824 pending_rounds.cc:85] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 6
I20260709 12:17:53.035866 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:53.065498 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:53.038012 27671 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:53.030761 27833 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:53.094380 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 48990.6us
I20260709 12:17:53.099071 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:53.091365 22865 connection.cc:256] RPC call timeout handler was delayed by -1.2603564040000492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2605s for a response
W20260709 12:17:53.095434 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.077885 22824 pending_rounds.cc:107] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:17:53.101871 22824 raft_consensus.cc:2889] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:53.102170 22865 connection.cc:256] RPC call timeout handler was delayed by -1.1199564040000496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2761s for a response
I20260709 12:17:53.104838 23493 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:53.107522 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:53.111634 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:53.113642 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:53.115208 22747 raft_consensus.cc:1275] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:17:53.116499 23494 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:53.117228 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:53.123921 22864 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:53.124963 22865 connection.cc:256] RPC call timeout handler was delayed by -1.0071335009999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
I20260709 12:17:53.120209 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:53.126988 22821 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:53.076581 27862 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:53.075785 27325 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:53.128100 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:53.132695 22821 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:53.132757 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:53.133808 22825 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:53.128139 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:53.135572 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:53.136466 23656 raft_consensus.cc:2368] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 20. Current term is 21.
I20260709 12:17:53.135978 27325 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:53.097035 27523 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:53.138907 27863 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:17:53.139550 27875 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:53.139896 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:53.140451 27523 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:53.140978 22822 raft_consensus.cc:2410] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:17:53.141405 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:53.141999 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:53.131857 27862 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:53.142706 27862 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:53.133114 27877 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:53.143591 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:53.144466 27874 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:53.117959 23659 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:53.135986 22746 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:17:53.142614 22822 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:53.149770 22899 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:17:53.142750 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:53.150974 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:53.153440 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:53.159042 22823 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:53.161532 22821 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:53.158169 22746 pending_rounds.cc:85] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 6
I20260709 12:17:53.166414 22746 pending_rounds.cc:107] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:17:53.166667 22746 raft_consensus.cc:2889] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:53.118441 27832 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:53.167450 22894 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:53.119941 27833 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:53.176821 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:53.179390 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:53.152442 27293 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:17:53.179347 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 51579.4us
I20260709 12:17:53.181361 22825 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:53.157266 27863 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:53.035929 27757 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:53.251212 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 74542.6us
I20260709 12:17:53.174358 27832 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.177616 27685 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.175812 27875 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:53.248706 27884 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:17:53.334527 27888 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:17:53.336246 27901 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 12:17:53.337793 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:53.348258 27907 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:17:53.352293 27863 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:53.355211 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:53.178587 27877 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:53.371236 22822 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:17:53.384690 22745 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:53.358481 27873 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:53.367903 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 185038us
I20260709 12:17:53.398543 22819 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:53.184747 27833 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:53.333097 27538 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:17:53.421133 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 264052us
I20260709 12:17:53.386413 27832 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:53.393325 27888 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:53.459463 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.504925 22790 leader_election.cc:400] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16.
I20260709 12:17:53.509651 23674 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 20: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:53.511571 27643 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:53.427661 27685 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:53.504586 27293 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:53.518204 27901 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:17:53.516390 27914 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.564601 22750 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:53.432235 27878 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:53.668766 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 335937us
I20260709 12:17:53.511795 27877 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:53.647542 27538 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:53.580847 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 330337us
I20260709 12:17:53.589418 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:53.595453 22744 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:17:53.568907 27828 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:53.604555 27908 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.001s
W20260709 12:17:53.607400 27909 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:17:53.614558 27671 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:53.578948 27921 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.683370 27685 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:53.617673 27920 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.684226 27920 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:53.672370 27914 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:53.641033 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:17:53.700608 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 59702us
I20260709 12:17:53.650285 22790 leader_election.cc:403] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:17:53.577134 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.009s	sys 0.005s
I20260709 12:17:53.674264 22744 pending_rounds.cc:85] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 7
I20260709 12:17:53.652900 27888 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:53.681386 27833 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:53.681946 27671 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:53.682649 23695 raft_consensus.cc:2368] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20.
I20260709 12:17:53.683126 27921 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:53.580708 27875 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:53.616986 27873 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:53.686739 27920 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:53.669520 27293 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:53.713620 27671 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:53.728410 27671 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:53.650637 27775 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:17:53.713495 27620 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.731365 27620 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:53.733237 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:53.733938 22898 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:53.691531 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:53.694063 27828 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:53.696815 27878 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:53.706694 27862 consensus_meta.cc:287] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.002s
W20260709 12:17:53.705935 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 285987us
I20260709 12:17:53.710892 22744 pending_rounds.cc:107] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:17:53.740753 22744 raft_consensus.cc:2889] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:53.711345 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:53.741557 22894 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 21
W20260709 12:17:53.714370 27915 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:17:53.701202 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:53.714102 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:53.677238 27538 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:53.716941 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:53.744436 22901 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:53.716601 22896 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:17:53.701812 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.009s	sys 0.005s
I20260709 12:17:53.719033 27874 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:53.713366 26954 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:53.748145 26954 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:53.707728 27685 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16.
I20260709 12:17:53.713646 27921 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:53.716666 27914 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:53.750162 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:53.747187 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46059us
I20260709 12:17:53.739892 27889 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:53.780671 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:53.782855 22898 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
W20260709 12:17:53.783867 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.786027 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:53.786620 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:53.787446 22824 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:53.789541 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:53.790866 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:53.793159 26954 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:53.791767 22893 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:17:53.797840 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:53.788864 22718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.009s	sys 0.014s
W20260709 12:17:53.800230 22718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.009s	sys 0.014s
I20260709 12:17:53.802747 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:53.750927 27671 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:53.803725 22820 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:17:53.810953 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.755645 27878 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:53.811617 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:53.741693 27862 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:53.815639 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 161584us
I20260709 12:17:53.773018 27874 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:53.818681 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 63417.9us
W20260709 12:17:53.820122 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:53.822727 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 131356us
I20260709 12:17:53.823951 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:53.824553 22819 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:53.818261 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:53.827651 22790 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:53.803557 27772 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:17:53.825989 27921 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.741163 23656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:45580
I20260709 12:17:53.859133 22900 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:53.853686 22744 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:53.857208 23656 raft_consensus.cc:606] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:53.830981 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:53.816035 27878 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.875732 22790 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:53.822417 27688 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:53.866353 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:53.869984 22898 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:53.821564 27914 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:53.882119 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:53.832927 27929 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:17:53.887441 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:53.910470 22818 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:17:53.847704 27892 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:53.839587 27757 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:53.916535 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:53.917847 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:53.918812 22896 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:53.833005 27894 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:53.831363 27541 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:17:53.811522 27918 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:17:53.836170 27772 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:53.874238 27495 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:53.921106 22823 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:53.878816 27873 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:53.832080 27879 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.152s
I20260709 12:17:53.894672 27914 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:53.923216 27936 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:53.925946 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:53.831988 27494 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:17:53.835882 27828 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:53.910518 22893 raft_consensus.cc:2410] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:53.967725 27541 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.935119 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:53.831907 27925 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.168s
I20260709 12:17:53.926692 22894 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:17:53.933715 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:53.832183 27930 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:17:54.007493 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:53.844762 27921 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:53.831812 27682 consensus_queue.cc:1048] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:17:53.912020 27557 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:53.976032 22750 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:54.032570 22750 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:53.873728 27878 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:53.980633 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:54.034229 22823 raft_consensus.cc:2376] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13. Re-sending same reply.
I20260709 12:17:53.987789 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:54.035679 22748 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:53.993374 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:53.993975 22818 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:53.869629 27832 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:53.845669 27874 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:53.934448 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:54.006865 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 80998.9us
I20260709 12:17:54.010942 22826 raft_consensus.cc:2368] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16.
I20260709 12:17:53.884162 27920 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 12:17:53.918406 27809 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:17:54.012979 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:54.046023 22745 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:17:53.912544 27807 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
W20260709 12:17:54.014374 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 80771.4us
I20260709 12:17:54.044664 22750 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:54.033486 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 186402us
I20260709 12:17:54.049609 22750 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:54.006376 27541 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:54.051077 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:54.048904 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:54.053797 27557 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:54.054994 27557 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:54.058760 22750 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:17:54.059545 27807 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:17:54.060014 27807 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:54.060972 27807 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:54.062266 27807 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:54.012598 27933 raft_consensus.cc:2764] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:17:54.015775 27918 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:17:53.991991 27873 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:54.040365 27567 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.045195 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:54.076161 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:54.048904 27920 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:54.083153 27920 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:54.084134 27920 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.039389 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:54.085472 27920 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:54.070171 27863 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:54.088286 27862 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:54.078972 27918 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:54.090195 27914 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:54.090915 23679 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:54.092082 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:54.092691 27921 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:54.093321 27772 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:54.094303 27863 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:54.095870 27863 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:54.096411 27885 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:54.096926 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:54.089824 27918 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:54.038905 27930 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:54.099225 27932 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:54.099795 27494 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:17:54.101280 27889 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:54.045497 27682 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:54.111068 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:54.111897 22824 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:17:54.126264 22819 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:17:54.128490 22820 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
W20260709 12:17:54.123297 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 474121us
W20260709 12:17:54.141570 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 44726.9us
W20260709 12:17:54.142045 27944 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:17:54.143715 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:54.128528 27889 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:54.147002 27862 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:54.147557 27862 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:54.149662 27862 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:54.129408 27682 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.151268 27682 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:54.151424 27877 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:54.152078 27877 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.155771 27930 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 18.7, Last appended by leader: 7, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:54.158617 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 81428us
I20260709 12:17:54.120160 27932 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:54.160979 27932 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:54.158728 27933 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:54.139555 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:54.120482 27894 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:54.169775 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1212) took 1048 ms. Trace:
I20260709 12:17:54.058540 27888 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.162087 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:54.173152 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:54.173869 22900 rpcz_store.cc:276] 0709 12:17:53.121180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.121349 (+   169us) service_pool.cc:224] Handling call
0709 12:17:53.152008 (+ 30659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:53.871986 (+719978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.169526 (+297540us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b540057bcd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:54.169707 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622703872}
I20260709 12:17:54.154488 27877 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:54.187705 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:54.182698 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:54.193542 23685 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 16. Ops: []
I20260709 12:17:54.194898 27888 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:54.195362 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:54.196595 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:54.190488 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:54.198349 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.204758 27832 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:54.109544 27567 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:54.211125 27877 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:54.211977 27877 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.213842 27567 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:54.214521 27877 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:54.219168 27917 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.220129 27917 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.223121 27921 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:54.166076 27933 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:54.244015 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.166194 27293 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:54.268272 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 72397.1us
W20260709 12:17:54.269260 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 86659.2us
I20260709 12:17:54.176239 27871 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:17:54.179994 27862 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:54.191728 27809 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:54.283490 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.281410 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:54.372742 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 88318.1us
I20260709 12:17:54.402029 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.196496 27858 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:17:54.375958 22900 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:54.271544 27933 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:54.177115 27796 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:17:54.190388 27494 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.183s
I20260709 12:17:54.241717 27918 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:54.276286 27833 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:54.427665 23656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:45580
I20260709 12:17:54.429921 23656 raft_consensus.cc:606] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:54.430444 23656 raft_consensus.cc:614] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:54.438822 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:54.284380 27947 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:54.466697 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.473037 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.473950 22899 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:17:54.480356 22900 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:54.496181 26954 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:54.422128 27874 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.496937 26954 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.416831 27888 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:54.501349 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.504657 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.509790 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.515538 26954 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:54.516173 26954 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:54.516652 26954 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:54.417301 27921 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:54.531667 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:54.531654 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:54.534257 22901 raft_consensus.cc:2376] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12. Re-sending same reply.
I20260709 12:17:54.537683 26954 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:54.471097 27918 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:54.468878 27833 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.517210 27893 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:54.513587 27888 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.511073 27874 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:54.517838 27541 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:54.591811 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.594728 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:54.569880 27832 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:54.524818 27927 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.416s
I20260709 12:17:54.614360 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:54.610016 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:54.618520 27927 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:54.619048 27927 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:54.619944 27927 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.620995 27927 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:54.621181 27897 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:54.621294 27538 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.875s	user 0.007s	sys 0.003s
I20260709 12:17:54.621784 27897 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.623317 27961 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:54.624117 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:54.625521 27620 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:54.637970 27748 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:54.638479 27748 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:54.639456 27748 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.640353 27897 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:54.646200 27873 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:54.647344 27959 log.cc:927] Time spent T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:17:54.612378 27832 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:54.650048 27832 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:54.651664 27541 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:54.654096 27949 log.cc:927] Time spent T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.151s	user 0.000s	sys 0.003s
I20260709 12:17:54.655494 27921 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:54.657223 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1075) took 1557 ms. Trace:
I20260709 12:17:54.657696 23685 rpcz_store.cc:276] 0709 12:17:53.100129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.100309 (+   180us) service_pool.cc:224] Handling call
0709 12:17:53.137274 (+ 36965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.194053 (+1056779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.656903 (+462850us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002909d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:54.657142 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428558592}
I20260709 12:17:54.660887 27932 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:54.662706 22745 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:54.665812 27874 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:54.626368 27833 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:54.627136 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.668110 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:54.668701 27807 consensus_meta.cc:287] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.606s	user 0.005s	sys 0.009s
I20260709 12:17:54.669672 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:54.627974 27757 consensus_meta.cc:287] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.004s
W20260709 12:17:54.628575 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.691056 22892 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
W20260709 12:17:54.615886 27922 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:17:54.635486 23659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "790207f3e8474996938608fcdf438660"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:45580
I20260709 12:17:54.695408 23659 raft_consensus.cc:606] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:54.695914 23659 raft_consensus.cc:614] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:54.671020 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:54.670698 22894 raft_consensus.cc:2368] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15.
I20260709 12:17:54.675665 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.697737 22901 raft_consensus.cc:2410] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:17:54.583348 27893 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.717242 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:54.743213 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:54.717420 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:54.744678 22818 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:54.743505 22821 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:54.746585 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:54.631712 27917 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:54.773873 22823 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:17:54.769424 22897 raft_consensus.cc:2376] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13. Re-sending same reply.
I20260709 12:17:54.774123 22820 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:17:54.778257 27874 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.738724 27807 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:54.783353 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:54.783968 22746 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:17:54.787207 27807 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.789299 27807 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:54.779170 27874 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:54.779558 27796 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:54.791581 27796 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:54.792829 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 1025) took 1040 ms. Trace:
I20260709 12:17:54.792613 27796 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:54.793314 22892 rpcz_store.cc:276] 0709 12:17:53.751966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.752896 (+   930us) service_pool.cc:224] Handling call
0709 12:17:54.792639 (+1039743us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b5400080054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:54.792753 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070838144}
I20260709 12:17:54.793828 27796 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:54.796243 27874 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:54.800343 27874 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:54.802956 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 399899us
W20260709 12:17:54.809844 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.002s	sys 0.006s
I20260709 12:17:54.811908 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:54.812911 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.814458 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:54.705296 27643 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.816885 22897 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
W20260709 12:17:54.817934 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.003s	sys 0.006s
I20260709 12:17:54.819164 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:54.826987 22751 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:54.816147 23660 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:54.832198 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:54.636530 27538 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:54.690829 27682 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:54.837481 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 647041us
I20260709 12:17:54.818109 27874 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:54.860040 22717 leader_election.cc:400] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16.
I20260709 12:17:54.861754 22717 leader_election.cc:403] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:17:54.876427 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:54.881155 27541 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:17:54.868316 27889 consensus_meta.cc:287] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.720s	user 0.005s	sys 0.008s
W20260709 12:17:54.872573 27920 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.787s	user 0.016s	sys 0.000s
I20260709 12:17:54.897450 23695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:45580
I20260709 12:17:54.904003 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:54.905921 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:54.906590 22826 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:54.907219 22749 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:54.825246 27643 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:54.908142 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 62734.6us
I20260709 12:17:54.909961 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:54.903662 27889 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:54.907258 27910 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.354s	user 0.001s	sys 0.013s
W20260709 12:17:54.913167 27878 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.869s	user 0.007s	sys 0.004s
I20260709 12:17:54.918447 27538 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:54.918973 22826 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:54.923926 27682 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:54.926175 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.928457 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:54.941028 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:54.941656 22747 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:54.933616 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:54.940390 22744 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:54.896637 27567 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:54.903584 27770 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:54.965621 22818 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:54.969470 27874 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:54.975637 27893 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:54.981509 27933 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.003s
I20260709 12:17:54.951130 27920 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:54.983304 27920 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:54.983707 27920 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:54.960750 27567 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:54.986006 27567 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:54.950495 27970 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:54.986907 27970 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:54.932204 27976 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16.
I20260709 12:17:54.989259 27970 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:54.940707 27878 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:54.989650 22749 raft_consensus.cc:2410] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:17:54.990186 27770 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:54.991194 27878 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:54.991532 22747 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:54.944830 27932 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:54.992419 27770 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:54.999168 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 48647.3us
I20260709 12:17:55.000198 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:55.001713 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46448.7us
I20260709 12:17:55.012777 27946 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:17:54.983724 27889 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:55.030359 22901 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:55.032274 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:55.036762 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:55.041147 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:55.041913 22894 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:17:55.042137 23685 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 17: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:55.047528 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:55.048255 22897 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:55.041080 27932 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:17:55.048413 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 45372.1us
I20260709 12:17:54.982120 27933 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:55.063199 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.041749 27682 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:55.069790 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:55.071849 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:55.069108 27682 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.074108 27932 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:55.074489 27682 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:55.088440 22753 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:55.089892 23695 raft_consensus.cc:606] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.090422 23695 raft_consensus.cc:614] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:55.097268 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.098289 23674 raft_consensus.cc:2410] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:17:55.099210 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.099472 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1076) took 1999 ms. Trace:
I20260709 12:17:55.099295 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.100596 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.101027 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.101783 23685 raft_consensus.cc:2368] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19.
I20260709 12:17:55.098217 27892 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:55.105492 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.100018 23679 rpcz_store.cc:276] 0709 12:17:53.100481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.100883 (+   402us) service_pool.cc:224] Handling call
0709 12:17:53.111271 (+ 10388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.091378 (+980107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.099242 (+1007864us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54003a7d54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:55.099419 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2213068160}
I20260709 12:17:55.099647 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.106699 23682 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:17:55.107758 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.104918 27892 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:55.115365 27970 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.115684 22897 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:55.116364 27892 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:55.117894 27892 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:55.118990 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:55.120854 22790 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:55.122740 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1360) took 1016 ms. Trace:
I20260709 12:17:55.123464 22745 rpcz_store.cc:276] 0709 12:17:54.105856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.202142 (+ 96286us) service_pool.cc:224] Handling call
0709 12:17:54.202530 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.663148 (+460618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.122354 (+459206us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b540043f654. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:55.122648 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057806080}
I20260709 12:17:55.128448 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.131374 27870 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.133314 27870 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:55.134176 27947 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:55.135105 27947 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:55.124228 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.085359 27567 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:17:55.109835 22717 connection.cc:256] RPC call timeout handler was delayed by -2.0604967809999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 12:17:55.113919 22894 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
W20260709 12:17:55.145105 22717 connection.cc:256] RPC call timeout handler was delayed by -2.0370967809999456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 12:17:55.145697 22717 connection.cc:256] RPC call timeout handler was delayed by -2.0289967809999325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 12:17:55.146085 22717 connection.cc:256] RPC call timeout handler was delayed by -1.906596780999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
W20260709 12:17:55.146420 22717 connection.cc:256] RPC call timeout handler was delayed by -1.8237967809998281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 12:17:55.147022 22717 connection.cc:256] RPC call timeout handler was delayed by -1.5753967809998812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:17:55.147641 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0534233339999446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 12:17:55.147724 22745 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:17:55.147990 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0399233339999228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
I20260709 12:17:55.135903 27870 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:55.150921 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44978.9us
I20260709 12:17:55.155320 22751 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:17:55.135644 27947 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:55.145049 27863 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.138232 27970 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:55.168217 27933 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:55.169639 27988 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:17:55.171906 27928 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:17:55.227217 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:55.179958 27870 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:55.144992 27567 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.154572 27688 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:55.150461 27807 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:55.189484 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:55.190842 27941 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 1.250s	user 0.008s	sys 0.003s
I20260709 12:17:55.194764 23493 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:55.244163 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 49504.2us
I20260709 12:17:55.145331 27937 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:55.205809 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.246857 22745 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:17:55.206079 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:55.152017 27925 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:55.205426 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.230567 22751 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:55.237190 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.241660 27894 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:55.242865 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 1169) took 1052 ms. Trace:
I20260709 12:17:55.207105 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.228801 27932 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.255070 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.253885 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.254230 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:55.251250 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.253247 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.253669 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.252981 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.255956 22749 rpcz_store.cc:276] 0709 12:17:54.181626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.194975 (+ 13349us) service_pool.cc:224] Handling call
0709 12:17:55.228034 (+1033059us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54001e5fd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:55.233430 (+  5396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623026560}
I20260709 12:17:55.240952 27567 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:55.252137 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.253831 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:55.263736 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 74346.1us
I20260709 12:17:55.260535 22745 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:55.236601 27882 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:55.269215 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.227159 27871 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:17:55.278715 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.279603 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:55.281576 22748 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:17:55.277019 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.283432 22744 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:55.250494 27933 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:55.258101 27770 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:55.206857 27863 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:55.234203 27974 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:17:55.294085 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:55.245424 27807 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:55.299424 27643 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.299628 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.327659 22865 leader_election.cc:400] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 20. Current term is 21.
I20260709 12:17:55.328043 22865 leader_election.cc:403] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:55.254588 27894 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:55.302649 27936 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.288483 27889 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:55.278566 27925 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:55.274392 27932 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:55.308231 27970 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:55.309655 27920 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:55.316243 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.323231 22751 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:55.278168 27882 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:55.246294 27688 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:55.325228 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.254693 27937 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:55.338815 22749 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:55.340235 22865 leader_election.cc:400] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20.
I20260709 12:17:55.354220 22865 leader_election.cc:403] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:17:55.340653 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:55.332322 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.356669 22746 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
W20260709 12:17:55.358567 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 64530.6us
W20260709 12:17:55.341609 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 147594us
I20260709 12:17:55.324298 27870 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.359911 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:55.362581 27770 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:17:55.373299 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:55.364559 27882 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.366398 27688 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.368216 27937 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.368685 22747 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:55.369165 22819 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:55.371788 27807 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:55.329631 27928 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:55.372226 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.372962 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.362762 27757 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20.
I20260709 12:17:55.375119 22752 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:17:55.382591 22746 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 10.
I20260709 12:17:55.330228 27682 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:55.372061 27863 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.378917 22748 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:17:55.343873 27643 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 20. Current term is 21.
I20260709 12:17:55.350946 27976 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:55.383613 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:55.384303 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:55.377660 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.378319 27877 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:55.384485 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.344074 27936 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:55.402489 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.382143 27970 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:55.404601 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:55.398756 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.398876 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:55.406870 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:55.383039 27770 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:55.376906 27870 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:55.394732 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 107660us
I20260709 12:17:55.410238 22790 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.411099 27933 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:55.411566 27928 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:55.411808 27933 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:55.412176 27928 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:55.412689 27928 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:55.415778 27932 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:55.417358 27682 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:55.418045 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:55.418851 22899 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:55.419231 27770 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:55.403920 27925 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:55.425343 27936 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:55.399564 27688 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:55.426671 27688 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:55.429634 27688 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.403620 27877 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:55.432299 27877 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:55.433784 27928 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:55.412708 27933 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:17:55.436997 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.425439 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:55.454159 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 47402.7us
I20260709 12:17:55.454424 22893 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:55.439546 27870 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.444830 22899 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:17:55.456246 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.462008 22897 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:17:55.462301 22895 raft_consensus.cc:2410] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:55.458312 22893 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:17:55.458479 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 84421.6us
W20260709 12:17:55.456580 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 116534us
I20260709 12:17:55.408829 27757 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:55.473366 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.467701 22897 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:17:55.476052 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.383224 27894 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:55.487767 27947 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:55.455235 27494 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:55.490549 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:55.492803 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.498620 23659 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:17:55.495106 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.499727 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.500217 22821 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:55.495955 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.496287 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.501361 23674 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 13: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:55.502437 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.504441 22824 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:55.505702 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.506253 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.507059 22898 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:17:55.507576 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:55.507860 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.508481 22895 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:55.508829 27863 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:55.512280 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.464092 27927 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:55.513304 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:55.509022 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:55.515815 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.517421 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:55.514220 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.470821 27999 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.471660 27871 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:17:55.521494 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.522267 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.536022 23656 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:55.523892 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.527957 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.524652 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.479657 27757 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.526654 22820 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:17:55.530766 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.490147 27947 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.531447 22897 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 15: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:55.529970 22893 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:55.537253 22899 raft_consensus.cc:2368] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19.
I20260709 12:17:55.537388 23679 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:17:55.510165 27863 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:55.541939 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.546483 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:55.553601 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.554610 22899 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:55.556267 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:55.557231 22899 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:55.523433 27974 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:55.562929 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:55.537420 23674 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:17:55.563812 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:55.527441 27937 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:55.566165 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.541441 27757 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:55.602505 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:55.566972 28004 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:17:55.576021 27918 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.539326 27999 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:55.609663 27999 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:55.584057 27882 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:17:55.589741 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:55.604383 22901 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:55.634967 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:55.635545 22899 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:55.581131 27920 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:55.581487 27946 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.628911 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:55.590734 27770 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:55.643183 22895 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:55.644426 22901 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: [13.8-14.9]
I20260709 12:17:55.638697 27541 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:55.646714 22895 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
W20260709 12:17:55.659505 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 169054us
W20260709 12:17:55.660573 22717 leader_election.cc:336] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.986s (SENT)
I20260709 12:17:55.661111 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:55.667950 27879 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:17:55.668623 27863 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:55.668766 22899 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:55.669001 27918 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:55.642041 27770 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:55.655593 27541 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.681425 26954 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:17:55.690531 27688 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.690984 27928 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.691345 27688 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:55.693929 27688 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:55.642822 27946 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:55.696415 27946 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:55.664186 27567 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:55.697793 27976 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:55.699096 22823 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:55.668663 27879 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:55.679219 27770 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:55.704358 27927 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:55.699191 27541 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:17:55.714098 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 181872us
I20260709 12:17:55.721006 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:55.723193 27937 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:55.724776 27937 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:55.725230 27888 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:55.729390 22820 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:17:55.729924 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.725319 27937 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:55.733336 27937 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:55.742955 27757 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:55.747745 27770 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:55.750226 27770 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.750502 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.745849 27541 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:55.740347 27567 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:55.738711 27879 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:55.756150 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.780647 22818 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:17:55.756558 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.781603 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:55.754624 27950 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 1.232s	user 0.006s	sys 0.000s
I20260709 12:17:55.767618 22820 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:55.784847 22820 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:17:55.787881 22824 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:55.793612 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.794364 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.795010 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.781021 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:55.782573 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:55.773187 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:55.781603 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:55.804113 23656 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:55.756227 27757 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.808327 27933 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:55.800324 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.811537 23685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:45580
I20260709 12:17:55.812207 22824 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:55.768633 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.768870 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.782935 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:55.755324 27541 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:55.777961 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:55.812237 23685 raft_consensus.cc:606] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.817193 23685 raft_consensus.cc:614] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:55.815335 22818 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:55.779244 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:55.820322 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 159788us
W20260709 12:17:55.821022 22717 leader_election.cc:336] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.010s (SENT)
I20260709 12:17:55.823171 23493 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.824345 27541 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:17:55.825131 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.827821 27541 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:55.831745 22751 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:17:55.832976 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:55.833567 22751 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:55.837199 22717 leader_election.cc:336] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.070s (SENT)
I20260709 12:17:55.837827 23493 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.837996 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:55.845095 22744 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:17:55.845211 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.845237 23656 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
W20260709 12:17:55.855214 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 76049.1us
W20260709 12:17:55.856024 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 173487us
I20260709 12:17:55.856300 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.856947 27875 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:17:55.857489 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.863577 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.865149 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:55.866148 22749 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:55.866876 22818 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 12:17:55.857743 27930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.265s	user 0.003s	sys 0.016s
I20260709 12:17:55.859253 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:55.831534 27933 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:55.888320 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:55.846315 27871 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:55.882305 22751 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:55.868462 27885 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:55.858762 27970 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:17:55.883174 27930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.003s	sys 0.016s
I20260709 12:17:55.884044 23493 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.857862 27928 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:55.855243 27541 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:55.892756 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:55.870278 28011 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:55.883853 27325 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:55.890111 27858 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:17:55.912910 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 75738.3us
W20260709 12:17:55.917210 22717 leader_election.cc:336] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.114s (SENT)
I20260709 12:17:55.893385 27643 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:55.912441 27325 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.921854 27325 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:55.918678 23493 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:55.918730 22717 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.177s (SENT)
I20260709 12:17:55.947685 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:55.892560 27882 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:17:55.945223 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:55.945719 22749 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:17:55.917472 27918 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:55.920392 27643 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.960423 27643 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:55.967368 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 48657.8us
W20260709 12:17:55.968318 22717 leader_election.cc:336] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.229s (SENT)
I20260709 12:17:55.968823 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:55.953305 27871 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:55.971757 28018 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:17:55.972707 27921 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:55.972900 27748 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:55.953743 27879 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:55.955006 27970 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:55.913304 28017 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:17:55.943231 28023 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:17:55.980842 27877 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:55.986481 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.987895 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:55.948655 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:55.929157 27969 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:55.980875 27885 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:56.001395 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:56.001643 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 53087us
I20260709 12:17:56.005275 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:56.006554 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:55.990816 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:55.954133 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 60669.9us
I20260709 12:17:56.007498 22751 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:17:56.008924 22749 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:55.926194 27889 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:17:56.015259 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:56.018464 22717 leader_election.cc:400] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19.
I20260709 12:17:56.018890 22717 leader_election.cc:403] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:56.013656 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:56.013152 27970 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:56.020649 27927 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19.
I20260709 12:17:56.013480 27921 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:56.002526 28023 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:17:56.021574 27927 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:56.021955 28023 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:56.022950 22751 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:56.023928 27933 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:56.019906 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:56.026507 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:56.027410 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1181) took 1960 ms. Trace:
I20260709 12:17:56.027444 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:56.025028 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:56.028882 22751 raft_consensus.cc:2368] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14.
I20260709 12:17:56.030872 27567 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.031642 27567 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:56.013734 28017 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:56.033824 28017 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:56.034085 27567 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:56.035524 22822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 882) took 2238 ms (client timeout 2063 ms). Trace:
W20260709 12:17:56.036001 22822 rpcz_store.cc:269] 0709 12:17:53.797475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.797613 (+   138us) service_pool.cc:224] Handling call
0709 12:17:56.035226 (+2237613us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b54002e8954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:56.035404 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4877935872}
I20260709 12:17:56.004297 27885 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:56.034307 28017 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:56.031147 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:56.027933 22750 rpcz_store.cc:276] 0709 12:17:54.067213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.068744 (+  1531us) service_pool.cc:224] Handling call
0709 12:17:54.069186 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:54.137328 (+ 68142us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:54.464288 (+326960us) log.cc:844] Serialized 14 byte log entry
0709 12:17:54.661780 (+197492us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b48000ed258. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf96a8aa1 00007fadf969fb37 00007fadf969f9ca 00007fadf979726f 00007fadf9796f37 00007fadf97ab55c 00007fadf97ab508 00007fadf97ab488 00007fadf97ab443 00007fadf97aa6ec 00007fadf86d4a96
0709 12:17:55.313000 (+651220us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b1800314560. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:17:55.462258 (+149258us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.462390 (+   132us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:55.463546 (+  1156us) log.cc:844] Serialized 26 byte log entry
0709 12:17:55.463723 (+   177us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:55.492424 (+ 28701us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.505390 (+ 12966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.505478 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:55.749755 (+244277us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b1800314560. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:17:56.027190 (+277435us) raft_consensus.cc:1685] finished
0709 12:17:56.027212 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.027343 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":184101,"prepare.queue_time_us":421417,"prepare.run_cpu_time_us":143,"prepare.run_wall_time_us":3470,"raft.queue_time_us":44193,"raft.run_cpu_time_us":11379,"raft.run_wall_time_us":539672,"spinlock_wait_cycles":87059840,"thread_start_us":399648,"threads_started":2,"wal-append.queue_time_us":1082558}
I20260709 12:17:56.028241 22749 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:56.041035 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:56.022509 28023 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:56.045858 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:56.047328 22717 leader_election.cc:400] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19.
I20260709 12:17:56.055982 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1191) took 1222 ms. Trace:
I20260709 12:17:56.022478 27927 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:56.059394 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:56.056668 22753 rpcz_store.cc:276] 0709 12:17:54.833802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.845414 (+ 11612us) service_pool.cc:224] Handling call
0709 12:17:54.873398 (+ 27984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.089428 (+216030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.055566 (+966138us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54004060d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:56.055882 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492304768}
I20260709 12:17:56.051231 27921 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:56.093381 22749 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
W20260709 12:17:56.109824 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 155718us
I20260709 12:17:56.052873 27976 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:56.053282 27920 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:56.121407 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.067953 28004 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:56.044049 27937 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:56.111629 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:56.111996 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.113976 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:56.118258 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:56.062685 27927 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:56.110062 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1031) took 1598 ms. Trace:
I20260709 12:17:56.071393 27947 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:17:56.135547 22896 rpcz_store.cc:276] 0709 12:17:54.512055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.519879 (+  7824us) service_pool.cc:224] Handling call
0709 12:17:54.520433 (+   554us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:55.726312 (+1205879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.726344 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:55.727000 (+   656us) log.cc:844] Serialized 52 byte log entry
0709 12:17:55.730998 (+  3998us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:55.731049 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.077551 (+346502us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002bd254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:56.077625 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:56.077704 (+    79us) raft_consensus.cc:1685] finished
0709 12:17:56.077726 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.109991 (+ 32265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42644,"raft.queue_time_us":4488,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":469,"spinlock_wait_cycles":2772932736,"thread_start_us":3545,"threads_started":1,"wal-append.queue_time_us":141053}
I20260709 12:17:56.139540 22748 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:17:56.139948 22748 pending_rounds.cc:85] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 9
I20260709 12:17:56.140190 22748 pending_rounds.cc:107] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:17:56.140501 22748 raft_consensus.cc:2889] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:56.136075 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:17:56.143953 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 95345.4us
I20260709 12:17:56.143996 23672 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:56.144901 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:56.109473 27921 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.081462 27932 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:17:56.117841 27933 raft_consensus.cc:2764] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:17:56.155121 27921 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:56.143404 27538 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:56.154081 22790 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:56.158500 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:56.177800 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:56.139024 27885 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:56.186348 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:56.143587 27770 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:17:56.201241 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 64065.8us
I20260709 12:17:56.205214 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:56.215224 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:56.216064 27918 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:56.156024 27889 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:17:56.217998 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:56.218705 22892 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:56.219022 27889 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:17:56.220881 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 66887.3us
I20260709 12:17:56.222815 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:56.165016 27920 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:17:56.247495 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 89531.9us
I20260709 12:17:56.250265 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:56.200173 27947 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:56.246644 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 99664.7us
W20260709 12:17:56.257022 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.257727 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:56.260026 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:56.262063 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:56.231112 28015 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:17:56.176649 27888 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:17:56.272276 28031 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:56.272796 27770 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:17:56.199726 27976 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:17:56.143985 28023 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:56.230990 27685 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:56.231232 27688 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:56.239943 27920 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.277135 27885 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:56.285302 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 102051us
I20260709 12:17:56.291371 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:56.265345 27947 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:56.297559 22745 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:17:56.379681 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 72800.6us
I20260709 12:17:56.274806 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:56.304685 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:56.271047 27557 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:56.265611 27538 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:56.263981 27937 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:56.310083 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:56.269642 28016 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:56.341784 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:56.379915 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 69185.4us
I20260709 12:17:56.304904 23656 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:56.343356 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:56.383776 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:56.409359 23493 leader_election.cc:400] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14.
I20260709 12:17:56.420833 23672 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:56.404750 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:56.405629 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 130886us
I20260709 12:17:56.452679 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:56.404399 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:56.450132 22899 raft_consensus.cc:2376] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15. Re-sending same reply.
I20260709 12:17:56.449227 23493 leader_election.cc:403] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:17:56.456022 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:56.294466 27685 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.463637 28004 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:56.293362 28031 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:56.307003 27996 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:56.312207 27920 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:17:56.396375 28028 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
I20260709 12:17:56.480605 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:56.391603 27970 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.385179 27928 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:17:56.495193 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46396.5us
I20260709 12:17:56.384640 27916 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:56.398969 28027 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:56.493002 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:56.342707 28014 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.171s
I20260709 12:17:56.499143 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:56.502354 22895 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:17:56.502159 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:56.503314 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 50751us
I20260709 12:17:56.474448 27685 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:56.507460 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:56.514235 28033 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:56.514802 22895 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:17:56.501627 28043 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:17:56.516206 28031 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:56.499963 27894 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:56.519119 27976 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:56.520135 27976 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:56.520602 27976 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:56.520992 27976 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:56.525695 27643 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.000s
I20260709 12:17:56.526348 27643 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:56.529865 22894 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:17:56.505025 27916 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:56.534142 27916 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:56.499228 27970 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:56.536607 27875 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:56.537065 27875 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:56.498083 27770 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:56.537935 27875 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:56.501600 28027 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:56.539855 27325 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.002s
I20260709 12:17:56.541603 22819 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:56.539595 28027 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:56.544539 22895 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 12:17:56.547305 22892 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:17:56.545099 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:56.551625 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:56.554967 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:56.556244 22746 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:56.549728 27325 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:56.559329 27947 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:56.559672 27918 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:56.560326 27918 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:56.560510 27947 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:56.560926 27918 consensus_queue.cc:1243] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:17:56.561602 27875 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:56.487614 28004 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:56.563045 27999 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:56.563519 27999 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:56.564319 27999 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:56.565560 27999 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:56.541039 27748 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.536s	user 0.013s	sys 0.000s
I20260709 12:17:56.457377 28016 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:56.567893 22900 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:17:56.580967 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:56.581882 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:56.604358 26954 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.606552 26954 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:56.392172 27538 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:56.550675 27932 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:56.605707 22744 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:56.566226 28041 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:17:56.550401 27888 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14.
I20260709 12:17:56.609849 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:56.614638 22822 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:56.550518 27969 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:56.560802 27325 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:56.536689 27970 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:56.644289 27970 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:56.645233 27970 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:17:56.646018 27970 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:56.508469 27937 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:56.632938 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 83770.9us
I20260709 12:17:56.612632 22819 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
W20260709 12:17:56.623067 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 213921us
I20260709 12:17:56.628628 22820 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:17:56.629971 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:56.656792 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.669529 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:56.628103 28027 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:56.625795 28041 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:56.675801 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45824.2us
I20260709 12:17:56.677699 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:56.678473 23672 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:56.634407 28056 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:56.682300 23679 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:17:56.683616 23493 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:56.664302 27567 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:56.670965 27643 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:56.667500 27325 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:17:56.689719 28056 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:56.704499 28040 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:17:56.705298 28056 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:56.693791 28043 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:17:56.713322 28043 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:56.714749 28043 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:56.718353 26954 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:56.725106 27921 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.001s
I20260709 12:17:56.693432 27567 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.726063 27567 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:56.725796 27921 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:56.723299 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.692732 27888 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:17:56.742766 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:56.748001 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 57373.3us
W20260709 12:17:56.751755 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 73913.4us
I20260709 12:17:56.754197 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:56.754251 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:56.755443 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:56.755730 22749 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:17:56.757365 22823 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:17:56.758962 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:17:56.793506 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 284567us
W20260709 12:17:56.868225 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 114119us
I20260709 12:17:56.939836 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:56.942291 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:56.943104 23695 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:17:56.943363 23689 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:17:56.943774 23689 pending_rounds.cc:85] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 9
I20260709 12:17:56.945827 23689 pending_rounds.cc:107] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:17:56.946077 23689 raft_consensus.cc:2889] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:56.949497 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:56.745352 28023 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:56.737779 28016 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:56.862082 27483 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:56.862164 28017 consensus_meta.cc:287] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.802s	user 0.012s	sys 0.001s
I20260709 12:17:56.952741 22749 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:17:56.975221 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 395562us
W20260709 12:17:56.975884 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 180869us
W20260709 12:17:56.955765 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 200395us
W20260709 12:17:56.941159 27885 consensus_meta.cc:287] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.528s	user 0.003s	sys 0.007s
I20260709 12:17:56.995541 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:57.008927 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:56.996773 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:57.004983 22748 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:57.009693 22745 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:17:57.014845 23493 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:56.744515 28050 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.300s
I20260709 12:17:57.008035 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:56.973184 28042 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:57.014446 26954 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:17:56.990626 27643 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.987762 27807 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:57.031397 23689 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:17:56.979537 28024 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:57.033739 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:57.036218 22748 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:17:56.986346 27916 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.029032 27643 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:57.038506 22819 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 12:17:57.040817 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:57.050709 22895 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:57.023825 27996 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.014395 27483 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.030576 27325 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:57.038980 27538 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.998333 27757 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:17:57.061811 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:57.050472 28021 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:17:57.039573 27871 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.036936 28049 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:57.051927 28031 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:57.020301 28017 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:57.082881 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:57.060787 27325 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:57.071076 28057 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:17:57.039300 27933 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:17:57.036537 28056 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:17:57.061297 27996 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:57.084105 28055 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:57.090430 27996 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:57.090726 28017 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:57.092119 23656 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:57.092365 27643 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:57.051081 27916 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:57.094852 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:57.095793 23689 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:17:57.096781 27921 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:57.098114 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:57.099211 23689 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:57.054417 28054 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:17:57.108235 28059 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 12:17:57.113075 27894 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
I20260709 12:17:57.116106 28031 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:17:57.118409 27920 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.001s
I20260709 12:17:57.074687 27807 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:17:57.126168 28062 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:17:57.079329 28049 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.133807 28031 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.074093 28051 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:17:57.084894 27871 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.052062 28024 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:57.077951 27538 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:57.140080 28066 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:17:57.141090 27685 consensus_meta.cc:287] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.000s
I20260709 12:17:57.084084 27325 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:57.153950 27807 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:57.178368 22898 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
W20260709 12:17:57.152952 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 66889.2us
W20260709 12:17:57.145725 27999 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.580s	user 0.014s	sys 0.002s
I20260709 12:17:57.138669 22901 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:17:57.155726 27567 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:57.194444 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 134988us
W20260709 12:17:57.229388 22717 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.124s (SENT) [suppressed 15 similar messages]
I20260709 12:17:57.227205 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:57.227047 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 1058) took 1041 ms. Trace:
I20260709 12:17:57.226558 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:57.239825 22823 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:57.239953 22897 rpcz_store.cc:276] 0709 12:17:56.185592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.186039 (+   447us) service_pool.cc:224] Handling call
0709 12:17:57.226831 (+1040792us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b5400080054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:57.226978 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039776128}
I20260709 12:17:57.154276 28049 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:57.142652 27920 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:57.166389 28051 consensus_queue.cc:1243] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:17:57.258266 22893 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:57.259830 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:57.187319 27858 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.268847 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:57.256696 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1056) took 1072 ms. Trace:
I20260709 12:17:57.274746 22896 rpcz_store.cc:276] 0709 12:17:56.184403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.185019 (+   616us) service_pool.cc:224] Handling call
0709 12:17:56.216190 (+ 31171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:56.478165 (+261975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:56.478213 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:56.488997 (+ 10784us) log.cc:844] Serialized 26 byte log entry
0709 12:17:56.521438 (+ 32441us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b48004f8558. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf96a8aa1 00007fadf969fb37 00007fadf969f9ca 00007fadf979726f 00007fadf9796f37 00007fadf97ab55c 00007fadf97ab508 00007fadf97ab488 00007fadf97ab443 00007fadf97aa6ec 00007fadf86d4a96
0709 12:17:56.652707 (+131269us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:17:56.652803 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.652889 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:57.247388 (+594499us) raft_consensus.cc:1685] finished
0709 12:17:57.247413 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.256594 (+  9181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121514,"raft.queue_time_us":68178,"raft.run_cpu_time_us":1945,"raft.run_wall_time_us":234367,"spinlock_wait_cycles":28338560,"thread_start_us":329851,"threads_started":2,"wal-append.queue_time_us":489259}
I20260709 12:17:57.274163 22748 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
W20260709 12:17:57.289067 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 49659.9us
I20260709 12:17:57.218556 28024 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:57.220571 27871 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:57.311640 22819 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:17:57.312053 22819 pending_rounds.cc:85] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 8
I20260709 12:17:57.306725 22747 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:17:57.312286 22819 pending_rounds.cc:107] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:17:57.312595 22819 raft_consensus.cc:2889] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:57.211246 28045 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:17:57.188148 27685 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.343262 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:57.343971 22822 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:17:57.305688 27967 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:57.439543 22823 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:17:57.311444 27870 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:57.225340 27807 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:57.447690 28071 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:17:57.451222 27920 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:57.454766 22826 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 12:17:57.455750 28072 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:17:57.456346 27967 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:57.458974 27870 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.288671 27858 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.336809 27885 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 12:17:57.465991 27963 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.469389 27963 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:57.471565 27963 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:57.476291 28075 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 12:17:57.480584 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 198906us
I20260709 12:17:57.480916 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1255) took 1182 ms. Trace:
W20260709 12:17:57.482851 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 253483us
I20260709 12:17:57.483399 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1253) took 1196 ms. Trace:
I20260709 12:17:57.485009 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:57.481562 22818 rpcz_store.cc:276] 0709 12:17:56.285281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.287002 (+  1721us) service_pool.cc:224] Handling call
0709 12:17:56.287344 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:56.312248 (+ 24904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:56.312284 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:56.940254 (+627970us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b2c0017bc48. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:17:56.940759 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:17:57.248425 (+307666us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:57.248487 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.248584 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:57.461895 (+213311us) raft_consensus.cc:1685] finished
0709 12:17:57.461916 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.467573 (+  5657us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85192,"raft.queue_time_us":23337,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":42011,"spinlock_wait_cycles":2318592,"thread_start_us":246443,"threads_started":1,"wal-append.queue_time_us":477176}
I20260709 12:17:57.481875 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:57.462029 27894 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.483779 22827 rpcz_store.cc:276] 0709 12:17:56.284645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.305910 (+ 21265us) service_pool.cc:224] Handling call
0709 12:17:56.394154 (+ 88244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:56.494809 (+100655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:56.494837 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:56.748751 (+253914us) spinlock_profiling.cc:243] Waited 991 us on lock 0x7b2c0017bc48. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:17:56.749222 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:17:57.243063 (+493841us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:57.243120 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.243220 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:57.461272 (+218052us) raft_consensus.cc:1685] finished
0709 12:17:57.461297 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.480687 (+ 19390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138298,"raft.queue_time_us":102769,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":6467,"spinlock_wait_cycles":2278272,"thread_start_us":492787,"threads_started":1,"wal-append.queue_time_us":697797}
I20260709 12:17:57.478504 27967 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:57.480223 28016 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:57.510357 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 168290us
I20260709 12:17:57.496523 27870 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:57.517481 22898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1582) took 2009 ms (client timeout 2124 ms). Trace:
I20260709 12:17:57.518226 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:57.494961 28031 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:17:57.501955 27920 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:57.549575 27976 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.028s	user 0.015s	sys 0.001s
I20260709 12:17:57.549379 27920 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.523285 27970 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:57.526754 27567 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:57.507043 28059 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:57.518033 27967 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:57.511713 28016 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.529332 27748 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:17:57.527742 28049 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:57.532868 28076 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:57.497901 28045 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:17:57.552024 27916 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:57.558622 27748 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:57.571084 27748 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:57.534199 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:57.536746 27685 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:57.541332 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:57.543052 22753 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:17:57.520069 27538 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:57.520421 28023 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.005s
W20260709 12:17:57.518718 22898 rpcz_store.cc:269] 0709 12:17:55.506271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.508793 (+  2522us) service_pool.cc:224] Handling call
0709 12:17:57.515101 (+2006308us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540072fe54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:57.515248 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3743809408}
I20260709 12:17:57.550117 27976 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:57.553547 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:57.556905 22750 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:57.506600 27894 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:57.586738 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 66796.7us
I20260709 12:17:57.526465 27325 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:57.587687 22899 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:57.572548 27748 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:57.587729 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:57.598429 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:57.555387 27970 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:57.600782 22748 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:17:57.582541 22790 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:17:57.590378 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56285.2us
I20260709 12:17:57.591066 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:57.606534 22750 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:57.607113 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:57.607383 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:57.607918 22750 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:17:57.608305 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:57.593122 27976 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:57.609443 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:57.610816 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:57.596483 28045 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:57.611718 28045 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:57.612618 28045 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:57.593677 22752 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:57.567553 28016 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:57.613315 27871 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:57.600036 27538 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:57.615981 27770 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:57.616617 27770 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:57.621712 23659 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:57.620132 27970 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:57.614287 27871 consensus_queue.cc:1243] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:57.620930 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:57.557996 28059 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:57.634352 22750 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:17:57.634250 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:57.605717 27974 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:17:57.636868 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 54455.8us
I20260709 12:17:57.637169 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:57.640544 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:57.641314 22823 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:57.626758 27967 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:57.626567 27770 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:57.644994 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:57.645210 22893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1587) took 1342 ms (client timeout 1702 ms). Trace:
I20260709 12:17:57.645426 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:57.646044 22822 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:57.646379 22818 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: [11.8-13.9]
W20260709 12:17:57.645793 22893 rpcz_store.cc:269] 0709 12:17:56.303809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.304346 (+   537us) service_pool.cc:224] Handling call
0709 12:17:57.645033 (+1340687us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b54004ed754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:57.645144 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1475142400}
I20260709 12:17:57.628687 27918 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:17:57.630443 27495 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:17:57.651258 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:57.632436 27920 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:57.654254 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:57.651902 27967 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:57.639117 27974 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.642549 27916 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:57.666180 22822 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:17:57.669366 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:57.669505 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:57.642318 28091 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:57.667413 27918 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:17:57.667797 27974 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:57.676119 28091 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.687353 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:57.662206 27970 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:17:57.689529 22893 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:17:57.694389 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:57.680115 27920 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:17:57.695504 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:57.690310 27541 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.696863 22818 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:17:57.711627 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:57.712458 22818 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:57.698086 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:57.697937 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:57.699365 28031 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.699699 28042 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:57.700179 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:57.716540 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:57.703126 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:57.704195 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1257) took 1418 ms. Trace:
I20260709 12:17:57.712989 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:57.718595 22898 raft_consensus.cc:2410] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:17:57.717351 22826 rpcz_store.cc:276] 0709 12:17:56.285852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.286001 (+   149us) service_pool.cc:224] Handling call
0709 12:17:56.286497 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:57.455358 (+1168861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.703787 (+248429us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400302854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:57.704106 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2686076672}
I20260709 12:17:57.710328 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:57.713734 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:57.720840 23656 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 17: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:57.714593 22824 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:57.714330 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:57.720338 22818 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:17:57.720103 22826 pending_rounds.cc:85] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 8
I20260709 12:17:57.724391 22826 pending_rounds.cc:107] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 12:17:57.724769 22826 raft_consensus.cc:2889] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:57.694757 27970 consensus_queue.cc:1243] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:17:57.727506 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:57.691862 28091 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:57.729116 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:57.732972 22821 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:17:57.740108 28012 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:17:57.728324 27685 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:17:57.748889 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:57.749794 22753 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:57.751785 27967 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:57.743609 28051 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:57.753043 27325 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:57.752867 28051 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.718876 28042 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:57.764737 28051 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:57.767160 28041 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.769011 28041 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:57.770526 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:57.771548 28042 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:57.772185 28093 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:57.721989 28031 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:57.772809 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:17:57.772814 28093 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:57.773993 28093 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:57.774870 28031 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:57.776328 28012 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:17:57.776374 27807 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:17:57.776935 28012 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:57.777248 27807 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:57.777989 28012 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:57.733738 28049 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:57.778235 27807 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:57.745440 27894 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:17:57.781096 28095 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:17:57.781810 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:57.782666 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:57.782994 22824 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:17:57.785063 28068 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.440s	user 0.004s	sys 0.000s
I20260709 12:17:57.784905 28093 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:57.785966 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:57.788757 27685 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:57.774920 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:57.794152 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:17:57.791077 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 66483.1us
I20260709 12:17:57.811172 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:57.812846 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:57.813580 22898 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:17:57.805459 22821 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:57.727154 27920 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:57.819876 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:57.816774 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:57.825809 22897 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:17:57.820029 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:57.718855 27541 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:57.823683 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:57.829404 22892 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 12:17:57.833457 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:57.814985 22898 pending_rounds.cc:85] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 6
I20260709 12:17:57.863270 22898 pending_rounds.cc:107] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:17:57.863651 22898 raft_consensus.cc:2889] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:57.864799 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 44888.4us
I20260709 12:17:57.832587 27685 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:57.867336 27920 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:57.829217 27921 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:17:57.807266 28051 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:57.832746 27967 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:57.871567 28094 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:17:57.872704 28091 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.874331 28076 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:17:57.864238 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:57.882929 22821 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:17:57.888783 23659 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:17:57.890612 22751 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:57.829727 28024 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:57.894524 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:57.890056 28085 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:57.926891 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:57.928227 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:57.912076 28027 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:17:57.934152 22827 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:17:57.940174 23494 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:57.941637 27879 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:57.943885 27541 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:57.945276 27685 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:57.946861 28093 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:57.948594 23682 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:17:57.955044 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:57.930025 27918 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:57.908835 28051 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:57.913069 27967 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:57.925794 28024 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:57.993275 28024 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:17:57.987869 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 65360.1us
I20260709 12:17:57.939239 28031 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:17:57.939175 27325 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:17:57.997033 23493 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:57.932260 28016 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:17:57.968740 27541 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:17:57.939091 28085 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:58.015975 28091 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:57.985982 27879 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:17:58.019259 27937 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:17:58.022948 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:57.995229 28043 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.029769 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:58.033418 27937 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:58.006028 28055 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:58.035053 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:58.035729 27970 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:17:58.036350 27974 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:58.038116 28051 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:17:58.039095 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 157187us
W20260709 12:17:58.031221 28104 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:17:58.005321 28031 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:58.056643 28041 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:58.059412 28041 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:58.059828 28041 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:58.060382 27974 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:58.061211 22893 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:17:58.038345 27927 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.065594 27927 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:58.073539 27858 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:58.053738 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:58.080685 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:58.080075 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:58.086256 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 45851.5us
I20260709 12:17:58.087800 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:58.088105 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.051091 27937 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:17:58.092033 22824 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:17:58.089110 27974 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:58.096903 27974 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:58.095800 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:58.099792 27974 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:58.105666 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:58.089313 27970 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:58.053051 28043 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.104806 28064 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:58.103377 28051 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:58.116350 27970 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:58.143386 27970 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:58.172631 28064 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:58.191993 28085 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:58.191779 28064 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:58.134121 27937 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:58.194100 28064 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:58.173734 28055 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:58.194672 27937 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:58.194983 28055 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:58.174384 27976 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.196165 27976 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.197161 28055 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:58.198377 22751 raft_consensus.cc:2410] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:17:58.131278 28031 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:58.201262 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:58.201298 28027 raft_consensus.cc:3055] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:17:58.203495 28027 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:58.205344 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1209) took 1210 ms. Trace:
I20260709 12:17:58.205843 22752 rpcz_store.cc:276] 0709 12:17:56.994858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.997421 (+  2563us) service_pool.cc:224] Handling call
0709 12:17:56.997826 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.613775 (+615949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.205136 (+591361us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400413554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:58.205286 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369812224}
I20260709 12:17:58.208006 28043 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:58.208787 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1224) took 1628 ms. Trace:
I20260709 12:17:58.209489 27483 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:58.209184 22746 rpcz_store.cc:276] 0709 12:17:56.580547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.587102 (+  6555us) service_pool.cc:224] Handling call
0709 12:17:56.587543 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:56.682130 (+ 94587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:56.682158 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:56.682645 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:17:57.055318 (+372673us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:57.055381 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.784330 (+728949us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:58.208470 (+424140us) spinlock_profiling.cc:243] Waited 62.7 ms on lock 0x7b54001e8cd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:58.208518 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:58.208574 (+    56us) raft_consensus.cc:1685] finished
0709 12:17:58.208587 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:58.208722 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18735,"raft.queue_time_us":35907,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":5270,"spinlock_wait_cycles":370581248,"thread_start_us":372239,"threads_started":1,"wal-append.queue_time_us":571493}
I20260709 12:17:58.218940 27927 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:58.219540 27927 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:58.220153 28049 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:58.220705 28049 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:58.221868 27927 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:58.225620 27921 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:58.227037 28051 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.234469 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1205) took 1241 ms. Trace:
W20260709 12:17:58.239380 22899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1591) took 1928 ms (client timeout 2117 ms). Trace:
W20260709 12:17:58.244675 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.245610 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:58.204703 28027 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:58.240060 22899 rpcz_store.cc:269] 0709 12:17:56.310505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.482044 (+171539us) service_pool.cc:224] Handling call
0709 12:17:58.239118 (+1757074us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54004ed9d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:58.239291 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2486008064}
I20260709 12:17:58.253237 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:58.235054 22747 rpcz_store.cc:276] 0709 12:17:56.993205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.995072 (+  1867us) service_pool.cc:224] Handling call
0709 12:17:57.029892 (+ 34820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:57.315531 (+285639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.234035 (+918504us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540043f154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:58.234382 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635739520}
I20260709 12:17:58.246481 22896 raft_consensus.cc:2376] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14. Re-sending same reply.
I20260709 12:17:58.265458 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.267210 23682 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:58.269658 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:58.277168 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:58.282744 22897 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:58.285355 22895 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:17:58.285996 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:58.291090 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.294191 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:58.227587 28051 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:17:58.295617 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 215011us
I20260709 12:17:58.297539 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:58.302704 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:58.270022 27770 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 12:17:58.351023 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56966.2us
I20260709 12:17:58.353987 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:58.355093 22895 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:17:58.228973 27921 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:58.283366 27858 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:58.369277 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:58.376215 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 78785.3us
I20260709 12:17:58.376401 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:58.376796 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:58.372421 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:17:58.377207 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 117856us
W20260709 12:17:58.374228 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 118056us
I20260709 12:17:58.362020 22752 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:17:58.379273 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.345027 28045 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:17:58.295658 28037 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:58.377777 22895 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
W20260709 12:17:58.350986 28116 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:17:58.343343 28113 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:58.317958 28034 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:58.284034 27541 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 12:17:58.351400 28115 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:17:58.362865 27927 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:58.292115 28024 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:58.406190 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.408877 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:58.344786 28041 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.407895 28113 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:58.385982 28093 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:17:58.359323 28064 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:17:58.386433 28045 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:58.455571 22898 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:17:58.382490 27858 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:58.466190 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 87517us
I20260709 12:17:58.450505 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:17:58.442121 28113 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:58.428726 27927 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:17:58.390096 28037 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.404376 28034 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:58.463925 28045 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:17:58.500312 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.415553 28123 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:17:58.472343 28031 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.474540 28049 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:58.525324 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.532451 23660 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:58.534668 23672 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:17:58.539332 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:58.537046 28132 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:58.541500 28108 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:17:58.541882 28125 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:17:58.542356 28127 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:17:58.517606 27770 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:17:58.543463 27858 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:58.582252 28099 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:58.571519 28044 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:58.593138 28133 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.163s
I20260709 12:17:58.593904 28044 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:58.596274 28044 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:58.599534 27927 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:58.602020 28024 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:58.604600 27970 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.537879 28064 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:58.524143 28031 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.622651 28044 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:58.699088 28146 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:58.701190 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.702283 28152 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:58.702986 28152 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.705276 28152 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:58.622498 28064 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.687855 28044 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:17:58.711202 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 243888us
I20260709 12:17:58.700266 28146 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.708900 28118 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:58.717190 27494 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.728225 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:58.734994 28147 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:17:58.736761 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1222) took 1080 ms. Trace:
I20260709 12:17:58.737258 22753 rpcz_store.cc:276] 0709 12:17:57.656363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.750414 (+ 94051us) service_pool.cc:224] Handling call
0709 12:17:57.755592 (+  5178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:57.783956 (+ 28364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:57.783999 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:57.784561 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 12:17:57.878343 (+ 93782us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:57.878399 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.736327 (+857928us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b54001e64d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:58.736383 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:58.736439 (+    56us) raft_consensus.cc:1685] finished
0709 12:17:58.736452 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:58.736692 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6404,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":6933,"spinlock_wait_cycles":64141696,"thread_start_us":93278,"threads_started":1,"wal-append.queue_time_us":113466}
I20260709 12:17:58.738664 28146 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:58.740381 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:17:58.742758 28152 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:58.745641 28031 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:58.779140 28152 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:58.746451 28133 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:17:58.749549 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:58.751633 27976 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:58.755630 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:58.787077 22901 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:58.787117 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1265) took 1146 ms. Trace:
I20260709 12:17:58.788024 22827 rpcz_store.cc:276] 0709 12:17:57.641074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.641507 (+   433us) service_pool.cc:224] Handling call
0709 12:17:58.786842 (+1145335us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54005d8754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:58.787036 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642426624}
I20260709 12:17:58.757892 28138 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.791620 27927 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:58.792138 28138 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:58.792279 27927 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:58.797268 27976 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:17:58.797981 28101 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.939s	user 0.009s	sys 0.000s
I20260709 12:17:58.797933 27976 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.759119 27494 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:58.805684 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:58.763206 28044 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.764273 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.765259 28064 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:58.765944 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.815557 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 916) took 1118 ms. Trace:
I20260709 12:17:58.769255 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:17:58.818145 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 66473.7us
W20260709 12:17:58.746084 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.779225 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:17:58.788260 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.757383 28136 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:58.786130 28147 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:58.806761 22752 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:58.812762 23682 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 17: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:17:58.820880 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:58.823314 23674 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:58.816114 22819 rpcz_store.cc:276] 0709 12:17:57.696686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.696871 (+   185us) service_pool.cc:224] Handling call
0709 12:17:57.697209 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:57.716298 (+ 19089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:57.716338 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:57.722812 (+  6474us) log.cc:844] Serialized 52 byte log entry
0709 12:17:57.794534 (+ 71722us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:57.794588 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.794676 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:58.734074 (+939398us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:58.804182 (+ 70108us) raft_consensus.cc:1685] finished
0709 12:17:58.804206 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:58.815478 (+ 11272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19563,"raft.queue_time_us":21053,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5038,"spinlock_wait_cycles":9008512,"thread_start_us":55349,"threads_started":1,"wal-append.queue_time_us":56310}
I20260709 12:17:58.785018 28133 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.824190 23674 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:58.827162 23695 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:17:58.829521 22747 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:17:58.830215 22747 pending_rounds.cc:85] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 7
I20260709 12:17:58.834300 22747 pending_rounds.cc:107] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:17:58.834817 22747 raft_consensus.cc:2889] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:58.835469 22747 pending_rounds.cc:107] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:17:58.794641 28138 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:58.836248 22747 raft_consensus.cc:2889] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:58.839201 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.830044 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:58.827934 23674 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:58.837206 28113 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.852676 22818 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:17:58.855149 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.860795 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:58.865391 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.866590 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.864006 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:58.867472 23682 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:17:58.838732 28147 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.789429 28045 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:58.844230 28133 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:58.878253 22747 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:58.844412 28155 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:17:58.885331 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:58.893610 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:58.887115 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:58.889940 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:58.820829 27894 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:17:58.854050 28113 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:58.850868 27927 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:58.858843 28138 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:58.865913 28146 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.897411 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:58.905118 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:17:58.906953 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:58.866734 28064 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:58.881083 28147 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:58.915787 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:17:58.916162 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.900782 28031 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.838574 28136 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:58.922152 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:58.908201 27920 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:58.928298 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:58.932013 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:58.932246 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:58.933035 22822 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
W20260709 12:17:58.931463 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 49146.2us
I20260709 12:17:58.936378 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:58.913626 28152 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:58.921417 28024 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:58.944345 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:58.930066 27807 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:58.945545 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:58.955626 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:58.954496 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:58.911229 28146 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:58.957772 22892 raft_consensus.cc:2410] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:17:58.912997 28064 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:58.956805 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:58.960201 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:58.960875 28024 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:58.966874 28152 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:17:58.848299 27541 consensus_queue.cc:1175] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" responder_term: 18 status { last_received { term: 14 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: [17.10-17.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:58.980120 28136 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:59.000336 28037 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:59.027498 27494 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:59.029273 28155 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:58.970397 28151 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:17:58.979615 27976 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:59.032287 22745 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:17:59.033346 28064 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:59.033869 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:17:58.988929 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 45565.4us
I20260709 12:17:59.039412 22864 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:59.042117 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:59.043025 22746 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:17:59.000587 28150 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:59.000955 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:17:58.990175 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:59.045737 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 44888.6us
I20260709 12:17:59.007078 28051 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:59.046530 28051 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:17:59.007452 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:59.047631 22744 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:59.043736 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:59.019969 27757 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.021083 28045 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:59.050930 27757 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:59.033741 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:59.054242 27757 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:59.055622 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:59.022922 28146 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:58.984346 27927 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:17:58.931104 28031 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:59.039250 27963 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:59.050006 22747 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:59.010038 28041 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:59.005959 28034 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:58.980870 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 1227) took 1026 ms. Trace:
I20260709 12:17:59.065867 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:59.067265 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:59.075955 22752 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:59.067018 22749 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:17:59.060853 27757 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:59.072831 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:59.081802 22822 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 15: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:17:59.091384 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56121.4us
I20260709 12:17:59.096195 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:59.092228 22751 rpcz_store.cc:276] 0709 12:17:57.954310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.954563 (+   253us) service_pool.cc:224] Handling call
0709 12:17:58.980576 (+1026013us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54005bb8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:58.980791 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555884800}
I20260709 12:17:59.102227 28155 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:17:59.104318 28136 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:17:59.105230 28136 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:59.105587 28136 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:59.106534 28136 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:59.108757 28136 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:59.111181 28133 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:59.113077 28140 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:59.113833 28133 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:59.114292 28140 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:59.116365 28031 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:59.119474 27494 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:17:59.120046 27494 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.120079 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:59.120563 27494 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:59.114740 28140 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:59.121685 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:59.123389 22897 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:59.122884 28140 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:59.120743 28155 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:17:59.124504 28155 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:59.125560 28155 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:59.126595 28149 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.127250 22750 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:59.128952 28155 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:59.130944 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:59.138247 22897 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:17:59.141690 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:59.140722 22790 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:59.147601 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:17:59.148486 22753 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:17:59.148738 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:59.153884 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:59.156385 22897 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:17:59.170591 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.174292 22898 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:17:59.174850 22898 pending_rounds.cc:85] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 6
I20260709 12:17:59.175119 22898 pending_rounds.cc:107] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:17:59.175403 22898 raft_consensus.cc:2889] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:59.177024 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:59.143463 28142 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:59.188719 22898 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:17:59.127243 28149 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:59.146417 28138 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:59.200002 22827 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:17:59.150310 28037 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:59.180250 27916 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:17:59.194080 28147 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:59.205480 27871 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:59.219625 22898 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:17:59.207726 28140 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:59.205859 28138 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:17:59.216017 22897 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:17:59.227623 22822 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:17:59.218057 27916 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:17:59.212644 28037 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:59.212021 28058 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:17:59.238300 22753 raft_consensus.cc:2410] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 12:17:59.215214 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 128059us
I20260709 12:17:59.221321 27871 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:17:59.266090 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.242388 28137 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:17:59.327446 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.239645 28031 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 12:17:59.438274 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.361637 27947 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:59.500816 27947 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:59.504235 27871 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:59.506004 27494 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:59.434558 27879 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:59.507735 27879 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:59.511175 27879 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:59.511669 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:59.434191 28064 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:59.447643 27969 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:59.444828 28146 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:17:59.385205 28159 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:17:59.557665 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:59.496678 28076 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:59.561548 27969 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:59.587423 27969 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:59.588096 27969 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.566918 28146 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:59.597265 28146 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:59.444162 28138 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:59.489837 27916 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:59.625910 28173 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:17:59.631708 28171 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:59.634965 27947 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:59.644038 28034 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:17:59.644872 28034 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:59.599216 27871 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:59.647163 27871 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:59.649823 27871 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:59.652058 28037 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:59.672065 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:59.553860 28064 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:59.680886 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:59.692420 28064 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:59.689975 28114 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:17:59.695636 28027 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:17:59.695883 28114 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:17:59.698683 28114 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:59.600649 28076 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:59.588722 27969 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:59.704119 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 147706us
I20260709 12:17:59.708407 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:59.713513 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:59.724364 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:59.725237 22897 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:17:59.727658 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:59.728966 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:59.731848 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:17:59.735957 28034 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:59.732620 28037 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.740741 28133 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:59.747493 28133 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:59.747110 28037 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:17:59.753782 28146 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:59.754676 28146 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:17:59.755668 28034 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.756239 28034 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:17:59.734939 28136 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.626s	user 0.013s	sys 0.000s
I20260709 12:17:59.771083 27969 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:17:59.761924 28155 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.632s	user 0.014s	sys 0.000s
I20260709 12:17:59.780407 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1096) took 1993 ms. Trace:
I20260709 12:17:59.759725 28146 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:59.758492 28133 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:17:59.786454 28140 consensus_meta.cc:287] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.006s
I20260709 12:17:59.792994 23659 rpcz_store.cc:276] 0709 12:17:57.786759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.786909 (+   150us) service_pool.cc:224] Handling call
0709 12:17:57.787262 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:57.925034 (+137772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.779998 (+1854964us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54003a7d54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:17:59.780303 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232672640}
W20260709 12:17:59.801817 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.803884 28185 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:17:59.804615 28185 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:59.806546 28177 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 12:17:59.811364 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:17:59.812014 22894 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 14. Ops: [12.7-12.7]
I20260709 12:17:59.806898 28185 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:17:59.823762 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1601) took 2014 ms. Trace:
I20260709 12:17:59.824545 22894 rpcz_store.cc:276] 0709 12:17:57.809743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.819244 (+  9501us) service_pool.cc:224] Handling call
0709 12:17:59.811587 (+1992343us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b58001e3398. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:17:59.811766 (+   179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:59.823532 (+ 11766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.823716 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2676480}
I20260709 12:17:59.835587 28034 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:59.836925 28037 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:59.837117 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:59.839473 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:59.844370 27967 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:17:59.849283 28163 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.764s	user 0.008s	sys 0.000s
I20260709 12:17:59.831502 28055 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:59.851325 28055 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:17:59.854871 28133 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:17:59.861140 28162 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.760s	user 0.000s	sys 0.013s
I20260709 12:17:59.863897 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1571) took 1005 ms. Trace:
I20260709 12:17:59.864173 28133 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:17:59.864626 22827 rpcz_store.cc:276] 0709 12:17:58.858525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.859079 (+   554us) service_pool.cc:224] Handling call
0709 12:17:59.863585 (+1004506us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54002d9e54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:59.863802 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700311424}
I20260709 12:17:59.866958 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 1103) took 1101 ms. Trace:
I20260709 12:17:59.867545 23695 rpcz_store.cc:276] 0709 12:17:58.765352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.765667 (+   315us) service_pool.cc:224] Handling call
0709 12:17:59.866644 (+1100977us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5400159354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:17:59.866823 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25361664}
I20260709 12:17:59.870651 28059 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:59.868183 28055 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:59.877926 23493 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:17:59.879937 22744 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:17:59.881723 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:59.882575 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:59.873724 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1069) took 1551 ms. Trace:
I20260709 12:17:59.874392 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:17:59.886404 22897 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:59.892928 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:59.883584 22826 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:17:59.896252 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:17:59.903263 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1081) took 1151 ms. Trace:
I20260709 12:17:59.884814 22899 rpcz_store.cc:276] 0709 12:17:58.322067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.322844 (+   777us) service_pool.cc:224] Handling call
0709 12:17:58.364767 (+ 41923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.365063 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:17:58.386157 (+ 21094us) log.cc:844] Serialized 14 byte log entry
0709 12:17:59.872831 (+1486674us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b180037a860. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a
0709 12:17:59.873228 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 12:17:59.873363 (+   135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:59.873412 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:17:59.873456 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.873558 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:59.873671 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24376,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":11738,"spinlock_wait_cycles":12844800,"thread_start_us":37898,"threads_started":1,"wal-append.queue_time_us":79370}
I20260709 12:17:59.904973 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:59.908182 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:17:59.879755 28059 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:59.910894 22901 rpcz_store.cc:276] 0709 12:17:58.752296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.791217 (+ 38921us) service_pool.cc:224] Handling call
0709 12:17:58.791588 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:58.799268 (+  7680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.799302 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:58.799883 (+   581us) log.cc:844] Serialized 52 byte log entry
0709 12:17:58.917712 (+117829us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:59.297758 (+380046us) log.cc:844] Serialized 14 byte log entry
0709 12:17:59.600254 (+302496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.600370 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:59.848079 (+247709us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:17:59.902919 (+ 54840us) raft_consensus.cc:1685] finished
0709 12:17:59.903013 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:59.903190 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7460,"prepare.queue_time_us":61492,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":257681,"raft.run_cpu_time_us":500,"raft.run_wall_time_us":21193,"spinlock_wait_cycles":77821184,"thread_start_us":730304,"threads_started":3,"wal-append.queue_time_us":264153}
W20260709 12:17:59.918239 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.922886 22897 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:17:59.931006 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:17:59.932390 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.916975 28149 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:17:59.950615 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:59.942098 27921 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:17:59.944635 27495 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:59.948731 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.939837 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:59.956492 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:17:59.971575 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:17:59.979916 28037 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.980762 28137 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:00.009869 22827 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:17:59.987514 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:17:59.988967 28139 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 1.489s	user 0.004s	sys 0.010s
I20260709 12:17:59.990574 28076 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:00.007589 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 51230.6us
I20260709 12:18:00.012179 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.023643 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:00.007606 28163 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:18:00.024708 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:00.026562 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:00.029348 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:00.033345 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.025453 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:00.033783 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:00.033485 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.036588 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:00.038623 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:00.014504 28113 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:00.008543 27495 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:00.052016 27495 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:00.036058 27918 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.056427 27918 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:00.056856 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.057415 23685 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:00.058945 23679 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:00.059561 28024 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:00.061944 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.062852 28059 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:00.063510 28059 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:00.065570 22820 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:00.041055 28140 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.066881 28140 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:00.067555 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.068459 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.069088 28140 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.037922 28141 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:00.069738 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.068506 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.043144 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.072079 23682 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:18:00.036161 28185 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:00.044009 28138 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:00.073536 28138 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:00.013633 28184 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:00.043299 23659 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:00.038736 27882 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:00.075029 28184 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:00.075567 28184 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:00.078511 28138 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:00.026824 28186 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:00.079559 28186 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:00.080030 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1413) took 1144 ms. Trace:
I20260709 12:18:00.080499 22749 rpcz_store.cc:276] 0709 12:17:58.935875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.936055 (+   180us) service_pool.cc:224] Handling call
0709 12:18:00.079792 (+1143737us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400413054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:00.079939 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296619392}
I20260709 12:18:00.081928 28186 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:00.046860 28155 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:00.047118 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:00.047271 28181 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:00.047623 28123 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:00.067716 27970 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:00.082317 27963 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:00.015831 28137 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:00.070195 28141 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:00.009341 28037 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:00.085677 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.099748 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.045596 28147 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:00.092100 22744 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:00.075347 27882 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.095405 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.099996 22897 raft_consensus.cc:2410] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:18:00.105106 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:00.102159 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.103780 23672 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:00.086511 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48000.5us
I20260709 12:18:00.093842 27495 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:18:00.092849 28185 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:00.107157 28123 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:00.107290 27882 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:00.108397 28141 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.110343 28137 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.111284 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.111441 28059 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:00.138161 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.117321 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:00.118161 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.091691 27325 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:17:57.087251 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:00.142043 22748 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:00.123041 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.124155 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:00.127396 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.128358 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.146548 23679 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:00.103456 27918 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.135179 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.138319 22900 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:00.122547 27928 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:00.148849 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1403) took 1287 ms. Trace:
I20260709 12:18:00.149248 22748 rpcz_store.cc:276] 0709 12:17:58.861800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.862570 (+   770us) service_pool.cc:224] Handling call
0709 12:18:00.117170 (+1254600us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:18:00.148785 (+ 31615us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3654528}
I20260709 12:18:00.139312 23682 raft_consensus.cc:2410] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:18:00.091377 28155 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:00.152947 28155 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:00.148469 27325 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:00.154901 27928 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:00.156059 27325 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:00.157011 27928 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:00.158517 27494 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:00.131381 27879 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:00.164124 22575 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43984 (request call id 159) took 17222 ms (client timeout 15000 ms). Trace:
I20260709 12:18:00.136763 28185 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:00.136965 28123 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:00.171871 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.175364 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.159040 22571 catalog_manager.cc:5697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:00.172809 22893 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:00.164314 27970 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.180235 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:00.180881 22748 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:00.180621 27970 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:00.182706 27970 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:00.100449 27963 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:00.163552 28137 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:00.162851 28141 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:00.196576 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.154469 28184 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:00.164785 22575 rpcz_store.cc:269] 0709 12:17:42.926297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.940148 (+ 13851us) service_pool.cc:224] Handling call
0709 12:18:00.148794 (+17208646us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:52.851330 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:52.852048 (+   718us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:52.852106 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:17:52.852127 (+    21us) tablet.cc:662] Decoding operations
0709 12:17:52.907917 (+ 55790us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:52.908057 (+   140us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:52.908083 (+    26us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:17:52.915546 (+  7463us) tablet.cc:701] Row locks acquired
0709 12:17:52.915604 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:17:52.915792 (+   188us) write_op.cc:270] Start()
0709 12:17:52.915987 (+   195us) write_op.cc:276] Timestamp: P: 1783599472915722 usec, L: 0
0709 12:17:52.931224 (+ 15237us) op_driver.cc:348] REPLICATION: starting
0709 12:17:53.013302 (+ 82078us) log.cc:844] Serialized 6796 byte log entry
0709 12:17:53.846278 (+832976us) op_driver.cc:464] REPLICATION: finished
0709 12:17:54.017734 (+171456us) write_op.cc:301] APPLY: starting
0709 12:17:54.017875 (+   141us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:54.826071 (+808196us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:54.847171 (+ 21100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:55.074841 (+227670us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:55.088737 (+ 13896us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 12:17:55.108274 (+ 19537us) write_op.cc:312] APPLY: finished
0709 12:17:55.174831 (+ 66557us) log.cc:844] Serialized 155 byte log entry
0709 12:17:55.332684 (+157853us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:55.332927 (+   243us) write_op.cc:454] Released schema lock
0709 12:17:55.333037 (+   110us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:55.342643 (+  9606us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:55.343861 (+  1218us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":202062,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":171016,"apply.run_cpu_time_us":50199,"apply.run_wall_time_us":1324857,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75255,"num_ops":17,"prepare.queue_time_us":82901,"prepare.run_cpu_time_us":13243,"prepare.run_wall_time_us":310555,"raft.queue_time_us":152395,"raft.run_cpu_time_us":17926,"raft.run_wall_time_us":127275,"replication_time_us":914838,"thread_start_us":451665,"threads_started":5,"wal-append.queue_time_us":706245,"wal-append.run_cpu_time_us":16648,"wal-append.run_wall_time_us":2327508}]]}
I20260709 12:18:00.189338 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:00.195240 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:00.178638 28185 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:00.204738 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:00.207679 22571 catalog_manager.cc:5697] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:00.178135 27879 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:00.218662 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 177103us
I20260709 12:18:00.232127 22748 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:00.238392 28155 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:00.239151 23689 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:00.238765 22571 catalog_manager.cc:5697] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 10 to 14, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 14 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:00.239229 28155 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:00.238499 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:00.240908 22571 catalog_manager.cc:5697] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 9 to 16, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 16 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:00.241926 28155 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.243705 28118 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:00.249531 28130 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:00.250195 28130 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:00.252732 28130 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:00.260560 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:00.202023 27995 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:18:00.265879 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:00.266382 27995 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:00.266976 27995 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:00.268054 27995 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:00.269407 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:00.269814 27995 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:00.270386 22825 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:18:00.271988 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:00.275528 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.275704 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:00.277746 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.213604 28141 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:00.284572 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.277671 22571 catalog_manager.cc:5697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:00.285657 23659 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:00.278518 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.279716 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:00.206000 27858 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:00.283638 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1568) took 1452 ms. Trace:
I20260709 12:18:00.285637 22897 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:00.279477 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:00.208304 27325 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:00.288560 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:00.235409 28111 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:00.203069 27947 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:18:00.291407 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:00.290699 22819 rpcz_store.cc:276] 0709 12:17:58.831838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.832278 (+   440us) service_pool.cc:224] Handling call
0709 12:17:58.832839 (+   561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:58.833417 (+   578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.833465 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:58.843233 (+  9768us) log.cc:844] Serialized 26 byte log entry
0709 12:17:59.935342 (+1092109us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b1800395920. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f0d1 00007fadf473aa0f
0709 12:18:00.186274 (+250932us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:00.186320 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:00.186596 (+   276us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:00.273167 (+ 86571us) raft_consensus.cc:1685] finished
0709 12:18:00.273187 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:00.283563 (+ 10376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":295042,"raft.queue_time_us":5173,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":295863,"spinlock_wait_cycles":8928000,"thread_start_us":250701,"threads_started":1,"wal-append.queue_time_us":1362485}
I20260709 12:18:00.293330 22571 catalog_manager.cc:5697] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 8, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 8 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:00.293032 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.274165 28137 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:00.301429 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:00.355690 22750 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:00.349558 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:00.339028 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 232648us
I20260709 12:18:00.361711 22899 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:00.303836 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:00.285774 27928 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.290635 27858 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:00.362509 22824 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:00.364418 27927 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:00.361409 28137 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.400528 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.288057 27918 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.406677 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.288441 28155 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:00.411448 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:00.413703 22897 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:00.292301 27970 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:00.290858 28194 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:00.429008 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.380462 27858 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:00.433930 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.331992 27325 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:00.431285 22571 catalog_manager.cc:5697] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:00.446346 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:00.452060 22899 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:00.456760 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:00.459602 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:00.412856 28137 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:00.375098 27928 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:00.421387 28037 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.467597 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.468559 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:00.469549 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:00.475657 22571 catalog_manager.cc:5697] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:00.480903 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:00.479223 22899 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
W20260709 12:18:00.482492 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 79892.8us
I20260709 12:18:00.483603 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:00.485131 22748 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:00.452287 27325 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:00.485924 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:00.458151 28086 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.491246 22750 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:00.487666 22864 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.444500 27918 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:00.498248 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.431023 28190 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:18:00.431525 28155 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:00.522873 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.446486 27970 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:00.568430 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.499316 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.445010 27882 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:00.527448 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:00.497985 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.489248 27963 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:00.563444 28184 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:00.537640 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:00.538519 28191 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
I20260709 12:18:00.490955 27927 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:18:00.538729 28196 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:18:00.644475 27927 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:00.644979 27927 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:00.647974 28142 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:00.648521 28142 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:00.649386 28142 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:00.448848 28194 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:00.463466 28141 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:00.626622 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 132601us
I20260709 12:18:00.657714 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.658360 28194 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:00.635354 28155 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:00.643787 27882 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.624913 22895 raft_consensus.cc:2410] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 12:18:00.633482 28195 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:18:00.660133 22864 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:00.661568 27967 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:00.687408 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 149884us
I20260709 12:18:00.647993 27928 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:00.667426 28064 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:00.668653 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 364910us
I20260709 12:18:00.665999 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1257) took 1532 ms. Trace:
W20260709 12:18:00.677225 28198 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260709 12:18:00.644678 28042 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:00.616040 27999 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:00.700237 22747 rpcz_store.cc:276] 0709 12:17:59.133654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.168994 (+ 35340us) service_pool.cc:224] Handling call
0709 12:18:00.083852 (+914858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:00.084296 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:00.084324 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:00.084850 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:18:00.189874 (+105024us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:00.189919 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:00.189989 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:00.664596 (+474607us) raft_consensus.cc:1685] finished
0709 12:18:00.664618 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:00.665720 (+  1102us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b5400413050. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:00.665931 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":245,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"spinlock_wait_cycles":2051973376,"thread_start_us":104659,"threads_started":1,"wal-append.queue_time_us":208782}
I20260709 12:18:00.668388 28142 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:00.494657 28086 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:00.739516 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 79469.3us
I20260709 12:18:00.678646 28184 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:00.683521 27879 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:00.689213 28130 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:00.763485 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:00.768985 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:00.764182 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 75836.5us
W20260709 12:18:00.773932 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.779904 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:00.782169 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:00.782857 22895 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:00.783041 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.783692 23689 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 12: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:18:00.774417 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 368928us
I20260709 12:18:00.711598 28111 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:00.784648 22790 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.786252 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.787710 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.764549 27757 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:00.789624 22898 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 17: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:18:00.778383 27995 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.005s
I20260709 12:18:00.711431 28064 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:00.770689 27882 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:00.742332 28218 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:00.768262 28206 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:18:00.818346 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:00.816545 23674 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:00.790910 27757 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.820806 27757 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:00.796115 28204 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:18:00.831365 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.832257 27879 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:00.832629 27947 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:00.833191 22790 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.779465 28184 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:00.838740 28211 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:00.839382 28211 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:00.840723 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:00.840832 28184 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:00.833040 27879 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:00.842669 28212 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.842340 27882 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:00.847195 28194 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:00.837710 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:00.897257 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 59640.2us
I20260709 12:18:00.897375 22895 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:00.840461 28211 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:00.849720 22790 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.746539 27999 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:00.788718 28023 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:00.856134 22750 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:00.854272 23674 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:18:00.852794 28190 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:00.851373 27947 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:00.801776 27916 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:00.860994 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:00.864923 28137 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:00.865609 28205 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:18:00.868420 27879 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:00.872833 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:00.874974 28212 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:00.786520 28130 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:00.901944 23674 pending_rounds.cc:85] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 9
I20260709 12:18:00.939057 23674 pending_rounds.cc:107] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:18:00.939350 23674 raft_consensus.cc:2889] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:00.940286 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1106) took 2150 ms. Trace:
I20260709 12:18:00.901844 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:00.939973 27757 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:00.940698 23674 rpcz_store.cc:276] 0709 12:17:58.789888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.790018 (+   130us) service_pool.cc:224] Handling call
0709 12:17:58.823197 (+ 33179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:00.815878 (+1992681us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b58000146d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46db0aa 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4
0709 12:18:00.939987 (+124109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:00.940193 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970959232}
I20260709 12:18:00.942008 22897 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:18:00.942652 28135 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:18:00.943070 27757 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:00.906939 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 57298.9us
W20260709 12:18:00.902707 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 161811us
I20260709 12:18:00.909636 22747 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:00.846544 27927 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:00.908311 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 224641us
I20260709 12:18:00.917651 27918 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:00.900525 27894 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:00.918757 28137 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.910025 28208 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:00.919495 28185 consensus_meta.cc:287] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.003s
I20260709 12:18:00.920712 27999 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:00.951330 27894 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.961470 27894 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:00.961714 28042 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:00.962239 27927 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.921857 28064 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:00.906734 28180 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:18:00.913256 28190 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:00.963510 27928 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:00.963873 28190 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:00.900964 28194 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:00.923633 27970 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.910948 28118 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:00.919490 27882 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.968644 28194 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.931335 27325 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:00.971165 27325 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:00.933153 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:00.972111 22750 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:18:00.935206 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:00.975297 22748 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:00.937513 28172 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.940716 28130 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:00.943920 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:00.946566 28212 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:00.949952 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:00.917824 28215 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:18:00.979188 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:00.950009 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:00.966158 28185 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:00.961496 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 59714.5us
I20260709 12:18:00.982277 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:00.998514 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 48566.2us
I20260709 12:18:00.999549 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:01.001492 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:01.005189 22896 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:00.985234 28118 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:00.982055 27916 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:01.005111 27757 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:01.013098 27894 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:01.015817 27894 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:01.005842 27970 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:00.997743 27947 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:01.017544 27947 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.018020 27947 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:01.004235 22864 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:01.009485 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:01.024231 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:01.027078 28137 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:01.027688 28137 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:01.028084 28137 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:00.983721 28172 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:01.006742 27927 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:01.029714 22892 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:18:01.029865 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.030524 23674 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
W20260709 12:18:01.032021 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 49102.4us
I20260709 12:18:01.035439 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.036753 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:01.038234 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:01.038769 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:01.002686 28212 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:01.047082 22900 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:01.047537 28185 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:01.048321 27858 consensus_meta.cc:287] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.003s
I20260709 12:18:01.048772 27858 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:01.049297 28044 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:01.039394 22893 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:18:01.043375 28206 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:01.052019 27927 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:01.052263 27920 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.004038 28194 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:01.055712 22824 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:01.056109 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:01.045331 22750 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:01.057130 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:01.058382 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:01.083374 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:01.084048 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:01.084573 23674 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:01.084589 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:01.085780 22826 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:01.091180 22747 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:00.987175 28219 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:18:01.092669 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:01.097347 22823 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:01.093667 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:01.059684 27970 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:01.098891 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:01.095120 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:01.096176 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 111852us
I20260709 12:18:01.062191 27920 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:01.110872 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:01.099061 28123 consensus_meta.cc:287] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.910s	user 0.010s	sys 0.004s
I20260709 12:18:01.128474 28123 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:01.131973 28209 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.354s	user 0.008s	sys 0.017s
I20260709 12:18:01.109548 28064 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:01.064172 28210 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:01.135738 22892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1270) took 1988 ms (client timeout 2026 ms). Trace:
I20260709 12:18:01.134719 28064 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:01.136273 22892 rpcz_store.cc:269] 0709 12:17:59.147501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.148421 (+   920us) service_pool.cc:224] Handling call
0709 12:18:01.135534 (+1987113us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b540015a254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:01.135668 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4323468672}
I20260709 12:18:01.045955 27916 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:01.135766 27858 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:01.141860 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:01.083300 27325 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:01.120345 22826 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
W20260709 12:18:01.144477 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.123937 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:01.145262 22821 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:01.119434 23674 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:18:01.126940 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:01.127755 28220 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:01.136361 28210 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:01.119972 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:01.112077 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:01.092751 27927 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:01.167471 23679 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:01.094659 28212 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:01.094870 28206 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:01.174437 22823 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:01.146803 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:01.174762 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 54904.4us
I20260709 12:18:01.184007 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:01.151136 22750 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:01.096805 28118 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:01.147089 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:01.172600 27325 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:01.173247 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:01.186424 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:01.200147 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:01.204891 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.205508 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.205737 23672 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:01.146085 28184 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:01.207304 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.145677 28064 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:01.099609 28194 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:01.207798 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.219436 22751 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:01.219517 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.207594 22745 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:01.162974 28186 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.220434 23689 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:01.172420 28012 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:18:01.230739 22821 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:01.199523 27927 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:01.244446 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.222954 28212 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:18:01.225592 28194 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:01.199209 27879 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:01.232664 28118 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:01.280597 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.281028 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.272010 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.206840 28221 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:01.206570 28185 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:01.274437 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.235034 28186 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:01.181593 28220 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.299175 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.287010 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:01.303755 22823 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:01.311286 22744 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:18:01.311733 22744 pending_rounds.cc:85] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 6
I20260709 12:18:01.312021 22744 pending_rounds.cc:107] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:18:01.312294 22744 raft_consensus.cc:2889] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:01.312870 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.313751 22745 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:01.235643 27947 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:01.274628 27970 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:01.301962 28184 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:18:01.346627 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 160294us
I20260709 12:18:01.347797 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:01.306550 28042 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:01.323396 27894 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:01.285072 27879 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:01.381856 27947 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:01.382922 28114 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:01.386155 22864 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:01.311030 28088 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 12:18:01.343281 28184 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:01.395732 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48050.3us
I20260709 12:18:01.382568 27927 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:01.398319 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 156147us
I20260709 12:18:01.407712 22893 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:01.409426 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:01.410622 22900 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:01.406400 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:01.419695 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:01.420419 22827 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:01.418984 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:01.385180 28185 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:01.421818 22823 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:01.425523 22827 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:01.417614 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:01.422870 23682 raft_consensus.cc:2410] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:18:01.429931 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:01.429479 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:01.399526 28181 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:01.432662 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:01.384289 27894 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.453536 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:01.412647 28180 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:01.457948 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:01.464097 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:01.412949 28206 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:01.430665 28044 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.428936 27757 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:01.431612 27969 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.431106 27541 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:01.428138 28216 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:01.453668 28042 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:01.461020 28180 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.462188 28155 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:01.459846 28138 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:01.461676 28181 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:01.431325 28185 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.472497 28023 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:01.470233 27918 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:01.462963 28184 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:01.477346 28044 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.458966 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:01.491034 27757 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:01.492466 27541 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:01.674100 27879 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:01.676515 27541 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:01.676939 23674 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:18:01.652206 28023 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:01.653662 27918 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:01.655459 27921 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:01.492764 27969 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.537338 27920 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.476931 28059 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:01.661374 27947 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:01.663627 28012 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:01.624442 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 407522us
I20260709 12:18:01.651769 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:01.632277 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 287547us
I20260709 12:18:01.629866 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:01.509124 28155 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:01.538479 28137 consensus_meta.cc:287] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.510s	user 0.004s	sys 0.009s
I20260709 12:18:01.503863 27809 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:18:01.645493 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 181338us
I20260709 12:18:01.640133 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:01.702841 28218 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.642310 22900 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:18:01.661396 28044 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:01.533195 28206 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.708215 27947 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:01.640654 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 210636us
I20260709 12:18:01.714031 28185 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:01.714380 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.708045 28042 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.705488 28181 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:01.690171 27894 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:01.692608 27757 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:01.718214 27920 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:01.727280 28155 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:01.729537 28123 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:01.507918 28180 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:01.731491 27809 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:18:01.535410 28142 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.791s	user 0.014s	sys 0.001s
I20260709 12:18:01.506621 28186 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:01.689978 27918 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:01.497360 28216 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.758142 28088 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:01.760179 28216 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:01.748098 28137 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:01.765406 28137 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:01.730156 28023 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:01.766140 28247 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:01.719198 27921 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:01.767124 28247 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:01.769466 27921 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:01.770174 28247 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:01.760473 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:01.760545 28088 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:01.773100 28184 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:01.774154 27809 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:01.755606 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.532513 28220 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:01.748243 28218 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:01.804526 28251 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:01.804970 28218 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:01.787539 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.806347 22744 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:01.806864 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:01.783114 28012 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:01.791004 28172 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:01.792002 22751 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:01.790432 27325 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:01.787561 27947 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:01.782457 28088 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:01.749673 27918 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:01.798825 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.806537 27916 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:01.791702 27999 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:01.809104 27757 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:01.781258 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:01.782341 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:01.778721 28064 consensus_meta.cc:287] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.008s
I20260709 12:18:01.818996 22750 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:01.818648 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:01.804543 23659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 1112) took 1702 ms (client timeout 2045 ms). Trace:
I20260709 12:18:01.780550 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:01.821342 27757 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:01.828339 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 46219.1us
W20260709 12:18:01.822099 23659 rpcz_store.cc:269] 0709 12:18:00.102276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.102414 (+   138us) service_pool.cc:224] Handling call
0709 12:18:01.803977 (+1701563us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54000325d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:01.804246 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316544896}
I20260709 12:18:01.829123 27325 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:01.829303 27969 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:01.829886 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:01.830426 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.832751 27809 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:01.835414 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:01.835453 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.842881 28172 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:01.861106 28172 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:01.861577 28172 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:01.862979 28172 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.864565 28172 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:01.839226 28142 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:01.867741 23656 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:01.867857 28142 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.844640 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:01.871302 28135 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:01.873080 23682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 1120) took 1598 ms (client timeout 1532 ms). Trace:
I20260709 12:18:01.845539 27999 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:01.873633 23682 rpcz_store.cc:269] 0709 12:18:00.274937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.275088 (+   151us) service_pool.cc:224] Handling call
0709 12:18:01.872511 (+1597423us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003750d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:01.872791 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2438530304}
W20260709 12:18:01.847992 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 76681.1us
I20260709 12:18:01.845739 23672 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:18:01.837587 28088 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:01.850733 27757 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:01.877060 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 121508us
I20260709 12:18:01.854981 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.855506 27325 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.856094 27920 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:18:01.845647 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 65639.3us
I20260709 12:18:01.856405 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.860133 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.843547 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.838100 28012 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:01.873302 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1193) took 1342 ms. Trace:
I20260709 12:18:01.873229 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:01.883663 23685 rpcz_store.cc:276] 0709 12:18:00.536617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.537122 (+   505us) service_pool.cc:224] Handling call
0709 12:18:01.807207 (+1270085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:01.807707 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.807730 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:01.807809 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:01.807858 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.807943 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:01.872917 (+ 64974us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000325d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:01.873089 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2919580416}
I20260709 12:18:01.880828 27325 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:01.834769 28042 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:01.894182 28088 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:01.898774 27999 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:01.881062 27920 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:01.899888 27920 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:01.908275 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.910961 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.912457 28113 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:01.912519 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.913056 28113 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:01.914515 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.915345 23685 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:01.870450 28142 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:01.930756 27969 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:01.932428 27928 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:01.933429 28210 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:01.933369 27928 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:01.935063 28218 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.935822 28218 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.938833 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:01.939406 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1099) took 1847 ms. Trace:
I20260709 12:18:01.939782 22896 rpcz_store.cc:276] 0709 12:18:00.087856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.088106 (+   250us) service_pool.cc:224] Handling call
0709 12:18:00.096844 (+  8738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:01.005742 (+908898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.934445 (+928703us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54002bd254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:01.934758 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088440192}
I20260709 12:18:01.943260 28004 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:01.947150 28042 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:01.914460 28113 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:01.949805 22892 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
W20260709 12:18:01.950325 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 115213us
I20260709 12:18:01.938544 28218 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:01.952731 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:01.954994 28086 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:01.955374 27928 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:01.886358 27685 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:01.957190 23660 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:01.843586 28064 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:01.964039 28113 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:01.951706 28240 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.438s	user 0.004s	sys 0.004s
I20260709 12:18:01.979115 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:01.984834 28155 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:01.986518 27494 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:01.964211 28064 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:01.987061 27494 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:01.987725 23674 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 13: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:01.988287 27494 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:01.989714 27494 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:01.993067 22894 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 12:18:01.995714 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 122710us
I20260709 12:18:01.996503 28142 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:01.997852 22894 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:01.998270 23493 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:01.944167 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:02.006736 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 77832.4us
I20260709 12:18:02.012553 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:01.986334 27920 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:02.021332 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:02.026953 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.006215 27325 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:02.034420 27858 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:02.037359 28138 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:02.053454 28155 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:02.060905 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.045174 27858 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:02.059286 28141 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.063645 27325 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:02.064694 23659 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:18:02.070322 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.057817 27969 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:18:02.078348 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 134404us
I20260709 12:18:02.080664 22892 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:02.084633 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:02.085798 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 87633.3us
I20260709 12:18:02.082232 23674 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:18:02.086499 27325 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:02.088007 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:02.088733 22752 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:18:02.093549 27325 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:02.091745 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 112852us
I20260709 12:18:02.073818 28141 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:02.101809 28180 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:02.115568 23493 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.093640 28142 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:02.094720 28137 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:02.118064 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.119937 27920 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:02.096884 27858 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:02.130856 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.131803 22892 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:02.132906 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:02.121984 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.122180 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.122891 27918 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:02.126173 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:02.099176 28113 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:02.134707 22896 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:02.137357 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:02.142970 28137 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:02.143791 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:02.144652 27918 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:02.145677 28137 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:02.146478 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.144099 22894 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:02.143437 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.149161 28135 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:02.150291 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:02.152231 27325 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:02.152812 27918 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:02.153318 27918 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:02.154009 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.154158 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:02.159204 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.151305 28138 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:02.160887 28138 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:02.161047 22893 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:02.147979 28113 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:02.162461 28138 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:02.164104 28138 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:02.150925 28135 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:02.167474 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.169400 28113 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:02.174939 22750 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:02.177763 27541 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:02.186102 28135 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:02.188419 28181 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:02.191629 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.196820 22744 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:02.178197 23493 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:02.203127 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.209673 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.156391 27918 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:02.204560 22750 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:02.208630 22894 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:18:02.219498 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:02.136461 28142 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:02.230881 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:02.231902 23674 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:02.216867 28137 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:02.238603 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.239883 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:02.240957 27541 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:02.248204 23659 raft_consensus.cc:2368] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18.
I20260709 12:18:02.237308 28181 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:02.250865 28181 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:02.251509 28181 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:02.237285 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0086584860000585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 12:18:02.253633 22864 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:02.254689 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 117987us
I20260709 12:18:02.254995 28118 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:02.255612 27757 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:02.256212 27757 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.255734 28118 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:02.256606 27757 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:02.254634 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:02.263381 27920 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:02.263289 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:02.265618 28262 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 12:18:02.266525 27920 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:02.244640 27541 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:02.274832 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:02.276329 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:02.207451 28155 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:18:02.279985 27541 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:02.287046 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:02.298733 28142 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:02.301990 22901 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:18:02.302517 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.303388 22893 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:18:02.304313 22572 catalog_manager.cc:5697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 7 to 11, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 11 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:02.283466 28118 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:02.307173 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.308351 23679 raft_consensus.cc:2410] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:18:02.309587 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.310410 23695 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
W20260709 12:18:02.311892 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 81804.4us
I20260709 12:18:02.312677 28247 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:02.313061 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:02.315128 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.313318 28247 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:02.323628 23674 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
W20260709 12:18:02.321671 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 80270.8us
I20260709 12:18:02.328828 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.329685 22893 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:02.331120 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.332008 23685 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:18:02.334491 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:02.336089 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.336608 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:02.362385 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 59019us
W20260709 12:18:02.368835 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 149126us
I20260709 12:18:02.371097 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.371904 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.337390 22572 catalog_manager.cc:5697] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 6 to 8, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 8 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:02.323601 28180 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:02.298883 28141 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:02.381860 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.326093 28247 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:02.386480 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:02.387953 23494 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:02.379626 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.384799 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:02.396127 27325 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:02.396682 27325 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.397089 27325 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:02.396229 22822 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:02.400323 22750 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:18:02.400897 22750 pending_rounds.cc:85] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 9
I20260709 12:18:02.397433 22751 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:02.403453 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.395895 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.404415 22824 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:02.401227 22750 pending_rounds.cc:107] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:18:02.411494 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.391427 28044 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:02.411854 22750 raft_consensus.cc:2889] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:02.415740 22893 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:02.421778 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:02.426146 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 149636us
I20260709 12:18:02.373090 27494 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 12:18:02.409476 22791 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 1.943s (SENT) [suppressed 3 similar messages]
I20260709 12:18:02.415776 22572 catalog_manager.cc:5697] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 2 to 13, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 13 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:02.418279 28044 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.421120 27969 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:02.439822 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.438661 22896 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:02.432216 28155 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:02.437320 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.454231 28130 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:02.454322 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:02.455732 22826 raft_consensus.cc:2368] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18.
I20260709 12:18:02.458941 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.459545 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:02.459051 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:18:02.463146 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 90955.7us
I20260709 12:18:02.463338 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:02.464955 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.465212 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:02.467291 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:02.468201 22896 raft_consensus.cc:2410] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:18:02.469224 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:02.470274 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.471148 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.466512 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:02.478593 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.480454 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:02.481365 22750 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 18: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:02.459448 22824 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
I20260709 12:18:02.479405 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.483842 22818 raft_consensus.cc:2368] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19.
I20260709 12:18:02.472107 22572 catalog_manager.cc:5697] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 7 to 9, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 9 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:02.484390 22752 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:02.484512 22893 raft_consensus.cc:2410] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:18:02.487502 22820 raft_consensus.cc:2410] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:18:02.488345 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.488716 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.443485 28180 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:02.490446 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.491070 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.467341 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.487280 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.447286 27969 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:02.442407 28044 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:02.491542 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:02.500622 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:02.446740 28206 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:02.499603 28186 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:02.497326 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.508710 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:02.505812 28206 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:02.512419 22571 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 132) took 17687 ms (client timeout 15000 ms). Trace:
I20260709 12:18:02.512676 28206 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:02.513314 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:02.514748 23679 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:02.437502 28086 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:18:02.516988 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:02.517222 28086 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:02.517747 28086 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.518155 28086 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:02.519023 28172 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:02.519519 28172 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:02.519877 28172 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:02.506058 28186 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.522261 28186 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:02.523965 28142 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.512789 28181 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:02.527680 28181 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:02.531625 27918 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:02.532101 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:02.533001 23695 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:02.534307 27969 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:02.536584 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:02.496357 28138 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:02.537477 22572 catalog_manager.cc:5697] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:02.496068 28155 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:02.550001 22823 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:02.546983 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:02.524725 28142 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:02.583096 27969 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:02.583544 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 118433us
I20260709 12:18:02.584398 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:02.587525 23674 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:18:02.596127 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:02.598398 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55943.7us
I20260709 12:18:02.538298 28135 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:02.602309 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.608887 22745 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 18: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:02.597076 22572 catalog_manager.cc:5697] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 7 to 11, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 11 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:02.614424 22895 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:02.608312 27541 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:02.618508 28271 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:02.620628 27541 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:02.620863 22790 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:02.623543 27494 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:02.624243 27494 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:02.625463 27494 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:02.628604 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:02.547554 28181 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:18:02.631227 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:02.632532 23660 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:02.633545 28212 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:02.634999 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.635973 28142 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:02.640528 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 161384us
I20260709 12:18:02.652341 27918 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:02.655197 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.661525 23679 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:02.674396 27928 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:02.675709 28155 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:02.678647 28273 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
I20260709 12:18:02.683276 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.685223 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:02.685384 28172 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:02.686585 22748 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:02.692479 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.695341 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.698177 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:02.701494 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58707.9us
I20260709 12:18:02.705543 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:02.577935 28138 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:02.715240 27918 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:02.715749 28259 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:02.716570 28259 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:02.716321 27918 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:02.721783 28274 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:18:02.723228 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:02.724205 23659 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:02.725535 22572 catalog_manager.cc:5697] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:02.634294 28247 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:02.710196 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 55127.5us
I20260709 12:18:02.741039 22572 catalog_manager.cc:5697] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 8 to 10, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 10 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:02.742282 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:02.745831 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:02.512961 22571 rpcz_store.cc:269] 0709 12:17:44.865208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.878920 (+ 13712us) service_pool.cc:224] Handling call
0709 12:18:02.512120 (+17633200us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:00.941101 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:00.941682 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:00.941714 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:18:00.941730 (+    16us) tablet.cc:662] Decoding operations
0709 12:18:00.942597 (+   867us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:00.942677 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:00.942713 (+    36us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:18:00.943407 (+   694us) tablet.cc:701] Row locks acquired
0709 12:18:00.943428 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:18:00.943597 (+   169us) write_op.cc:270] Start()
0709 12:18:00.943705 (+   108us) write_op.cc:276] Timestamp: P: 1783599480943548 usec, L: 0
0709 12:18:00.943724 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:18:00.944394 (+   670us) log.cc:844] Serialized 3281 byte log entry
0709 12:18:01.469561 (+525167us) op_driver.cc:464] REPLICATION: finished
0709 12:18:01.572884 (+103323us) write_op.cc:301] APPLY: starting
0709 12:18:01.572993 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:01.713440 (+140447us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:01.713690 (+   250us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:01.974758 (+261068us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:01.975611 (+   853us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:18:01.975778 (+   167us) write_op.cc:312] APPLY: finished
0709 12:18:01.977899 (+  2121us) log.cc:844] Serialized 80 byte log entry
0709 12:18:02.011902 (+ 34003us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:02.012196 (+   294us) write_op.cc:454] Released schema lock
0709 12:18:02.012261 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:02.013008 (+   747us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:02.013039 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26787,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":99422,"apply.run_cpu_time_us":19480,"apply.run_wall_time_us":440071,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37599,"num_ops":8,"prepare.queue_time_us":274024,"prepare.run_cpu_time_us":27020,"prepare.run_wall_time_us":101333,"raft.queue_time_us":273734,"raft.run_cpu_time_us":7146,"raft.run_wall_time_us":153992,"replication_time_us":500882,"thread_start_us":487287,"threads_started":4,"wal-append.queue_time_us":148356}]]}
I20260709 12:18:02.757216 22748 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:18:02.750905 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45490.1us
I20260709 12:18:02.759995 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:02.732829 28138 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:02.755987 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:02.765640 23660 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:02.718015 28259 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:02.744447 28137 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:02.785084 27858 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:18:02.786403 27757 consensus_meta.cc:287] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.004s
I20260709 12:18:02.787757 28172 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:02.768191 28211 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:02.778892 28212 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:02.771873 27325 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:02.780645 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:02.777539 28247 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:02.762507 27920 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:02.805274 28044 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:02.764201 28180 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:02.817862 22717 leader_election.cc:400] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18.
I20260709 12:18:02.824141 22717 leader_election.cc:403] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:18:02.820721 28212 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:02.827302 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 46769.5us
I20260709 12:18:02.830798 27928 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:02.835048 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.805706 28259 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:02.805707 28206 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:02.824844 27920 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:02.832237 28212 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:02.862507 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 453000us
W20260709 12:18:02.861235 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.801928 27757 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:02.819466 28186 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:02.880564 28206 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:02.881438 28206 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18.
I20260709 12:18:02.862166 27920 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:02.852478 28086 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:02.895001 22895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:02.896293 22895 raft_consensus.cc:606] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.897715 28086 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:02.864626 27894 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.899250 27894 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:02.902338 27894 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:02.902500 22752 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:02.908640 23656 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:02.932053 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:02.934052 23493 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.934970 22892 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:18:02.935565 23685 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:02.943617 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:02.944329 22818 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:02.945385 23679 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 12:18:02.869098 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.951131 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:02.937865 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:02.975394 22824 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:18:02.981725 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:02.950484 28135 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:02.985026 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 390512us
I20260709 12:18:02.991319 23494 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.011040 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:02.997202 27974 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:18:02.988694 28142 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:18:03.014413 28086 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:03.030579 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:03.053721 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 276272us
I20260709 12:18:03.054550 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:03.031702 28141 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:03.019618 27894 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:18:03.059770 28138 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:03.061648 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.047363 28206 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.055135 28044 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:03.071537 22825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.043s	sys 0.074s
I20260709 12:18:03.046773 28137 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:18:03.057588 28086 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:03.074084 23685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba57a7932934f629e6ed95148994535"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:45580
I20260709 12:18:03.075753 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:03.068463 28149 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.077011 23685 raft_consensus.cc:606] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.079743 27325 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:03.069115 27757 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:03.084793 28281 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.077281 28186 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:03.071348 28206 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:03.139801 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:03.140543 22748 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:03.143513 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:03.091926 28149 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:03.147112 28149 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:03.149612 28283 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:03.150209 28283 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:03.080329 28086 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:03.094899 28281 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:03.172732 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 114367us
W20260709 12:18:03.181993 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 190752us
I20260709 12:18:03.182247 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:03.183967 27325 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:03.184303 28186 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:03.186281 27325 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:03.186815 27325 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:03.187691 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:03.188021 27325 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:03.189314 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:03.192350 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:03.193205 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:03.194157 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:03.194528 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:03.195132 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:03.195406 22892 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:03.195505 22899 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:03.195830 22820 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:03.199681 22826 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:03.200263 22826 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:03.201244 22826 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:03.202524 22826 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:03.203374 27325 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:03.204452 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:03.206003 22898 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:03.207247 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:03.209621 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:03.202381 22894 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:03.217121 22826 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:03.222222 28271 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:03.174362 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:03.229377 22825 raft_consensus.cc:2410] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:18:03.229480 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:03.235232 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 242647us
I20260709 12:18:03.235807 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:03.238077 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:03.242326 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:03.238258 27918 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:03.247267 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:03.236027 28172 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:03.247992 28172 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:03.248943 28172 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:03.250133 28172 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:03.251662 28138 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:03.251875 23674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5444065d09a34471bca8963724a74d20"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
mode: GRACEFUL
new_leader_uuid: "2c3a0d56045540b7802937559599f09c"
 from {username='slave'} at 127.0.0.1:45580
I20260709 12:18:03.252820 23674 raft_consensus.cc:606] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Received request to transfer leadership to TS 2c3a0d56045540b7802937559599f09c
I20260709 12:18:03.248097 23659 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:18:03.256431 28282 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:18:03.260376 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 291297us
I20260709 12:18:03.262344 23685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:45580
I20260709 12:18:03.266219 23685 raft_consensus.cc:606] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.263300 27920 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:03.268172 22748 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:03.266623 23685 raft_consensus.cc:614] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:03.279911 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:03.280901 22894 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:03.276454 22892 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:03.282128 22820 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:18:03.290316 23656 raft_consensus.cc:2410] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:18:03.289935 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:03.293079 22748 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:03.283059 23494 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:03.289455 22818 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:03.297641 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:03.294998 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:03.298712 22750 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 12. Current term is 13. Ops: []
W20260709 12:18:03.309345 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.314131 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.317281 22823 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:03.319409 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:03.320957 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:03.327883 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:03.331434 27325 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:03.324023 22827 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:03.333841 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.334565 27325 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:03.353433 23493 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.353732 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a35aee871f0b41e48335c0260a873076"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:03.354341 22821 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:03.354521 22894 raft_consensus.cc:606] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:03.333303 28044 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.336741 28247 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.370312 27325 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:03.373917 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:03.377313 23493 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.363682 28289 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:03.388015 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:03.395087 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:03.396605 22826 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:03.370152 28206 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:03.403298 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:03.379113 28138 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:03.370252 28044 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:03.442708 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:03.378118 28247 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:03.359017 28283 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:03.425462 28135 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:03.426280 28206 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:03.447332 28086 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:03.464987 28259 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260709 12:18:03.450491 28294 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:03.457486 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:03.467288 28086 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:03.469941 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:03.474257 28292 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:18:03.459985 28281 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:03.461573 27920 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:03.501701 22822 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 12:18:03.502384 22822 pending_rounds.cc:85] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 6
I20260709 12:18:03.502681 22822 pending_rounds.cc:107] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:18:03.502996 22822 raft_consensus.cc:2889] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:03.501771 22826 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:03.506856 22827 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:18:03.509096 28279 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.442s	user 0.007s	sys 0.003s
I20260709 12:18:03.511780 28138 raft_consensus.cc:993] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: : Instructing follower e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:03.516793 28138 raft_consensus.cc:1081] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Signalling peer e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:03.523769 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1273) took 1040 ms. Trace:
I20260709 12:18:03.526600 22749 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ba57a7932934f629e6ed95148994535"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:49004
I20260709 12:18:03.488391 28259 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:18:03.528832 22749 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:03.529520 22749 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:03.524474 22751 rpcz_store.cc:276] 0709 12:18:02.483095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.497962 (+ 14867us) service_pool.cc:224] Handling call
0709 12:18:02.498327 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:02.541077 (+ 42750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:02.541127 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:02.616401 (+ 75274us) log.cc:844] Serialized 26 byte log entry
0709 12:18:02.996787 (+380386us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:02.996834 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.996918 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:03.508683 (+511765us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b240051d268. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15189c4 00007fadf1516acb 00007fadf16d1dc9 00007fadf16d1a55 00007fadf16d109d 00007fadf430310e 00007fadf431a88c 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221
0709 12:18:03.512286 (+  3603us) raft_consensus.cc:1685] finished
0709 12:18:03.512319 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.523683 (+ 11364us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30726,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":36498,"spinlock_wait_cycles":87302400,"thread_start_us":290110,"threads_started":1,"wal-append.queue_time_us":337424}
W20260709 12:18:03.540823 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 137584us
I20260709 12:18:03.545763 22824 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:03.542555 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:03.543780 22749 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:03.506462 28295 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:18:03.540747 28135 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:03.544997 28086 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:03.558328 22749 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:03.566520 28044 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:03.554538 27809 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:03.578614 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:03.579339 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 52277.9us
W20260709 12:18:03.575094 28300 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.178s	user 0.000s	sys 0.002s
I20260709 12:18:03.585223 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:03.563422 28135 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:03.582559 28212 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.708s	user 0.015s	sys 0.000s
I20260709 12:18:03.580649 28247 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:03.584704 28309 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:03.595227 28269 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:03.595919 28149 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:03.596526 28149 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:03.590168 28212 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:03.597591 28149 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:03.598590 22745 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:03.599766 28212 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:03.600625 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.602185 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.603129 28247 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:03.603670 28247 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:03.604125 28247 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:03.605566 28135 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:03.595631 28283 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:03.606281 28269 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:03.607506 28269 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:03.609082 28269 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:03.609203 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:03.609485 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:03.628990 27969 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.629753 27969 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:03.635071 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:03.662526 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 77395.5us
I20260709 12:18:03.611763 28212 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:03.612099 27809 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:18:03.613510 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.606233 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.616114 28149 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:03.617012 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:03.617794 27894 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:03.719183 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 113061us
I20260709 12:18:03.719434 22899 raft_consensus.cc:2368] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18.
I20260709 12:18:03.720006 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:03.721179 27894 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:03.722054 28086 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:03.722833 28086 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:03.723197 28086 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:03.723565 28086 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:03.724467 27894 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:03.727499 28172 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:03.731940 22751 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:03.731752 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:03.733568 23674 raft_consensus.cc:2368] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18.
W20260709 12:18:03.733619 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.619665 27995 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:03.735325 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:03.736253 28295 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:03.622397 22744 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:03.623535 27858 raft_consensus.cc:993] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: : Instructing follower e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:03.698994 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:03.700587 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:03.739841 27858 raft_consensus.cc:1081] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Signalling peer e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:03.740065 22894 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:03.740679 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:03.701843 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:03.701689 27494 consensus_queue.cc:1059] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:03.707059 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:03.742049 22750 raft_consensus.cc:2410] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:18:03.742280 28283 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:03.742046 27494 raft_consensus.cc:3055] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:03.743484 27494 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:03.744539 27494 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:03.746008 27494 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:03.714471 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:03.747509 22898 raft_consensus.cc:2410] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:18:03.742069 22717 leader_election.cc:400] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18.
I20260709 12:18:03.750312 22717 leader_election.cc:400] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19.
I20260709 12:18:03.751533 28309 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:03.752014 28309 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:03.752425 28309 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:03.754989 27809 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:03.755424 27809 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:03.757048 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:03.758000 23674 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:03.750648 22717 leader_election.cc:403] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:03.759670 27920 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19.
I20260709 12:18:03.760514 23674 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:03.730641 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:03.760422 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:03.696399 27969 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:03.716248 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:03.740916 28278 raft_consensus.cc:993] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: : Instructing follower 2c3a0d56045540b7802937559599f09c to start an election
I20260709 12:18:03.700426 28259 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:03.742862 28283 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:03.768179 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:03.712436 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.778668 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48105.6us
I20260709 12:18:03.782272 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:03.783700 28135 raft_consensus.cc:1081] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Signalling peer 2c3a0d56045540b7802937559599f09c to start an election
I20260709 12:18:03.782596 27894 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:03.779392 28212 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:03.795266 23674 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:03.799396 28259 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:03.799698 28212 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:03.799932 28259 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:03.796039 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:03.804394 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.792186 28283 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:03.801299 28259 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:03.810568 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.813277 27325 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:03.814460 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.796036 28181 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:03.820537 28034 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:03.813949 28288 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:03.810935 27894 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:03.823004 28212 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:03.831198 28288 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:03.805014 28295 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.837903 27918 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:03.838053 28295 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:03.805241 28135 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:03.834110 28289 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:03.839753 28289 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:03.840885 28295 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:03.836261 27894 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:03.837215 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.839537 28288 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:03.838050 28212 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:03.840744 28289 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:03.808372 28259 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:03.808465 28130 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:18:03.815614 28297 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:03.832458 28278 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:03.823733 28247 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:03.832610 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:03.842684 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.843788 28289 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:03.847404 28135 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:03.856063 28301 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:03.857081 28301 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:03.858001 28301 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:03.869055 23494 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.870645 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:03.874936 23656 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:03.875185 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:03.875869 23674 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:03.872504 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:03.885421 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:03.887113 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:03.889910 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:03.891714 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.868662 28135 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:03.896426 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:03.905130 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:03.906633 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 101234us
I20260709 12:18:03.874279 28278 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:03.881656 27920 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:03.890239 28297 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:03.909942 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:03.854058 28181 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:03.893111 27918 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:03.913218 28296 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 12:18:03.917317 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 109096us
I20260709 12:18:03.929225 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:03.881587 28137 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:18:03.905965 28186 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:03.887174 28283 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:03.930724 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:03.935385 23494 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:03.942996 22894 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:03.945873 28278 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:03.945953 28269 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:03.896163 28281 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:18:03.917790 28044 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:03.951602 22892 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5444065d09a34471bca8963724a74d20"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
 from {username='slave'} at 127.0.0.1:40028
I20260709 12:18:03.976034 22892 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:03.976460 22892 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:03.905992 27928 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:18:03.953851 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:03.932339 28206 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:03.931555 28135 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:18:03.978487 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 82156.8us
I20260709 12:18:03.984409 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:03.978986 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:03.978996 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.004772 22824 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:04.004304 22745 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:03.904867 28212 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:04.030752 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 53532.5us
I20260709 12:18:04.037622 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:04.004340 28206 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.947456 28269 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:04.029894 28135 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:04.047832 22892 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:04.024943 28034 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:04.003193 27858 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:18:04.036972 27757 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:04.083673 22744 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:04.085918 22892 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:04.050252 28278 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:04.057993 28206 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:04.090164 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 52602.7us
I20260709 12:18:04.074290 28034 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:04.111429 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 217446us
I20260709 12:18:04.115283 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:04.088901 27995 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:04.121042 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:04.131374 22824 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:04.133071 28336 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:04.116468 28044 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:18:04.136260 28034 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:04.141487 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:04.121781 28211 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:04.105623 28278 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:04.157837 27969 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:04.141974 28325 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:18:04.141518 28135 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:04.163966 28086 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:04.164191 28309 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:04.183171 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.154551 28324 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:18:04.204270 22818 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:18:04.142459 27494 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:04.206990 28181 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:04.207119 27969 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:04.207942 27325 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:04.219164 22895 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:18:04.254276 27325 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:04.255110 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 359532us
I20260709 12:18:04.256958 27325 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:04.258114 28138 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:04.258898 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:04.258701 28138 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:04.260982 28172 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:04.262161 28138 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:04.220232 28086 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:04.216141 28278 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:04.228468 28286 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:04.250416 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 214936us
I20260709 12:18:04.242293 28294 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:04.195575 28044 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:04.261866 28172 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:04.263504 28211 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.264669 22751 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:42860
I20260709 12:18:04.287297 22751 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:04.267835 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:04.206441 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 256202us
I20260709 12:18:04.275410 22753 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
W20260709 12:18:04.289279 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 165964us
I20260709 12:18:04.290153 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:04.291047 28339 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:04.291533 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:04.291973 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:04.280437 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 156084us
I20260709 12:18:04.294716 22827 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:04.282007 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:04.295243 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:04.295565 27325 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:04.297235 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:04.288919 28044 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:04.287881 22751 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:04.301218 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:04.302219 27325 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:04.303484 27325 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:04.305375 27325 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:04.316593 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:04.320729 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:04.321555 23695 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:04.280216 28294 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:04.327734 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:04.330142 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:04.333928 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:04.275460 27494 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:04.287700 28333 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.340652 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:04.332942 23695 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:04.304083 28259 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:04.347566 23674 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:04.349965 23682 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:04.305997 28332 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:04.295567 28283 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:04.355279 23656 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:04.356313 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:04.326220 27995 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:04.355371 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:04.356343 27325 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:04.355430 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:04.364167 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:04.326557 28269 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:04.368263 23660 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:04.363466 22899 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:04.372272 22898 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 15: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:04.359515 22894 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:04.334903 28181 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.334282 28286 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:04.374080 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:04.371524 23660 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:04.380646 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:04.348814 27809 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.003s
I20260709 12:18:04.378479 23689 raft_consensus.cc:2393] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:04.381718 22824 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:04.370719 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:04.384876 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:04.304214 28211 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:04.392642 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:04.381932 23660 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:04.398020 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:04.391291 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:04.398032 27325 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:04.394263 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:04.402082 22819 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:04.436015 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:04.383513 28181 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:04.409561 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:04.439256 23682 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:04.379478 28286 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:04.440240 28286 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:04.409227 28294 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:04.448419 28294 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:04.449679 28247 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:04.412279 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:04.462749 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50587.8us
I20260709 12:18:04.370702 28335 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.409595 28288 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:04.467614 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:04.452507 28326 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.269s	user 0.000s	sys 0.002s
W20260709 12:18:04.474406 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 98027.6us
I20260709 12:18:04.364756 28333 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:04.391355 27809 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:04.467484 28289 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.611s	user 0.007s	sys 0.006s
I20260709 12:18:04.476845 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:04.481684 23689 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:18:04.459674 28340 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:04.487917 22791 leader_election.cc:400] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18.
I20260709 12:18:04.488281 22791 leader_election.cc:403] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:18:04.470554 28283 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:04.484966 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:04.470294 28288 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.492766 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:04.492998 22820 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:04.502465 22893 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:04.506402 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:04.520334 28303 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:04.476049 27920 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:18:04.522819 28333 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:04.507776 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:04.503437 28289 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:04.524780 28301 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:04.524930 28289 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:04.525485 28301 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:04.523027 28321 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:04.532024 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:04.491389 28149 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:04.537784 23682 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:04.490990 28211 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:04.492954 28283 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:04.493052 28288 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:04.494714 28259 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:04.497617 28044 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:04.497148 28309 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:04.547137 27920 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:04.475353 28335 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:04.569245 22822 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:18:04.569849 28338 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:18:04.563508 28322 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:18:04.625873 28181 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:04.555301 28283 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:04.555398 28333 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:04.628274 28333 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.628865 28333 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:04.496867 28347 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18.
W20260709 12:18:04.631666 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.638238 28328 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.710s	user 0.006s	sys 0.000s
I20260709 12:18:04.638923 23660 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:04.643450 22900 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:04.646133 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:04.650007 22791 leader_election.cc:400] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18.
I20260709 12:18:04.585080 23685 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:04.595155 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:04.596659 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.654374 22819 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:18:04.589308 27920 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:04.595021 27494 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:04.607967 27809 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:04.539227 28149 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:04.608786 28289 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:04.564769 28172 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:04.526582 28301 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:04.580233 28259 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:04.498587 28340 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:04.612942 28303 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:04.618603 28044 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:04.618862 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:04.703994 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:04.620833 28335 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:04.622006 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:04.589615 27969 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:04.622488 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:04.746548 23656 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:18:04.586537 28348 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:04.625300 28285 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.751742 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:04.655049 22751 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:04.660288 23695 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:04.662611 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:04.657617 27920 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:04.670683 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:04.754933 22825 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:04.657112 28206 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.000s
I20260709 12:18:04.676746 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:04.709184 28044 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:04.709622 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:04.710630 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:04.721359 28332 consensus_queue.cc:1059] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:04.726920 28303 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:04.730382 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:04.665436 28149 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:04.747896 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:04.752074 28348 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.762858 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:04.769066 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:04.770624 22751 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:04.753484 22753 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:04.767191 23660 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:18:04.772456 28335 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:04.810810 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:04.774304 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:04.813815 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:04.812885 28335 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.824555 28303 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:04.826109 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.785537 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:04.817009 28294 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:04.815436 22823 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:04.835351 22826 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:04.840232 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:04.841071 22826 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:04.843487 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:04.834553 22825 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 22.
I20260709 12:18:04.768330 28044 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:04.759263 28285 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:04.854369 28303 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:04.856482 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:04.867125 28283 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:04.762537 28206 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:04.869203 28044 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:04.837899 28335 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:04.829130 28348 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:04.874367 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 88994.2us
I20260709 12:18:04.882258 28288 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:04.859076 27995 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:04.886864 22823 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:04.772672 28247 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 12:18:04.889168 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:04.893199 22748 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:04.873592 28303 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:04.879581 27494 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:04.848958 28294 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:04.898697 28259 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:04.904985 28294 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:04.897548 28364 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:04.881527 28338 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:18:04.888367 27995 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:04.908947 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:04.908936 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:04.911823 23685 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:04.911877 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:04.913825 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:04.913546 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:04.916522 28294 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:04.919697 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:04.920264 28364 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:04.920409 28281 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:04.920921 28281 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:04.921468 28364 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:04.921880 28281 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:04.922977 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.923192 28294 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:04.920418 23660 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:04.924233 28294 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:04.924918 28281 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:04.926630 28333 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:04.878134 27920 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:04.899461 28340 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:04.950486 27920 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:04.906225 28303 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:04.929622 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:04.910310 28044 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:04.898960 28285 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:04.901124 28349 raft_consensus.cc:3055] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:04.920037 28338 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:04.939352 28346 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:04.979295 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:04.972740 28286 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 12:18:05.002424 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:04.991230 23494 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:05.003325 22820 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:18:04.992173 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:05.001935 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.003343 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:04.995096 22826 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:04.971637 28340 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.001222 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:05.011809 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:04.974608 28338 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:05.014290 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.015173 22823 raft_consensus.cc:2393] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:04.966655 28368 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:05.016741 28283 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:05.012650 28269 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:05.022723 28269 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:05.023916 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:04.999300 28138 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.024003 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:04.971362 28349 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:04.976779 28333 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:05.028828 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:05.031081 27918 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:18:05.032038 28367 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:18:05.015718 28340 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.033528 23659 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:05.034713 28340 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:05.039579 23659 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:05.041491 28283 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:05.043586 28206 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:05.044652 28362 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:18:05.044495 28348 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.046738 28348 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:05.050568 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:05.029690 28138 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.025274 28338 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:05.057787 28138 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:05.060338 22823 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:05.062122 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:05.062924 23659 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:05.024545 28368 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:04.993585 28346 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.009912 28286 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:05.048195 28288 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:05.067291 28283 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:18:05.076805 28286 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:05.076866 28353 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.259s	user 0.000s	sys 0.009s
I20260709 12:18:05.077608 22824 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:05.055286 28340 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:05.083127 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:05.083410 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:05.067519 28368 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:05.097419 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:05.088950 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:05.086455 27918 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:18:05.092335 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1605) took 1163 ms. Trace:
I20260709 12:18:05.092931 28346 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:05.087702 28172 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:05.094048 28288 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:05.101611 23659 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:05.099893 22822 rpcz_store.cc:276] 0709 12:18:03.929184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.930472 (+  1288us) service_pool.cc:224] Handling call
0709 12:18:05.092125 (+1161653us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b540045c754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:05.092244 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629019008}
I20260709 12:18:05.109825 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.110584 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:05.113510 22893 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:05.115466 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:05.116520 28294 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:05.117357 28294 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:05.119277 28294 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.123220 22893 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:05.125989 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.128190 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.133311 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:05.136224 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:05.141626 27757 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:05.113137 28172 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:05.107455 27969 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:18:05.147881 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.150447 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:05.152158 22899 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:18:05.146958 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:05.155351 28138 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:05.095702 28149 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.158004 28149 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:05.144594 28181 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:05.164381 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.144984 28346 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:05.082288 28349 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.149171 28206 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:05.149763 28172 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:05.148489 28339 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:05.170344 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:05.170408 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.179415 22895 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:05.183861 22893 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:05.184284 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.154095 27920 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:05.185683 22901 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:05.163549 28181 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:05.149662 27757 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.201228 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:05.145159 28335 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.220672 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:05.192819 28206 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:05.187922 28269 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:18:05.168921 27969 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:18:05.216156 28339 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:05.213220 28138 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:05.216868 28181 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:05.242028 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:05.235849 28374 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:18:05.222337 28289 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:18:05.220801 28278 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.012s	sys 0.024s
I20260709 12:18:05.267310 28339 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.222648 28346 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.275107 28347 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:05.270617 28335 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:05.217114 27920 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.259094 28212 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:05.262387 28349 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:05.274250 28356 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.452s	user 0.000s	sys 0.005s
W20260709 12:18:05.281886 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 93064.4us
I20260709 12:18:05.275621 28347 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:05.285831 22899 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:05.224663 27918 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:18:05.276396 28278 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.012s	sys 0.025s
I20260709 12:18:05.287003 28206 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:05.291827 28371 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:18:05.293840 27920 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:05.287572 28212 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:05.281587 28287 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:05.304240 28377 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:18:05.307425 28363 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.485s	user 0.005s	sys 0.009s
I20260709 12:18:05.309243 28149 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:05.313756 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.315102 28347 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:05.317800 28281 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:05.275269 28346 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.296808 27918 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.326506 28212 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:05.331406 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:05.336454 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:05.322398 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:05.298080 27757 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:05.357004 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:05.321741 28309 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:05.321221 28335 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:05.374775 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:05.357841 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:05.377362 22753 raft_consensus.cc:2410] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:18:05.381734 22748 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:05.320670 28303 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:05.376226 23682 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:05.379081 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 56829.1us
I20260709 12:18:05.386651 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:05.367671 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 233408us
I20260709 12:18:05.391031 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:05.338135 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:05.323755 28377 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.404567 23659 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:05.404731 28377 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:05.355571 28330 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:05.406956 28330 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:05.416983 23659 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:18:05.419988 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:05.421218 28377 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.422564 23672 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 20: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:05.425407 23660 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:05.428602 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:05.378952 27918 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:05.380498 28347 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:05.432421 23682 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:05.382298 28212 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:05.327904 28287 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:05.327999 28181 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.400564 28269 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 12:18:05.401022 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 159158us
I20260709 12:18:05.469086 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.469879 22893 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 12.
I20260709 12:18:05.458707 23493 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:05.470428 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:05.350063 28149 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:05.464039 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:05.467721 23660 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 12:18:05.459560 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.471220 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:05.477038 22893 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:05.477463 22893 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:05.467876 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:05.474643 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.473763 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:05.478906 23659 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:05.476867 22821 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:05.337433 28338 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:05.357682 28281 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.489094 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:05.443291 28330 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:05.485028 22901 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:05.489941 23659 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:18:05.483952 22892 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 17: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:05.491261 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:05.496618 22900 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:05.384755 28335 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:05.384943 28309 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:05.508767 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:05.484751 28278 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.514339 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:05.515323 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:05.481961 28212 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:05.519969 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:05.498193 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 92776.1us
I20260709 12:18:05.526472 22749 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:05.535738 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:05.528887 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:05.544693 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:05.545286 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 86664.8us
I20260709 12:18:05.489359 28172 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.548141 22900 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:05.554646 22749 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:05.555276 23685 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:05.532578 28383 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:05.518364 28387 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:05.541687 28286 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:05.576956 28286 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:05.578001 28286 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.578933 28354 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:05.579311 28346 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:05.580631 28338 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:05.548844 28294 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:05.582134 28294 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:05.566581 28377 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:05.566850 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:05.584031 28335 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:05.584255 22899 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:05.583237 28294 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.584935 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:05.585462 28287 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:05.586287 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:05.567649 28384 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:18:05.571344 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:05.571745 28391 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:18:05.572096 28387 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:05.574079 28309 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:05.589820 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 981) took 1048 ms. Trace:
I20260709 12:18:05.569448 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:05.583228 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:05.603580 22895 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:05.566039 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:05.597071 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:05.600446 22746 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:05.531359 28278 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.611582 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.612725 22900 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 15: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:05.613010 28339 raft_consensus.cc:2764] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:18:05.615015 28281 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:05.615335 28149 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:05.612613 28172 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:05.616513 28368 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.001s
I20260709 12:18:05.616981 23685 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:05.603595 22819 rpcz_store.cc:276] 0709 12:18:04.540900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.836859 (+295959us) service_pool.cc:224] Handling call
0709 12:18:04.850743 (+ 13884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:04.883912 (+ 33169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:04.883948 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:04.884522 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:18:04.917407 (+ 32885us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:04.959562 (+ 42155us) log.cc:844] Serialized 14 byte log entry
0709 12:18:04.962462 (+  2900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.291414 (+328952us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b180039a600. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf865358f 00007fadf1692571 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd
0709 12:18:05.315048 (+ 23634us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b180039a600. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:18:05.588779 (+273731us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b180039a600. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419
0709 12:18:05.589485 (+   706us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b5400301954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:05.589533 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:05.589582 (+    49us) raft_consensus.cc:1685] finished
0709 12:18:05.589596 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.589753 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5733,"prepare.queue_time_us":39072,"prepare.run_cpu_time_us":220,"prepare.run_wall_time_us":220,"raft.queue_time_us":2648,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":7071,"spinlock_wait_cycles":117047680,"thread_start_us":32415,"threads_started":1,"wal-append.queue_time_us":80202}
I20260709 12:18:05.630300 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:05.631981 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:05.631256 22899 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:18:05.623220 28395 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.645943 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:05.623600 28309 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:05.645411 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:05.643472 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:05.652632 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:05.657547 22823 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:05.657933 23685 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:05.652870 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.659286 22899 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:18:05.663148 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:05.664692 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:05.665223 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:05.665509 22900 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:05.623045 28368 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.667013 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:05.571784 28212 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:05.645733 28287 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:18:05.672760 28330 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:05.672829 27920 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:05.665438 27928 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:05.685761 28387 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.696156 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:05.697329 22746 raft_consensus.cc:2393] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:05.655566 28172 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:05.707568 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 48343.4us
I20260709 12:18:05.710289 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:05.748155 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 43539us
I20260709 12:18:05.700906 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:05.713160 27995 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:05.698390 28338 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:18:05.744920 22825 raft_consensus.cc:2393] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:05.756073 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:05.715674 28181 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:05.760298 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.710620 28278 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:05.749574 27858 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:18:05.753959 28397 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:05.754348 28288 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:05.754616 22819 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:18:05.758849 22823 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:05.748224 23685 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:05.702455 28296 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.761013 22894 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:05.653769 28395 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.748247 27928 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:05.768251 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:05.775103 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:05.776118 22749 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:05.776717 22747 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:18:05.779588 23674 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:05.775426 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:05.769639 28397 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.792129 28383 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:05.805781 28397 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:05.790095 28393 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:05.806342 28393 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.768491 28338 consensus_queue.cc:1243] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:05.806728 28393 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:05.807273 28338 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:05.807785 28338 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:05.809855 28338 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:05.796569 28368 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:05.811142 28303 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:05.812474 28400 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:18:05.811185 27928 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.815562 28393 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.801138 28335 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.820284 28335 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.781571 28296 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:05.804033 28395 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:05.788184 28278 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:05.823467 28278 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:05.823915 28296 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:05.825245 28335 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:05.825491 28278 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:05.799438 27918 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.826987 23659 raft_consensus.cc:2368] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16.
I20260709 12:18:05.831835 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:05.832873 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:05.833645 22748 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:05.833612 27918 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:05.837123 28397 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:05.839133 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 79981.5us
I20260709 12:18:05.839648 22900 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:05.831858 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:05.841473 22819 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 13: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:05.843070 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:05.845954 28368 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:05.847134 28393 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:05.847453 28130 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:05.847963 28130 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:05.848308 28397 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:05.848904 28130 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:05.850987 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:05.851200 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:05.851727 22746 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:05.851608 22748 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:18:05.857138 22893 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:05.862733 22893 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:05.863867 22746 raft_consensus.cc:2410] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:18:05.865211 22748 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
W20260709 12:18:05.885228 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.888722 22893 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:05.889463 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:05.890470 22748 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:05.869848 23493 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:05.901018 22790 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:05.902717 22790 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:05.913383 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 43655.1us
I20260709 12:18:05.879606 27918 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:05.917506 22790 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:05.887945 27995 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.925766 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:05.904487 28354 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:05.918109 28403 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:05.913570 22748 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:05.931998 23493 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:05.911806 28388 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:05.940871 27494 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:05.941614 27494 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:05.944988 28340 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:18:05.945515 28340 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:05.931216 27995 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:05.946666 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:05.930483 28286 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:05.745620 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:06.017839 28340 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:05.969607 28403 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:05.918956 27918 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.074074 28397 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:06.064617 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 138987us
I20260709 12:18:05.949291 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:05.987185 27858 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:18:05.975909 28181 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:05.969789 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:05.985778 28138 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:06.065393 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:05.934201 28349 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:05.975708 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:06.077153 28286 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:06.045882 28393 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:06.086279 28286 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:06.087117 28393 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:06.089391 28393 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:06.088634 28403 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:05.948035 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:06.075973 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1156) took 1026 ms. Trace:
I20260709 12:18:06.082089 22899 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:06.090996 22896 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:18:06.097565 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 151014us
I20260709 12:18:06.082911 22895 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:05.969967 28395 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:05.970536 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:06.111646 22894 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:06.077955 28340 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:06.097868 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 335662us
I20260709 12:18:06.107339 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:05.943974 27494 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:06.108525 22821 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:18:05.986260 28206 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:06.080446 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:06.114027 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:06.117317 22748 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:06.111791 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:06.120201 22864 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:06.080437 27995 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:06.082249 27918 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:06.080853 28368 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:06.124321 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:06.082463 28138 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:06.126231 22746 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:06.079259 28259 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:06.127220 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46953.4us
I20260709 12:18:06.109644 28329 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.105250 28130 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:06.133936 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:06.127277 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:06.127317 28393 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:06.108690 28044 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.112797 28278 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:06.079067 28397 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:06.136520 22892 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:06.136518 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:06.129760 28387 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:06.116751 28206 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:06.140329 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:06.142285 22899 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:06.081584 28181 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:06.173595 23674 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:06.109620 23689 rpcz_store.cc:276] 0709 12:18:05.049173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.049497 (+   324us) service_pool.cc:224] Handling call
0709 12:18:05.062089 (+ 12592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:05.062453 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:05.062482 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:05.074836 (+ 12354us) log.cc:844] Serialized 26 byte log entry
0709 12:18:05.140024 (+ 65188us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:05.140260 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.140396 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:05.938870 (+798474us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b2400123848. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15189c4 00007fadf1516acb 00007fadf16d1dc9 00007fadf16d1a55 00007fadf16d0fb0 00007fadf4347488 00007fadf4347be8 00007fadf431f398 00007fadf431a76a 00007fadf4319bb6
0709 12:18:05.939759 (+   889us) raft_consensus.cc:1685] finished
0709 12:18:05.939781 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:06.075872 (+136091us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1400,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":6004,"spinlock_wait_cycles":17129856,"thread_start_us":64700,"threads_started":1,"wal-append.queue_time_us":186436}
I20260709 12:18:06.133180 28348 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:06.133395 28296 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.179575 22900 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:18:06.180359 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:06.206017 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.196522 28336 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:06.208164 28336 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.181653 23672 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:06.138607 28259 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:06.173036 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:06.210186 23659 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 20: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:18:06.181800 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 183484us
I20260709 12:18:06.211293 28259 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:06.212042 28259 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:06.212522 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:06.196934 28278 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:06.212993 28172 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:18:06.182332 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 62275.7us
I20260709 12:18:06.213945 28278 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:06.130226 28395 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:06.215746 28395 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:06.194252 28388 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:06.216950 28288 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:06.222105 22744 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:18:06.224337 28206 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:06.225541 28206 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:06.208550 28406 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:18:06.208555 28296 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:06.230293 28296 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:06.208541 28336 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:06.238946 28348 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:06.240142 28348 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:06.204121 28396 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:06.241890 28396 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:06.244146 28396 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:06.218385 28288 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:18:06.251078 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:06.252132 28397 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:06.252748 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:06.253543 27858 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:06.155612 28044 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:06.192716 22894 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:06.262157 28044 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:06.155184 27494 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 20.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:18:06.135483 28368 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:06.268731 27494 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:06.269210 27494 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:06.270040 27494 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.8, Last appended by leader: 8, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:06.143441 28329 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:06.194650 28138 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:06.274070 27757 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:06.155851 28382 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:06.275122 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:06.280612 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:06.297119 22894 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 12: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:06.281418 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:06.298283 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:06.283419 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:06.284595 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:06.285655 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:06.298983 22900 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 20: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:06.298923 22896 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:06.287938 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:06.288970 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:06.299670 22895 raft_consensus.cc:2376] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15. Re-sending same reply.
W20260709 12:18:06.293084 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 114505us
I20260709 12:18:06.294509 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:06.295377 23659 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:06.287052 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:06.270401 28368 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:06.323491 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:06.335559 22894 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:06.344216 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:06.345124 23689 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 11.
I20260709 12:18:06.329830 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:06.348186 22717 leader_election.cc:400] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16.
I20260709 12:18:06.350569 22717 leader_election.cc:403] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:06.296445 28269 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.355073 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1288) took 1705 ms. Trace:
I20260709 12:18:06.332038 27757 consensus_queue.cc:1243] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:06.302500 27858 raft_consensus.cc:2764] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 12:18:06.356601 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 166371us
I20260709 12:18:06.358898 23679 rpcz_store.cc:276] 0709 12:18:04.649301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.668478 (+ 19177us) service_pool.cc:224] Handling call
0709 12:18:04.668800 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:04.673720 (+  4920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:04.673758 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:05.694757 (+1020999us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b1800432940. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a
0709 12:18:05.695668 (+   911us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b2c00058028. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:18:05.703886 (+  8218us) log.cc:844] Serialized 26 byte log entry
0709 12:18:06.098877 (+394991us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:06.354022 (+255145us) log.cc:844] Serialized 14 byte log entry
0709 12:18:06.354394 (+   372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.354476 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:06.354848 (+   372us) raft_consensus.cc:1685] finished
0709 12:18:06.354863 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:06.355010 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4526,"raft.queue_time_us":5899,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":29853,"spinlock_wait_cycles":10248832,"thread_start_us":571755,"threads_started":2,"wal-append.queue_time_us":473155}
I20260709 12:18:06.352190 28381 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:06.355293 28138 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:06.356040 28287 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:06.355872 28401 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:06.359738 28410 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16.
I20260709 12:18:06.357576 28259 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:06.354537 28368 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:06.353917 28411 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:18:06.373235 28364 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:18:06.366462 28269 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:06.384783 28381 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:06.390285 28287 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:06.416745 28417 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:06.389773 27920 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:18:06.387583 28259 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:06.384423 28401 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:06.461159 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:06.459364 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 319074us
I20260709 12:18:06.401860 28368 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:06.466284 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 93795.2us
I20260709 12:18:06.467739 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:06.469507 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:06.470832 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.472019 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:06.473666 22823 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:06.474664 22821 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 20: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:06.477289 22823 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:06.480453 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:06.481505 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:06.483063 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:06.485173 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.489812 28381 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:06.466289 27918 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:06.495399 27995 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:06.496419 27995 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:06.496860 28259 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:06.497699 28259 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:06.498071 28259 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:06.499369 28259 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:06.503188 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:06.504478 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 123360us
I20260709 12:18:06.509833 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.513785 22821 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:06.520370 23659 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:06.486922 28403 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.455681 28417 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:06.534066 28417 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:06.536135 22821 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:06.544413 28403 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:06.547668 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.548805 22818 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:18:06.511121 28329 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:06.560916 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:06.561934 22899 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:06.576076 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.573524 22896 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:18:06.579238 22826 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:06.580520 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.581223 22826 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:06.512084 28336 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:06.546684 28403 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:06.624151 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.624486 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.637156 22827 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:18:06.625386 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.582048 28259 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:06.741457 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:06.526726 28287 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:06.742432 22748 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:06.727492 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:06.733354 22893 raft_consensus.cc:2368] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18.
I20260709 12:18:06.733418 28368 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:06.635334 28424 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:18:06.753918 28301 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:18:06.735536 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 196057us
I20260709 12:18:07.067883 28402 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:07.068749 28402 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:07.070217 28287 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:06.736267 22745 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:18:07.070854 28287 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:06.736820 22822 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:07.073043 28287 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:07.073262 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:06.737465 28340 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.003s
I20260709 12:18:06.741989 28336 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:06.547019 28281 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 12:18:06.751403 22899 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
W20260709 12:18:06.771723 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 194327us
I20260709 12:18:06.754494 28301 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:07.083788 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.084292 28301 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:07.085551 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.085708 28301 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:06.788375 22818 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:07.088212 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:06.825047 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.090425 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:07.091120 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:06.815346 23660 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:18:07.091955 23660 pending_rounds.cc:85] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 10
I20260709 12:18:07.092240 23660 pending_rounds.cc:107] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:18:07.092499 23660 raft_consensus.cc:2889] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:06.804795 22826 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:06.842896 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:06.815220 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.830885 22748 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:06.804312 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.803856 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:06.828989 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:06.816426 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:06.815945 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:06.848335 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.783037 28393 consensus_meta.cc:287] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.011s
I20260709 12:18:06.769608 27995 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:06.874481 22751 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:18:07.097630 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:06.885625 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.098611 22751 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:06.875197 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:06.852154 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:06.868553 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:06.806878 28382 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:06.799610 28278 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.102182 28278 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.102962 28349 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.103565 28349 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:07.104394 28278 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:07.105647 28426 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.105918 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:07.106202 28426 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.108629 28388 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.108991 28430 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:07.109649 28437 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
W20260709 12:18:06.939615 28420 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.396s	user 0.005s	sys 0.003s
I20260709 12:18:07.110103 28130 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:06.934235 28348 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.110752 28130 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:07.111411 28348 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:06.896554 28401 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:07.113150 28403 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:07.113727 28348 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:06.944725 28427 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:06.851346 28206 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.010s
I20260709 12:18:06.892201 28181 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:07.115185 28206 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.847222 28329 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:07.115685 28181 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:07.115953 28329 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:07.116931 28424 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:07.117519 28424 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:06.979822 28423 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.433s	user 0.009s	sys 0.000s
W20260709 12:18:06.958237 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 145545us
I20260709 12:18:06.981812 28296 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:07.119318 28296 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:07.119593 22818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c"
dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
mode: GRACEFUL
new_leader_uuid: "2c3a0d56045540b7802937559599f09c"
 from {username='slave'} at 127.0.0.1:43202
I20260709 12:18:07.119973 28424 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:07.120317 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:07.121508 28296 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:07.121783 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:06.983774 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:07.122606 28340 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:07.123241 28340 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:07.124053 28427 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:07.124276 28340 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:07.125068 22819 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:07.126303 28427 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:06.983368 28138 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:07.115689 28206 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.127583 28138 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:06.987756 28377 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:07.128538 28377 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:07.129202 28206 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:07.129562 28138 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:07.129820 28206 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:07.001457 22892 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:07.003540 22894 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:07.004596 22895 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:18:07.015727 28419 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.472s	user 0.006s	sys 0.000s
I20260709 12:18:07.018251 27494 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:07.034773 28269 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:07.044001 28441 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.103s	user 0.003s	sys 0.002s
I20260709 12:18:07.050194 28259 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:18:07.058423 28415 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.682s	user 0.008s	sys 0.000s
I20260709 12:18:07.079433 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.080307 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:07.095224 22827 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:07.095758 22744 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:07.099741 22893 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:07.094305 23674 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:07.100361 23656 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:07.100639 22864 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:07.138408 22820 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:07.096361 27995 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.109177 28388 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.180558 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.158062 22826 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:07.140692 22748 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:18:07.158998 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 75552.1us
I20260709 12:18:07.148655 22818 raft_consensus.cc:606] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Received request to transfer leadership to TS 2c3a0d56045540b7802937559599f09c
I20260709 12:18:07.162528 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:07.158496 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 57727.4us
I20260709 12:18:07.185644 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.157878 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:07.164466 27494 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:07.187180 22818 raft_consensus.cc:614] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:07.166251 22897 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:18:07.167287 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 75373.7us
I20260709 12:18:07.188459 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:07.173213 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.106025 28393 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:06.983981 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.110702 27918 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:07.118098 28329 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:07.191241 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.193302 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.194041 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.188571 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.195129 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:07.195545 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 94985.9us
I20260709 12:18:07.196041 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:07.189296 22750 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:07.182699 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:07.204015 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46228.7us
I20260709 12:18:07.204149 22819 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:07.205222 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:07.205583 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:07.205876 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:07.206545 27494 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:07.207079 23685 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:07.175207 28269 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:07.130295 28206 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.209326 22820 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:07.173624 27858 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:07.167764 28259 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:07.178462 28294 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:07.234527 28294 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:07.234675 28259 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:07.235638 28424 consensus_queue.cc:1175] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a89a4b420ea9496aab55475fc38bb6f7" responder_term: 16 status { last_received { term: 16 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 16 index: 9 } }
I20260709 12:18:07.236850 28294 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:07.236941 22749 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:07.179756 28289 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:07.238083 22790 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:07.238327 28289 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:07.238948 28287 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:07.240556 28289 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:07.166373 28387 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:18:07.242236 27995 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:07.243037 22821 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:07.191425 28377 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:07.248103 28407 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:07.248955 28149 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:07.216796 28381 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:07.219830 27494 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:07.250438 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:07.223129 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.224192 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.216003 28401 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:07.225152 28172 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:07.202317 28402 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:07.219584 28269 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.226095 22825 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:07.166571 28336 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:18:07.163606 28034 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:18:07.229103 28206 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:07.230721 28388 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:07.232697 22827 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:07.203075 27757 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:07.286499 28401 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.313356 28401 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:07.314148 28426 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:07.291311 28172 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.315153 28172 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:07.218940 28396 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:18:07.251744 28403 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:07.319207 28403 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:07.307109 28269 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:07.109663 28430 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.321409 28403 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:07.291286 27858 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:07.322909 28430 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:07.322729 27858 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.249176 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:07.280165 28382 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:07.212520 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.218583 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:07.215119 22822 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:07.264231 22823 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
I20260709 12:18:07.290772 22746 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:07.286715 22745 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:18:07.255165 27494 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:07.299976 22744 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
W20260709 12:18:07.300067 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 49708.4us
I20260709 12:18:07.304282 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:07.335968 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:07.251374 28287 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:18:07.256047 22790 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:07.308269 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:07.224234 22571 catalog_manager.cc:5697] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 12 to 16, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 16 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:07.219343 28138 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:07.324954 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 75866.1us
I20260709 12:18:07.343282 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:07.310586 28301 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:07.179443 28339 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:07.332175 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 113665us
I20260709 12:18:07.348592 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:07.348879 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:07.349529 23682 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 22.
W20260709 12:18:07.350311 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 94345.4us
I20260709 12:18:07.350420 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:07.353344 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:07.355762 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:07.327627 28382 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.361304 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:07.362151 22893 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:07.362454 27494 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:07.366765 23682 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:18:07.342414 28138 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:07.363104 22790 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:07.332983 28388 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:07.368991 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.370870 22894 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:18:07.372121 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.386842 22826 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:07.387126 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:07.373169 22898 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:07.373088 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:07.374850 23695 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:07.377962 22864 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:07.338740 28403 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:07.393440 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:07.385869 22821 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:07.398331 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.354873 28452 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:07.356967 28206 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:07.359453 28426 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:07.394923 27918 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:18:07.374128 28427 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.390875 28289 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:18:07.363080 28377 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:07.374315 28382 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:07.365257 28402 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:07.384560 28138 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:07.379086 28417 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:07.406740 22752 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:07.383934 28388 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:07.447995 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.402062 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:07.467119 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:07.413132 28455 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:18:07.471609 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:07.472306 22897 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:07.474900 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.475253 28451 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 12:18:07.401922 28403 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:07.476315 28403 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:07.465270 28402 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:07.477054 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:07.478873 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:07.421169 28301 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.480100 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:07.479642 28269 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.419744 28354 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:07.481648 22896 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:07.482204 28269 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:07.483646 28402 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:07.485565 28425 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.488999 23679 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:07.478490 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:07.478490 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:07.491583 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.459767 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:07.493299 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 157418us
I20260709 12:18:07.494760 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:18:07.463721 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 104647us
I20260709 12:18:07.503723 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:07.505064 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:07.502089 22893 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:07.390869 28340 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:18:07.503125 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:07.525991 22821 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:07.527458 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:07.415606 28445 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:18:07.529378 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 127458us
W20260709 12:18:07.525367 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 65724.9us
I20260709 12:18:07.489619 28388 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:07.464876 28417 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.532341 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:07.536638 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.536962 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:07.540124 22822 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:07.537683 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.523751 28354 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:07.499656 27757 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:07.494481 27858 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:07.553418 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:07.550164 22717 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.731s (SENT) [suppressed 1 similar messages]
I20260709 12:18:07.536270 28430 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:07.479737 28301 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:07.556205 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.537539 28269 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:07.457820 28377 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.531612 28396 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:07.528765 28347 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:07.531678 28212 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.533545 28445 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:07.535527 28380 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:07.566689 22822 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:07.419296 28427 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.569991 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.545279 28417 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:07.583935 22824 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:07.579077 28465 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:07.557586 28130 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:07.486109 28425 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:07.596383 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50896.4us
I20260709 12:18:07.597599 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.538941 28287 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:18:07.579684 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:07.600621 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:07.568552 28430 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:07.604470 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:07.626123 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:07.587448 28445 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:07.597141 28461 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:18:07.633476 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.625211 28430 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:07.632140 28396 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:07.644011 28401 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:07.663462 28464 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:18:07.665663 28172 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:07.653205 22897 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:18:07.678602 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45043.1us
I20260709 12:18:07.601900 28347 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:18:07.635092 28458 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:07.694064 28401 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:07.687618 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 137493us
I20260709 12:18:07.637768 28289 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:18:07.702677 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:07.695869 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.647946 28286 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:07.590939 28212 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:07.709856 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:07.678236 28396 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:07.711421 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:07.712455 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1343) took 1233 ms. Trace:
I20260709 12:18:07.726245 28443 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:18:07.763171 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51815.8us
I20260709 12:18:07.717963 22823 rpcz_store.cc:276] 0709 12:18:06.479458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.481262 (+  1804us) service_pool.cc:224] Handling call
0709 12:18:07.712260 (+1230998us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54002e8954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:07.712376 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622563072}
I20260709 12:18:07.765638 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:07.714685 28347 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:18:07.711206 27920 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:07.775123 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:07.649986 27757 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:07.778236 22823 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:07.718215 28396 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:07.716641 28287 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:07.715431 28427 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:07.766620 28411 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:07.772318 28296 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.778107 27928 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.799414 22821 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:07.767063 28443 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:07.767522 28388 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:07.802510 28349 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:07.810367 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 44834.2us
I20260709 12:18:07.808197 28468 raft_consensus.cc:2764] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:18:07.817830 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:07.782100 28294 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:18:07.830413 22717 leader_election.cc:400] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18.
I20260709 12:18:07.835954 22717 leader_election.cc:403] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:18:07.840704 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1179) took 1321 ms. Trace:
I20260709 12:18:07.841420 23685 rpcz_store.cc:276] 0709 12:18:06.519395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.519537 (+   142us) service_pool.cc:224] Handling call
0709 12:18:06.527375 (+  7838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.207484 (+680109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.840344 (+632860us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b540059e054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:07.840612 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562236160}
I20260709 12:18:07.819038 28206 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.853752 28462 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:18:07.811973 28296 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:07.830116 28377 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:07.832005 27920 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:07.833599 28388 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:07.813711 27928 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:07.848398 28468 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18.
I20260709 12:18:07.872208 28382 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.873843 23674 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 16: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:07.852108 28206 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:07.876223 28301 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:07.891532 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:07.878966 28259 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:07.883178 28172 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:07.998045 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 106620us
I20260709 12:18:07.999311 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:07.996624 28347 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:08.002753 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:07.859477 28443 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:07.884806 28468 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.117s
I20260709 12:18:08.008064 28418 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.003067 28347 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:08.008752 28467 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:08.008946 27928 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:08.009761 28476 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
W20260709 12:18:08.011301 28181 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.895s	user 0.014s	sys 0.000s
W20260709 12:18:08.002454 28419 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.111s	user 0.004s	sys 0.000s
I20260709 12:18:08.044036 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:08.015455 28443 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:08.055104 28382 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:08.054143 28296 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:08.004274 27757 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:08.050726 28469 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:08.051515 28478 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.060966 28206 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:08.061391 28478 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:08.061997 28172 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.051895 28354 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:08.062534 28172 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:08.063064 28354 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:08.043099 28418 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.065438 28354 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:08.065747 28418 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:08.066355 22892 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:18:08.066810 22892 pending_rounds.cc:85] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 9
I20260709 12:18:08.067067 22892 pending_rounds.cc:107] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:18:08.067344 22892 raft_consensus.cc:2889] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:08.069415 28478 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:08.072144 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.074254 28478 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:08.074859 28478 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:08.075242 28478 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:08.076263 28347 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:08.061070 28469 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:08.077590 28469 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.8, Last appended by leader: 8, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.078655 28181 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:08.079259 28181 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.081321 28181 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:08.097863 27757 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.098565 27757 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:08.099633 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:08.101019 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:08.101414 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43202 (request call id 6) took 1065 ms. Trace:
I20260709 12:18:08.101649 22825 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:18:08.101832 22818 rpcz_store.cc:276] 0709 12:18:07.035575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.119398 (+ 83823us) service_pool.cc:224] Handling call
0709 12:18:08.101198 (+981800us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b54002e8954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf4779853 00007fadf974760a 00007fadf2ccd7d4 00007fadf2ccd762 00007fadf2ccd691 00007fadf2ccd60c 00007fadf2ccc8c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:08.101319 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65133312}
I20260709 12:18:08.102860 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:08.103381 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:08.104060 22818 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:08.100982 27757 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:08.115624 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:08.113397 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:08.117520 22749 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 19
W20260709 12:18:08.091033 28417 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.001s
I20260709 12:18:08.122095 23493 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:08.124614 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:08.126562 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.127715 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.092164 28347 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.135396 23493 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:08.141707 22744 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:18:08.145017 23656 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:18:08.145527 22818 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:18:08.153570 22752 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 12:18:08.154023 22752 pending_rounds.cc:85] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 10
I20260709 12:18:08.154335 22752 pending_rounds.cc:107] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:18:08.154826 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:08.154613 22752 raft_consensus.cc:2889] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:08.133778 28403 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.657s	user 0.013s	sys 0.000s
W20260709 12:18:08.144646 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 297339us
I20260709 12:18:08.160019 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:08.140291 28377 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:08.132090 28296 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:18:08.157279 28138 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.000s
I20260709 12:18:08.121656 28382 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:08.129381 28427 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:08.131992 28278 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:08.184392 23685 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:18:08.140981 28465 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:08.254709 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:08.255625 22744 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:08.157593 28340 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:08.155519 28458 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:08.250665 28138 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:08.276309 28445 consensus_meta.cc:287] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.628s	user 0.003s	sys 0.009s
I20260709 12:18:08.254330 28427 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:08.138900 28388 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:18:08.276865 28445 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:08.278168 28138 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:08.279071 22898 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:08.209309 28296 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.280210 28296 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:08.132207 28417 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.238860 28329 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:08.283331 28329 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:08.284453 28329 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.286130 22824 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 22. Current term is 23. Ops: []
I20260709 12:18:08.260842 28289 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:08.287300 28289 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:08.250895 28382 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.287978 28289 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:08.289777 28382 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:08.239941 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.153090 28347 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:08.291427 22752 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
W20260709 12:18:08.292341 28477 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:18:08.293329 28347 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:08.294400 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:08.259761 28278 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:08.297468 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:08.297696 28278 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:08.298237 23682 raft_consensus.cc:2368] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19.
I20260709 12:18:08.306377 28445 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:08.309242 28301 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:08.204272 22749 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:08.311739 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:08.311901 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:08.314184 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:08.275527 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.276098 28458 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:08.282652 28417 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:08.242990 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:08.326421 23679 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:08.319947 22892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5085cb71870c4e7782244635c250487e"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:08.192593 28403 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:08.328660 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 173828us
W20260709 12:18:08.272594 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 65490us
I20260709 12:18:08.334218 23685 raft_consensus.cc:2410] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:18:08.334152 22819 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:08.278612 28427 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:08.241333 28476 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:18:08.339172 22744 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:08.342000 28336 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:08.342504 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:08.348894 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 188962us
W20260709 12:18:08.330770 28475 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.330s	user 0.000s	sys 0.002s
I20260709 12:18:08.352072 23659 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:08.356865 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:08.364866 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:08.368794 28339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.010s	sys 0.009s
I20260709 12:18:08.388410 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:08.337097 28478 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:08.382685 28396 consensus_meta.cc:287] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.001s
I20260709 12:18:08.396298 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:08.387738 28339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.010s	sys 0.009s
I20260709 12:18:08.407712 23679 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:18:08.409498 22892 raft_consensus.cc:606] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:08.389710 28378 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:08.414289 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:08.420845 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 78313us
I20260709 12:18:08.401667 28481 raft_consensus.cc:2764] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:18:08.421221 28430 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.004s
I20260709 12:18:08.422725 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:08.404515 28301 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:08.429980 28336 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:08.425622 28430 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:08.441267 28430 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:08.441717 27494 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:08.443547 28484 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:08.441812 28339 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:08.442673 27494 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.426059 28329 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:18:08.448365 27494 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:08.450078 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:08.451375 28489 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:08.452162 28489 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:08.453502 28489 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:08.455272 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.458350 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:08.459229 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:08.459667 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:08.460350 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:08.461077 23679 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:08.459661 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:08.462157 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:08.462918 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.464689 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.460498 23682 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:08.470263 27494 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:08.424130 28401 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:08.473758 28296 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:08.473889 28401 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:08.476979 27494 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.474478 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.478070 22894 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 15: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:08.406724 28396 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.479948 23672 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:08.481166 22897 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:08.482621 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1356) took 1121 ms. Trace:
I20260709 12:18:08.483083 22895 rpcz_store.cc:276] 0709 12:18:07.361413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.362882 (+  1469us) service_pool.cc:224] Handling call
0709 12:18:07.363155 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.384956 (+ 21801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.385012 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:07.385086 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:07.385139 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.482316 (+1097177us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b5400317c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:08.482374 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:08.482549 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49414400}
I20260709 12:18:08.484766 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.494597 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:08.486109 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 83548.6us
I20260709 12:18:08.496238 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.497828 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.498616 22748 raft_consensus.cc:2410] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:18:08.499555 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.500195 22751 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:08.495357 22746 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:18:08.484553 28458 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:08.504256 23493 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:08.505060 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:08.509363 27494 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:08.509516 22748 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:08.506167 23679 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:08.507237 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.508617 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:08.511682 22753 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:08.494807 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:08.512988 23689 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:08.510946 22747 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:08.522804 22717 leader_election.cc:400] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19.
I20260709 12:18:08.523312 22717 leader_election.cc:403] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:08.480314 28488 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.539855 23493 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:08.541193 28378 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19.
I20260709 12:18:08.550813 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:08.546339 27494 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:08.544967 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.546038 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:08.568024 23695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:45580
I20260709 12:18:08.568894 23695 raft_consensus.cc:606] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:08.569278 23695 raft_consensus.cc:614] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:08.570701 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:08.548112 23682 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 23.
I20260709 12:18:08.574069 23659 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:18:08.578610 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.581526 22892 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:08.579988 28347 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:08.583063 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:08.583317 28347 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.583700 28347 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:08.583901 27494 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:08.584313 27494 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:08.584671 27494 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:08.574862 22748 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:18:08.594580 22749 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:08.594249 27494 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.598305 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:08.599202 22892 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:08.535089 28403 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:08.612542 22892 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:08.616142 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:08.543493 28458 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:08.617410 22747 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:08.635673 27494 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:08.641057 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.560160 28336 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:08.566546 28340 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:08.574800 28377 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:08.650488 22752 raft_consensus.cc:2368] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16.
I20260709 12:18:08.591801 27995 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:08.656349 28336 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:08.665755 28336 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:08.647078 28403 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:08.540458 28287 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 12:18:08.667047 28403 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.668308 28478 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:08.670671 28403 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:08.674916 28396 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:08.543721 28382 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 12:18:08.688611 28347 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:08.658380 28401 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:08.559335 28138 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
W20260709 12:18:08.693040 28487 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.273s	user 0.003s	sys 0.004s
I20260709 12:18:08.695573 28296 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:08.696911 28464 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:18:08.675056 28034 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:08.644629 28349 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:08.560650 28488 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:08.699513 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:08.633823 28289 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:08.702314 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 159441us
I20260709 12:18:08.729866 27494 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.738431 22892 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:08.712541 22897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
W20260709 12:18:08.759604 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 60233.2us
I20260709 12:18:08.759850 22897 raft_consensus.cc:606] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:08.761574 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:08.762933 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:08.765357 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:08.760366 27494 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:08.734884 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 171946us
I20260709 12:18:08.767633 22821 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:08.771073 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:08.653703 28340 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:08.742033 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:08.774653 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:08.704185 28034 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:08.795493 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:08.793514 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:08.796475 22818 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:18:08.793871 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:08.797334 22820 raft_consensus.cc:2368] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13.
W20260709 12:18:08.712249 28496 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:18:08.703102 28377 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:08.794544 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.798691 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:08.799085 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:08.801828 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:08.802527 22820 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:08.764706 28490 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:08.820766 28490 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.821194 28490 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:08.821288 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1200) took 1320 ms. Trace:
I20260709 12:18:08.821686 22900 rpcz_store.cc:276] 0709 12:18:07.500405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.500536 (+   131us) service_pool.cc:224] Handling call
0709 12:18:07.500841 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.531734 (+ 30893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.531866 (+   132us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:08.443640 (+911774us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b2c001e6a18. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:18:08.444181 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 12:18:08.627653 (+183472us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:08.627711 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.627814 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:08.820977 (+193163us) raft_consensus.cc:1685] finished
0709 12:18:08.820997 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:08.821226 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41810,"raft.queue_time_us":34087,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":9981,"spinlock_wait_cycles":2955008,"thread_start_us":182922,"threads_started":1,"wal-append.queue_time_us":329459}
I20260709 12:18:08.822921 28430 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:08.824249 28034 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:08.825232 28259 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.857s	user 0.011s	sys 0.002s
I20260709 12:18:08.825332 28034 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:08.825961 28388 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.826483 28388 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.828081 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.829813 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.804375 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:08.805516 27494 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:08.806377 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:08.831382 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.832474 22827 raft_consensus.cc:2368] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20.
I20260709 12:18:08.832620 22752 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:08.833582 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.834509 22895 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:08.808491 22825 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 21: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:08.713037 28396 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:08.835506 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.809955 22818 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:08.767131 28347 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:08.811990 28497 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:18:08.796590 28481 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:08.816893 28507 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:08.817420 28289 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:08.708544 28418 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:08.836477 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:08.823582 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:08.837347 22895 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:08.835959 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:08.838014 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 67880.6us
I20260709 12:18:08.838810 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:08.840494 22749 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:08.842379 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:08.792590 28340 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:08.854717 23695 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:08.855446 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:08.857009 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.859653 23679 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:18:08.792737 28381 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:18:08.861624 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:08.873584 22900 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:18:08.876418 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.847461 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:08.847991 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:08.766975 28349 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:08.852805 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:08.884176 22820 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:08.843521 28443 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:18:08.881456 22900 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:08.879050 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:08.889433 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:08.889595 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:08.890050 23679 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:08.892230 23679 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:08.880981 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:08.841428 22864 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:08.886077 22752 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:08.871215 28287 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:08.842875 28396 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:08.895763 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 54373.2us
I20260709 12:18:08.912127 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:08.878038 28478 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.899346 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:08.886317 28377 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:08.916234 28514 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:08.940356 28514 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:08.941700 28512 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:08.866703 28418 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:08.918911 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.929893 22571 catalog_manager.cc:5697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:08.919795 22898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1363) took 1283 ms. Trace:
I20260709 12:18:08.911945 27995 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:18:08.920254 23674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 1188) took 1628 ms (client timeout 2035 ms). Trace:
I20260709 12:18:08.920456 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:08.969947 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:08.921921 22572 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43994 (request call id 150) took 49705 ms (client timeout 15000 ms). Trace:
I20260709 12:18:08.931434 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1360) took 1231 ms. Trace:
I20260709 12:18:08.976984 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.972294 22824 rpcz_store.cc:276] 0709 12:18:07.700133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.879924 (+179791us) service_pool.cc:224] Handling call
0709 12:18:07.880174 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.286696 (+406522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.931013 (+644317us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400791154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:08.931289 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933075200}
W20260709 12:18:08.968521 23674 rpcz_store.cc:269] 0709 12:18:07.291815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.307963 (+ 16148us) service_pool.cc:224] Handling call
0709 12:18:08.920058 (+1612095us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400352d54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:08.920190 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221492992}
I20260709 12:18:08.942334 28512 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:08.957154 22571 catalog_manager.cc:5697] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
W20260709 12:18:08.959949 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 47967.8us
I20260709 12:18:08.989389 22571 catalog_manager.cc:5697] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 8 to 15, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 15 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:08.980633 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.888242 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:08.956348 22898 rpcz_store.cc:276] 0709 12:18:07.636097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.636230 (+   133us) service_pool.cc:224] Handling call
0709 12:18:07.636536 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.279596 (+643060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.919459 (+639863us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b5400848354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:08.919706 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477078272}
I20260709 12:18:08.991679 22571 catalog_manager.cc:5697] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 13 to 20. New cstate: current_term: 20 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:08.992379 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:08.994738 22571 catalog_manager.cc:5697] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:08.993834 23695 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
I20260709 12:18:08.934048 28388 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:08.996388 22571 catalog_manager.cc:5697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:08.995462 22898 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:09.002302 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:09.004244 22571 catalog_manager.cc:5697] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 11 to 14, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 14 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:08.904753 28489 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
W20260709 12:18:09.008447 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 110847us
W20260709 12:18:09.009402 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 121253us
I20260709 12:18:09.010241 23494 leader_election.cc:400] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13.
I20260709 12:18:09.009495 22571 catalog_manager.cc:5697] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 12, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 12 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.010591 23494 leader_election.cc:403] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:18:09.010620 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:08.971652 22572 rpcz_store.cc:269] 0709 12:17:19.216680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.217115 (+   435us) service_pool.cc:224] Handling call
0709 12:18:08.921818 (+49704703us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:03.252545 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:03.253180 (+   635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:03.253238 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:18:03.253257 (+    19us) tablet.cc:662] Decoding operations
0709 12:18:03.254159 (+   902us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:03.254249 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:03.254282 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:18:03.304061 (+ 49779us) tablet.cc:701] Row locks acquired
0709 12:18:03.304135 (+    74us) write_op.cc:260] PREPARE: finished
0709 12:18:03.304328 (+   193us) write_op.cc:270] Start()
0709 12:18:03.304483 (+   155us) write_op.cc:276] Timestamp: P: 1783599483304246 usec, L: 0
0709 12:18:03.304507 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:18:03.389102 (+ 84595us) log.cc:844] Serialized 3277 byte log entry
0709 12:18:03.641026 (+251924us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b180020a8e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf46fc190 00007fadf46f5ae7 00007fadf46f4dd9 00007fadf46ff930
0709 12:18:03.817809 (+176783us) op_driver.cc:464] REPLICATION: finished
0709 12:18:04.145495 (+327686us) write_op.cc:301] APPLY: starting
0709 12:18:04.196259 (+ 50764us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:04.596034 (+399775us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:04.596068 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:05.056247 (+460179us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:05.056499 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:18:05.056546 (+    47us) write_op.cc:312] APPLY: finished
0709 12:18:05.056855 (+   309us) log.cc:844] Serialized 80 byte log entry
0709 12:18:05.144874 (+ 88019us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:05.153955 (+  9081us) write_op.cc:454] Released schema lock
0709 12:18:05.160152 (+  6197us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:05.212869 (+ 52717us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:05.216265 (+  3396us) write_op.cc:454] Released schema lock
0709 12:18:05.316704 (+100439us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b180020a8e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
Metrics: {"mutex_wait_us":54713,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":286631,"apply.run_cpu_time_us":35047,"apply.run_wall_time_us":1030804,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37599,"num_ops":8,"prepare.queue_time_us":239407,"prepare.run_cpu_time_us":48433,"prepare.run_wall_time_us":271424,"raft.queue_time_us":249321,"raft.run_cpu_time_us":72356,"raft.run_wall_time_us":276652,"replication_time_us":499740,"spinlock_wait_cycles":50489856,"thread_start_us":572700,"threads_started":5,"wal-append.queue_time_us":237866,"wal-append.run_cpu_time_us":22841,"wal-append.run_wall_time_us":2310392}]]}
I20260709 12:18:08.955649 28288 consensus_queue.cc:1059] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:18:09.015552 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:08.995103 28495 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:08.955888 28478 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:08.988613 27995 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:08.916841 28287 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:09.020146 23695 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:09.037664 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1203) took 1398 ms. Trace:
I20260709 12:18:08.990022 28512 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:08.993124 28497 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:09.038149 22893 rpcz_store.cc:276] 0709 12:18:07.639674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.639864 (+   190us) service_pool.cc:224] Handling call
0709 12:18:07.640349 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.670947 (+ 30598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.670985 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:08.440670 (+769685us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b48004f8558. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf96a8aa1 00007fadf969fb37 00007fadf969f9ca 00007fadf979726f 00007fadf9796f37 00007fadf97ab55c 00007fadf97ab508 00007fadf97ab488 00007fadf97ab443 00007fadf97aa6ec 00007fadf86d4a96
0709 12:18:08.656620 (+215950us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b2c001e6a18. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:18:08.692418 (+ 35798us) log.cc:844] Serialized 26 byte log entry
0709 12:18:08.773935 (+ 81517us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:08.773977 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.774060 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:09.037390 (+263330us) raft_consensus.cc:1685] finished
0709 12:18:09.037412 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.037595 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30069,"raft.queue_time_us":30254,"raft.run_cpu_time_us":5021,"raft.run_wall_time_us":764126,"spinlock_wait_cycles":20493952,"thread_start_us":81084,"threads_started":1,"wal-append.queue_time_us":195359}
I20260709 12:18:09.011381 22571 catalog_manager.cc:5697] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 16 to 20, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 20 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:09.018538 28514 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:09.029186 28488 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:09.029477 28500 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:18:09.026401 28509 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:09.021412 28495 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:09.029879 28340 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:09.028980 28286 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:09.047528 27494 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:18:09.052614 28425 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:09.054212 28212 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:09.063048 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:09.064520 22571 catalog_manager.cc:5697] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.067260 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:09.075297 22895 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:18:09.088594 28523 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:09.006254 28349 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.105123 23659 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
W20260709 12:18:09.089682 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 70559.8us
I20260709 12:18:09.108548 22571 catalog_manager.cc:5697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:09.109452 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 87038.6us
I20260709 12:18:09.110694 23682 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:09.111649 22571 catalog_manager.cc:5697] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 8 to 11, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 11 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.113246 22571 catalog_manager.cc:5697] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 10 to 14, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 14 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.115257 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:09.116072 22571 catalog_manager.cc:5697] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.117944 22571 catalog_manager.cc:5697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.092085 28495 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:09.122171 22864 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:09.119822 22571 catalog_manager.cc:5697] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:09.085326 28426 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:09.097708 28286 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.126621 22571 catalog_manager.cc:5697] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 14 to 17, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 17 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:09.140331 22571 catalog_manager.cc:5697] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 9 to 14, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 14 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:09.142848 22571 catalog_manager.cc:5697] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 10 to 16, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 16 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.143736 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:09.144893 23682 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:09.148423 22571 catalog_manager.cc:5697] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 12 to 17, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 17 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:09.079433 28497 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:09.161078 22571 catalog_manager.cc:5697] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 16, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 16 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.157099 28288 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:09.127743 28388 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:09.166630 28388 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:09.167986 28388 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:09.169553 28388 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:09.170039 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:09.170859 22752 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:09.171512 28468 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:09.172132 28468 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:09.177074 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.177280 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:09.178002 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:09.180451 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:09.165681 22571 catalog_manager.cc:5697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 8 to 15, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 15 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:09.183214 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:09.186159 22746 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:18:09.146446 28286 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:09.185930 22571 catalog_manager.cc:5697] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 11 to 21, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 21 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
W20260709 12:18:09.190814 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 75655.9us
I20260709 12:18:09.158893 28259 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:09.193488 22571 catalog_manager.cc:5697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 3 to 13. New cstate: current_term: 13 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.205006 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:09.206115 28388 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:09.158286 28418 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:09.147092 28488 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:18:09.191234 28514 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:09.121472 28523 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:09.149202 28426 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.196451 28259 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:09.238380 28528 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:09.214643 28396 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:09.214421 28288 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:09.217869 28513 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:18:09.265064 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 51829.4us
I20260709 12:18:09.162887 27995 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.191640 28533 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 12:18:09.238736 28480 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.880s	user 0.003s	sys 0.000s
W20260709 12:18:09.288710 28526 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:18:09.290373 28529 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:18:09.219506 28490 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.301371 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1361) took 1835 ms. Trace:
I20260709 12:18:09.235287 28259 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:09.309849 22899 rpcz_store.cc:276] 0709 12:18:07.466109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.466397 (+   288us) service_pool.cc:224] Handling call
0709 12:18:07.466919 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.535403 (+ 68484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.535440 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:07.809572 (+274132us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b2c001e6a18. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:18:07.819050 (+  9478us) log.cc:844] Serialized 26 byte log entry
0709 12:18:08.003717 (+184667us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:08.003752 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.003820 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:08.931400 (+927580us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:18:09.301009 (+369609us) raft_consensus.cc:1685] finished
0709 12:18:09.301043 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.301280 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89015,"raft.queue_time_us":68432,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":15337,"spinlock_wait_cycles":91004416,"thread_start_us":155989,"threads_started":1,"wal-append.queue_time_us":287506}
I20260709 12:18:09.261523 28468 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:09.351980 22901 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:18:09.364620 28034 consensus_meta.cc:287] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.539s	user 0.016s	sys 0.000s
I20260709 12:18:09.362525 28340 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:09.369992 28478 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:09.407070 28535 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:09.407864 28535 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.410436 28535 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:09.411011 28497 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:09.421059 28426 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:09.401228 28531 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:09.426086 28531 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:09.373725 28288 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:09.432056 28523 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:09.429394 28531 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:09.443338 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 79366.2us
I20260709 12:18:09.476171 28339 raft_consensus.cc:3055] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:09.476966 28339 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:09.496977 28377 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13.
I20260709 12:18:09.498208 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:09.499436 28490 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:09.499719 28497 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:09.500236 28497 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.500576 28497 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:09.502552 27858 raft_consensus.cc:993] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: : Instructing follower e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:09.503131 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:09.496655 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 486514us
I20260709 12:18:09.503798 23656 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:09.504338 23494 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:09.496311 28138 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:09.512413 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:09.536262 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:09.537473 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:09.537756 28278 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:09.538445 28278 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:09.538993 28278 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:09.539609 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:09.540295 22893 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:09.541065 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:09.541826 22894 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:09.539098 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:09.542973 28508 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:09.537541 23494 leader_election.cc:400] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20.
I20260709 12:18:09.542747 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:09.549751 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:09.551002 28401 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:09.552351 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:09.553869 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:09.540990 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.555263 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:09.556119 23685 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 15: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:09.557619 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:09.566421 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:09.569356 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:09.562336 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:09.585170 28381 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:09.584779 28495 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:09.585923 28381 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:09.586483 28381 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:09.494313 28286 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:09.587100 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:09.588747 28286 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:09.589871 22892 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:09.592409 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:09.594056 28458 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:09.600061 28172 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:09.601085 28546 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:09.601740 28546 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:09.602245 28546 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:09.606967 28149 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:09.609232 28286 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:09.609421 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1279) took 1436 ms. Trace:
I20260709 12:18:09.609839 28149 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:09.609959 28286 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:09.557335 28287 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:09.613602 28286 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:09.606323 28495 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:09.607348 22893 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:09.621258 28289 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:09.621831 28289 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:09.478197 28339 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:09.624728 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:09.626614 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:09.609977 23672 rpcz_store.cc:276] 0709 12:18:08.173323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.199392 (+ 26069us) service_pool.cc:224] Handling call
0709 12:18:08.199790 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.491371 (+291581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.609098 (+1117727us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400292554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:09.609350 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643825024}
I20260709 12:18:09.632789 28287 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:09.559082 28508 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:09.634928 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:09.635708 22746 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:09.566987 28401 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:09.631995 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:09.564569 28523 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:09.651136 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.624953 27858 raft_consensus.cc:1081] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Signalling peer e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:09.652499 23695 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:09.645674 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.634670 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:09.655598 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:09.664505 23656 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:09.658313 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:09.666208 22819 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:09.634334 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:09.660395 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:09.625335 28354 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:09.671190 22819 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:18:09.636404 28287 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:09.674656 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:09.676541 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:09.681357 22747 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:09.653241 28508 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:09.656739 28396 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:09.653026 28548 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:09.698046 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:09.698928 22747 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:09.670377 28149 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:09.694154 28388 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:09.669373 28523 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:09.688306 28468 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:09.715451 28452 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:09.750872 28468 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:09.751214 28452 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:09.751492 28468 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:09.719390 28296 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:09.752501 28296 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:09.753409 28296 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.754439 28296 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:09.756065 28512 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.672s	user 0.013s	sys 0.000s
I20260709 12:18:09.756670 28512 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:09.756883 28381 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.758819 23682 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:09.758963 28548 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:09.760351 28548 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.720556 28497 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:09.721338 28513 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:09.680081 28401 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:09.678618 28525 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.684948 28549 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:09.714938 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:09.739414 28181 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:09.742300 27918 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:09.744052 28523 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:09.745198 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:09.746125 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:09.782048 22749 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:09.747334 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:09.747681 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:09.749524 28287 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:09.750062 28509 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:09.751788 28452 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:09.695034 28396 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:09.633188 28289 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.695417 28354 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:09.747236 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:09.771468 28513 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:09.791247 23695 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:09.770768 27995 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:09.788931 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:09.798110 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:09.800969 23659 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:09.800104 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:09.774197 28388 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.771947 28401 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:09.803920 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:09.819866 22753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:42860
I20260709 12:18:09.820540 22753 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:09.820935 22753 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:09.804630 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.817788 27494 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:09.823714 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:09.781471 28149 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:09.824222 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1545) took 1325 ms. Trace:
I20260709 12:18:09.779153 28181 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:09.778947 28418 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:09.828449 28497 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:09.781364 27918 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:09.832917 22822 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:09.795578 28396 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:09.834138 22790 leader_election.cc:400] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16.
I20260709 12:18:09.831750 22750 rpcz_store.cc:276] 0709 12:18:08.490795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.490917 (+   122us) service_pool.cc:224] Handling call
0709 12:18:08.491239 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.349950 (+858711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.349983 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:09.350028 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:09.350056 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.816077 (+466021us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b54004065d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:09.816136 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.816307 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974301440}
I20260709 12:18:09.779531 28525 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:09.838959 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:09.839169 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:09.839687 22749 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:09.839944 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:09.821656 28287 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:09.838588 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:09.845257 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:09.847738 22790 leader_election.cc:403] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:09.838552 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 162097us
I20260709 12:18:09.825443 28401 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:09.901150 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:09.902637 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:09.888932 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55053.6us
I20260709 12:18:09.855756 22900 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:09.781605 28549 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:09.831256 28512 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:09.831334 28381 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:09.858036 28443 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:09.841704 28149 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.825688 28388 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.847483 28281 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:18:09.865314 28546 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.822316 27995 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:09.846839 28467 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:18:09.846650 28349 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:09.880852 28181 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:09.889605 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1208) took 1134 ms. Trace:
I20260709 12:18:10.022037 22900 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:09.889967 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:09.894625 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:10.024060 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 134226us
I20260709 12:18:09.897118 22747 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:09.835007 28495 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.840636 27918 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:09.887070 22895 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
W20260709 12:18:09.984563 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 64662.4us
W20260709 12:18:09.988677 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 86129.7us
I20260709 12:18:09.989914 23674 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:09.843858 28259 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:09.900132 28287 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.904276 28426 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16.
I20260709 12:18:09.866888 28354 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:09.921259 27858 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:09.913887 28478 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:10.006891 22790 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:09.850458 27928 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 12:18:09.844254 28418 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:09.987102 28485 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:10.018616 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.013424 22753 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:10.038029 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:10.036656 28489 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:10.022244 22897 rpcz_store.cc:276] 0709 12:18:08.755036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.771469 (+ 16433us) service_pool.cc:224] Handling call
0709 12:18:08.771899 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.773833 (+  1934us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:08.862920 (+ 89087us) log.cc:844] Serialized 14 byte log entry
0709 12:18:09.722332 (+859412us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b18004211e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a 00007fadf4789a2a
0709 12:18:09.851123 (+128791us) log.cc:844] Serialized 14 byte log entry
0709 12:18:09.889001 (+ 37878us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:09.889231 (+   230us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:09.889358 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.889423 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.889546 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190594,"prepare.queue_time_us":92912,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1743,"raft.queue_time_us":55822,"raft.run_cpu_time_us":887,"raft.run_wall_time_us":145040,"spinlock_wait_cycles":12240512,"thread_start_us":105369,"threads_started":1,"wal-append.queue_time_us":1140011}
I20260709 12:18:09.919866 28488 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
W20260709 12:18:10.042570 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.017685 28425 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:09.850370 28452 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:10.046550 28287 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:10.057567 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 50801.2us
I20260709 12:18:10.040457 28407 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:18:09.929628 28497 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 12:18:10.052361 28181 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:10.066171 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:10.029568 28281 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:10.068708 22747 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:10.029886 28349 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:10.099668 28555 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:18:10.044476 28172 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:18:10.039539 28495 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:10.100827 22753 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:10.045396 28458 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:18:10.217254 28212 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:10.218353 28259 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:10.218006 28212 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:10.225718 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 188121us
I20260709 12:18:10.100338 28407 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:10.149163 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:10.138150 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:10.228271 23493 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:10.127852 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:10.232940 23674 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.239249 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:10.191359 28559 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 12:18:10.107569 28563 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:10.105888 28549 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:10.241804 22744 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:10.063830 28523 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:10.242624 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:10.107141 28546 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:10.148538 28514 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:10.248896 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:10.252280 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:10.073143 28509 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:10.260732 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:10.106312 28278 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 12:18:10.256387 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:10.193024 28418 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:10.275012 23679 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 15: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:10.099114 28463 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.173s
I20260709 12:18:10.147871 28388 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:10.280687 28407 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:10.104214 28525 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:10.070066 28485 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:10.268805 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:10.070601 28425 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:10.276538 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:10.302417 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 63246.9us
I20260709 12:18:10.304352 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:10.305178 23672 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:10.277372 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:10.278716 23656 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:10.199220 28557 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:10.275252 28514 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:10.260443 28564 raft_consensus.cc:2764] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 12:18:10.306316 23679 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
W20260709 12:18:10.306289 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 178617us
I20260709 12:18:10.309599 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:10.112176 27995 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:10.125011 28281 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:10.328207 28281 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:10.328869 28281 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.329381 28281 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:10.297268 28468 consensus_meta.cc:287] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.545s	user 0.014s	sys 0.000s
I20260709 12:18:10.331157 28468 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:10.332967 22749 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:10.333112 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:10.293859 28149 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:10.277413 28396 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:10.352048 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 285957us
W20260709 12:18:10.320499 28508 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.004s
W20260709 12:18:10.347622 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 265965us
I20260709 12:18:10.311894 28407 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:10.306879 28259 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:10.279276 28278 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:10.388018 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:10.313407 28525 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:10.355306 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 145575us
I20260709 12:18:10.404081 28514 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:10.318801 28557 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:10.408953 28557 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:10.409621 27918 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:10.410420 28349 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:10.410967 23695 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:10.412184 28396 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:10.412766 28452 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:10.413625 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:10.415803 28485 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:10.417094 28212 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:10.355973 28551 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:18:10.419942 28513 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.007s
I20260709 12:18:10.420459 28513 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:10.422119 27918 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:10.389568 28425 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:10.425099 28425 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:10.427295 23685 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:10.428982 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:10.429908 22896 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:10.324805 22790 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:10.362037 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:10.364069 23674 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:18:10.366375 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:10.392048 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:10.395879 23660 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
W20260709 12:18:10.432897 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 66658us
I20260709 12:18:10.398041 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:10.435089 22898 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 12:18:10.435587 22898 pending_rounds.cc:85] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 11
I20260709 12:18:10.435829 22898 pending_rounds.cc:107] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 12:18:10.436116 22898 raft_consensus.cc:2889] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:10.436532 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 111830us
I20260709 12:18:10.437249 23672 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:10.441184 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:10.441538 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.441773 22822 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:10.443424 22819 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:18:10.444032 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.445228 28495 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:10.445528 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:10.448455 23672 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:10.452966 28278 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:10.333690 28458 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:18:10.422551 28513 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:10.459333 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:10.460713 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:10.466051 22824 raft_consensus.cc:2410] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:18:10.461043 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:10.466482 22901 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:10.466717 22826 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:10.472779 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:10.469556 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:10.474431 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 121728us
W20260709 12:18:10.463409 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 63755.8us
I20260709 12:18:10.463459 28509 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:10.482359 27858 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:10.486802 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:10.489790 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:10.490406 22896 raft_consensus.cc:3055] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:10.490748 22897 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:10.490963 22896 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:10.488116 22900 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:18:10.494519 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.495747 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:10.496248 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:10.496415 22821 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:10.505368 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:10.492321 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:10.505584 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:10.505311 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:10.506347 23672 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 18: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:10.510309 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:10.510936 22897 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:10.454602 28485 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:10.462725 28534 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:10.455993 28212 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:10.462999 28512 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.497529 22896 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:10.390667 28508 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:10.536916 22901 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:10.542325 22821 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
W20260709 12:18:10.543753 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 43984.2us
I20260709 12:18:10.549923 27494 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.550806 27494 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:10.553114 27494 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:10.515147 28497 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:10.561925 22897 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:10.557511 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:10.525408 27995 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:10.566244 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:10.515044 28468 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:10.537525 28259 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:10.601063 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 51822.1us
I20260709 12:18:10.567622 23494 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:10.581882 28445 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:10.586961 27920 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:10.672626 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:10.590919 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1208) took 1030 ms. Trace:
I20260709 12:18:10.537842 28452 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.507498 28296 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 12:18:10.643179 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 115923us
I20260709 12:18:10.603231 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:10.681131 22820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c"
dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
mode: GRACEFUL
new_leader_uuid: "2c3a0d56045540b7802937559599f09c"
 from {username='slave'} at 127.0.0.1:43202
I20260709 12:18:10.681886 23660 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:10.681886 22820 raft_consensus.cc:606] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Received request to transfer leadership to TS 2c3a0d56045540b7802937559599f09c
I20260709 12:18:10.682938 22820 raft_consensus.cc:614] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:10.530001 28485 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:10.543219 28212 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:10.686378 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:10.607985 28401 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.621s	user 0.013s	sys 0.000s
I20260709 12:18:10.603273 22748 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:10.603574 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:10.616587 28281 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:10.603974 28545 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:10.694579 22825 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:10.543876 28512 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:10.663558 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 61048.4us
I20260709 12:18:10.664167 22749 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:10.501459 27858 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:10.671161 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.673470 23685 rpcz_store.cc:276] 0709 12:18:09.560829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.563144 (+  2315us) service_pool.cc:224] Handling call
0709 12:18:09.629569 (+ 66425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.427820 (+798251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.590580 (+162760us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54007080d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:10.590829 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833997184}
W20260709 12:18:10.669265 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 91080.3us
I20260709 12:18:10.691154 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:10.702740 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:10.685158 28181 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.560s	user 0.005s	sys 0.009s
I20260709 12:18:10.673142 27920 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:10.678180 28488 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:10.709640 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:10.749236 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:10.677505 28445 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:10.751307 28445 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:10.535408 28443 consensus_queue.cc:1175] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" responder_term: 11 status { last_received { term: 10 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:10.721668 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:10.685437 28497 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:10.754441 28497 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:10.761399 22892 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
W20260709 12:18:10.768679 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55034.7us
W20260709 12:18:10.773291 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 51781.2us
I20260709 12:18:10.777165 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:10.678393 28259 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:10.706080 28138 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:10.785450 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:10.686278 28574 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 12:18:10.691665 28452 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:10.695183 28401 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:10.792320 27494 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:10.793475 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:10.796339 23685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:45580
I20260709 12:18:10.804131 23685 raft_consensus.cc:606] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:10.804224 27494 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:10.804731 23685 raft_consensus.cc:614] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:10.805181 27494 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:10.809719 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:10.766597 27995 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:10.774842 27918 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:10.806407 27494 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:10.783875 28407 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:18:10.784334 28525 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:10.790683 28418 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:10.846398 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:10.848809 23682 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:10.809477 28551 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:10.767064 28488 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:10.861097 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:10.785022 28515 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:18:10.822726 27918 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:10.865630 22820 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:10.856086 28551 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:10.800303 28138 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:10.883912 23682 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:10.876183 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:10.879370 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:10.828965 28349 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:18:10.881152 27918 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:10.895336 28467 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:10.946074 28467 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:10.947247 28467 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:10.895741 28485 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:10.898384 22827 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:10.899041 28452 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:10.900774 28259 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:10.902612 28401 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:10.904680 28550 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.853s	user 0.002s	sys 0.002s
W20260709 12:18:10.905925 28287 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.004s
I20260709 12:18:10.860798 27995 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:10.921275 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1373) took 1175 ms. Trace:
I20260709 12:18:10.925377 28488 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:10.876778 28588 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:10.875762 28551 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:10.986291 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 215924us
I20260709 12:18:10.862723 28418 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:10.873734 28508 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:10.891327 28585 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:10.963487 22748 rpcz_store.cc:276] 0709 12:18:09.745404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.747818 (+  2414us) service_pool.cc:224] Handling call
0709 12:18:09.748079 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.687686 (+939607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.920970 (+233284us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b5400406ad4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:10.921193 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1966269824}
I20260709 12:18:10.984043 27995 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.995857 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 1220) took 1101 ms. Trace:
I20260709 12:18:11.007759 23682 rpcz_store.cc:276] 0709 12:18:09.894150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.894349 (+   199us) service_pool.cc:224] Handling call
0709 12:18:10.995610 (+1101261us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b540059cc54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:10.995772 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1895188736}
I20260709 12:18:11.000535 22827 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:11.010071 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:10.952013 28535 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:18:10.990692 27858 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:10.968084 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:10.991086 28467 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:10.995586 28212 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:10.991148 28512 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:11.015353 23659 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:18:11.002050 28585 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:10.963267 28287 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:11.031988 22896 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:11.032975 22826 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:10.997812 28588 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:11.034284 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:11.013665 27995 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:11.068727 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 294365us
I20260709 12:18:10.964648 27920 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:11.075961 23659 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:11.076671 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:11.079243 23679 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:18:11.039564 28425 consensus_meta.cc:287] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.006s
W20260709 12:18:11.065487 28591 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 12:18:11.089381 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:11.091401 23674 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:11.092120 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.091926 22825 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
W20260709 12:18:11.096345 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:11.097618 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.068614 28259 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:11.095655 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 528101us
I20260709 12:18:11.067624 28138 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:11.113011 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:11.128262 28594 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:18:11.131224 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:11.107182 28585 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:11.132202 28382 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:11.133172 28382 consensus_queue.cc:1243] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:18:11.136453 22827 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:11.131258 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:11.137760 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:11.139955 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:11.138355 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:11.140342 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:11.145926 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:11.153784 22744 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:18:11.087497 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 366758us
I20260709 12:18:11.147231 22896 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 11.
I20260709 12:18:11.192509 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:11.193632 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:11.194275 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:11.195041 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:11.195905 22892 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:11.197960 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:11.198628 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:11.150250 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:11.140297 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:11.162976 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:11.153244 28382 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:11.086483 28535 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:18:11.175380 28469 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:11.183447 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:11.187444 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.188846 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:11.203310 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:11.217866 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:11.184899 28587 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:18:11.120224 28259 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:11.204936 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:11.205421 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.233011 22746 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:11.206873 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:11.208213 27494 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.209182 22790 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:11.210007 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:11.210111 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.237107 22896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:11.237892 22896 raft_consensus.cc:606] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:11.238303 22896 raft_consensus.cc:614] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:11.220543 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:11.239980 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:11.239987 22749 raft_consensus.cc:2368] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20.
I20260709 12:18:11.243227 23493 leader_election.cc:400] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20.
I20260709 12:18:11.243691 23493 leader_election.cc:403] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:18:11.243402 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:11.185699 28567 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:11.204358 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:11.119586 28354 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:18:11.232142 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:11.263648 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:11.250934 22746 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:11.235219 27494 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:11.094897 28418 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:11.271523 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:11.273789 23659 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 17: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:11.282195 27494 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:11.184630 28596 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 12:18:11.288702 22825 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:11.232467 28382 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:11.315737 22824 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:11.230878 28469 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:11.223263 28534 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
W20260709 12:18:11.393896 28594 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 12:18:11.409320 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.280601 28296 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 12:18:11.443688 22898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:11.445945 22898 raft_consensus.cc:606] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:11.280308 28452 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:11.468883 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:11.471603 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:11.472772 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:11.483644 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 399812us
I20260709 12:18:11.486676 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:11.396462 28340 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20.
I20260709 12:18:11.444144 28570 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.503957 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:11.486755 28605 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.095s	user 0.001s	sys 0.004s
I20260709 12:18:11.462253 28541 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:18:11.547850 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 314298us
W20260709 12:18:11.569573 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 326558us
I20260709 12:18:11.547327 28534 raft_consensus.cc:2764] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:18:11.553303 28588 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:11.594661 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 346198us
I20260709 12:18:11.563701 28212 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:11.557613 28287 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:11.499073 28452 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:18:11.566351 28288 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:11.602602 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:11.571664 28577 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:18:11.605406 28340 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:11.606078 28396 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.608572 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:11.545137 28570 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:11.573805 28541 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:11.611284 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 406997us
I20260709 12:18:11.633671 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:11.657310 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:11.669591 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.662492 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:11.612825 28402 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:11.713289 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:11.723095 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.620787 28138 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:11.754882 22893 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:11.697263 28296 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:18:11.609603 28212 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:11.632411 28259 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:11.761719 28138 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:11.751322 28497 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.735750 27858 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:11.840852 28570 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:11.620461 28288 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:11.845573 28541 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:11.847299 23494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.015s	sys 0.010s
W20260709 12:18:11.863957 23494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.015s	sys 0.010s
I20260709 12:18:11.740702 28588 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:11.864337 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 639149us
I20260709 12:18:11.870811 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:11.626974 28340 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:11.628206 28396 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:11.886112 22897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.052s	sys 0.106s
W20260709 12:18:11.887626 22897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.053s	sys 0.106s
W20260709 12:18:11.888664 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 325412us
I20260709 12:18:11.902294 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:11.756862 28402 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:11.901172 22896 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:11.901721 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:11.937479 22901 raft_consensus.cc:2368] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20.
W20260709 12:18:11.898723 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.933355 22899 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
W20260709 12:18:11.884876 27918 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.938s	user 0.015s	sys 0.000s
I20260709 12:18:11.872462 28278 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:11.885885 27757 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:18:11.890872 28509 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.397s	user 0.016s	sys 0.002s
I20260709 12:18:11.898694 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:11.978353 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:11.997725 22823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 1028) took 2297 ms (client timeout 2102 ms). Trace:
W20260709 12:18:11.998339 22823 rpcz_store.cc:269] 0709 12:18:09.659944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.660112 (+   168us) service_pool.cc:224] Handling call
0709 12:18:11.957327 (+2297215us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54007a1054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:11.957564 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826587904}
I20260709 12:18:11.928510 28382 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:11.895804 27858 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:12.005368 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 50492.5us
I20260709 12:18:12.014384 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:12.011204 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 379746us
I20260709 12:18:11.956166 28457 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:12.003763 28611 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:18:11.873875 28497 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:12.002738 28600 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 12:18:11.947248 28296 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:11.886215 28588 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:12.002597 28608 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.341s	user 0.000s	sys 0.000s
W20260709 12:18:12.003669 28614 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 12:18:12.011823 28613 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 12:18:12.047874 28626 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:11.959463 27757 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:12.000480 28509 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:11.956414 28622 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:11.956954 28172 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:11.980562 28469 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:12.003894 28620 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.012696 28610 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:12.005059 28619 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:11.961496 27918 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:11.981812 28278 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:12.112890 28570 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:12.145067 28609 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.531s	user 0.000s	sys 0.002s
I20260709 12:18:12.133848 28597 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:12.044148 28489 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.195690 28212 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:12.160406 28287 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:12.143280 28296 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:12.205446 28467 consensus_meta.cc:287] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.184s	user 0.016s	sys 0.000s
I20260709 12:18:12.168883 28626 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:12.190364 28172 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:12.240978 28418 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.028s	sys 0.038s
W20260709 12:18:12.261494 28418 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.029s	sys 0.038s
W20260709 12:18:12.253060 28551 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.262s	user 0.016s	sys 0.001s
I20260709 12:18:12.216506 28570 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.204658 28610 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:12.250883 28288 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:12.387573 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.416894 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:12.087939 22823 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:12.085951 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:12.499106 28281 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:12.087666 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:12.088483 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:12.501847 22821 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:12.089190 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:12.503647 22822 raft_consensus.cc:2376] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16. Re-sending same reply.
I20260709 12:18:12.089929 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:12.504510 23679 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:12.504954 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:12.098593 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:12.426767 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1373) took 1748 ms. Trace:
W20260709 12:18:12.504627 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 88398.8us
I20260709 12:18:12.428529 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1385) took 1331 ms. Trace:
I20260709 12:18:12.430173 22751 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:18:12.435667 22865 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.005s	sys 0.020s
I20260709 12:18:12.437654 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1405) took 1200 ms. Trace:
I20260709 12:18:12.508095 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:12.438596 22897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.033s	sys 0.070s
I20260709 12:18:12.508131 22790 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:12.509265 22897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.034s	sys 0.070s
W20260709 12:18:12.442806 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 494396us
I20260709 12:18:12.308167 28289 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:12.451999 22864 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:12.518453 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:12.212570 27858 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:12.508735 22892 rpcz_store.cc:276] 0709 12:18:11.237113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.240186 (+  3073us) service_pool.cc:224] Handling call
0709 12:18:11.240699 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:11.634643 (+393944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:11.634674 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:11.665563 (+ 30889us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.091336 (+425773us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:12.091383 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.091457 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.436619 (+345162us) raft_consensus.cc:1685] finished
0709 12:18:12.436679 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.437251 (+   572us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136504,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":643813,"threads_started":2,"wal-append.queue_time_us":489363}
I20260709 12:18:12.526237 28301 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:12.527477 28301 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.527860 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:12.461738 27918 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:12.464752 27920 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:12.530926 22865 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.005s	sys 0.021s
W20260709 12:18:12.531774 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 871272us
I20260709 12:18:12.533890 28354 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:12.534070 28452 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.470997 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:12.250031 28138 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:12.535645 28463 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:12.536715 28138 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:12.536823 28463 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:12.537878 28138 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.478974 28172 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:12.539269 28525 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:12.540316 28525 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:12.283911 28278 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:12.543736 28278 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:12.544759 28278 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:12.544978 28418 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:12.546275 28418 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:12.542515 28138 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:12.547693 28468 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:12.227437 28287 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.298476 28296 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:12.548688 28468 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.446345 27494 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:12.552073 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 100675us
I20260709 12:18:12.554044 23660 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:12.550642 27494 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:12.557710 27494 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:12.262755 28340 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:12.322299 28349 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:12.559820 28349 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:12.257426 28396 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:12.290993 28402 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:12.563333 28172 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:12.335824 28445 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:12.225389 28489 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:12.289935 28497 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:12.506863 22819 rpcz_store.cc:276] 0709 12:18:10.678562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.679074 (+   512us) service_pool.cc:224] Handling call
0709 12:18:10.679374 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.836567 (+157193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.836619 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.837332 (+   713us) log.cc:844] Serialized 26 byte log entry
0709 12:18:11.068583 (+231251us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:11.068630 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.425522 (+1356892us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540022ef54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:12.425645 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.425828 (+   183us) raft_consensus.cc:1685] finished
0709 12:18:12.425862 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.426458 (+   596us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4222,"raft.queue_time_us":3886,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":10182,"spinlock_wait_cycles":351503744,"thread_start_us":187491,"threads_started":1,"wal-append.queue_time_us":356991}
I20260709 12:18:12.512517 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1409) took 1273 ms. Trace:
I20260709 12:18:12.513366 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:12.507901 22825 rpcz_store.cc:276] 0709 12:18:11.097455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.098531 (+  1076us) service_pool.cc:224] Handling call
0709 12:18:11.098867 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:11.289297 (+190430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.427828 (+1138531us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54007a2954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:12.428313 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435282816}
I20260709 12:18:12.516974 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:12.224756 27757 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:12.569130 28489 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:12.566628 22897 rpcz_store.cc:276] 0709 12:18:11.238639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.238817 (+   178us) service_pool.cc:224] Handling call
0709 12:18:11.239256 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:11.889074 (+649818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:11.889130 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:11.889946 (+   816us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.510103 (+620157us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:12.510202 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.510351 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.512083 (+  1732us) raft_consensus.cc:1685] finished
0709 12:18:12.512108 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.512402 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129084,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":167,"spinlock_wait_cycles":61824,"thread_start_us":1268635,"threads_started":2,"wal-append.queue_time_us":410463}
I20260709 12:18:12.535162 28354 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:12.572237 28513 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:12.281378 28339 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:12.535205 28452 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:12.500277 28281 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:12.294929 28551 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:12.293958 28570 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:12.328449 28585 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:12.288275 28588 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:12.220192 28597 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:12.647432 28418 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:12.648447 28418 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:12.333114 28610 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:12.214944 28619 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:12.651489 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 143699us
I20260709 12:18:12.653070 22790 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:12.197772 28620 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:12.655750 28514 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.656870 28514 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:12.657271 28551 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:12.657510 28620 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:12.277347 28625 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:18:12.336571 28626 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:12.296473 28628 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:18:12.659703 28525 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:12.507709 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:12.614053 28468 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:12.562527 28287 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:12.575163 28301 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:12.651496 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:12.561968 28349 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:12.623386 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:12.622329 28354 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:12.643642 23494 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 2.102s (SENT) [suppressed 5 similar messages]
I20260709 12:18:12.659979 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:12.688763 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.004s	sys 0.003s
I20260709 12:18:12.667940 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:12.654531 28619 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:12.666617 28278 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:12.702909 23679 raft_consensus.cc:2410] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:18:12.704174 28514 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:12.710427 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:12.658473 28551 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:18:12.723086 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.004s	sys 0.005s
W20260709 12:18:12.726969 23498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.000s	sys 0.009s
I20260709 12:18:12.712754 28181 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.727274 23659 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:18:12.724327 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 82700.5us
I20260709 12:18:12.709494 28418 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:12.734457 23498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.000s	sys 0.010s
W20260709 12:18:12.735852 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 694922us
I20260709 12:18:12.739434 28181 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:12.740955 22901 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:12.742152 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:12.709187 28597 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:12.703120 28452 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:12.748449 28349 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:12.768496 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:12.769626 22748 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:12.771587 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:12.772881 22745 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:12.773964 28569 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.774442 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:12.783617 28603 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:12.788836 28567 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.790939 28281 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:12.793236 28626 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:12.794040 28626 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.794586 28354 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:12.795338 28610 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:12.795823 28623 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:12.795648 28354 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:12.796106 28610 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:12.798372 28354 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:12.792671 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:12.799443 28259 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.800971 28633 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:18:12.760682 23695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.004s	sys 0.002s
I20260709 12:18:12.798404 28626 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:12.800819 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 147992us
I20260709 12:18:12.804055 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:12.800034 28525 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:12.732575 28620 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:12.819370 23695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.005s	sys 0.003s
I20260709 12:18:12.796584 28623 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:12.829651 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 186065us
I20260709 12:18:12.798646 28610 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:12.790814 28567 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.774739 28569 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.784863 28603 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:12.828246 28278 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:12.855227 28378 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:12.855801 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:12.838197 28259 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:12.857259 28623 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:12.865455 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:12.865876 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.866225 28378 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:12.869020 28378 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:12.869505 23494 leader_election.cc:400] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20.
I20260709 12:18:12.849323 28525 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:12.871109 28626 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:12.871840 28525 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:12.873159 28382 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:12.882758 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:12.874562 28382 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:12.842670 28620 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:12.875329 28650 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:12.862530 28463 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:12.893147 28630 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:12.879573 28281 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:12.882314 28445 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.884548 28597 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.887179 28382 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:12.898965 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:12.911438 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:12.911895 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 108060us
I20260709 12:18:12.910039 28525 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:12.908011 28445 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.903193 28278 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:12.922914 28289 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:12.933693 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:12.924178 28561 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.938551 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:12.942173 22744 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:12.902137 28650 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.932406 28512 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:12.947026 22864 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:12.953805 28512 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:12.954250 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 215391us
I20260709 12:18:12.939738 28289 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:12.929560 28281 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:12.925887 28597 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.964716 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:12.960444 28289 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:12.977886 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:12.981163 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 47863.6us
I20260709 12:18:12.980772 22745 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:12.960878 28644 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:12.992106 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:12.979266 28631 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:12.999904 27858 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:13.006055 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.007455 28603 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:12.979729 28382 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:12.981775 28567 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.004379 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:13.015041 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 172267us
I20260709 12:18:13.006417 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.017944 28623 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.014087 28402 consensus_queue.cc:1175] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" responder_term: 20 status { last_received { term: 20 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 20 index: 11 } }
I20260709 12:18:13.022945 27757 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:13.023434 22790 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:13.024674 28650 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.025449 22790 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:13.003952 27858 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:13.026577 28551 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:13.004918 28259 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.030646 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:12.983541 28561 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.036674 28452 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:18:13.037453 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.038079 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:13.037297 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 44077.9us
I20260709 12:18:13.022266 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.043393 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.044349 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:13.044778 23659 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:13.044989 28381 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:13.014379 28339 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:13.038143 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.035131 27858 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:13.054399 22753 raft_consensus.cc:2393] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:13.038262 28551 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.022516 28623 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:13.053093 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.051592 28339 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:13.043452 28445 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.062686 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:13.067497 23679 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:18:13.053854 27918 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:13.069507 28551 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:13.070281 28339 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:13.092037 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:13.070477 28181 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:13.071849 28626 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:13.086108 28514 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:13.099062 28172 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.154388 28514 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:13.154894 28514 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.154589 28172 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.124719 28623 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:13.120596 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.157014 28172 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.125788 28512 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.080317 28259 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:13.131501 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.132599 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.133632 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:13.136667 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 134714us
I20260709 12:18:13.090034 28445 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:18:13.139221 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.140444 28588 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:13.048344 28631 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.141224 28626 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:13.084617 28402 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:13.142969 28597 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.143235 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.143520 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:13.144451 28619 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:13.144873 28278 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:13.147836 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.173995 22749 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:13.149376 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:13.151968 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 126688us
I20260709 12:18:13.153729 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:13.128127 28652 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.231s	user 0.004s	sys 0.000s
W20260709 12:18:13.096279 28649 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.230s	user 0.006s	sys 0.000s
I20260709 12:18:13.161748 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.185400 22753 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:13.186671 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1590) took 1675 ms. Trace:
I20260709 12:18:13.186929 28512 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.187463 28512 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.188103 28623 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:13.188571 28623 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:13.188180 28402 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:13.189832 28512 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.189589 28623 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:13.130429 27995 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 2.044s	user 0.007s	sys 0.024s
I20260709 12:18:13.171341 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.165318 23685 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:18:13.196429 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.169703 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1374) took 1196 ms. Trace:
I20260709 12:18:13.061139 28644 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.208302 28631 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:13.121434 27918 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:13.182802 22893 raft_consensus.cc:2410] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:18:13.210909 28278 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:13.184279 28579 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:13.211966 28579 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.211691 28278 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:13.212572 28579 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.214184 28278 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.201128 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1356) took 2949 ms. Trace:
I20260709 12:18:13.187129 22752 rpcz_store.cc:276] 0709 12:18:11.511599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.562065 (+ 50466us) service_pool.cc:224] Handling call
0709 12:18:11.563136 (+  1071us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:11.946109 (+382973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:11.946160 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:12.001197 (+ 55037us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.694844 (+693647us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:12.712963 (+ 18119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.729133 (+ 16170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.905765 (+176632us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:18:13.186211 (+280446us) raft_consensus.cc:1685] finished
0709 12:18:13.186244 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.186448 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7745,"raft.queue_time_us":38064,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7961,"spinlock_wait_cycles":30929664,"thread_start_us":611176,"threads_started":2,"wal-append.queue_time_us":696122}
I20260709 12:18:13.215101 23689 rpcz_store.cc:276] 0709 12:18:10.251991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.252147 (+   156us) service_pool.cc:224] Handling call
0709 12:18:10.252496 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.922771 (+2670275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.923245 (+   474us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.927612 (+  4367us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:12.927662 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.200352 (+272690us) spinlock_profiling.cc:243] Waited 2.65 s on lock 0x7b540059d8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:13.200450 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.200836 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4947,"raft.queue_time_us":16138,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":1336,"spinlock_wait_cycles":6090037504}
I20260709 12:18:13.202157 22747 raft_consensus.cc:2410] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 21 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 12:18:13.202569 28653 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.356s	user 0.002s	sys 0.008s
I20260709 12:18:13.203177 22899 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:13.194630 28259 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:18:13.215098 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.205511 28281 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.217077 28644 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:13.231333 28633 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:13.241791 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.212620 27918 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.196717 28623 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:13.248413 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 170524us
I20260709 12:18:13.197531 23695 rpcz_store.cc:276] 0709 12:18:12.008181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.035408 (+ 27227us) service_pool.cc:224] Handling call
0709 12:18:12.037750 (+  2342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:12.879154 (+841404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.882270 (+  3116us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:12.928281 (+ 46011us) log.cc:844] Serialized 26 byte log entry
0709 12:18:13.048388 (+120107us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:13.048434 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.053055 (+  4621us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:13.160002 (+106947us) raft_consensus.cc:1685] finished
0709 12:18:13.160022 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.165685 (+  5663us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6304,"raft.queue_time_us":142209,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":12998,"thread_start_us":854026,"threads_started":2,"wal-append.queue_time_us":148416}
I20260709 12:18:13.238852 28597 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:13.241196 28445 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:13.233584 28278 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:13.244213 28512 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:13.269210 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:13.267812 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 124494us
I20260709 12:18:13.245535 28569 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:13.268333 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.267038 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.254941 28172 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:13.272532 22899 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:18:13.256953 27918 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.260636 28445 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:13.278165 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.239248 27995 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:13.283347 28512 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:13.289373 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.273792 28172 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.300364 27918 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:13.306952 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.307684 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.307910 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.308101 28418 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.308355 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:13.326084 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 66792.9us
I20260709 12:18:13.310716 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.311976 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.312355 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.312582 28402 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:13.312878 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.313879 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.314126 28579 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:13.299816 28645 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.333897 28645 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.334434 28579 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.335101 22748 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:18:13.315233 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.337285 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.318389 22751 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:13.323267 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:13.286906 28445 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:13.309231 28654 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.359s	user 0.000s	sys 0.009s
I20260709 12:18:13.327684 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.327364 22901 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:13.320013 28172 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:13.331238 22893 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:13.340293 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:13.331522 22820 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 21. Current term is 22. Ops: []
W20260709 12:18:13.331947 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 54463.8us
I20260709 12:18:13.281971 28278 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:13.330075 28349 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.003s
I20260709 12:18:13.338604 28645 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.353744 22892 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
W20260709 12:18:13.358958 28585 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.692s	user 0.012s	sys 0.006s
I20260709 12:18:13.338858 28561 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.361430 27918 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:13.364430 28512 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:13.367065 22744 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 12.
I20260709 12:18:13.367906 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:13.368325 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:13.369170 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 86448.7us
I20260709 12:18:13.369988 28488 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:13.371485 28551 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:13.374954 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.385469 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:13.375861 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.351686 28631 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:13.375247 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.394809 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.391551 28626 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:13.392910 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.398263 22748 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:13.400520 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.401162 22893 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:13.409214 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:13.419790 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.419124 28631 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:13.424129 28620 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.424887 28631 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.396034 27858 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:13.427011 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 97438us
W20260709 12:18:13.434718 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 67006.7us
I20260709 12:18:13.389551 28452 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:13.452395 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.453142 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.399868 28645 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.458746 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.453706 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.413446 28512 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:13.457407 22745 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:13.408290 28561 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:13.470821 28645 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:13.473034 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:13.473325 28645 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:13.422045 28585 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:13.474050 28585 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:13.474534 28585 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:13.474915 28281 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:13.475387 27995 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:13.476012 28278 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.477916 27858 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:13.434913 28626 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:13.454864 28597 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:18:13.479039 28626 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.479532 28626 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:13.477916 28382 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:13.455022 27918 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:13.481318 28339 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.482178 27918 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.482642 27918 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:13.482821 22899 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:13.462324 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:13.405040 28418 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:13.401921 28289 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:13.463922 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.467248 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1378) took 2595 ms. Trace:
I20260709 12:18:13.492836 23695 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:13.487515 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:13.462541 22746 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:13.466401 22752 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:13.464813 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.486505 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.491266 22820 rpcz_store.cc:276] 0709 12:18:10.866235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.894813 (+ 28578us) service_pool.cc:224] Handling call
0709 12:18:10.895163 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.357003 (+2461840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.428638 (+ 71635us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54002e8954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:13.461200 (+ 32562us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5582776576}
I20260709 12:18:13.499761 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:13.500481 28561 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:13.501709 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:13.502243 22745 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:13.500537 28489 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:13.468009 28512 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.503963 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:13.498226 28402 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:13.506846 28489 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:13.511052 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.511500 28489 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.511931 23672 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:18:13.512005 28339 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.518396 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.519297 28603 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:13.500982 28561 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:13.519762 28603 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.520172 28561 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:13.522049 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.522764 23659 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:18:13.525477 28172 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.529090 28289 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.511077 28402 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.531257 28402 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:13.531874 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:13.535192 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 60550.3us
I20260709 12:18:13.467357 28514 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.512972 28512 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:13.537693 28301 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:13.538388 28301 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:13.538542 28514 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.538949 28301 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:13.514880 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.515013 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.543992 22744 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:13.468792 28181 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 12:18:13.567664 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.569877 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:13.574504 28585 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.520226 28603 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:13.586007 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 49083.7us
I20260709 12:18:13.588835 22897 raft_consensus.cc:2368] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:18:13.589622 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:13.590536 22901 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.594942 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:13.596652 22893 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:13.594722 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.599153 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.599993 22753 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:18:13.599896 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.600718 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.581571 28289 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:13.611279 28289 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.611804 28289 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:13.613056 28349 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:13.613692 28349 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:13.615432 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.615985 28172 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.618381 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:13.619139 22819 raft_consensus.cc:2376] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16. Re-sending same reply.
I20260709 12:18:13.620513 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.623282 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.623860 28551 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.624812 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.625486 28585 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:13.626866 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.628294 28278 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:13.628551 22818 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:13.628813 28278 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.629191 28278 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.600412 22753 pending_rounds.cc:85] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 7
I20260709 12:18:13.631362 22753 pending_rounds.cc:107] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:18:13.631747 22753 raft_consensus.cc:2889] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:13.633451 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:13.634984 28588 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:13.636051 28588 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:13.636942 28588 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:13.637319 28588 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:13.611305 23493 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.640403 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.641137 22824 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:13.642277 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.642683 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.642963 22821 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:13.623373 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:13.645633 28488 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:13.646412 22895 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.648649 28620 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:13.649276 28620 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:13.597733 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 76925.2us
I20260709 12:18:13.581686 28354 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.651760 22824 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:13.651520 28354 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:13.653772 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:13.655062 22892 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:13.655623 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.656325 22823 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:13.656477 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:13.657258 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.657666 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:13.657976 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.658418 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:13.658982 28660 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:18:13.677047 22753 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:13.673949 22826 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:13.658804 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.660106 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.679113 22820 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:13.660943 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.649343 28349 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:13.652971 22825 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:13.655665 28354 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.661761 27918 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:13.662304 22821 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:18:13.663096 22818 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:13.663203 28418 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:13.657063 22824 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:13.666944 28512 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.580843 28579 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:18:13.605317 28445 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:13.649808 28620 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:13.673221 22901 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:13.602392 28514 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.675822 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.676397 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:13.689890 22749 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:13.638180 28588 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:13.680315 28650 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:13.653774 28402 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.683740 22745 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:13.685349 22823 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:18:13.706440 23656 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 21: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:13.686096 28418 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:13.709988 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.720690 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.722230 22752 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:13.721953 22823 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:13.731084 22790 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:13.731804 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:13.738919 28551 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:13.710151 28301 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.740079 27918 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.741418 28301 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:13.743124 28567 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:13.743721 28567 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:13.744860 28512 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.745254 28567 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.695756 28514 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:13.746762 28445 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:13.751304 22822 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:18:13.812229 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.813115 22822 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:13.813964 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.757413 28402 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.759976 28278 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:13.764918 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.818579 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.819141 22746 raft_consensus.cc:2410] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:18:13.765413 22896 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:13.766556 28514 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:13.817849 28278 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:13.775048 28561 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:13.775221 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.825631 28551 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:13.777098 28354 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.826651 28551 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:13.826894 28354 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:13.829591 28354 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.825950 28349 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:13.777438 23660 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
I20260709 12:18:13.830400 28349 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:13.830897 28349 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:13.783757 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.831912 22826 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:13.832866 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.833573 22826 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 22: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:13.834365 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:13.784219 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.829823 28551 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.836026 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.787762 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.836658 22819 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:18:13.837548 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.837822 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:13.838461 22819 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:13.794941 28396 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.839712 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.839879 28396 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:13.840728 28652 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 12:18:13.782760 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:13.787320 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.803901 22864 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.796108 28489 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:13.783023 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.804910 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:13.844498 22826 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.845095 22745 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:13.845471 28489 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.846276 28619 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:13.747371 28567 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:13.805475 28626 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.840596 22819 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:13.746882 28588 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.851521 28626 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.782198 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.844362 22823 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
W20260709 12:18:13.839919 28674 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.076s	user 0.015s	sys 0.005s
I20260709 12:18:13.855727 22821 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:13.799710 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:13.825753 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 50622.2us
I20260709 12:18:13.752303 28418 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.854830 22826 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:13.860124 28551 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:13.801855 28289 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.864491 28551 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:13.865029 28551 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:13.865904 28289 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.842684 28396 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:13.846904 28619 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:13.766659 28579 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:13.781309 28603 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.867219 28579 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:13.867733 28619 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:13.868429 28579 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:13.870127 28579 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:13.866034 28551 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:13.871093 23685 raft_consensus.cc:2368] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16.
I20260709 12:18:13.772941 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:13.872484 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 99622.1us
I20260709 12:18:13.874200 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:13.874569 28603 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:13.875010 28488 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:13.875499 28488 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:13.875929 28488 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:13.876564 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:13.877238 22746 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:18:13.883426 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:13.884197 22820 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.886067 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.876593 22822 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:13.891346 22823 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 16: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:13.878566 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:13.900313 22745 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:13.902710 22749 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:13.902217 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.892325 22895 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:13.907053 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:13.911646 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.913537 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.905511 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.905213 28445 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:13.871960 28551 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:13.922317 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:13.922544 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.923380 23685 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:18:13.924010 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:13.912509 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.911890 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.917424 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.926424 28445 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.926966 22823 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:13.927925 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.929252 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:13.927156 28445 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:13.912992 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:13.931438 23656 raft_consensus.cc:2368] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20.
I20260709 12:18:13.937304 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.944618 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.947525 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:13.948235 22897 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:13.949409 22824 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:13.934739 22750 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:13.953989 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:13.914336 28514 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:13.911994 28181 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:13.971827 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:13.957222 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:13.972756 22892 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:13.963665 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:13.966938 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.966097 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:13.934228 28172 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:13.977761 22790 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:13.945067 28626 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:13.966111 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:13.984112 22893 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:13.977730 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:13.984875 22895 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.985270 22899 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:13.979099 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:13.985929 22745 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:13.981413 23682 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:13.976752 23494 leader_election.cc:400] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:18:13.988449 23494 leader_election.cc:403] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:13.974233 22900 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:13.987865 22747 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:13.991238 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.979382 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:13.992676 22749 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:13.993747 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.995635 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.995962 22901 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:14.001833 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:13.998383 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:14.003880 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:14.004371 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.005182 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:14.009449 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:14.009202 28489 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:14.016958 23685 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:14.018296 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:14.019071 22745 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:13.986958 28452 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:14.024561 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.023655 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.028569 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.039549 22749 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:14.001505 28181 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:14.015990 28172 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:14.044307 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.047037 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.048409 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.048907 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:14.049237 28673 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:18:14.049711 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:14.050060 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:14.012805 28603 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:14.012987 28289 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:14.057734 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:13.984022 28396 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 12:18:14.067457 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.069006 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.071970 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.072676 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.070508 22895 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:14.069754 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.078133 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.027483 28452 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.078837 28623 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:14.079123 28452 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:14.079569 28623 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.081123 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:14.081239 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:14.081772 28623 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:14.082041 22818 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:14.082563 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:14.089130 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:14.089947 22822 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:14.091099 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:14.092355 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:14.053380 28172 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.093453 28172 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:14.090354 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.019829 28489 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:14.097390 22899 raft_consensus.cc:2410] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:18:14.098253 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.105944 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.107671 22895 raft_consensus.cc:2368] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18.
I20260709 12:18:14.095736 22898 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:14.116660 22896 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
W20260709 12:18:14.120118 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.122351 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.124101 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.131634 27995 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:14.097059 28561 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:14.065263 28289 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:14.135105 28289 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:14.135931 28633 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:14.136561 22897 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:14.141999 22818 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:14.143045 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:14.142531 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.119321 28354 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:14.146842 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:14.150516 23674 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:14.152197 23656 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:18:14.154945 28512 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:14.159610 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.155941 22746 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:14.160827 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.162369 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.164300 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:14.166857 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.167961 22791 leader_election.cc:400] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20.
I20260709 12:18:14.168375 22791 leader_election.cc:403] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:18:14.168432 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:14.125201 23685 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:14.175149 22821 raft_consensus.cc:2410] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:18:14.179878 22899 raft_consensus.cc:2410] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 12:18:14.180706 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.181348 22820 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:14.184561 22896 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: []
W20260709 12:18:14.186653 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46259us
I20260709 12:18:14.195472 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:14.198099 22898 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:14.206398 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.154109 28349 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:14.205333 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:14.220485 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.221381 23685 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:14.220499 22897 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:14.222215 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:14.142588 22717 connection.cc:256] RPC call timeout handler was delayed by -1.1644794509998064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 12:18:14.228363 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 158719us
I20260709 12:18:14.169564 28673 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
W20260709 12:18:14.227432 22717 connection.cc:256] RPC call timeout handler was delayed by -1.1608794509998006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:18:14.236714 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0366794509998272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 12:18:14.185316 28551 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:14.205946 28620 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:14.214442 28624 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:14.249974 28289 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.237804 28513 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:14.215057 28626 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:14.253793 28619 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:14.257099 28452 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:14.259193 28181 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:14.260485 28489 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.204495 28259 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:14.261510 28445 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.262310 28382 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:14.262630 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.299813 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.264205 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.199646 28610 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:14.184401 28603 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:14.197576 28623 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:14.248142 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:14.276522 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:14.279632 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.284312 23685 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:14.240677 28633 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:14.246459 22893 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:14.293067 23659 raft_consensus.cc:2393] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 20: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:14.266846 28551 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:14.275126 28402 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:14.263473 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.301524 28418 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:14.302556 28452 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:14.339462 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:14.341292 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 77184.3us
I20260709 12:18:14.345683 22820 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:14.233032 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:14.300920 28382 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:14.296939 28619 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:14.282627 28561 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:18:14.328030 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 51614.1us
I20260709 12:18:14.355247 23493 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.355973 22820 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:14.357189 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.352228 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.329640 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.305949 22825 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 18: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:14.347425 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.361136 22896 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:14.349104 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:14.349541 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 116647us
I20260709 12:18:14.288739 28513 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.334234 28588 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:14.369047 22894 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:14.369706 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.371068 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.372098 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:14.373723 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:14.374615 28624 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:14.376349 22896 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 20. Ops: []
I20260709 12:18:14.377015 28624 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:14.356524 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:14.379592 28603 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.381963 28633 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:18:14.335688 28339 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:14.344587 28551 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:14.365743 22899 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 17: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:14.368217 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.368578 28513 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:14.375074 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.344324 28579 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:14.368950 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.384987 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:14.398694 22746 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:14.383011 28673 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:14.390712 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:14.395181 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 95535.9us
I20260709 12:18:14.353042 28663 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:14.334801 28623 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:14.401561 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.346532 28418 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:14.411839 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:14.359352 28172 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:14.419584 28445 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:14.409032 28354 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:18:14.421418 28623 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:14.422322 27995 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:14.424716 28680 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:18:14.427140 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:14.427156 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.403199 28620 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:14.433851 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.434839 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:14.435631 28569 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:14.438235 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:14.487919 22898 raft_consensus.cc:2368] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 21. Current term is 22.
W20260709 12:18:14.443161 28675 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:18:14.478768 28645 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:14.489271 28569 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:18:14.489581 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 62555us
I20260709 12:18:14.489817 28569 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:14.490633 28259 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20.
I20260709 12:18:14.490959 28569 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 9, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.492067 28588 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:14.492447 28569 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:14.444718 28682 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:14.388819 28567 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:18:14.448477 28677 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 12:18:14.397392 28610 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:18:14.498091 28512 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:14.498281 28610 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:14.498651 28512 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:14.498715 28610 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:14.499660 28512 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:14.501050 28512 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:14.500777 28610 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.502094 28610 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:14.503335 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 69581.8us
W20260709 12:18:14.449887 28488 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.001s
I20260709 12:18:14.413403 23685 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:14.486860 28349 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:14.462743 23672 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:14.508396 28488 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:14.477757 23689 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:14.512410 28488 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:14.513273 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:14.513880 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.514657 23689 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:14.515884 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.484220 28452 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:14.517105 28452 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:14.518080 28452 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.519507 28452 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:14.516719 22901 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:14.528101 28172 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:14.529829 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:14.530711 22753 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:18:14.532352 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.541535 22753 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 22.
I20260709 12:18:14.543459 22864 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:14.478402 22892 consensus_meta.cc:287] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260709 12:18:14.349869 28626 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:14.546166 22892 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:18:14.547101 22900 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:14.490587 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:14.549779 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 59299.1us
I20260709 12:18:14.503974 28445 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:14.550762 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:14.554687 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.551527 28588 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:14.556241 28588 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:14.556705 28588 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:14.559474 28445 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:14.559573 28281 raft_consensus.cc:2764] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 12:18:14.560268 28402 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:14.560478 28445 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:14.560757 28281 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:14.561081 28445 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:14.475610 22746 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:14.562353 28445 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:14.565390 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.446017 28619 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:14.455556 28289 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:14.516709 23672 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:14.566632 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.471262 23695 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:14.560878 28402 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:14.579025 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.571609 22824 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
W20260709 12:18:14.591559 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 201599us
W20260709 12:18:14.586560 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 221989us
I20260709 12:18:14.558354 28551 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:14.601150 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.598862 28681 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:14.603996 22818 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:14.605866 28551 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:14.602330 28579 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:14.606709 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.607548 28281 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:14.608078 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.608861 28281 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:14.609360 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:14.608186 28579 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:14.610082 28281 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:14.610433 28281 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:14.610807 28281 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:14.617421 28588 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:14.620105 28588 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:14.599800 28631 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:14.621513 22746 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:14.624660 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:14.626526 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.629956 28681 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:14.631234 28694 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:14.633358 22791 leader_election.cc:400] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18.
I20260709 12:18:14.633881 22791 leader_election.cc:403] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:14.630594 28681 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:14.636343 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.636673 23493 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:14.638056 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.638686 28681 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:14.641081 28181 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:14.639923 28525 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18.
W20260709 12:18:14.645303 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.650012 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48967.8us
I20260709 12:18:14.647306 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:14.637384 28610 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:14.659139 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.648562 28694 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:14.620846 28281 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:14.664129 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:14.671758 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.672761 23682 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:14.653910 28525 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:14.656198 28181 raft_consensus.cc:2764] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 12:18:14.679824 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 51092.1us
I20260709 12:18:14.680276 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:14.683081 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.686043 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:14.689330 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:14.688786 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:14.691704 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.671459 28488 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:14.657584 28289 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:18:14.692479 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:14.696877 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:14.691349 23494 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.677529 28569 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:14.677891 28525 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:14.667176 28172 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:18:14.677336 28694 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:14.660800 28691 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:18:14.710295 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:14.711848 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.706142 28525 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:14.603425 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:14.720088 28702 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:14.723939 28691 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:14.724467 28691 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:14.725385 28691 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.728574 28695 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:14.729295 28695 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:14.708561 28489 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:14.732730 28489 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:14.733723 28489 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:14.734820 28281 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:14.730304 28695 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:14.735481 28489 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:14.738888 28701 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:18:14.696237 28488 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:14.704977 28569 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.761044 23660 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:14.758165 28569 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:14.767271 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:14.768050 22818 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:14.769595 28418 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:14.769786 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:14.770378 28693 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:14.773042 28382 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:14.775229 28694 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:14.777307 28172 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.779277 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.779227 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.777894 28172 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:14.759171 28488 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:14.787153 28172 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:14.744621 28691 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:14.793341 28689 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.377s	user 0.004s	sys 0.000s
W20260709 12:18:14.795286 28685 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.368s	user 0.003s	sys 0.001s
I20260709 12:18:14.800155 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.787212 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:14.803603 23660 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:14.823338 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.837039 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:14.843890 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44226us
W20260709 12:18:14.844408 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 153176us
I20260709 12:18:14.848097 22746 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:14.774724 28382 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:14.860409 28569 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.853190 23682 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:18:14.864954 23659 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:14.857748 22818 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
W20260709 12:18:14.865031 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 115961us
I20260709 12:18:14.865856 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.857620 23695 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:14.870457 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:14.811661 28172 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:14.874266 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:14.875670 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.880087 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:14.880977 22745 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:14.880710 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:14.891289 22753 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
W20260709 12:18:14.899096 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 44656.7us
I20260709 12:18:14.900378 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.851572 28418 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:14.889791 28259 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:14.857512 28525 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:14.922417 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:14.926628 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:14.929212 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.876498 28702 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:14.894011 28631 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:14.890350 28623 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:14.919656 28289 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:14.932773 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.883034 28354 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:18:14.932183 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:14.810004 22570 catalog_manager.cc:5697] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 12 to 15, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 15 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:14.949604 28670 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:14.968299 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:14.951186 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:14.934103 28569 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:14.950109 28349 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:14.951887 28402 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.945355 28710 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:14.941049 28681 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:14.963604 28525 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:14.933843 28259 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:14.964855 28702 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:14.973013 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:15.018153 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45249.7us
I20260709 12:18:15.018986 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:15.020731 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:18:15.021746 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.995837 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:14.945889 28289 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:15.011945 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 60819.2us
I20260709 12:18:15.016580 23685 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:14.996690 28695 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:15.010422 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 133437us
I20260709 12:18:14.977023 23660 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 22.
I20260709 12:18:15.007746 28551 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:15.028162 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:15.028976 22749 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:18:15.023360 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 157611us
I20260709 12:18:15.044521 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:15.003144 28631 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:18:15.064198 28631 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:15.064649 28631 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:15.047344 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:15.051810 28259 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:15.056041 28512 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:15.059265 28561 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:15.070940 28561 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:15.071489 28561 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:15.031152 28289 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:15.032987 28645 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:15.060231 28181 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:15.047652 28281 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:15.024809 28579 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:18:15.061156 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 65425us
I20260709 12:18:15.079541 22717 leader_election.cc:400] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16.
I20260709 12:18:15.079854 22717 leader_election.cc:403] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:15.071144 28623 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:15.013433 28670 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:15.048333 28707 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:18:15.088280 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:15.089751 23494 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:15.095219 28710 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16.
I20260709 12:18:15.074710 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:15.031831 28278 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:15.077751 23656 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:15.076102 28631 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:15.100822 23494 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:15.111316 22749 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:15.076378 28645 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:15.077576 28181 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:15.116101 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:15.119930 28489 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:15.120589 28489 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:15.121577 28489 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:15.078902 28579 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:15.086341 28681 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:15.128111 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 53606.4us
I20260709 12:18:15.119107 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:15.097086 28695 raft_consensus.cc:2764] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:18:15.131611 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:15.134132 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:15.135663 23682 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:15.140169 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:15.140391 23695 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:15.140815 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:15.136344 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.137925 22901 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:15.108839 28512 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:15.143009 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:15.141636 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 47294.7us
I20260709 12:18:15.143901 22825 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:15.139396 22827 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:15.144426 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:15.153855 22749 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:18:15.156657 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:15.157181 22821 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:15.157774 22892 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:15.159703 22753 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:15.125257 28645 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:15.167315 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:15.160881 22819 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:15.164773 22899 raft_consensus.cc:2368] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:18:15.157596 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:15.156773 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:15.126533 28281 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:15.175081 22826 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:15.175631 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:15.132486 28579 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:15.097417 28690 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:18:15.167685 22820 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:18:15.148489 28620 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:15.143780 28716 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:15.219713 28349 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.149619 28396 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:18:15.311618 23695 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
W20260709 12:18:15.309358 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 139776us
I20260709 12:18:15.144897 28512 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:15.299602 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 158858us
W20260709 12:18:15.312242 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 137986us
W20260709 12:18:15.313519 28603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.017s	sys 0.026s
W20260709 12:18:15.317535 28673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.006s	sys 0.010s
I20260709 12:18:15.178328 28681 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.144s
I20260709 12:18:15.340885 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:15.326901 28620 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:15.352087 28620 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:15.355885 28339 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:15.342728 28402 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:15.362210 22819 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:15.332410 28181 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:15.324139 28695 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:15.321401 28663 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:15.335799 28512 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:15.370616 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:15.332195 28717 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.236s	user 0.000s	sys 0.008s
I20260709 12:18:15.325538 28699 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.326094 28702 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:15.327901 28445 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:18:15.380846 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 216187us
W20260709 12:18:15.384091 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46275.2us
W20260709 12:18:15.334726 28603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.018s	sys 0.027s
W20260709 12:18:15.339512 28673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.006s	sys 0.011s
W20260709 12:18:15.389727 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:15.383414 28693 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:18:15.337371 28716 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:15.398017 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:15.401165 23494 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:15.401535 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:15.399865 28445 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:15.413995 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:15.332865 28349 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:15.416180 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:15.393280 28695 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:15.423832 28445 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:15.424579 28695 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:15.425665 28445 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:15.423086 28723 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:15.420369 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:15.398311 28619 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:15.423102 28670 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:15.428417 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:15.435066 28603 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:15.439601 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:15.439755 28603 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:15.440634 28588 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:15.440795 28603 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:15.441471 28588 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:15.442461 28588 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:15.443115 28588 raft_consensus.cc:3055] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:18:15.443212 23674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 1401) took 1284 ms (client timeout 1695 ms). Trace:
I20260709 12:18:15.443470 28588 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:15.443657 23674 rpcz_store.cc:269] 0709 12:18:14.158842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.162058 (+  3216us) service_pool.cc:224] Handling call
0709 12:18:15.442984 (+1280926us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400292554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:15.443125 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2874806656}
I20260709 12:18:15.446713 28588 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:15.448122 28588 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:15.429574 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.449992 28716 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:15.427809 28690 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:15.459988 28488 consensus_meta.cc:287] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.008s
I20260709 12:18:15.460448 28488 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:15.462245 28561 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:15.465617 28289 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:15.435102 28281 raft_consensus.cc:2764] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:18:15.415812 28181 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:15.428181 28489 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:15.469823 28489 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:15.470985 28489 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:15.471665 28349 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:15.400622 28699 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:15.475073 22896 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:15.436848 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:15.477207 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:15.480095 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.407099 28673 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:15.490067 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 53328.2us
W20260709 12:18:15.468789 28418 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.557s	user 0.014s	sys 0.003s
W20260709 12:18:15.492928 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 103678us
I20260709 12:18:15.418109 28714 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:15.398518 28691 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:18:15.497641 28402 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:18:15.392872 28663 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:15.524165 23494 leader_election.cc:400] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:18:15.525452 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:15.527812 23494 leader_election.cc:403] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:18:15.526753 22899 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:15.462491 28488 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:15.532879 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:15.612754 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:15.500341 28690 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:18:15.629971 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 97207.4us
I20260709 12:18:15.500166 28418 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:15.627233 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:15.631649 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 100955us
W20260709 12:18:15.638366 28728 log.cc:927] Time spent T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.079s	user 0.003s	sys 0.000s
I20260709 12:18:15.638917 28719 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:15.639535 28719 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:15.642428 28722 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:18:15.627650 28339 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:18:15.505625 28579 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:15.644512 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 120545us
I20260709 12:18:15.649147 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:15.650734 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 211176us
I20260709 12:18:15.652069 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:15.653340 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:15.653904 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:15.614830 28626 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:18:15.634863 28690 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.641942 28719 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:15.613370 28569 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:18:15.611955 28670 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:18:15.614609 28645 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:15.671939 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:15.682262 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:15.659128 28488 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:15.673050 28396 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:15.673105 28690 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:15.698518 22899 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:15.709362 22818 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:15.710067 28724 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:18:15.711175 28727 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:15.731446 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:15.697954 28710 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:18:15.707103 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 53322.2us
I20260709 12:18:15.710181 28512 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:15.697640 28561 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:15.731736 28732 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:15.746963 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 66102.1us
I20260709 12:18:15.735747 28569 raft_consensus.cc:3055] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:15.699225 28488 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:15.761705 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:15.765388 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:15.766734 22819 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:15.687600 28673 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:15.748785 28727 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:15.756173 28569 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:15.776928 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:15.756886 28418 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:15.787407 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:15.789011 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:15.795001 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58296.5us
I20260709 12:18:15.796279 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:15.796037 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:15.803205 28512 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:15.774695 27995 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:18:15.814652 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.764896 28732 consensus_queue.cc:1059] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:18:15.825702 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:15.824323 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:15.793977 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:15.811650 27995 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:15.834429 22899 raft_consensus.cc:606] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:15.817190 28579 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:15.794646 28418 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:15.831409 28645 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:15.846033 22824 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:15.833878 28663 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:15.836318 28706 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:15.842252 28551 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.865772 28452 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:15.866384 28452 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:15.867866 28551 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:15.869167 28726 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:15.869740 28726 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:15.885396 28733 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 12:18:15.870749 28726 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:15.886991 28726 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:15.846202 28727 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:15.871555 27995 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:15.872231 28488 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:15.854666 28738 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.889984 28738 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:15.894550 28742 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:15.844214 28690 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:15.895217 28742 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:15.896631 28690 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:15.900168 28734 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:18:15.903513 28699 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:15.904376 28452 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:15.905560 28172 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:15.896227 28742 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:15.907390 28740 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.907953 28740 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:15.919550 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1638) took 1045 ms. Trace:
I20260709 12:18:15.920238 22746 rpcz_store.cc:276] 0709 12:18:14.873845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.874001 (+   156us) service_pool.cc:224] Handling call
0709 12:18:15.919119 (+1045118us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54006798d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:15.919402 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015019392}
I20260709 12:18:15.931767 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:15.931596 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:15.932708 22751 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:15.932961 22818 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:15.937150 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:15.955080 22745 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:18:15.962738 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 151189us
W20260709 12:18:15.968645 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.970584 22824 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:15.989161 22746 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:15.989648 22746 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:15.992241 22899 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:15.990979 22746 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:16.019752 28729 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:16.020484 28729 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:16.022573 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:16.024555 28631 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:16.031298 28738 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:16.034729 28702 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.627s	user 0.012s	sys 0.003s
I20260709 12:18:16.035384 28702 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:16.036201 28740 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:16.045559 22818 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:15.992287 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:16.046878 22746 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:16.048034 22900 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:16.057338 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:15.990358 28418 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:15.987854 28452 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:16.062574 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:16.065614 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:16.067399 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:16.115330 22818 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:16.068509 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:16.070681 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.116998 22825 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:16.074128 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.074921 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.076218 22892 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:16.083258 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:16.119827 22823 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 22.
I20260709 12:18:16.084830 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:16.114238 22899 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:16.098062 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:16.146199 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 55444.5us
I20260709 12:18:16.158556 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1448) took 1107 ms. Trace:
I20260709 12:18:15.978502 28645 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 12:18:16.161382 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:16.162204 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:16.161367 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 90840.1us
I20260709 12:18:16.172989 22826 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:15.987571 28561 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:18:15.993309 28402 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:18:16.159293 22896 rpcz_store.cc:276] 0709 12:18:14.967590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.968055 (+   465us) service_pool.cc:224] Handling call
0709 12:18:16.075176 (+1107121us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54004ec0d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:16.075358 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120696576}
W20260709 12:18:16.075969 28181 consensus_meta.cc:287] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.010s
I20260709 12:18:16.179391 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:16.061820 28745 raft_consensus.cc:3055] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:16.199841 22893 raft_consensus.cc:2410] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 12:18:16.190496 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 105756us
I20260709 12:18:16.204563 22818 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
W20260709 12:18:16.229362 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.125855 28706 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:16.162308 28488 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:16.202054 28745 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:16.240283 22746 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:16.185364 28259 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:16.178803 28624 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.160012 28690 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:18:16.249223 22826 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
W20260709 12:18:16.251175 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 71751.8us
I20260709 12:18:16.240777 28603 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.242641 28623 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.240424 28619 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:16.271404 28723 consensus_meta.cc:287] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.844s	user 0.018s	sys 0.000s
I20260709 12:18:16.271118 28603 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.250845 28488 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:16.244052 28747 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:16.263000 28489 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:16.257378 28740 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:18:16.285993 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 319620us
I20260709 12:18:16.255623 28732 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:16.264189 28624 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:16.299531 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 43588.9us
I20260709 12:18:16.302492 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:16.276175 28181 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.243459 28706 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:16.289655 28278 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.181s	user 0.005s	sys 0.017s
W20260709 12:18:16.296149 28721 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.900s	user 0.025s	sys 0.034s
I20260709 12:18:16.289350 28561 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:16.329634 28561 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.332203 28561 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:16.290518 28742 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.285050 28619 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.343822 28619 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:16.344877 28488 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:16.280105 28623 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.350292 28281 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:16.313436 28732 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:16.350945 28281 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:16.351854 28281 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:16.352639 28732 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:16.304067 28727 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:18:16.295907 28723 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:16.340700 28742 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:16.366567 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.297497 28402 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.295984 28740 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.327536 28702 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:18:16.339980 28746 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:18:16.291563 28747 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.372153 22751 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:16.374126 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.367642 22748 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:18:16.404356 22746 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:16.388756 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:16.390524 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.397428 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:16.399407 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 197802us
I20260709 12:18:16.364748 22825 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:16.411973 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.360262 28729 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:16.350318 28623 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:16.400946 28740 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:16.386371 28278 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:16.358153 28690 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:18:16.316781 28181 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:16.436110 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 133702us
W20260709 12:18:16.436667 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 257391us
I20260709 12:18:16.408026 28747 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:16.446571 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 454329us
I20260709 12:18:16.442230 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:16.402897 28402 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.419533 28732 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:16.416558 28663 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:16.450618 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.451640 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.438530 28739 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:16.447891 28623 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.450569 28725 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:18:16.472420 22893 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:16.440146 28619 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:16.433466 28610 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:18:16.479308 28402 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:16.480105 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:16.481703 28551 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:16.482774 28624 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:16.483592 28603 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:16.489600 28706 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:16.489893 28289 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:16.491808 28726 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.604s	user 0.012s	sys 0.006s
I20260709 12:18:16.310493 28745 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.492915 28745 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.493778 27995 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:16.494954 22820 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:16.479310 28623 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:16.497253 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:16.499642 22826 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:16.500800 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.455935 28732 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:16.503023 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 49611.2us
I20260709 12:18:16.505064 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.512424 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1710) took 1009 ms. Trace:
W20260709 12:18:16.512714 23672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 1407) took 1877 ms (client timeout 1770 ms). Trace:
W20260709 12:18:16.505601 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 61557.8us
W20260709 12:18:16.513083 23672 rpcz_store.cc:269] 0709 12:18:14.635000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.636003 (+  1003us) service_pool.cc:224] Handling call
0709 12:18:16.512534 (+1876531us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54002be8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:16.512650 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3867247360}
I20260709 12:18:16.515929 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:16.512957 22900 rpcz_store.cc:276] 0709 12:18:15.503219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.503359 (+   140us) service_pool.cc:224] Handling call
0709 12:18:16.512256 (+1008897us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540057ce54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:16.512362 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340478720}
I20260709 12:18:16.516618 22826 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:16.515618 22864 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.456578 28396 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:18:16.504041 28699 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.525420 28488 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:16.527884 28699 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:16.528002 28488 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:16.530364 28488 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:16.531859 28181 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:16.533787 28569 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:16.535130 28569 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:16.509982 28623 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:16.535772 28752 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:18:16.502583 28619 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:16.536692 28631 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.007s
W20260709 12:18:16.536720 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:16.539804 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.544246 28742 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:16.544749 28619 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:16.546944 28624 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:16.547545 28624 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:16.548261 28736 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.755s	user 0.003s	sys 0.008s
I20260709 12:18:16.549862 28624 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:16.550992 28623 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:16.551484 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1708) took 1059 ms. Trace:
I20260709 12:18:16.556381 22892 rpcz_store.cc:276] 0709 12:18:15.502435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.502604 (+   169us) service_pool.cc:224] Handling call
0709 12:18:16.075906 (+573302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:16.119141 (+ 43235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.551292 (+432151us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54004ec0d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:16.551424 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067161856}
I20260709 12:18:16.548309 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:16.557834 28759 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:18:16.476305 28739 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:16.564656 28732 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.565778 28739 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:16.537662 28753 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.511502 28710 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:16.566241 22751 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:18:16.566767 28753 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.567291 22751 pending_rounds.cc:85] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 7
I20260709 12:18:16.567206 28699 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:16.567791 22751 pending_rounds.cc:107] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 11.8
W20260709 12:18:16.568248 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.568213 22751 raft_consensus.cc:2889] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:16.522728 28172 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:18:16.572357 28763 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:16.572988 28763 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:16.576102 28763 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:16.579517 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1646) took 1257 ms. Trace:
I20260709 12:18:16.580292 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.579712 28525 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:16.587028 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:16.581868 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 70159.9us
I20260709 12:18:16.578703 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:16.504274 28349 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.566305 28732 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:16.585526 22749 rpcz_store.cc:276] 0709 12:18:15.322226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.322459 (+   233us) service_pool.cc:224] Handling call
0709 12:18:15.322845 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:15.376255 (+ 53410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.376319 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:15.385933 (+  9614us) log.cc:844] Serialized 26 byte log entry
0709 12:18:15.737786 (+351853us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:15.737860 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.737968 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.547516 (+809548us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:18:16.579153 (+ 31637us) raft_consensus.cc:1685] finished
0709 12:18:16.579184 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.579447 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22401,"raft.queue_time_us":8902,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":8513,"spinlock_wait_cycles":37475712,"thread_start_us":327136,"threads_started":1,"wal-append.queue_time_us":368888}
I20260709 12:18:16.582428 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.599203 22750 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:16.599664 22901 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:18:16.603598 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:16.606030 22899 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:16.604827 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:16.607445 22901 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:16.606863 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:16.609819 22893 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:18:16.611738 28757 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.002s
I20260709 12:18:16.611879 22892 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:16.612027 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:16.612733 22895 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:16.601161 28349 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:16.615468 28349 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:16.619848 22820 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:16.622342 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.623142 22748 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:16.626150 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.624497 22748 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:16.628787 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.646878 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:16.643234 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:16.635494 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.649535 23695 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 13: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:16.635006 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.653900 23672 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:16.653065 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.652053 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:16.658527 23656 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:16.659318 23679 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:18:16.659157 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.604900 28513 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:16.602576 28452 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:16.630227 28739 raft_consensus.cc:993] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: : Instructing follower e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:16.686589 22818 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:18:16.665343 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.688879 22750 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:16.666894 23685 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:16.668001 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.689924 22748 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:16.630607 28525 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:16.668932 28716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.007s	sys 0.012s
I20260709 12:18:16.672056 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.610328 28699 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:16.675465 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.676582 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.701251 28551 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.701812 28774 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.702972 28579 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:16.703588 28579 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.705935 28579 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:16.696290 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:16.709908 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.711647 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.711956 23679 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:18:16.712663 23695 raft_consensus.cc:2393] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:16.712510 28747 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:16.713047 28756 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:16.713928 28756 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:16.714461 28756 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:16.714984 22827 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:16.715513 28756 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:16.659629 28349 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:16.719247 28349 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:16.711750 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.682271 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:16.675827 23493 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:16.721350 23494 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.721800 22825 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:16.723011 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.624414 28740 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:16.726459 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 50923.7us
I20260709 12:18:16.696170 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.697530 28727 raft_consensus.cc:1081] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Signalling peer e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:16.680807 23689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:45580
I20260709 12:18:16.692312 23659 raft_consensus.cc:2393] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:16.735918 23689 raft_consensus.cc:606] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.728399 23660 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 22.
I20260709 12:18:16.728252 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:16.677945 28513 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:16.692507 28716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.218s	user 0.007s	sys 0.012s
W20260709 12:18:16.748008 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.748968 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:16.701844 28551 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:16.759835 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.723862 28620 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.765430 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.764348 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:16.769071 22818 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:16.769974 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.767836 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.702457 28774 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.766098 22826 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:18:16.735822 28569 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.748446 28513 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:16.724258 28525 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:16.777231 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.748018 28725 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:16.787750 22899 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:18:16.782859 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 285723us
I20260709 12:18:16.784248 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.759027 28747 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:16.762193 28724 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.787077 28725 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:16.800565 28725 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.800347 28724 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:16.762121 28700 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:16.803226 28700 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:16.805523 23674 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:16.763700 28278 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:16.785173 28512 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:18:16.774935 28620 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.817581 28620 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:16.762336 28289 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:16.818199 28289 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:16.819394 28724 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:16.820364 28289 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:16.783540 28445 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:16.763469 28579 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:18:16.795543 28768 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.795955 28753 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:16.799728 28551 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:16.799366 28349 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:16.807580 22750 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:16.792333 23659 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:16.808457 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.849417 22745 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:16.850461 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.851516 22745 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:16.773912 28181 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:18:16.790001 22790 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:16.810086 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:16.778496 28645 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:16.775925 28488 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:16.763588 28396 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:18:16.822727 22825 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 20: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:16.834903 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.844645 23660 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:16.774091 28339 consensus_queue.cc:1059] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:18:16.798923 28727 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:16.847750 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 70193.5us
I20260709 12:18:16.851176 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:16.833909 22753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:42860
I20260709 12:18:16.866284 23674 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:18:16.866209 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 76268.8us
I20260709 12:18:16.804308 28700 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:16.812624 28739 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:16.853880 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:16.783988 28569 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:16.870667 22753 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:16.872253 22717 leader_election.cc:400] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 21. Current term is 22.
I20260709 12:18:16.875998 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:16.872794 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:16.914291 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:16.914608 22899 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:16.875201 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:16.912914 22753 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:16.850231 28512 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.921352 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:16.922087 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 47291.5us
I20260709 12:18:16.915577 22901 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
W20260709 12:18:16.922675 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 46762us
I20260709 12:18:16.849972 28673 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:16.925429 22819 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:16.930004 22820 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:16.952374 22894 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:16.896476 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:16.935927 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 82146.2us
I20260709 12:18:16.955513 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:16.879927 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:16.968869 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 67454.3us
I20260709 12:18:16.970695 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.869443 28278 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:16.872901 28349 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:16.912843 28710 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:16.974388 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:16.867413 28745 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:18:16.921241 28723 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:16.863171 28645 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.995543 22893 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:18:17.001515 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:17.002260 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.929041 28670 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:18:17.035364 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 61160.5us
I20260709 12:18:16.981613 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:17.019343 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 64825.5us
I20260709 12:18:16.999702 22753 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:16.989050 28742 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:18:17.063733 28259 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:17.055524 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 84962.3us
I20260709 12:18:17.095922 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:16.921777 28603 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 12:18:16.982831 28349 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.914820 28727 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:16.928849 28588 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 12:18:16.929006 28702 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 12:18:17.110002 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:16.928695 28488 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 12:18:17.036155 28645 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:16.966063 28512 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:17.080829 28786 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:18:17.081307 28749 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.229s
I20260709 12:18:16.862742 28768 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:17.155064 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:17.155876 22818 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:17.013085 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:16.975116 28673 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:17.086504 22826 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:16.971621 28489 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:18:17.088241 28778 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.358s	user 0.000s	sys 0.002s
I20260709 12:18:17.100023 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:17.102885 22753 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:17.104168 28349 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:17.108253 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:16.983300 28710 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:17.116653 28780 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:18:17.117888 28681 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.118698 28727 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:17.087000 28670 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:17.119895 22900 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:17.120666 28278 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:17.109386 28748 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:18:17.110965 28758 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.263s
I20260709 12:18:17.110461 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:17.111599 28769 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:18:17.100844 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:17.078090 28740 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:17.130425 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:17.087700 28764 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:17.136300 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:17.286352 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 175950us
I20260709 12:18:17.100035 28785 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:17.155421 28569 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:17.239106 23695 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:17.167133 28774 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:17.180682 28691 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:17.276741 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:17.316421 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 360996us
I20260709 12:18:17.167246 28702 consensus_queue.cc:1243] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:17.163793 28768 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:17.174533 28489 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:17.189404 28710 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:17.185674 28525 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:17.331091 28172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.004s	sys 0.015s
I20260709 12:18:17.293373 28785 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:17.290033 22896 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:17.181099 22894 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:17.345779 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:17.294548 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 164241us
I20260709 12:18:17.239519 28670 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:17.297029 23689 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:18:17.149181 28695 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.137s
I20260709 12:18:17.355444 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:17.350622 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:17.299831 28723 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:17.345043 28172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.005s	sys 0.016s
I20260709 12:18:17.300788 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:17.315747 22748 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:17.367060 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:17.320659 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:17.200963 28339 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:18:17.324879 28774 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:17.287714 28749 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:17.382851 28749 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:17.383841 28513 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 12:18:17.384363 28513 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:17.385366 28749 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:17.357563 28603 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:17.293998 28732 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.003s
I20260709 12:18:17.287282 28726 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:17.290800 28764 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.290410 28762 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:17.336355 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:17.239080 28681 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:17.289273 22822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.016s	sys 0.013s
W20260709 12:18:17.395510 22822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.016s	sys 0.013s
I20260709 12:18:17.297075 28788 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:17.348729 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:17.349911 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:17.400102 22894 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:17.400563 22894 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:17.350764 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:17.403810 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 53133.2us
I20260709 12:18:17.346534 22751 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:18:17.342132 28489 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:17.367877 22744 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:17.370955 23682 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: []
W20260709 12:18:17.371800 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 71124.8us
I20260709 12:18:17.440224 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:17.353111 28702 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:17.380335 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:17.361109 28181 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:17.387691 22753 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:18:17.354332 28785 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:17.323644 28742 consensus_queue.cc:1059] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 12:18:17.311009 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 213387us
I20260709 12:18:17.483893 28633 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:17.393394 22824 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.015s	sys 0.037s
I20260709 12:18:17.392973 22750 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
W20260709 12:18:17.492638 22824 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.015s	sys 0.037s
I20260709 12:18:17.432324 28732 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:17.377856 28525 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:17.378686 28623 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:18:17.456035 23689 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:17.390450 28695 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:17.392850 28402 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:17.511791 28673 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:17.511973 28797 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:17.512255 28700 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:17.512771 28673 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:17.512835 28797 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:17.502200 28695 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:17.514642 28695 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:17.515326 28765 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:17.516188 28695 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:17.516317 28784 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:18:17.489518 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:17.388108 28795 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 12:18:17.517398 28402 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:17.519001 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.520133 28402 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:17.520305 28513 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:17.395995 28764 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:17.391973 22752 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 12:18:17.526532 22752 pending_rounds.cc:85] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 10
I20260709 12:18:17.394887 28762 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.526950 22752 pending_rounds.cc:107] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 12:18:17.527289 22752 raft_consensus.cc:2889] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:17.499046 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:17.450696 28702 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.478229 28181 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.482375 22894 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:17.530592 22819 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:17.396318 28726 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:17.492671 28418 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.392728 28603 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:17.560425 23660 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:17.556905 28702 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:17.531739 28762 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:17.596622 22751 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:17.597213 22751 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:17.553938 28512 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:17.559968 28181 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:17.598304 22751 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:17.557827 28732 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:18:17.611910 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:17.528441 28803 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 12:18:17.637012 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:17.566391 28418 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:17.641166 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:17.645193 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:17.625263 28551 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:17.635315 23672 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:17.560392 28723 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:17.651537 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 294783us
I20260709 12:18:17.656780 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:17.658294 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:17.634824 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 142835us
I20260709 12:18:17.638543 28738 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:17.674475 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:17.633033 28172 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:18:17.676304 23685 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:17.672772 23493 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:17.641047 28797 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:17.686878 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:17.688853 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:17.653316 28774 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:17.653992 28794 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:18:17.682482 28725 consensus_meta.cc:287] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.881s	user 0.015s	sys 0.000s
I20260709 12:18:17.700209 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:17.677769 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:17.702251 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:17.684753 28513 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:17.683328 28738 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.658970 28551 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:17.750710 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 251568us
W20260709 12:18:17.737936 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 60240.8us
I20260709 12:18:17.706741 28681 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:17.707056 28402 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:17.832250 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:17.839576 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 171827us
I20260709 12:18:17.779122 22749 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:18:17.847939 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 205549us
W20260709 12:18:17.712411 28802 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:18:17.708416 28513 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:17.764915 28807 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:18:17.824081 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 58638.7us
I20260709 12:18:17.858991 22749 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:17.859787 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 141673us
I20260709 12:18:17.864665 23689 raft_consensus.cc:2410] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 12:18:17.780826 28805 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:18:17.851516 28756 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:17.733246 28620 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:18:17.823288 28804 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 12:18:17.930009 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:17.699944 28774 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:17.938562 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:17.875124 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1453) took 1043 ms. Trace:
I20260709 12:18:17.876650 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:17.878451 23679 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:17.881263 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:17.882282 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 182242us
I20260709 12:18:17.849608 28402 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.724453 28795 raft_consensus.cc:3055] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:17.715893 28738 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:17.868448 28673 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:18:17.933986 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.706264 28725 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:17.944869 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:17.941531 22823 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:17.748006 28710 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:17.883487 28513 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:17.939688 22747 rpcz_store.cc:276] 0709 12:18:16.831658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.831829 (+   171us) service_pool.cc:224] Handling call
0709 12:18:16.863356 (+ 31527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:16.864828 (+  1472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:16.864869 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:16.873158 (+  8289us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.286991 (+413833us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:17.287063 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.287155 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:17.874755 (+587600us) raft_consensus.cc:1685] finished
0709 12:18:17.874808 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.875038 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":992,"raft.queue_time_us":2277,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3630,"thread_start_us":297838,"threads_started":1,"wal-append.queue_time_us":496530}
I20260709 12:18:17.927222 22749 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:17.883710 28603 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:17.872246 28726 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:17.961551 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:18.004235 23672 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:17.993649 22827 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:17.953646 28727 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:17.953435 28402 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:18.033413 22746 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:17.948421 28795 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:17.999873 22825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1448) took 1265 ms (client timeout 1574 ms). Trace:
I20260709 12:18:18.006140 23659 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:17.958827 28673 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:18.030910 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 134057us
I20260709 12:18:17.942718 28278 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:18:18.000982 22749 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:18.041035 22825 rpcz_store.cc:269] 0709 12:18:16.727748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.727919 (+   171us) service_pool.cc:224] Handling call
0709 12:18:17.993102 (+1265183us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b54007a1554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:17.993331 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192235392}
I20260709 12:18:17.998376 28816 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:17.998447 28820 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:18.069968 28809 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:18.070601 28809 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:18.071448 28259 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.967s	user 0.014s	sys 0.000s
I20260709 12:18:18.072139 28259 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:17.943159 28756 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:18.072974 28259 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.074525 28822 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:18.074294 28259 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.075218 28822 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.077471 28259 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:18.084890 28828 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.085695 28828 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.073052 28710 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:18.088435 28402 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.055303 28278 consensus_queue.cc:1243] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:18.093122 28828 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:18.032507 28418 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:18.064395 28774 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:18.063515 28795 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:18.065074 28806 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.223s	user 0.000s	sys 0.002s
W20260709 12:18:18.095888 28702 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 12:18:18.065879 28815 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:18.096441 28702 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:18.096625 28815 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:18.098047 28402 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:18.099756 23672 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 23.
I20260709 12:18:18.101610 28551 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:18.102928 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:18.103801 28702 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:18.104486 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:18.108631 28702 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:18.109580 28702 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:18.069010 28764 consensus_meta.cc:287] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.006s
I20260709 12:18:18.050319 28673 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:18.112023 28825 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:18.034611 28727 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:17.954752 28699 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:18:18.041131 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1294) took 1124 ms. Trace:
I20260709 12:18:18.075227 28756 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:18.099109 28815 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:18.067742 28725 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:18.050992 28706 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:18:18.110141 28785 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.002s
I20260709 12:18:18.068521 28810 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.059465 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:18.155387 28727 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:18.130995 22899 rpcz_store.cc:276] 0709 12:18:16.916722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.917352 (+   630us) service_pool.cc:224] Handling call
0709 12:18:16.917746 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:16.952857 (+ 35111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:16.952889 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:16.966483 (+ 13594us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.354124 (+387641us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:17.354502 (+   378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.354614 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.040824 (+686210us) raft_consensus.cc:1685] finished
0709 12:18:18.040853 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.041039 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7161,"raft.queue_time_us":42139,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":13973,"thread_start_us":297481,"threads_started":1,"wal-append.queue_time_us":557810}
I20260709 12:18:18.155761 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1263) took 1375 ms. Trace:
W20260709 12:18:18.182066 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.099481 28813 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:18:18.072934 28809 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:18.073556 28799 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:18.167397 28816 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:18.132098 22744 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:18:18.176501 22747 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 12.
I20260709 12:18:18.187641 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:18.181856 23682 rpcz_store.cc:276] 0709 12:18:16.780646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.849916 (+ 69270us) service_pool.cc:224] Handling call
0709 12:18:16.850263 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:17.439051 (+588788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.155376 (+716325us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b5400462b54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:18.155683 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196929792}
I20260709 12:18:18.170639 28706 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:18.164872 28259 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:18.194906 22748 raft_consensus.cc:3055] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:18:18.172191 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 228298us
I20260709 12:18:18.195402 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:18.175885 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 247497us
I20260709 12:18:18.205367 22825 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:18.203899 22748 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:18.205626 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:18.128820 28764 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.186247 28725 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:18.220458 22822 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:18.214751 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:18.215835 22899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:18.216178 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:18.217415 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:18.223002 22892 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:18.224218 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:18.225739 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:18.226424 22823 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:18.227198 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:18.229709 22753 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:18.216552 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:18.230202 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:18.213243 22748 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:18.203553 28706 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:18.234656 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:18.233276 22824 raft_consensus.cc:2393] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:18:18.248680 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.279268 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:18.279014 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:18.278021 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:18.276779 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:18.228159 28681 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:18.233279 28739 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.228542 28820 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.183229 28810 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.179276 28785 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.278636 22826 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:18.339573 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:18.307651 22900 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:18:18.229414 28699 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:18.342361 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:18.342559 22826 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:18.344003 22822 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:18.209326 28259 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:18.351004 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.352022 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 55758.7us
W20260709 12:18:18.355144 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 136439us
I20260709 12:18:18.358539 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:18.362177 22826 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:18.363255 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:18.364997 23695 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:18.285488 28821 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.284708 28823 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:18.307088 28716 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:18.281011 28822 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:18.205467 28816 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:18.232656 28725 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:18.201548 28799 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.375713 28764 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:18.321084 28739 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.379971 28830 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.454007 28724 raft_consensus.cc:993] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7: : Instructing follower e5f99cf1fbc740e3895959adc4f3d10e to start an election
W20260709 12:18:18.381467 28829 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:18:18.379966 22753 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
W20260709 12:18:18.384222 28349 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.183s	user 0.015s	sys 0.000s
I20260709 12:18:18.277038 28710 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:18:18.389334 28259 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:18.338758 28681 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:18.391934 28810 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:18.400393 28785 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:18.405278 22823 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:18.406397 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:18.411075 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:18.359992 28699 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.413059 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:18.423523 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:18.389391 28762 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.787s	user 0.012s	sys 0.000s
I20260709 12:18:18.398597 28619 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:18.472880 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:18.514074 23493 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:18.421155 28716 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.475306 28723 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.475044 28838 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 12:18:18.476214 28839 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:18:18.476823 28739 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:18.409700 28821 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.479871 28840 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:18.478305 28489 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.992s	user 0.014s	sys 0.001s
W20260709 12:18:18.477046 28645 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.319s	user 0.010s	sys 0.006s
W20260709 12:18:18.484843 28181 consensus_meta.cc:287] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.858s	user 0.010s	sys 0.003s
I20260709 12:18:18.485564 28702 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:18.489837 28799 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:18.490023 28673 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.490983 23685 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 23.
I20260709 12:18:18.502077 28727 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.508670 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1673) took 1194 ms. Trace:
I20260709 12:18:18.572031 22746 rpcz_store.cc:276] 0709 12:18:17.314391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.317195 (+  2804us) service_pool.cc:224] Handling call
0709 12:18:17.343607 (+ 26412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.034062 (+690455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.508211 (+474149us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54001e6ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:18.508564 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585738112}
I20260709 12:18:18.513978 22822 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:18.515527 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:18.338089 28820 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:18.522697 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 99271.3us
I20260709 12:18:18.477684 28844 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:18.523998 22897 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:18.495854 28603 raft_consensus.cc:1081] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Signalling peer e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:18.494022 28738 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:18.533183 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 174472us
I20260709 12:18:18.495982 28349 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:18.514850 28710 consensus_queue.cc:1243] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:18.524994 28785 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:18.531873 28758 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:18:18.570080 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.531848 28619 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 23 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:18.581710 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:18.611965 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:18.554569 28259 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:18.592391 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:18.612385 22826 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:18:18.597544 22864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.011s	sys 0.014s
W20260709 12:18:18.618747 22864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.011s	sys 0.014s
I20260709 12:18:18.613960 22818 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:18:18.593318 28838 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:18.535524 28723 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.608228 23672 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:18:18.573112 28851 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:18.596411 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:18.644138 22825 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:18:18.565348 28489 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:18.652205 28775 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
W20260709 12:18:18.652778 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.647994 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:18.612334 28690 raft_consensus.cc:3055] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:18:18.626828 28670 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.256s	user 0.008s	sys 0.008s
I20260709 12:18:18.576581 28623 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:18.624253 22900 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:18:18.523236 28762 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.414544 28823 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.562156 28840 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:18.492723 28830 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.622143 22899 raft_consensus.cc:606] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Received request to transfer leadership to TS cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:18.710071 22899 raft_consensus.cc:614] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:18.567517 28645 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:18.647330 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 55043.5us
I20260709 12:18:18.640092 28758 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:18.594904 28765 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:18.612838 28753 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:18.612342 28842 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.622300 22821 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:18:18.595014 28702 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:18:18.654208 28851 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:18.646602 28633 consensus_meta.cc:287] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.154s	user 0.015s	sys 0.000s
I20260709 12:18:18.707194 28823 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:18.711239 22901 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:18.627545 28739 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:18.712232 22826 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 23.
I20260709 12:18:18.708698 23674 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:18.715762 22822 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:18.737149 22896 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 21: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:18.571015 28181 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:18.708153 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55135.8us
I20260709 12:18:18.714752 28856 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.743260 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:18.720198 28859 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:18.628259 28259 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:18.662671 28690 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:18.738319 22818 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:18.701994 28785 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:18.744201 22822 raft_consensus.cc:2368] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20.
I20260709 12:18:18.707967 28775 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:18.744432 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:18.695917 28623 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:18.722873 28765 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:18.723229 28753 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:18.701558 28670 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.766381 22892 raft_consensus.cc:2368] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17.
I20260709 12:18:18.756270 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:18.598912 28844 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:18.738912 28633 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:18.645207 28838 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:18.804832 28843 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 12:18:18.744251 28725 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:18.807092 22823 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:18.807686 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:18.815150 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:18.814154 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 259826us
I20260709 12:18:18.785718 28445 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:18.768590 28848 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:18:18.823568 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.810429 22901 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:18.818621 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:18.830466 22745 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:18.766956 28859 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.771183 28816 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:18.747463 28739 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.837054 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:18.843613 22822 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:18.811959 28488 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:18:18.739250 28619 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 9, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.855187 28489 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:18.835170 28681 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:18.839293 28859 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:18.769496 28856 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:18.828323 28445 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.881835 28738 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:18.838406 28758 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.859300 28673 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:18.868355 28849 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:18.742408 28842 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.908056 28762 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:18.856950 28753 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:18.908768 28445 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:18.880686 28716 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:18.881659 28349 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:18.772503 28775 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.900585 28821 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:18.930600 28840 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:18.939385 22791 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.058s (SENT) [suppressed 1 similar messages]
I20260709 12:18:18.856703 28690 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:18.948907 28670 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:18.928627 28445 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.954084 28745 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.962710 28745 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.966063 28745 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:18.935137 28681 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.963198 28851 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:18.958240 28852 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.255s	user 0.000s	sys 0.002s
I20260709 12:18:18.916558 28849 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:18.968348 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 1095) took 1116 ms. Trace:
I20260709 12:18:18.949599 28844 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:18.943142 28723 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:19.032454 28749 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:19.036011 28851 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:19.036903 28851 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:19.039875 28815 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:19.040707 28815 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:19.043678 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1377) took 1915 ms. Trace:
I20260709 12:18:19.045887 28259 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:19.044461 23656 rpcz_store.cc:276] 0709 12:18:17.128747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.128929 (+   182us) service_pool.cc:224] Handling call
0709 12:18:17.156227 (+ 27298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.200957 (+ 44730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.200990 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.255060 (+ 54070us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.568888 (+313828us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:17.568949 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.030587 (+1461638us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b5400706f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:19.030668 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.030752 (+    84us) raft_consensus.cc:1685] finished
0709 12:18:19.030773 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.043565 (+ 12792us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1383,"raft.queue_time_us":38139,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":25784,"spinlock_wait_cycles":78814976,"thread_start_us":256712,"threads_started":1,"wal-append.queue_time_us":364780,"wal-append.run_cpu_time_us":25920,"wal-append.run_wall_time_us":1377985}
I20260709 12:18:18.947374 28645 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:19.026396 22819 rpcz_store.cc:276] 0709 12:18:17.852088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.852239 (+   151us) service_pool.cc:224] Handling call
0709 12:18:17.872178 (+ 19939us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:17.872601 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.872626 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:17.880931 (+  8305us) log.cc:844] Serialized 52 byte log entry
0709 12:18:18.169003 (+288072us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:18.190408 (+ 21405us) log.cc:844] Serialized 14 byte log entry
0709 12:18:18.194030 (+  3622us) log.cc:844] Serialized 14 byte log entry
0709 12:18:18.201133 (+  7103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.201235 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.967980 (+766745us) raft_consensus.cc:1685] finished
0709 12:18:18.968013 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.968250 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5668,"prepare.queue_time_us":35892,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":38514,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":66200,"spinlock_wait_cycles":12001408,"thread_start_us":210795,"threads_started":1,"wal-append.queue_time_us":478486}
W20260709 12:18:19.064126 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.969913 28739 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:19.091924 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:19.093540 23656 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:18.966619 28856 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:18.966764 28745 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:19.080107 28488 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:19.086501 28700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.022s	sys 0.028s
I20260709 12:18:19.021349 28181 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:18.990211 28820 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:19.019966 28842 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:19.016618 28445 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:19.137724 28815 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:19.108238 28699 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:19.110178 23674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 1268) took 2098 ms (client timeout 1884 ms). Trace:
W20260709 12:18:19.146166 23674 rpcz_store.cc:269] 0709 12:18:17.012327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.012664 (+   337us) service_pool.cc:224] Handling call
0709 12:18:19.109899 (+2097235us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400159354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:19.110040 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3568773888}
I20260709 12:18:19.111694 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1272) took 1010 ms. Trace:
I20260709 12:18:19.147778 23672 rpcz_store.cc:276] 0709 12:18:18.101561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.101899 (+   338us) service_pool.cc:224] Handling call
0709 12:18:18.109278 (+  7379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.642082 (+532804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.111359 (+469277us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b540073b254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:19.111622 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146744704}
I20260709 12:18:19.117877 28561 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:19.121301 28488 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:19.123731 28513 consensus_meta.cc:287] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.118s	user 0.011s	sys 0.006s
I20260709 12:18:19.022295 28681 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:19.127894 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.085911 28670 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:19.129608 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:19.312216 23656 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:19.127707 28706 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.835s	user 0.017s	sys 0.000s
W20260709 12:18:19.139979 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.316108 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.105305 28745 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:19.151384 23674 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:19.266856 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1450) took 2356 ms. Trace:
I20260709 12:18:19.134672 28445 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:19.317517 22752 rpcz_store.cc:276] 0709 12:18:16.805716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.806243 (+   527us) service_pool.cc:224] Handling call
0709 12:18:16.815383 (+  9140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:17.527825 (+712442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.161340 (+1633515us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54001e87d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:19.161569 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319677696}
I20260709 12:18:19.326915 28830 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:19.329627 28849 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:19.340129 28851 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:19.340910 22751 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:19.350230 28681 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:19.350901 28710 consensus_queue.cc:1175] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" responder_term: 13 status { last_received { term: 12 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:19.352046 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1469) took 1136 ms. Trace:
I20260709 12:18:19.369522 22901 rpcz_store.cc:276] 0709 12:18:18.215768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.215911 (+   143us) service_pool.cc:224] Handling call
0709 12:18:19.351713 (+1135802us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54006eb754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:19.351925 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123467008}
I20260709 12:18:19.162176 28561 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:19.371919 28795 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:19.354436 22894 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:19.356963 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1264) took 2576 ms. Trace:
I20260709 12:18:19.359431 28745 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:19.359668 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1718) took 1125 ms. Trace:
I20260709 12:18:19.385162 22892 rpcz_store.cc:276] 0709 12:18:18.234160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.234410 (+   250us) service_pool.cc:224] Handling call
0709 12:18:19.359379 (+1124969us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400848354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:19.359595 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123550976}
I20260709 12:18:19.361426 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1722) took 1065 ms. Trace:
I20260709 12:18:19.321849 28706 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:19.390610 28838 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:19.311600 28513 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:19.396387 28339 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:19.397150 28339 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:19.319701 28670 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:19.399433 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1380) took 1439 ms. Trace:
I20260709 12:18:19.400017 23659 rpcz_store.cc:276] 0709 12:18:17.960480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.961357 (+   877us) service_pool.cc:224] Handling call
0709 12:18:17.961839 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.043257 (+ 81418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.398987 (+1355730us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b5400088c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:19.399338 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101441920}
I20260709 12:18:19.401715 28670 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:19.402364 23689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 1440) took 1762 ms (client timeout 2058 ms). Trace:
W20260709 12:18:19.403083 23689 rpcz_store.cc:269] 0709 12:18:17.640592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.640795 (+   203us) service_pool.cc:224] Handling call
0709 12:18:19.402009 (+1761214us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400281754. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:19.402274 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511271296}
I20260709 12:18:19.390455 28706 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:19.372114 28561 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:19.414395 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1461) took 1760 ms. Trace:
I20260709 12:18:19.416571 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1267) took 2429 ms. Trace:
I20260709 12:18:19.417309 22744 rpcz_store.cc:276] 0709 12:18:17.653478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.654263 (+   785us) service_pool.cc:224] Handling call
0709 12:18:17.654620 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.198525 (+543905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.413991 (+1215466us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400406ad4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:19.414303 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057588608}
I20260709 12:18:19.416328 28339 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:19.421416 28339 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:19.375823 23660 rpcz_store.cc:276] 0709 12:18:16.780901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.869868 (+ 88967us) service_pool.cc:224] Handling call
0709 12:18:16.923858 (+ 53990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:17.564448 (+640590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.356612 (+1792164us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54003755d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:19.356877 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463171840}
I20260709 12:18:19.386477 22897 rpcz_store.cc:276] 0709 12:18:18.295956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.337595 (+ 41639us) service_pool.cc:224] Handling call
0709 12:18:19.361226 (+1023631us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54004b6ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:19.361362 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401787776}
W20260709 12:18:19.423199 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.363670 28488 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:19.428207 28814 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 1.650s	user 0.011s	sys 0.000s
I20260709 12:18:19.417471 23679 rpcz_store.cc:276] 0709 12:18:16.987168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.987515 (+   347us) service_pool.cc:224] Handling call
0709 12:18:16.987908 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:17.943518 (+955610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.416150 (+1472632us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54002909d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:19.416463 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047341312}
I20260709 12:18:19.443395 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 1090) took 2545 ms. Trace:
I20260709 12:18:19.443928 22827 rpcz_store.cc:276] 0709 12:18:16.898283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.899263 (+   980us) service_pool.cc:224] Handling call
0709 12:18:17.993280 (+1094017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.004980 (+ 11700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.443122 (+1438142us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54007a1550. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:19.443309 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2514844416}
I20260709 12:18:19.444792 28172 consensus_queue.cc:1059] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:19.458194 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 1098) took 1604 ms. Trace:
I20260709 12:18:19.438925 28513 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:19.458762 22821 rpcz_store.cc:276] 0709 12:18:17.853746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.853916 (+   170us) service_pool.cc:224] Handling call
0709 12:18:17.854447 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.738018 (+883571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.457872 (+719854us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54007a1f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:19.458113 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765016320}
I20260709 12:18:19.460539 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1717) took 2111 ms. Trace:
I20260709 12:18:19.460983 22895 rpcz_store.cc:276] 0709 12:18:17.348618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.349407 (+   789us) service_pool.cc:224] Handling call
0709 12:18:17.368227 (+ 18820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.478269 (+110042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.478316 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.494975 (+ 16659us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.637554 (+142579us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:17.637592 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.360955 (+1723363us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b540057add4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:19.361011 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.383781 (+ 22770us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b24003482a8. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15189c4 00007fadf1516acb 00007fadf16d1dc9 00007fadf16d1a55 00007fadf16d109d 00007fadf430310e 00007fadf431a88c 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221
0709 12:18:19.460254 (+ 76473us) raft_consensus.cc:1685] finished
0709 12:18:19.460276 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.460426 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26923,"raft.queue_time_us":27093,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8739,"spinlock_wait_cycles":220270720,"thread_start_us":125588,"threads_started":1,"wal-append.queue_time_us":165701}
I20260709 12:18:19.449024 28623 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:19.471583 28623 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:19.471336 22748 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:19.458870 28859 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.006s
W20260709 12:18:19.462374 28765 consensus_meta.cc:287] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.008s
W20260709 12:18:19.477771 28289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.035s	sys 0.052s
W20260709 12:18:19.483175 23682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.020s	sys 0.051s
W20260709 12:18:19.488374 23682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.020s	sys 0.051s
I20260709 12:18:19.489616 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1382) took 1129 ms. Trace:
W20260709 12:18:19.480569 28809 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.015s	sys 0.054s
I20260709 12:18:19.499897 22894 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:19.505398 23656 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:18:19.504427 23682 rpcz_store.cc:276] 0709 12:18:18.360123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.361900 (+  1777us) service_pool.cc:224] Handling call
0709 12:18:18.362364 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.362661 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:18.589772 (+227111us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.489170 (+899398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.489242 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:19.489303 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.489390 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.489549 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142571,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":109,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":1074970,"threads_started":2}
I20260709 12:18:19.511155 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:19.498585 28809 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.016s	sys 0.055s
W20260709 12:18:19.490338 28289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.036s	sys 0.052s
W20260709 12:18:19.534485 22894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1716) took 2152 ms (client timeout 2029 ms). Trace:
I20260709 12:18:19.502987 28822 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:19.538558 23498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.021s	sys 0.056s
W20260709 12:18:19.539338 23498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.021s	sys 0.056s
I20260709 12:18:19.538959 22751 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:18:19.540691 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1678) took 1945 ms. Trace:
I20260709 12:18:19.489980 28765 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:19.542393 22751 rpcz_store.cc:276] 0709 12:18:17.595832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.596056 (+   224us) service_pool.cc:224] Handling call
0709 12:18:17.596483 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.340230 (+1743747us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b58005e16d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46db0aa 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4
0709 12:18:19.539916 (+199686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.540601 (+   685us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3483669888}
W20260709 12:18:19.551741 22719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.007s	sys 0.009s
W20260709 12:18:19.552824 22790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.009s	sys 0.041s
W20260709 12:18:19.555452 22790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.009s	sys 0.041s
W20260709 12:18:19.543762 28631 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 12:18:19.536933 28855 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:18:19.553172 22719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.007s	sys 0.010s
I20260709 12:18:19.558938 28855 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:19.559139 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.562891 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.013s	sys 0.018s
I20260709 12:18:19.553794 28726 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.551875 28579 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.536907 28822 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:19.565383 23493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.020s	sys 0.038s
W20260709 12:18:19.566536 23493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.020s	sys 0.039s
W20260709 12:18:19.563371 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.013s	sys 0.018s
W20260709 12:18:19.570245 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 733808us
I20260709 12:18:19.571326 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:19.574131 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:19.566550 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 826374us
W20260709 12:18:19.572157 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 960274us
I20260709 12:18:19.580973 28860 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:19.566017 28760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.024s	sys 0.048s
I20260709 12:18:19.590240 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.487879 28859 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:19.575659 28855 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:19.584640 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:19.536268 22894 rpcz_store.cc:269] 0709 12:18:17.348276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.348443 (+   167us) service_pool.cc:224] Handling call
0709 12:18:19.353603 (+2005160us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b580066b3d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46db0aa 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf478327c 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c
0709 12:18:19.500767 (+147164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2222281984}
I20260709 12:18:19.587765 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:19.602944 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 457860us
I20260709 12:18:19.603227 22897 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
W20260709 12:18:19.593538 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.581581 28788 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.903s	user 0.016s	sys 0.028s
I20260709 12:18:19.588335 28817 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:19.579025 28809 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:19.601624 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.600119 22895 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:18:19.592340 28760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.024s	sys 0.049s
W20260709 12:18:19.611178 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.570552 28726 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:19.608294 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.652463 23679 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:19.652899 23659 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:19.653079 22892 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:19.626924 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:19.655979 22750 raft_consensus.cc:2410] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 22 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:18:19.628331 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.657037 22897 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:19.570150 28579 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:19.596792 28620 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.631268 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.665970 23656 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:19.632192 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.633759 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.666193 22752 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:19.666641 23689 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
I20260709 12:18:19.616851 28817 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:19.637553 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:19.642994 28793 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:19.675684 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:19.661589 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.662494 22748 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:19.663276 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.679560 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1471) took 1492 ms. Trace:
W20260709 12:18:19.605957 28788 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.932s	user 0.016s	sys 0.028s
I20260709 12:18:19.681978 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.674870 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:19.684278 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46822.8us
I20260709 12:18:19.684839 23659 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:19.672637 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.680099 22748 rpcz_store.cc:276] 0709 12:18:18.186686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.186940 (+   254us) service_pool.cc:224] Handling call
0709 12:18:18.187270 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.445893 (+1258623us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54003d3ea0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46f4a1d 00007fadf46db1a4 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419
0709 12:18:19.679193 (+233300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.679488 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743815040}
I20260709 12:18:19.692229 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.695753 23679 raft_consensus.cc:2410] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:18:19.629364 28695 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:18:19.697052 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:19.606455 28860 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:19.698344 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:19.673424 28758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.010s	sys 0.015s
I20260709 12:18:19.704106 22752 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
W20260709 12:18:19.706271 22792 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.004s	sys 0.025s
I20260709 12:18:19.705912 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:19.699404 22865 leader_election.cc:400] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20.
I20260709 12:18:19.672259 28727 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:19.681874 28817 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:19.681607 28872 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.696941 28745 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:18:19.712297 22792 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.004s	sys 0.025s
I20260709 12:18:19.689496 28838 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:19.711828 22865 leader_election.cc:403] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 12:18:19.717896 22791 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.011s	sys 0.020s
I20260709 12:18:19.720113 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:19.723670 22791 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.012s	sys 0.020s
W20260709 12:18:19.720343 22867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.036s	sys 0.081s
I20260709 12:18:19.714334 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:19.709569 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:19.724961 22867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.037s	sys 0.081s
I20260709 12:18:19.697408 28854 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:19.708451 28619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.008s	sys 0.014s
I20260709 12:18:19.724139 22892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:19.729297 22892 raft_consensus.cc:606] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:19.710312 28758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.011s	sys 0.015s
I20260709 12:18:19.727375 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.669543 28620 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:19.713253 28742 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:19.703552 28849 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:18:19.731390 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:19.724184 23674 raft_consensus.cc:2410] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:18:19.703378 28488 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:18:19.733454 22717 leader_election.cc:400] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17.
I20260709 12:18:19.693161 28793 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:19.728700 23679 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:19.743496 23660 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:19.721992 28745 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.751528 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:19.729966 28619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.009s	sys 0.014s
I20260709 12:18:19.752460 22752 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:19.755854 28765 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:19.752013 28745 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:19.758333 28620 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:19.747008 22717 leader_election.cc:403] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:19.739398 28172 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:19.723057 28872 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:19.761147 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.727916 28624 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:19.777247 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:19.783360 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:19.783670 22827 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:19.785815 22827 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:19.767807 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1470) took 1551 ms. Trace:
W20260709 12:18:19.724159 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 784761us
I20260709 12:18:19.734166 28716 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:19.788101 22896 rpcz_store.cc:276] 0709 12:18:18.216137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.216276 (+   139us) service_pool.cc:224] Handling call
0709 12:18:19.767524 (+1551248us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400a83ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:19.767723 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163816320}
I20260709 12:18:19.777957 23679 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
I20260709 12:18:19.794152 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.795161 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:19.737473 28742 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:19.795907 22752 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:18:19.784144 22824 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:19.795228 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.802896 22897 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:18:19.803494 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.804260 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.804857 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.797693 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.798462 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:19.799489 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.795182 22892 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:19.796917 22821 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 13: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:19.806630 23674 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
W20260709 12:18:19.800215 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 66932.8us
I20260709 12:18:19.810236 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:19.755951 28726 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:19.731138 28838 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:19.811766 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.816816 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.812217 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:19.817721 22897 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:19.812444 22818 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:19.775676 28859 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:19.826953 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:19.731415 28854 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:19.827131 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.779986 28765 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:19.836371 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:19.827131 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.810588 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:19.840907 22898 pending_rounds.cc:85] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 9
I20260709 12:18:19.795356 28818 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.840953 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.842622 22897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "790207f3e8474996938608fcdf438660"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:19.858552 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:19.859210 22897 raft_consensus.cc:606] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:19.859477 22900 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:19.844604 23674 raft_consensus.cc:2393] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:19.816341 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:19.831482 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.846114 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:19.860948 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50447.1us
I20260709 12:18:19.851511 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.862555 22901 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:19.852432 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:19.806432 28742 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:19.854032 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:19.857203 22898 pending_rounds.cc:107] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:18:19.851008 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:19.858191 22716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.006s	sys 0.045s
I20260709 12:18:19.844027 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:19.861310 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45080.6us
W20260709 12:18:19.851612 22793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.005s	sys 0.045s
I20260709 12:18:19.857122 22895 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:19.856244 22750 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
W20260709 12:18:19.880236 22793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.008s	sys 0.045s
I20260709 12:18:19.880709 22898 raft_consensus.cc:2889] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:19.881296 23679 raft_consensus.cc:2393] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 23: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:18:19.881711 22716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.007s	sys 0.045s
I20260709 12:18:19.835059 28842 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:19.782822 28172 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:19.840117 28763 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 12:18:19.841193 28873 log.cc:927] Time spent T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:18:19.882040 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.890092 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:19.891065 23672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.004s	sys 0.046s
W20260709 12:18:19.902544 23672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.004s	sys 0.046s
I20260709 12:18:19.889043 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:19.903625 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:19.877736 28710 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:19.861006 28681 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:19.895334 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.890560 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:19.913026 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:19.877427 28620 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:19.909996 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.800218 28624 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:19.913712 22821 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:19.914395 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:19.908494 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:19.911381 28797 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:19.930919 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:19.932600 23674 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:19.900786 28488 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:19.920190 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:19.924192 28877 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:19.925236 28854 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:19.926585 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:19.927471 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:19.929159 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:19.949395 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.929605 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:19.919601 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:19.938313 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.934461 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:19.878139 28818 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:19.940903 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:19.941749 22747 raft_consensus.cc:2368] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18.
I20260709 12:18:19.876224 28765 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:19.962306 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:19.953722 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:19.942649 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:19.918726 28835 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:19.955518 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:19.967092 22746 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:19.956386 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:19.943723 28795 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.009s
I20260709 12:18:19.909052 28710 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:19.959789 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:19.919512 28681 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:19.963596 23674 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:19.911135 28702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.166s	user 0.022s	sys 0.037s
I20260709 12:18:19.984251 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:19.922416 28620 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:19.912744 28850 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:19.941582 28874 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:19.960143 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:19.921866 28695 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:18:19.983448 28831 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:19.995137 28831 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.995551 28831 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:19.998421 28876 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:19.999137 28876 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.999743 28876 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:19.941922 28488 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.002918 28488 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:19.966382 28691 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:20.004558 28691 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.004951 28691 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:19.985232 22821 raft_consensus.cc:2393] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:19.978466 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:19.980597 28710 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:20.008482 28695 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:20.009251 28695 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:20.009734 28695 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:20.011125 28874 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:20.011492 28812 consensus_queue.cc:1059] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:20.012614 28812 raft_consensus.cc:3055] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:20.013002 28812 raft_consensus.cc:740] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:20.014824 28620 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:20.006953 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46912.7us
W20260709 12:18:20.019465 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.021206 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:19.983865 28681 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:19.966607 28835 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:19.984325 28702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.022s	sys 0.038s
I20260709 12:18:19.919268 28758 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:18:20.033063 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:20.035676 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.013917 28812 consensus_queue.cc:260] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:19.988855 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:20.047401 22899 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:19.933902 28870 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:18:19.968096 28860 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:19.963099 28854 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:18:20.059460 28793 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:20.061242 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:20.063988 28579 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:20.064069 28809 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:20.063827 28695 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:20.064705 28809 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:20.062633 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:20.065860 28809 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:20.068681 28872 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:20.071564 28812 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:20.073346 28871 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.442s	user 0.000s	sys 0.002s
I20260709 12:18:20.073941 23689 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:20.089020 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:20.027145 28700 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.066498 28695 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:20.043339 28835 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:19.972738 28727 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:18:20.108037 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:20.110917 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:20.050189 28795 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:20.076452 28868 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.425s	user 0.003s	sys 0.000s
W20260709 12:18:20.150998 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.102830 28860 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:20.018992 28850 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:20.131824 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 98877.5us
I20260709 12:18:20.187546 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:20.045248 28289 consensus_queue.cc:1059] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:18:20.151623 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1387) took 1774 ms. Trace:
I20260709 12:18:20.188920 23672 rpcz_store.cc:276] 0709 12:18:18.377561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.149081 (+771520us) service_pool.cc:224] Handling call
0709 12:18:19.150165 (+  1084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:19.161988 (+ 11823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.162033 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:19.311365 (+149332us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.914198 (+602833us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:19.914258 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.914353 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:20.151353 (+237000us) raft_consensus.cc:1685] finished
0709 12:18:20.151379 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.151548 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11318,"raft.queue_time_us":11461,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":61822,"thread_start_us":546290,"threads_started":1,"wal-append.queue_time_us":720724}
I20260709 12:18:20.194818 28756 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:18:20.144488 28339 consensus_meta.cc:287] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.720s	user 0.012s	sys 0.004s
I20260709 12:18:20.170130 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1461) took 1551 ms. Trace:
W20260709 12:18:20.144237 28623 consensus_meta.cc:287] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.672s	user 0.015s	sys 0.000s
I20260709 12:18:20.150452 22752 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:20.176167 22899 raft_consensus.cc:2410] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:18:20.194866 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:20.123260 23674 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:20.138967 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:20.207993 22819 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:20.200155 22825 rpcz_store.cc:276] 0709 12:18:18.618817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.644857 (+ 26040us) service_pool.cc:224] Handling call
0709 12:18:18.645245 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.806803 (+161558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.806834 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:18.806876 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:18.806903 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.169821 (+1362918us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400302854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:20.169880 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.170055 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370992512}
I20260709 12:18:20.163789 28753 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:20.133105 28727 consensus_queue.cc:1243] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:18:20.118477 28879 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.189095 28860 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.135793 28695 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:20.170446 28768 raft_consensus.cc:3055] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:20.178653 28809 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:20.147087 28882 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:20.211781 22892 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:20.117915 28588 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 12:18:20.218071 22896 raft_consensus.cc:2410] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260709 12:18:20.219949 23685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45650 (request call id 1383) took 1858 ms (client timeout 1906 ms). Trace:
I20260709 12:18:20.207943 22746 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:18:20.193863 28690 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:20.077932 28787 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.164s
I20260709 12:18:20.238323 28775 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:20.242354 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:20.277482 22899 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:20.153585 28624 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:20.167797 28818 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:20.146445 28172 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:20.251878 28768 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:20.254376 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:20.311537 22901 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:20.255394 28289 raft_consensus.cc:3055] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:20.192363 28838 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:20.154287 28877 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:20.119988 28700 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:20.167028 28795 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:20.263494 23685 rpcz_store.cc:269] 0709 12:18:18.360524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.362912 (+  2388us) service_pool.cc:224] Handling call
0709 12:18:20.218611 (+1855699us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540073b9d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:20.218763 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291409280}
I20260709 12:18:20.267314 22819 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:20.212136 28849 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17.
I20260709 12:18:20.337199 28877 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:20.212798 28856 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:20.271658 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:20.355932 22824 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:20.355826 28856 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:20.249274 28860 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:20.361157 28700 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:20.324393 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:20.363792 22825 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
I20260709 12:18:20.333223 22901 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:20.326543 28710 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:20.365917 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:20.367100 28710 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:20.367268 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:20.368055 22901 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:20.369722 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:20.376236 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:20.377461 22901 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:20.378753 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:20.399816 22901 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:20.405328 28860 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:20.409214 28860 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:20.413861 28561 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:20.321537 28289 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:20.352828 28795 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:20.370399 28856 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:20.439184 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:20.421348 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:20.440023 22827 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:20.343941 28768 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:20.422578 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:20.248441 28879 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:20.420133 28716 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.004s
I20260709 12:18:20.261377 28620 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:20.442881 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:20.454295 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:20.449986 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:20.457242 22899 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:20.459148 22790 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:20.311157 28588 consensus_queue.cc:1243] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:18:20.267694 28882 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:20.472261 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.390224 28765 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:20.546834 28768 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:20.494251 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:20.386299 28822 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:20.506052 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:20.469484 28716 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20.
I20260709 12:18:20.556393 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:20.460719 28856 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.367110 28785 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.545135 28863 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.461099 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:20.566124 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 105098us
W20260709 12:18:20.445904 28760 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.022s	sys 0.038s
I20260709 12:18:20.554205 22892 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:20.565193 22823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.015s	sys 0.025s
I20260709 12:18:20.546048 28758 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:20.571045 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:20.545368 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 86333.5us
I20260709 12:18:20.580241 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:20.571923 23660 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.015s	sys 0.037s
W20260709 12:18:20.581892 23660 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.015s	sys 0.037s
I20260709 12:18:20.551302 28861 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:20.573186 22899 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:20.581713 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:20.576462 22898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.028s	sys 0.049s
W20260709 12:18:20.585665 22898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.028s	sys 0.049s
I20260709 12:18:20.581135 22897 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:20.568147 22823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.015s	sys 0.025s
I20260709 12:18:20.564960 28785 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:20.570096 28760 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.022s	sys 0.038s
I20260709 12:18:20.612474 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:20.585021 28745 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.826s	user 0.009s	sys 0.005s
I20260709 12:18:20.586109 28859 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.612715 28879 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:20.567505 28856 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:20.580564 28603 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:18:20.625280 22865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.020s	sys 0.053s
I20260709 12:18:20.636368 28620 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:20.638870 22895 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:20.575635 28863 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:20.625371 28817 consensus_meta.cc:287] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.897s	user 0.013s	sys 0.001s
W20260709 12:18:20.648700 22750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.022s	sys 0.023s
W20260709 12:18:20.702422 22750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.026s	sys 0.026s
I20260709 12:18:20.562556 22570 catalog_manager.cc:5697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:20.696640 22865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.022s	sys 0.066s
I20260709 12:18:20.671415 22892 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:20.649267 22897 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:20.700387 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:20.651978 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.712337 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 831643us
I20260709 12:18:20.716009 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:20.640307 28850 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:20.714672 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:20.719228 22893 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:18:20.733168 22821 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
W20260709 12:18:20.642861 28691 consensus_meta.cc:287] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.637s	user 0.018s	sys 0.003s
I20260709 12:18:20.735908 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:20.738240 22719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.039s	sys 0.048s
W20260709 12:18:20.713950 28876 consensus_meta.cc:287] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.007s
W20260709 12:18:20.718096 28681 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.001s
I20260709 12:18:20.750528 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:20.739130 22901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
W20260709 12:18:20.725112 28753 consensus_meta.cc:287] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.001s
W20260709 12:18:20.740562 22719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.040s	sys 0.048s
I20260709 12:18:20.740589 23672 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:20.741616 22897 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 12:18:20.743077 22894 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.032s	sys 0.029s
I20260709 12:18:20.752187 22901 raft_consensus.cc:606] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:20.622021 28745 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:20.755110 22897 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
W20260709 12:18:20.748312 22716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.022s	sys 0.048s
W20260709 12:18:20.767943 22716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.022s	sys 0.048s
I20260709 12:18:20.748283 28788 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:18:20.758441 23672 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260709 12:18:20.696946 28603 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:20.755424 22894 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.032s	sys 0.029s
W20260709 12:18:20.753544 22864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.011s	sys 0.063s
I20260709 12:18:20.758635 22745 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:20.766001 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:20.781790 22864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.011s	sys 0.064s
I20260709 12:18:20.782585 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:20.642442 28859 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:20.759986 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.718925 28817 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:20.784336 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 849929us
I20260709 12:18:20.780951 22825 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:20.790414 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:20.793450 22897 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:18:20.773746 28795 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.795328 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:20.795624 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:20.783855 28603 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:20.796450 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:20.799070 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:20.789230 28831 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.793s	user 0.012s	sys 0.004s
I20260709 12:18:20.791245 22824 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:20.801299 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:20.803042 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:20.817204 22753 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:20.805490 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:20.772573 28788 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:20.774058 28753 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:20.796267 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:20.755564 28681 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:20.810222 28835 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.651s	user 0.007s	sys 0.006s
I20260709 12:18:20.809136 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:20.812016 22750 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:20.811092 22744 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:20.755026 28876 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:20.818306 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:20.838426 22753 raft_consensus.cc:2410] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 12:18:20.838629 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.009s	sys 0.018s
I20260709 12:18:20.817757 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:20.823041 22748 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 15: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:18:20.808554 23695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.023s	sys 0.030s
I20260709 12:18:20.796911 28860 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:20.827051 28797 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.009s	sys 0.036s
I20260709 12:18:20.793040 28822 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:20.835567 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:20.857749 22747 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 19: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:20.826709 28788 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:20.862480 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:20.863370 22753 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:20.835054 28690 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:20.804347 28809 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:20.845017 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:20.756769 28691 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:20.846508 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.010s	sys 0.018s
I20260709 12:18:20.846257 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:20.847254 23695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.023s	sys 0.030s
W20260709 12:18:20.844101 28870 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.015s	sys 0.030s
I20260709 12:18:20.851064 22752 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
W20260709 12:18:20.858644 28797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.009s	sys 0.037s
I20260709 12:18:20.858726 22900 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 20: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:20.793548 28631 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:20.839018 23493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.009s	sys 0.017s
I20260709 12:18:20.898171 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:20.865907 22818 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:20.866423 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:20.899446 23493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.009s	sys 0.017s
I20260709 12:18:20.900656 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:20.901969 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:20.886932 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:20.868069 28864 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:18:20.874931 28870 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.016s	sys 0.030s
I20260709 12:18:20.910557 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:20.847728 28835 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:20.869982 22750 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:20.829315 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:20.813856 28882 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:20.853551 28812 consensus_meta.cc:287] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.781s	user 0.009s	sys 0.005s
W20260709 12:18:20.872864 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 829632us
I20260709 12:18:20.820448 28831 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:20.867501 28690 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:20.859213 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.011s	sys 0.027s
I20260709 12:18:20.814218 28795 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:20.902612 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.917160 22790 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:20.951849 22753 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:20.952154 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:20.857856 28860 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:20.889041 28842 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:20.948738 22750 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:18:20.922843 22744 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 19: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:20.835525 28753 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:20.950558 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.011s	sys 0.027s
I20260709 12:18:20.865564 28822 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:20.960876 23689 raft_consensus.cc:2410] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:18:20.880105 28797 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:20.984795 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 1.07626e+06us
I20260709 12:18:20.912266 28727 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:20.913475 28737 raft_consensus.cc:2764] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 12:18:20.988720 23682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.022s	sys 0.036s
W20260709 12:18:21.011356 23682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.022s	sys 0.037s
I20260709 12:18:21.012492 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1275) took 1432 ms. Trace:
I20260709 12:18:20.913645 28864 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:20.875982 28809 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:20.991993 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 69358.2us
W20260709 12:18:20.992338 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 163121us
I20260709 12:18:20.919550 28855 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:21.025385 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:20.990654 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 421882us
I20260709 12:18:21.004245 28753 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:20.964968 28690 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:21.004741 28898 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:21.009177 22746 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:20.946128 28856 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:20.945350 28863 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:20.903275 28631 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:21.042539 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.043574 28895 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:18:21.019966 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1480) took 1125 ms. Trace:
I20260709 12:18:20.966992 28861 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:21.048867 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 1320) took 1128 ms. Trace:
I20260709 12:18:20.996433 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:21.026240 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1692) took 1316 ms. Trace:
I20260709 12:18:21.049592 22900 rpcz_store.cc:276] 0709 12:18:19.920142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.934774 (+ 14632us) service_pool.cc:224] Handling call
0709 12:18:21.048546 (+1113772us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54000ed154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:21.048775 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059310464}
I20260709 12:18:21.050403 22748 rpcz_store.cc:276] 0709 12:18:19.702938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.704733 (+  1795us) service_pool.cc:224] Handling call
0709 12:18:21.018736 (+1314003us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54004051d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:21.018942 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2555214720}
I20260709 12:18:21.027522 22745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:49004
I20260709 12:18:20.984311 28760 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:21.032838 22750 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 12:18:21.008657 28795 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:21.012984 23682 rpcz_store.cc:276] 0709 12:18:19.579887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.580115 (+   228us) service_pool.cc:224] Handling call
0709 12:18:19.580498 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.580765 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:18:20.051715 (+470950us) log.cc:844] Serialized 14 byte log entry
0709 12:18:21.011937 (+960222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:21.012019 (+    82us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:21.012097 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.012200 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:21.012412 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1028290,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":2565,"thread_start_us":1430096,"threads_started":2}
I20260709 12:18:21.014814 28727 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:21.027186 28855 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:21.045867 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:21.044227 22893 rpcz_store.cc:276] 0709 12:18:19.894303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.895055 (+   752us) service_pool.cc:224] Handling call
0709 12:18:21.019779 (+1124724us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54002fec54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:21.019892 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853024512}
I20260709 12:18:21.052203 22745 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:21.060823 22745 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:21.051177 22892 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:20.989589 28765 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 12:18:21.055804 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 59456.7us
I20260709 12:18:21.063284 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:21.064602 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:21.026573 28172 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:18:21.055068 28561 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.641s	user 0.014s	sys 0.000s
I20260709 12:18:21.057051 28838 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:21.049015 28861 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:21.092049 28861 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:21.067028 28864 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:21.058574 28876 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:21.068770 28855 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:21.048767 28877 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.003s
I20260709 12:18:21.070163 28745 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:21.071002 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1451) took 1222 ms. Trace:
I20260709 12:18:21.070734 28797 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.071595 28817 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:21.072090 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 1454) took 1171 ms. Trace:
W20260709 12:18:21.076149 28900 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:18:21.077163 28691 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:21.077694 28835 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:21.078641 28892 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:18:21.078747 28809 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:21.111529 28877 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:21.121126 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1464) took 1309 ms. Trace:
I20260709 12:18:21.121533 22823 rpcz_store.cc:276] 0709 12:18:19.811818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.811948 (+   130us) service_pool.cc:224] Handling call
0709 12:18:19.822523 (+ 10575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:19.823137 (+   614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.823173 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:19.823974 (+   801us) log.cc:844] Serialized 26 byte log entry
0709 12:18:20.590057 (+766083us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:20.590119 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.590233 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:21.120868 (+530635us) raft_consensus.cc:1685] finished
0709 12:18:21.120896 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:21.121057 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1625,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"thread_start_us":765549,"threads_started":1,"wal-append.queue_time_us":1033884}
I20260709 12:18:21.064216 28859 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:21.079414 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1468) took 1104 ms. Trace:
I20260709 12:18:21.123323 22818 rpcz_store.cc:276] 0709 12:18:19.975111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.975321 (+   210us) service_pool.cc:224] Handling call
0709 12:18:21.079185 (+1103864us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b54007a3354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:21.079343 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927854976}
I20260709 12:18:21.081848 23493 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:21.082691 28488 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.079s	user 0.015s	sys 0.000s
I20260709 12:18:21.124845 28488 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:21.125840 28908 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:21.126322 28908 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:21.060093 28896 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:21.126682 28908 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:21.127317 28488 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:21.128468 22896 raft_consensus.cc:2368] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 21. Current term is 22.
I20260709 12:18:21.043673 28289 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:21.129326 28289 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:21.125463 23493 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:21.085559 28860 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:21.087064 28822 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:21.086859 28768 consensus_meta.cc:287] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.537s	user 0.013s	sys 0.000s
I20260709 12:18:21.159024 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:21.087504 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:21.089308 28788 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:21.059770 28727 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:21.161054 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1487) took 1199 ms. Trace:
I20260709 12:18:21.161607 22892 rpcz_store.cc:276] 0709 12:18:19.961842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.735685 (+773843us) service_pool.cc:224] Handling call
0709 12:18:21.050898 (+315213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:21.061817 (+ 10919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.160792 (+ 98975us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54000ed150. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:21.160979 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678264192}
W20260709 12:18:21.103883 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 58170.3us
I20260709 12:18:21.053910 28760 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.102939 23695 rpcz_store.cc:276] 0709 12:18:19.848141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.887103 (+ 38962us) service_pool.cc:224] Handling call
0709 12:18:19.887474 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:19.913214 (+ 25740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.913240 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:19.930453 (+ 17213us) log.cc:844] Serialized 26 byte log entry
0709 12:18:20.873746 (+943293us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:20.881916 (+  8170us) log.cc:844] Serialized 14 byte log entry
0709 12:18:20.882210 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.882296 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:21.070689 (+188393us) raft_consensus.cc:1685] finished
0709 12:18:21.070714 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:21.070923 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33688,"prepare.queue_time_us":8524,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":26113,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":14750,"thread_start_us":903105,"threads_started":1,"wal-append.queue_time_us":1046807}
I20260709 12:18:21.113330 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:21.185293 28760 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:21.114898 23689 rpcz_store.cc:276] 0709 12:18:19.900481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.138286 (+237805us) service_pool.cc:224] Handling call
0709 12:18:21.071859 (+933573us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b54001900d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:21.072026 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729213824}
I20260709 12:18:21.084231 28831 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:21.186056 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:21.186463 28860 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:21.137100 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:21.150406 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:21.186149 28896 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:21.187814 28896 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:21.188153 28896 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:21.190347 28870 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:21.180815 22748 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:18:21.097277 28758 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.187163 22900 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 20: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:21.097518 28795 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:18:21.186147 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 72926.8us
I20260709 12:18:21.192981 22893 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:21.200996 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:21.194002 22864 leader_election.cc:400] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18.
I20260709 12:18:21.199821 22898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1313) took 1377 ms. Trace:
I20260709 12:18:21.114549 28588 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:21.145610 22746 raft_consensus.cc:2410] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:18:21.205570 22745 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:21.187165 28860 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.150862 28631 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:21.114890 28894 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:21.182966 28842 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:21.191576 28877 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:21.181581 28874 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:21.218153 28588 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:21.238873 28588 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.212559 28561 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:18:21.243955 28870 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:18:21.244400 28870 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:21.245298 28870 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:21.246852 28788 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:21.247308 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1490) took 1260 ms. Trace:
I20260709 12:18:21.248011 22896 rpcz_store.cc:276] 0709 12:18:19.986486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.382530 (+396044us) service_pool.cc:224] Handling call
0709 12:18:21.247066 (+864536us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400a83ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:21.247230 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1563444480}
I20260709 12:18:21.249603 22750 raft_consensus.cc:1240] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:21.249748 28690 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:21.219738 28603 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:21.252785 28603 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:21.253743 28681 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:21.215813 28758 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:21.259409 28742 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.368s	user 0.012s	sys 0.004s
I20260709 12:18:21.259933 28742 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:21.262184 28742 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:21.267138 22749 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:21.210250 28795 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:21.276301 28690 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:21.277858 28619 raft_consensus.cc:993] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: : Instructing follower e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:21.278452 28619 raft_consensus.cc:1081] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Signalling peer e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:21.202688 22864 leader_election.cc:403] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:18:21.283062 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1306) took 1480 ms. Trace:
I20260709 12:18:21.283629 22894 rpcz_store.cc:276] 0709 12:18:19.802532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.802682 (+   150us) service_pool.cc:224] Handling call
0709 12:18:19.803038 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.912088 (+109050us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:18:20.779652 (+867564us) log.cc:844] Serialized 14 byte log entry
0709 12:18:21.217442 (+437790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:21.217537 (+    95us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:21.217622 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.282564 (+ 64942us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54004eb954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:21.282624 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:21.283004 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4439,"prepare.queue_time_us":998313,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":5082,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":10047,"spinlock_wait_cycles":250223360,"thread_start_us":1250710,"threads_started":2}
I20260709 12:18:21.254446 28860 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:21.131330 28753 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:18:21.203014 22898 rpcz_store.cc:276] 0709 12:18:19.839462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.840347 (+   885us) service_pool.cc:224] Handling call
0709 12:18:19.840709 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:19.896414 (+ 55705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.896462 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:19.913805 (+ 17343us) log.cc:844] Serialized 52 byte log entry
0709 12:18:20.588817 (+675012us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:21.024690 (+435873us) log.cc:844] Serialized 14 byte log entry
0709 12:18:21.025029 (+   339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.025114 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:21.199551 (+174437us) raft_consensus.cc:1685] finished
0709 12:18:21.199577 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:21.199747 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6430,"prepare.queue_time_us":429374,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":53426,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":20356,"spinlock_wait_cycles":1836800,"thread_start_us":1079923,"threads_started":2,"wal-append.queue_time_us":956370}
I20260709 12:18:21.131520 28882 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 12:18:21.209627 28864 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:21.218223 22745 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:21.289041 23660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.006s	sys 0.032s
I20260709 12:18:21.215571 28835 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:21.301084 23660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.007s	sys 0.032s
I20260709 12:18:21.237758 28874 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:21.278812 28861 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.303074 28850 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:21.306176 28835 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:21.287889 28785 consensus_meta.cc:287] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.006s
W20260709 12:18:21.333550 22827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.039s	sys 0.050s
I20260709 12:18:21.310491 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:21.336884 23689 raft_consensus.cc:2410] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:18:21.310658 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 116774us
I20260709 12:18:21.312052 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:21.313709 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:21.316886 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:20.984383 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:21.320843 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1405) took 1497 ms. Trace:
I20260709 12:18:21.329643 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:21.337129 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:21.332114 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:21.340694 23659 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
W20260709 12:18:21.340034 22827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.040s	sys 0.051s
I20260709 12:18:21.332981 28835 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:21.309744 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:21.339072 23685 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:18:21.323017 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:21.342926 22898 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:21.338459 23672 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:21.339239 22864 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:21.315236 28811 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18.
I20260709 12:18:21.347869 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:21.353814 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:21.319769 28850 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:21.333894 28695 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:21.369946 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:21.370922 23672 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 15: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:21.364068 22864 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:21.373076 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:21.376832 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:21.377741 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:21.378513 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:21.379216 23689 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:21.381858 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:21.381124 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:21.356120 28758 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:21.358738 28885 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:21.337529 28785 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.399999 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:21.404031 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 419000us
I20260709 12:18:21.407051 22746 raft_consensus.cc:1217] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Deduplicated request from leader. Original: 14.8->[16.9-19.11]   Dedup: 16.9->[17.10-19.11]
I20260709 12:18:21.408020 22746 pending_rounds.cc:85] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 9
I20260709 12:18:21.408277 22746 pending_rounds.cc:107] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:18:21.371508 28619 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:21.408507 22746 raft_consensus.cc:2889] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:21.412822 23689 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:21.410094 22790 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:21.415246 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.381721 28811 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:21.418232 28811 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.425948 22790 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:21.412523 28758 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:21.413499 28885 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:21.417728 28619 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:21.426322 28765 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:21.429498 28811 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:21.415715 28850 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.451581 28850 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:21.449782 28765 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:21.453219 28765 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:21.457255 28885 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.441087 28691 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:21.418426 28908 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:21.465806 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 427831us
I20260709 12:18:21.459381 28691 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:21.469246 28691 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:21.443060 28758 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:21.339643 23660 rpcz_store.cc:276] 0709 12:18:19.823631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.825233 (+  1602us) service_pool.cc:224] Handling call
0709 12:18:19.825693 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.826122 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:18:20.584909 (+758787us) log.cc:844] Serialized 14 byte log entry
0709 12:18:21.320435 (+735526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:21.320490 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:21.320539 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.320654 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:21.320785 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18654,"prepare.queue_time_us":869796,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":18778,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2954,"thread_start_us":1472304,"threads_started":2}
I20260709 12:18:21.420759 28896 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.471834 28785 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:21.472571 22745 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:21.370927 28874 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:21.477392 28874 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:21.478403 22570 catalog_manager.cc:5697] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.480495 28908 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:21.490525 22744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:42860
W20260709 12:18:21.491631 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.500267 22744 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:18:21.500587 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.377810 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.493155 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.004s	sys 0.013s
W20260709 12:18:21.501667 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.004s	sys 0.013s
W20260709 12:18:21.502234 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 515315us
I20260709 12:18:21.500644 22744 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:21.515463 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:21.516031 28758 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:21.516372 22749 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:21.515771 22745 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 22. Current term is 23. Ops: []
I20260709 12:18:21.517035 28896 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:21.481748 22570 catalog_manager.cc:5697] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 10 to 12, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 12 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:21.530490 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:21.508844 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:21.531337 22750 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 13.
I20260709 12:18:21.534731 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.535892 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:21.536882 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:21.537046 22750 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:21.540138 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:21.540513 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 44774us
I20260709 12:18:21.549461 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:21.550144 22750 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:21.541985 22749 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
W20260709 12:18:21.552603 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.507017 28882 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:21.561560 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:21.562399 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:21.459157 28619 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:21.556124 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:21.563128 22894 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:21.557821 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 52580.1us
I20260709 12:18:21.572428 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:21.573762 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:21.507817 28899 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:21.583377 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:21.567310 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.567665 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.568111 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.568673 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:21.580379 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:21.580580 28172 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:21.590415 28172 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:18:21.590920 28172 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:21.576260 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 385911us
I20260709 12:18:21.590687 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:21.577297 23689 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 23.
I20260709 12:18:21.537703 28681 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.561830 28758 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.604053 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:21.566057 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:21.594487 22827 raft_consensus.cc:2368] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14.
W20260709 12:18:21.597040 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.606444 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:21.600440 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.608688 23493 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:21.613154 22894 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:21.587941 22900 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:21.575220 28788 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:21.618103 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:21.621199 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:21.628779 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.589020 28842 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:21.619894 28172 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:21.599586 28822 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:21.629585 22827 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 13.
I20260709 12:18:21.592845 28797 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:21.589334 28914 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:21.621905 28788 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.637562 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:21.591970 28861 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:21.600627 28879 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:21.642484 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:21.629980 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:21.575984 28894 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:18:21.658093 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:21.628150 28876 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:21.630980 28859 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:21.616577 28525 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:21.592279 28899 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:21.648600 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.674134 22744 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.648993 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.650857 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:21.627952 28768 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:21.684475 22744 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:21.684183 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:21.621404 28831 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:18:21.635035 28690 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:21.708734 28690 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.709270 28690 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:21.712671 28588 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:21.713240 28588 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:21.713629 28588 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:21.716842 28760 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.003s
I20260709 12:18:21.717087 28870 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:21.718027 28525 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:21.719135 28525 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:21.709787 22570 catalog_manager.cc:5697] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 8 to 11, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 11 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:21.721872 28690 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.722675 28917 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:21.723430 28917 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:21.724797 28917 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.724080 22570 catalog_manager.cc:5697] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 10 to 15, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 15 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:21.726751 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:21.728000 28919 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:18:21.728633 28695 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:21.729918 28695 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:21.730439 28695 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:21.730930 28831 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:21.731323 28831 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:21.732234 28831 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:21.732265 22570 catalog_manager.cc:5697] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:21.733700 28831 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:21.735548 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.736529 28695 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:21.663007 28822 raft_consensus.cc:697] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:21.664398 28855 consensus_meta.cc:287] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.009s
W20260709 12:18:21.740082 28918 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:18:21.740583 28855 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:21.741087 28822 consensus_queue.cc:237] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:21.743065 23494 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.859s (SENT)
I20260709 12:18:21.743252 28855 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:21.658687 28788 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:21.662436 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:21.606879 28289 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:18:21.645020 28172 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:21.748858 22744 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:21.574774 28882 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:21.619378 28758 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:21.682618 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.754894 22823 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:21.683359 22825 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:21.575138 28915 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 12:18:21.607686 28681 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:21.684675 28859 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:18:21.692131 28923 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:18:21.651012 28920 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:21.683928 28768 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:21.693620 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:21.775339 22896 raft_consensus.cc:2376] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19. Re-sending same reply.
I20260709 12:18:21.685756 28603 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:21.699015 28835 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:21.698426 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:21.669492 28726 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:18:21.703421 28727 consensus_meta.cc:287] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.008s
W20260709 12:18:21.703480 28924 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:18:21.705111 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 75215.5us
I20260709 12:18:21.737989 28691 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:21.669731 22790 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:21.746989 22745 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:21.747542 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:21.751665 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:21.796521 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 126881us
W20260709 12:18:21.797043 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 54029.6us
I20260709 12:18:21.751839 22898 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:21.799860 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:21.800621 22894 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:18:21.786226 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 159200us
W20260709 12:18:21.792323 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 93975.6us
I20260709 12:18:21.803754 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:21.805275 22821 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:21.773506 28917 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:21.801932 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:21.848045 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46195.8us
I20260709 12:18:21.774714 28920 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.812690 23689 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:21.825176 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:21.826368 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:21.853399 23679 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:21.854576 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.828644 23685 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:21.829558 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:21.836118 28876 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:21.838337 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:21.842200 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:21.843744 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:21.717381 28760 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:21.780660 28768 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:21.874585 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.858954 22821 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 8. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260709 12:18:21.795806 28753 raft_consensus.cc:2764] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:18:21.904044 28811 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.865824 28513 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:21.803642 28921 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:21.807500 28850 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:21.911324 28850 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.911931 28850 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:21.865104 28920 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:21.860183 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:21.861258 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:21.791363 28835 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.914657 28835 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:21.915521 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:21.873044 22824 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:21.874073 23659 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:21.859779 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.795311 28727 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:21.877429 28876 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:21.879683 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:21.884413 28726 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:21.885131 28690 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:21.885751 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:21.886253 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:21.894670 28864 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.594s	user 0.014s	sys 0.003s
I20260709 12:18:21.804502 28894 raft_consensus.cc:2764] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 12:18:21.871126 28896 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:21.896835 28691 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:21.897640 28760 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:21.898600 22818 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:21.771415 28765 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:21.929788 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:21.930037 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 68912us
I20260709 12:18:21.963925 22717 leader_election.cc:400] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14.
I20260709 12:18:21.964260 22717 leader_election.cc:403] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:18:21.932374 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:21.930612 28797 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:21.959051 22751 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:21.960708 22825 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:21.918622 28915 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:21.935513 28561 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:21.976251 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.999644 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:22.001053 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:22.006821 22821 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:22.008562 22821 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:18:22.008935 22898 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:21.989238 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:21.989516 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:22.011278 22826 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:22.011575 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:21.989950 22823 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:18:21.991533 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:22.013199 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:21.974658 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:22.013976 22827 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:18:21.992251 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:22.015342 22822 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:22.017271 22819 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:22.019541 22898 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 15: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:21.947659 28726 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:22.026638 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:22.033070 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:22.034590 22898 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:22.036453 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:22.037840 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:22.031551 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 273364us
I20260709 12:18:22.044754 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:22.045022 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:22.045820 22893 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:22.047340 22825 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
W20260709 12:18:22.049752 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.050266 28842 consensus_queue.cc:1059] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:22.051483 28842 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.052045 28842 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.053483 28812 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:22.053987 28812 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:22.055054 28812 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.056787 28812 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:22.061050 22826 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:22.064677 22893 raft_consensus.cc:2410] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:18:22.065166 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:22.017513 28864 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 13. Current term is 14.
I20260709 12:18:22.018654 28811 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:22.101524 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:21.998309 28561 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:22.080439 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.105276 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:21.939205 28859 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:22.069416 28874 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.591s	user 0.018s	sys 0.000s
I20260709 12:18:22.109663 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:22.125519 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:22.114178 22820 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:22.064265 28915 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.127204 22819 raft_consensus.cc:2368] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:18:22.128888 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:22.129391 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:22.130200 22893 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:22.130396 22819 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:22.135491 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 108971us
I20260709 12:18:22.100498 28797 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:22.139101 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:22.142990 22823 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 18: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:22.140331 22717 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:22.152525 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:22.158967 22749 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:22.160446 22893 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:22.125409 28864 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:22.164727 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:22.165411 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:22.165562 22820 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:22.167017 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:22.167374 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:22.171252 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:22.172160 22752 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 15: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:22.181762 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:22.182600 22744 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:22.188869 22895 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 23.
I20260709 12:18:22.177819 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:22.183804 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:22.197181 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:22.198009 22895 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:22.198357 22895 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:22.209515 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:22.210889 22745 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:22.214214 28690 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:22.214937 28690 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.215355 28690 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:22.139967 28915 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:22.220042 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:22.220763 22818 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:22.223075 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1495) took 1237 ms. Trace:
I20260709 12:18:22.223518 22751 rpcz_store.cc:276] 0709 12:18:20.985977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.020840 (+ 34863us) service_pool.cc:224] Handling call
0709 12:18:21.021200 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:21.973971 (+952771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.222826 (+248855us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b540043ec54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:22.223015 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151975680}
I20260709 12:18:22.223156 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:22.201237 28931 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:18:22.163964 28797 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:22.272841 22749 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:22.278672 23679 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 22.
I20260709 12:18:22.235244 23659 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 24.
I20260709 12:18:22.180652 28896 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:22.203231 28513 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:22.179649 28855 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 12:18:22.242220 28831 consensus_meta.cc:287] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.508s	user 0.019s	sys 0.000s
I20260709 12:18:22.247810 28842 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:22.179118 28681 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:22.277257 28788 consensus_meta.cc:287] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.000s
W20260709 12:18:22.257365 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.263654 28727 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:22.264593 28876 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:22.265651 28726 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:22.272722 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:22.336231 22744 raft_consensus.cc:2410] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:18:22.281831 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:22.282155 22898 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:22.173985 28864 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:22.290669 22745 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:22.288017 22820 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:22.256336 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:22.300348 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.325642 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.292147 28603 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.006s
I20260709 12:18:22.341720 22749 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:18:22.344805 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 63083.8us
I20260709 12:18:22.293864 28933 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.343508 22864 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:22.354666 22819 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:22.352393 22752 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:22.294219 28942 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:22.359400 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:22.352097 28943 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:22.363343 28588 consensus_meta.cc:287] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.649s	user 0.013s	sys 0.000s
I20260709 12:18:22.363610 28943 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:22.363912 28588 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.366361 28943 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:22.368717 28835 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:22.369386 28920 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:22.371142 28942 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:22.179267 28561 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:22.379338 23494 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:22.401386 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:22.290472 28797 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.339191 28864 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:22.328910 28691 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:18:22.297567 28944 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.148s
I20260709 12:18:22.352272 28513 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:22.333571 28788 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:22.366768 28588 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:22.433241 22820 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:22.435345 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: true dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:22.435093 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 55862.7us
I20260709 12:18:22.355618 28603 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:22.435341 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:22.372483 28942 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:22.434567 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:22.404366 22745 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:22.375521 28765 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:22.433473 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:22.463110 22822 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:18:22.445365 23656 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
I20260709 12:18:22.487829 22823 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:18:22.489064 22819 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:18:22.489861 23674 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:22.482558 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 139151us
W20260709 12:18:22.496348 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 345422us
I20260709 12:18:22.498335 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:22.490499 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:22.373880 28822 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:18:22.512286 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:22.509788 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 160302us
I20260709 12:18:22.513103 22898 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 12.
I20260709 12:18:22.517666 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:22.465085 28917 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.007s
I20260709 12:18:22.510950 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:22.524461 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:22.525676 22894 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 12:18:22.458302 28940 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:18:22.437036 28727 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:18:22.464394 28870 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.747s	user 0.007s	sys 0.007s
I20260709 12:18:22.378971 28933 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:22.537145 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 43787.5us
I20260709 12:18:22.431368 28768 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:22.445665 28938 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:22.539064 22893 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:22.528648 22822 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:22.529533 22820 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:22.460471 28920 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:22.498993 28812 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.517539 28588 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:22.516431 28619 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.531703 23674 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:22.533880 23679 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:22.533638 28172 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:22.540869 23682 raft_consensus.cc:2410] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:18:22.445662 28896 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.513060 28908 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:22.466111 28797 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:22.547354 23494 leader_election.cc:336] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 2.010s (SENT)
I20260709 12:18:22.566963 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:22.543641 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.531185 23672 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:22.509543 28951 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:18:22.537583 28937 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:18:22.568907 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:22.537771 28943 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:22.578070 28690 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.579273 28943 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:22.580363 28943 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:22.570050 22899 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:22.570713 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:22.582912 23674 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:22.581137 28690 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:22.587700 28939 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 12:18:22.587939 28690 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:18:22.584698 28726 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:22.588954 28788 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:22.589381 28726 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.589874 28726 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:22.596253 28768 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:22.542337 28835 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:22.597349 28899 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:22.576505 28870 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:22.598814 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 1292) took 1226 ms. Trace:
I20260709 12:18:22.599265 23682 rpcz_store.cc:276] 0709 12:18:21.372551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.372736 (+   185us) service_pool.cc:224] Handling call
0709 12:18:22.598516 (+1225780us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540059cc54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:22.598703 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2682801408}
I20260709 12:18:22.600124 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1706) took 1224 ms. Trace:
I20260709 12:18:22.544241 28727 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:22.601250 28758 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:22.601858 28727 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:22.603863 28856 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:22.604354 28856 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:22.582333 28908 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:22.605396 28856 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:22.570462 28619 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:22.606734 28908 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:22.608652 22897 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:18:22.609230 28619 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:22.542248 28938 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.610869 28947 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.573128 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:22.571889 22896 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:22.612346 23679 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:22.600612 22746 rpcz_store.cc:276] 0709 12:18:21.376142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.376303 (+   161us) service_pool.cc:224] Handling call
0709 12:18:21.406726 (+ 30423us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:21.497300 (+ 90574us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:21.720425 (+223125us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b18004322e0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf81773c7 00007fadf47899a7 00007fadf47990bf 00007fadf4799038
0709 12:18:21.972555 (+252130us) log.cc:844] Serialized 14 byte log entry
0709 12:18:22.076399 (+103844us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:22.077003 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 12:18:22.077134 (+   131us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:22.077164 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.077231 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:22.599797 (+522566us) raft_consensus.cc:1685] finished
0709 12:18:22.599913 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.600064 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95894,"prepare.queue_time_us":70603,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":267095,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":5895,"spinlock_wait_cycles":7697792,"thread_start_us":344221,"threads_started":2,"wal-append.queue_time_us":200826}
I20260709 12:18:22.573650 28920 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:22.614722 28947 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.615311 28920 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:22.616135 28938 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:22.617731 28920 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:22.620500 28864 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:22.586194 28951 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:22.622879 28951 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.623348 28963 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:18:22.624358 28963 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:22.624769 28963 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:22.565971 28885 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:18:22.625636 28963 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:22.627800 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:22.635393 28850 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.723s	user 0.015s	sys 0.006s
I20260709 12:18:22.636281 28963 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:22.622462 28929 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.590s	user 0.003s	sys 0.000s
I20260709 12:18:22.652117 22895 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:22.654070 22895 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:22.655817 28620 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:22.656504 28620 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:22.657793 28620 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:22.550437 28812 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.636137 28850 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:22.672636 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:22.688176 22900 raft_consensus.cc:2368] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 21. Current term is 22.
I20260709 12:18:22.672123 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:22.666072 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:22.680641 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:22.669486 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:22.673795 22901 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 23. Current term is 24. Ops: []
I20260709 12:18:22.691347 22893 raft_consensus.cc:2368] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20.
I20260709 12:18:22.697290 22897 raft_consensus.cc:2393] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 20: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:18:22.677856 28954 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
I20260709 12:18:22.714702 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:22.639240 28856 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:22.724025 22899 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:22.724694 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:22.728574 22826 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:22.672078 28933 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:22.734934 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:22.738118 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:22.800662 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.630825 28758 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:18:22.804948 22899 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 21: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:22.806915 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:22.813043 22752 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 11.
I20260709 12:18:22.808519 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:22.730125 28859 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:22.771967 28620 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:22.817169 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 299581us
I20260709 12:18:22.821741 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:22.815559 22749 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:22.825594 22745 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:22.826582 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:22.828888 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:22.825736 22791 connection.cc:256] RPC call timeout handler was delayed by -1.0045828659999643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 12:18:22.845265 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:22.830832 22751 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:18:22.864513 22824 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1717) took 1326 ms (client timeout 1693 ms). Trace:
W20260709 12:18:22.984527 22824 rpcz_store.cc:269] 0709 12:18:21.537868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.537995 (+   127us) service_pool.cc:224] Handling call
0709 12:18:22.864247 (+1326252us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54006a09d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:22.864433 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658596736}
W20260709 12:18:22.972216 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 444089us
I20260709 12:18:22.715361 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:23.002436 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:23.003532 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:23.004285 22824 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:23.005066 22818 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:22.871122 22827 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20. Ops: []
W20260709 12:18:23.007942 22825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52398 (request call id 1488) took 1138 ms (client timeout 1508 ms). Trace:
W20260709 12:18:23.008772 22825 rpcz_store.cc:269] 0709 12:18:21.873225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.885744 (+ 12519us) service_pool.cc:224] Handling call
0709 12:18:23.007190 (+1121446us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b54001261d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:23.007607 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48102656}
I20260709 12:18:23.019928 22821 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:23.017984 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 1124) took 1023 ms. Trace:
I20260709 12:18:23.024134 22826 rpcz_store.cc:276] 0709 12:18:21.994710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.101193 (+106483us) service_pool.cc:224] Handling call
0709 12:18:23.016991 (+915798us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54001252d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:23.017582 (+   591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439036288}
I20260709 12:18:23.027148 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 1121) took 1037 ms. Trace:
I20260709 12:18:23.027912 22821 rpcz_store.cc:276] 0709 12:18:21.989919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.009647 (+ 19728us) service_pool.cc:224] Handling call
0709 12:18:23.019128 (+1009481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:23.020907 (+  1779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:23.026681 (+  5774us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001261d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:23.027054 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2320239360}
I20260709 12:18:22.848253 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:23.032994 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 494114us
W20260709 12:18:23.033869 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 187682us
I20260709 12:18:23.037204 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:23.038197 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.041077 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:22.848901 22895 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:22.827607 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:23.048341 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1735) took 1087 ms. Trace:
I20260709 12:18:23.048966 22894 rpcz_store.cc:276] 0709 12:18:21.995355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.006644 (+ 11289us) service_pool.cc:224] Handling call
0709 12:18:22.007248 (+   604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:22.526875 (+519627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:23.047527 (+520652us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b540057ce54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:23.048089 (+   562us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191581440}
I20260709 12:18:22.843873 22900 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:23.054953 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:23.056802 22825 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:23.062077 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.881836 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:23.067878 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:23.068216 23656 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:22.879138 23494 leader_election.cc:400] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:18:23.069416 23494 leader_election.cc:403] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:18:23.069734 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:22.872020 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:23.071084 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:23.073555 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:23.074110 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:23.071169 23672 raft_consensus.cc:2410] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:18:23.075551 23659 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:23.076249 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:23.076830 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:23.077703 23672 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:22.877293 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:22.880800 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:22.871022 23685 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:22.870489 28726 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.823521 28691 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:22.849638 28811 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:22.829459 28760 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:22.865718 28850 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:22.830014 28859 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:22.804543 28785 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.882118 28758 consensus_queue.cc:1059] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:18:22.877524 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:22.878454 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:22.884107 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:23.155791 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:23.157826 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 281746us
I20260709 12:18:23.100135 28691 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:23.091799 28690 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:18:23.159829 23494 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:23.161152 28874 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:23.161679 28874 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.162045 28874 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:23.162178 28788 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.163205 28788 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:23.166347 28788 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:22.866392 28864 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:22.868245 28882 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:22.869552 28906 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:23.205838 28968 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.909116 28915 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:22.914880 28933 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:23.219694 28906 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:22.855186 28947 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:23.219941 28968 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:22.855834 28948 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:22.851997 28958 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:18:22.857599 28962 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:18:22.872641 28967 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:18:23.224025 28906 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:23.003811 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:23.086098 23659 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:23.232872 28968 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:23.097827 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:23.233743 28963 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.013s
I20260709 12:18:23.099174 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:23.093961 28289 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:23.136979 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:23.095527 28525 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:23.094353 28726 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:23.089727 28716 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:23.243443 28716 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 20 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:23.245204 23674 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 21. Current term is 22. Ops: []
I20260709 12:18:23.244982 28716 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:23.001483 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:23.101017 28822 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.100677 28753 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.145617 23660 raft_consensus.cc:2368] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:18:23.147495 28768 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:23.148494 28561 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:23.253130 28822 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:23.253772 28968 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:23.100564 28811 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:23.254570 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 253507us
I20260709 12:18:23.167915 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:23.168777 28885 raft_consensus.cc:993] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: : Instructing follower e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:23.169297 28944 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.174439 28859 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:23.158594 28619 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.162195 28812 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:23.178475 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:23.179533 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:23.074281 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:23.174274 22571 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 133) took 19547 ms (client timeout 15000 ms). Trace:
I20260709 12:18:23.246650 28525 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:23.205688 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.276044 28619 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:23.276778 28525 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:23.277300 28822 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:23.279659 28812 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:18:23.206748 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:23.281420 22748 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:23.205855 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:23.283034 22752 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:23.091533 28172 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 12:18:23.101300 28797 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 12:18:23.101495 28760 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:23.286557 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:23.237644 23679 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:18:23.240021 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.254686 28968 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:23.205466 28727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.032s
I20260709 12:18:23.251911 22825 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:23.194993 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:23.293284 28727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.001s	sys 0.032s
I20260709 12:18:23.270684 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:23.295051 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:23.271076 28958 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 24 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:23.275460 23682 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 21: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:23.270834 28811 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:23.275653 28753 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:23.280063 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.232925 22823 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:23.299696 28753 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:23.300455 28753 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:23.282896 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:23.302174 22750 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:18:23.279690 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 112130us
I20260709 12:18:23.304294 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:23.268714 22571 rpcz_store.cc:269] 0709 12:18:03.627689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.627896 (+   207us) service_pool.cc:224] Handling call
0709 12:18:23.173944 (+19546048us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:09.900410 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:10.149931 (+249521us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:10.161678 (+ 11747us) write_op.cc:435] Acquired schema lock
0709 12:18:10.172826 (+ 11148us) tablet.cc:662] Decoding operations
0709 12:18:10.528828 (+356002us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:10.548791 (+ 19963us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:10.554130 (+  5339us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:18:10.878226 (+324096us) tablet.cc:701] Row locks acquired
0709 12:18:10.878257 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:18:10.878469 (+   212us) write_op.cc:270] Start()
0709 12:18:10.878628 (+   159us) write_op.cc:276] Timestamp: P: 1783599490878400 usec, L: 0
0709 12:18:10.878657 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:18:10.879611 (+   954us) log.cc:844] Serialized 9924 byte log entry
0709 12:18:12.234178 (+1354567us) op_driver.cc:464] REPLICATION: finished
0709 12:18:12.769056 (+534878us) write_op.cc:301] APPLY: starting
0709 12:18:12.769236 (+   180us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:13.013693 (+244457us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:13.047813 (+ 34120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:13.668694 (+620881us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:13.669141 (+   447us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 12:18:13.669208 (+    67us) write_op.cc:312] APPLY: finished
0709 12:18:13.669840 (+   632us) log.cc:844] Serialized 219 byte log entry
0709 12:18:14.023284 (+353444us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:14.086727 (+ 63443us) write_op.cc:454] Released schema lock
0709 12:18:14.086840 (+   113us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:14.087449 (+   609us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:14.087475 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1767229,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":530929,"apply.run_cpu_time_us":89349,"apply.run_wall_time_us":1318462,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108727,"num_ops":25,"prepare.queue_time_us":445116,"prepare.run_cpu_time_us":28697,"prepare.run_wall_time_us":1253825,"raft.queue_time_us":656822,"raft.run_cpu_time_us":51646,"raft.run_wall_time_us":606378,"replication_time_us":1331584,"thread_start_us":1679993,"threads_started":5,"wal-append.queue_time_us":763024,"wal-append.run_cpu_time_us":35189,"wal-append.run_wall_time_us":2956997}]]}
I20260709 12:18:23.307914 28619 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:23.278105 28944 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:23.287891 28760 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:23.290617 28968 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:23.173287 28785 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:23.295331 22749 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:18:23.297573 28958 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:23.301071 28753 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:23.221112 28951 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:23.220701 28933 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:23.319126 28948 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:23.334933 28896 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:23.321445 28785 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:23.327852 28768 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:23.321158 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:23.336457 28944 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:23.314685 28691 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:23.337689 28948 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:23.337442 28768 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:23.330516 28951 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:23.340358 28951 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:23.327445 28908 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.335702 28896 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:23.296919 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:23.331633 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 84529.7us
I20260709 12:18:23.321873 22899 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:23.342604 28951 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:23.327548 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 357281us
I20260709 12:18:23.249547 28906 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.366015 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:23.366698 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 64765.6us
I20260709 12:18:23.367034 22892 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 21. Current term is 22. Ops: []
I20260709 12:18:23.368527 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:23.327299 28885 raft_consensus.cc:1081] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Signalling peer e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:23.380136 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:23.383692 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 87160.3us
I20260709 12:18:23.385016 28812 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:23.331712 28933 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:23.387324 28859 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:23.391727 28942 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:23.397630 23682 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:23.402580 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:23.404393 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:23.409722 22752 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 19
W20260709 12:18:23.410907 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45494.8us
I20260709 12:18:23.343770 28908 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:23.409476 28942 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:23.332739 28753 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:23.425652 28861 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:23.443256 28861 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:23.443522 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:23.440167 28691 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:23.446475 28812 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:23.446625 28933 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:23.447170 28812 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.447685 28812 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:23.430876 28942 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:23.456103 22747 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:23.429165 28906 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:23.441462 28859 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:23.484247 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:23.486478 28856 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.753s	user 0.019s	sys 0.000s
W20260709 12:18:23.491374 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 87115.8us
I20260709 12:18:23.492028 28870 consensus_queue.cc:1059] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:18:23.460059 28947 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.090s
W20260709 12:18:23.566588 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.581172 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 127979us
W20260709 12:18:23.587874 28988 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.010s
I20260709 12:18:23.444716 28861 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:23.611086 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 154676us
I20260709 12:18:23.631953 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:23.633260 22753 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 22.
I20260709 12:18:23.642071 22752 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:23.625177 28948 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.671135 22748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:42860
W20260709 12:18:23.671685 28983 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:18:23.673031 28906 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:23.673799 28588 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.096s	user 0.010s	sys 0.018s
I20260709 12:18:23.674288 28588 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:23.675974 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.675784 28948 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:23.678530 28812 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:23.679464 22746 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:23.679741 28561 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:23.680512 28561 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:23.681180 28812 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:23.646345 28896 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:23.645771 28726 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:23.685009 28726 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:23.690986 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:23.691686 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 45062.4us
I20260709 12:18:23.691942 22744 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:23.695897 28726 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:23.698561 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 268984us
I20260709 12:18:23.638000 28968 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:23.692221 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:23.666301 28603 raft_consensus.cc:3055] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:23.658033 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:23.720201 28603 raft_consensus.cc:740] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:23.726389 28603 consensus_queue.cc:260] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:23.727869 28603 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:23.732427 28726 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:23.738561 28898 consensus_queue.cc:1059] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:23.742533 28856 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.743352 28811 raft_consensus.cc:3055] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:23.743371 28856 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:23.744300 28811 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:23.744393 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:23.745573 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:23.746622 28906 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:23.747119 28908 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:23.747164 28906 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.747968 28906 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:23.745573 28811 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:23.751554 23493 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:23.644827 28927 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:23.752942 28812 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:23.752749 28927 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:23.753901 28908 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:23.754406 28908 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.754839 28908 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:23.701756 28915 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:23.755682 28915 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:23.758258 28915 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:23.758389 28811 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:23.721150 28289 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:18:23.753480 28812 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:23.760371 28812 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:23.762421 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.769088 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:23.770292 22821 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 15: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:18:23.732203 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.782924 28927 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:23.806355 28861 raft_consensus.cc:2764] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 12:18:23.806627 28986 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:18:23.807878 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:23.808969 28990 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 12:18:23.665092 28525 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:23.812283 22824 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:23.812484 28525 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:23.815855 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 198272us
I20260709 12:18:23.816183 28859 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:23.738283 28942 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:23.817160 28908 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:23.817901 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:23.818836 28942 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:23.819085 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.820116 28908 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:23.823030 28989 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:18:23.830853 22892 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:18:23.834172 22892 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:23.714640 28968 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:23.839854 23682 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:23.791261 28561 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:23.847034 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.790814 28856 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:23.846101 22717 leader_election.cc:400] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:18:23.864421 22717 leader_election.cc:403] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:23.840072 28968 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:23.844067 28859 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:18:23.880520 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 62763.3us
I20260709 12:18:23.883407 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:23.871587 28874 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.709s	user 0.014s	sys 0.005s
I20260709 12:18:23.898074 23656 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
W20260709 12:18:23.899518 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 191054us
I20260709 12:18:23.907069 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:23.908118 23679 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:23.890849 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:23.893915 28859 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:23.930626 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:23.930981 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:23.911633 28620 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.829s	user 0.011s	sys 0.022s
I20260709 12:18:23.936821 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:23.913894 28942 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.926016 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:23.940163 22744 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:23.943497 28561 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.948689 22824 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:23.923641 28768 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:23.950327 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:23.948342 28951 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.574s	user 0.005s	sys 0.009s
I20260709 12:18:23.976922 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:23.927508 28948 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:23.982630 22753 raft_consensus.cc:2410] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 12:18:23.987648 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 69535.8us
I20260709 12:18:23.962556 28933 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:23.993964 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.995431 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:23.967741 28768 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.996004 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:24.012405 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:23.984972 28561 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:24.029778 28561 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:23.998355 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:24.043048 23689 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
W20260709 12:18:24.045130 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 105260us
I20260709 12:18:23.999922 28958 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:23.905687 28874 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:24.060431 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:24.066407 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.065759 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:24.069965 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.070274 22821 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:24.069483 28859 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:24.053782 28768 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:24.077908 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:24.084802 28991 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.343s	user 0.000s	sys 0.002s
I20260709 12:18:24.068080 28948 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:24.055135 28933 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:24.090739 28561 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.144461 28561 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:24.078627 28958 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:24.125298 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:24.150539 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:24.133746 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.056536 28906 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:24.158248 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.159534 28958 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:24.162348 28906 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:24.163249 22745 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:18:24.089558 28716 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:24.078344 28812 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:24.154147 23679 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
W20260709 12:18:24.158496 28987 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.365s	user 0.004s	sys 0.000s
I20260709 12:18:24.189519 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:24.147472 28620 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.194183 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:24.192648 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:24.182433 22826 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:24.191586 22821 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:24.196578 22745 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:24.197515 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:24.199940 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.167092 22717 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.514s (SENT) [suppressed 19 similar messages]
I20260709 12:18:24.178196 28716 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.178504 28933 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:24.198242 23660 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:24.224807 22824 raft_consensus.cc:2410] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:18:24.155652 28948 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:24.193848 28760 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:18:24.226733 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 128760us
I20260709 12:18:24.227240 22897 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:18:24.231559 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:24.245046 22823 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:24.243454 22753 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:24.227516 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:24.252847 22818 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:18:24.258490 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:24.262029 23656 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:18:24.264456 28908 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.264910 22900 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:24.265210 28908 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:24.221285 28716 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:24.267892 28908 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:24.231212 28561 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:24.272344 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:24.273780 22753 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:24.274971 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:24.275552 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:24.276878 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:24.277905 28561 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:24.278733 28561 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.279294 28561 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:24.291420 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56731.7us
I20260709 12:18:24.187203 28726 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:18:24.266002 22573 catalog_manager.cc:5697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 8 to 9, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 9 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:24.296710 28726 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:24.299970 28812 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:24.300817 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:24.301658 22898 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:24.278106 23660 raft_consensus.cc:2410] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:18:24.228787 28811 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.232367 28948 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:24.216004 28620 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:24.245425 28898 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:24.325501 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.231217 22570 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43994 (request call id 151) took 36362 ms (client timeout 15000 ms). Trace:
I20260709 12:18:24.245913 28760 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:24.332023 23679 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:24.348217 22898 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:18:24.349858 22745 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
W20260709 12:18:24.361496 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.325642 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:24.367093 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 52377.5us
I20260709 12:18:24.367458 22897 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:24.368381 22791 leader_election.cc:400] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 21. Current term is 22.
I20260709 12:18:24.370069 28856 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:24.218075 28906 consensus_queue.cc:1059] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 12:18:24.371840 28760 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:24.392683 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:24.419807 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:24.424567 22791 leader_election.cc:400] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 21. Current term is 22.
I20260709 12:18:24.427454 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:24.330390 28811 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:24.450212 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:24.393185 28927 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:24.333767 28898 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:24.418722 28525 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.465010 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:24.456275 28906 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:24.455027 28874 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:24.456045 28927 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:18:24.503222 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 414281us
I20260709 12:18:24.506326 22748 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:24.514766 22748 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:24.507099 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1736) took 1026 ms. Trace:
I20260709 12:18:24.514062 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:24.546437 23679 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
W20260709 12:18:24.550757 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 383675us
I20260709 12:18:24.553534 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:24.489506 28525 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:24.491427 28768 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:24.557560 22894 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:24.524303 28906 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 23 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:24.548409 28968 consensus_meta.cc:287] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.651s	user 0.007s	sys 0.008s
W20260709 12:18:24.559113 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 142039us
W20260709 12:18:24.593173 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.597409 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.607564 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:24.625682 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 236585us
I20260709 12:18:24.623579 22897 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:24.631640 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:24.633064 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.635589 22900 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 23: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:24.584509 28968 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:24.614671 28620 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:24.654394 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:24.654733 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:24.655277 22897 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:24.655855 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:24.657401 28753 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:24.662607 28898 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:24.664180 23674 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
W20260709 12:18:24.664565 23494 leader_election.cc:336] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.634s (SENT)
I20260709 12:18:24.667289 22749 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:24.668213 28968 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:24.331321 22570 rpcz_store.cc:269] 0709 12:17:47.868599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.868895 (+   296us) service_pool.cc:224] Handling call
0709 12:18:24.230933 (+36362038us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:22.207397 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:22.219625 (+ 12228us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:22.219693 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:18:22.219734 (+    41us) tablet.cc:662] Decoding operations
0709 12:18:22.220719 (+   985us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:22.220855 (+   136us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:22.220898 (+    43us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:18:22.221657 (+   759us) tablet.cc:701] Row locks acquired
0709 12:18:22.221715 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:18:22.221941 (+   226us) write_op.cc:270] Start()
0709 12:18:22.222116 (+   175us) write_op.cc:276] Timestamp: P: 1783599502221855 usec, L: 0
0709 12:18:22.222138 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:18:22.232131 (+  9993us) log.cc:844] Serialized 2890 byte log entry
0709 12:18:22.636577 (+404446us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:18:22.928896 (+292319us) op_driver.cc:464] REPLICATION: finished
0709 12:18:23.300400 (+371504us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b1800345280. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:18:23.300741 (+   341us) write_op.cc:301] APPLY: starting
0709 12:18:23.300933 (+   192us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:23.672019 (+371086us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:23.672093 (+    74us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:23.734052 (+ 61959us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:23.734501 (+   449us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:18:23.734587 (+    86us) write_op.cc:312] APPLY: finished
0709 12:18:23.736250 (+  1663us) log.cc:844] Serialized 72 byte log entry
0709 12:18:23.736748 (+   498us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:23.737622 (+   874us) write_op.cc:454] Released schema lock
0709 12:18:23.737845 (+   223us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:23.744050 (+  6205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:23.744089 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8365566,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":356350,"apply.run_cpu_time_us":19791,"apply.run_wall_time_us":443338,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33415,"num_ops":7,"prepare.queue_time_us":252983,"prepare.run_cpu_time_us":29295,"prepare.run_wall_time_us":205343,"raft.queue_time_us":59014,"raft.run_cpu_time_us":25639,"raft.run_wall_time_us":311747,"replication_time_us":706608,"spinlock_wait_cycles":51818112,"thread_start_us":833461,"threads_started":4,"wal-append.queue_time_us":213948}]]}
I20260709 12:18:24.671821 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:24.641328 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 102731us
I20260709 12:18:24.675752 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:24.676337 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:24.679705 22791 leader_election.cc:400] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20.
I20260709 12:18:24.680121 22791 leader_election.cc:403] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 12:18:24.683543 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 54499.7us
I20260709 12:18:24.685024 23494 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:24.705472 22900 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
W20260709 12:18:24.706091 29002 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:18:24.706681 28561 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:24.725785 29018 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.647230 28906 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:24.726466 29018 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:24.707819 28874 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:24.708678 28525 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:24.709700 29012 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:24.712178 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:24.682926 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.718286 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.720896 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.613340 28927 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:24.721647 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:24.729971 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:24.726619 28561 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:24.729766 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:24.736720 22745 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
W20260709 12:18:24.681471 28998 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.225s	user 0.001s	sys 0.001s
I20260709 12:18:24.742709 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:24.677645 28811 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:24.714116 28768 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:24.679591 28620 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:18:24.747231 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:24.744884 28874 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:24.755089 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:24.680400 28603 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
W20260709 12:18:24.758558 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 99836us
I20260709 12:18:24.746011 28856 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20.
I20260709 12:18:24.783790 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:24.789191 22745 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 23: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:24.778396 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:24.790999 29019 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.791239 22894 raft_consensus.cc:606] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:24.791587 28948 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:24.792378 28948 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:24.746963 28812 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:24.751273 28908 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:24.791697 22894 raft_consensus.cc:614] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:24.757117 28927 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:24.801854 22749 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:24.781158 28726 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:24.779661 29018 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:24.818943 29026 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:24.788009 28525 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.825457 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1737) took 1220 ms. Trace:
W20260709 12:18:24.819072 29008 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:18:24.848606 28716 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.580s	user 0.004s	sys 0.009s
I20260709 12:18:24.816318 28726 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.829842 22750 rpcz_store.cc:276] 0709 12:18:23.604322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.604651 (+   329us) service_pool.cc:224] Handling call
0709 12:18:23.619360 (+ 14709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.644925 (+ 25565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.644957 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.667169 (+ 22212us) log.cc:844] Serialized 26 byte log entry
0709 12:18:24.065734 (+398565us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:24.065782 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.065881 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:24.819874 (+753993us) raft_consensus.cc:1685] finished
0709 12:18:24.819902 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:24.820046 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11877,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":15296,"thread_start_us":397855,"threads_started":1,"wal-append.queue_time_us":657828}
I20260709 12:18:24.793557 28948 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:24.778630 28874 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:24.902588 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:24.906208 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.857275 28726 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:24.941618 22750 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:24.935415 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 287762us
I20260709 12:18:24.942508 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:24.938941 22748 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:24.943169 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 58424.2us
W20260709 12:18:24.943889 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 201257us
I20260709 12:18:24.945204 28753 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:24.950960 29009 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.948148 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:24.829129 28525 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:24.963341 22894 raft_consensus.cc:606] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:24.963928 22894 raft_consensus.cc:614] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:24.964617 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 142794us
I20260709 12:18:24.969049 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:24.746304 29012 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:24.856570 28716 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:24.791755 29019 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:24.947913 28968 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:18:24.959249 28942 consensus_meta.cc:287] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.981s	user 0.015s	sys 0.002s
I20260709 12:18:24.515513 22747 rpcz_store.cc:276] 0709 12:18:23.480388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.505955 (+ 25567us) service_pool.cc:224] Handling call
0709 12:18:23.568111 (+ 62156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:23.568795 (+   684us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:18:23.616395 (+ 47600us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.505708 (+889313us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.506038 (+   330us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:24.506104 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:24.506170 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.506858 (+   688us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:24.507021 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78489,"prepare.queue_time_us":122748,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":27926,"raft.queue_time_us":7428,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":16335,"spinlock_wait_cycles":9572224,"thread_start_us":819493,"threads_started":3,"wal-append.queue_time_us":691173}
I20260709 12:18:24.983264 28561 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.985154 28856 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:18:24.988977 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 165248us
I20260709 12:18:24.999668 29028 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:25.000208 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:25.000574 29028 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:25.001256 28896 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:25.001601 29004 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.001746 29028 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:25.002465 29004 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:25.003754 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.003629 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:25.004611 28561 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:25.005054 28896 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:24.978915 28906 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.008703 28906 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:25.009440 28561 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:25.011816 22896 raft_consensus.cc:2393] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:18:25.018661 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.022017 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.023572 28906 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:25.023882 22791 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.025254 29031 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:25.026367 29031 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:25.026446 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:24.963467 29009 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:25.027225 29030 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.027654 28896 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:24.998041 28942 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
I20260709 12:18:24.995004 29024 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:25.028003 29030 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:24.961477 28753 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:25.019645 28948 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:25.005128 29004 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:25.044730 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.053699 22752 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:25.027316 29031 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:25.034303 28958 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:25.081133 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:25.082500 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 113570us
I20260709 12:18:25.054817 29015 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:18:25.084410 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 139077us
I20260709 12:18:25.044692 29009 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:25.060818 29018 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.089308 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.082970 22750 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
W20260709 12:18:25.089811 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.095487 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.103765 29039 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.104621 29039 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:25.117205 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.115550 28859 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:18:25.122633 22750 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:25.084067 28525 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:25.077620 29004 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:18:25.129645 28812 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:18:25.129866 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 103533us
I20260709 12:18:25.130501 29030 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:25.131047 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:25.122540 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:25.124740 23493 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:25.135499 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.123109 28859 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:25.137120 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.137549 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.138499 22752 raft_consensus.cc:2393] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:25.130297 28812 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:25.045326 29024 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:25.118211 28856 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:25.157267 28856 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:25.159825 28856 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:25.160526 28716 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:25.161799 28753 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:25.133280 29034 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:18:25.148010 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:25.149434 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 108787us
I20260709 12:18:25.141126 28525 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:18:25.127035 28760 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.003s
I20260709 12:18:25.154639 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:25.155570 29046 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:25.163592 29012 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:25.166677 22751 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13.
I20260709 12:18:25.174110 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.096421 29018 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:25.154109 28812 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:25.174139 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:25.168015 28874 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:25.177325 28908 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.203795 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:25.204180 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.204447 22744 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:25.202538 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.176254 28525 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:25.168273 29037 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:25.199818 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:25.192986 28874 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.214581 28874 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:25.173815 28760 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:25.218097 29036 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.196913 28859 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:25.223543 29014 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 12:18:25.197264 28603 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:25.227075 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.194119 29012 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:18:25.239437 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 107159us
I20260709 12:18:25.242374 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:25.247301 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.248129 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.254868 29038 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:18:25.255661 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.240936 28603 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.245098 29012 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.243428 29037 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:25.263955 29040 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:25.264659 29024 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:25.265779 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.266211 29039 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:25.265832 28726 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:25.208413 28908 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:25.243065 29036 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:25.282908 28908 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:25.250188 29019 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:25.280647 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.275350 22901 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
I20260709 12:18:25.283514 29037 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:25.284251 29036 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:25.271931 29012 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:25.262218 28716 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:25.286700 28726 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:25.295316 29041 log.cc:927] Time spent T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.226s	user 0.000s	sys 0.004s
W20260709 12:18:25.296787 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 55362.2us
I20260709 12:18:25.272651 29018 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:25.298363 28760 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:25.301136 22748 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:25.250924 29014 consensus_queue.cc:1243] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:18:25.302651 28525 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:25.264681 28859 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:25.304891 28874 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:25.305390 29051 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.308248 28812 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:25.268718 28603 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:25.333173 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:42860 (request call id 1742) took 1691 ms. Trace:
I20260709 12:18:25.338061 22744 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
W20260709 12:18:25.333647 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 179150us
W20260709 12:18:25.339391 23494 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 2.000s (SENT)
W20260709 12:18:25.320631 22791 connection.cc:256] RPC call timeout handler was delayed by -1.5982749149998199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 12:18:25.349643 22791 connection.cc:256] RPC call timeout handler was delayed by -1.5271749149999323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 12:18:25.350148 22791 connection.cc:256] RPC call timeout handler was delayed by -1.5109749149999061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 12:18:25.350528 22791 connection.cc:256] RPC call timeout handler was delayed by -1.256274914999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 12:18:25.350955 22791 connection.cc:256] RPC call timeout handler was delayed by -1.1878749149998384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
W20260709 12:18:25.351330 22791 connection.cc:256] RPC call timeout handler was delayed by -1.1635749149997991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 12:18:25.351688 22791 connection.cc:256] RPC call timeout handler was delayed by -1.1176749149999523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
W20260709 12:18:25.352062 22791 connection.cc:256] RPC call timeout handler was delayed by -1.1158749149999494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 12:18:25.352424 22791 connection.cc:256] RPC call timeout handler was delayed by -1.093374914999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
W20260709 12:18:25.352808 22791 connection.cc:256] RPC call timeout handler was delayed by -1.0204749149997951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 12:18:25.319186 29046 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:25.353614 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:25.369355 28726 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:25.347034 22748 rpcz_store.cc:276] 0709 12:18:23.629693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.660353 (+ 30660us) service_pool.cc:224] Handling call
0709 12:18:23.728429 (+ 68076us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b5400679728. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf96a8aa1 00007fadf9723ebc 00007fadf975bb0c 00007fadf97471fb 00007fadf9746c85 00007fadf2ccb254 00007fadf2ccb1e2 00007fadf2ccb111 00007fadf2ccb08c 00007fadf2cca342 00007fadf2aba48c
0709 12:18:25.299737 (+1571308us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54006798d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf4776a3d 00007fadf9746cd0 00007fadf2ccb254 00007fadf2ccb1e2 00007fadf2ccb111 00007fadf2ccb08c 00007fadf2cca342 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:25.320750 (+ 21013us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862938368}
W20260709 12:18:25.373406 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.327009 28915 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:25.376336 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.367461 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.380100 23679 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 23. Current term is 24. Ops: []
I20260709 12:18:25.381791 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:25.381662 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:25.338719 28896 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:25.384454 23660 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:25.389976 23659 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 21. Current term is 22. Ops: []
I20260709 12:18:25.395264 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:25.396070 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.398943 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:25.399163 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.395517 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:25.400142 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 218705us
I20260709 12:18:25.397182 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:25.400875 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:25.402424 23674 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:25.403328 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.403918 22749 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:25.395987 23685 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:25.400029 22899 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:25.405620 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.405485 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:25.406692 23660 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:25.414592 23672 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:18:25.418128 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:25.407258 29054 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:18:25.423574 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.420579 22900 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:25.402567 29018 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:25.421324 23682 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:25.430338 22899 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 17: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:25.368219 29051 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:25.408209 28906 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:25.386763 28915 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:25.435849 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 92145.4us
I20260709 12:18:25.418622 28760 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:25.392395 28896 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:25.448710 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 47874.8us
I20260709 12:18:25.454303 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:25.456259 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.457091 22749 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
W20260709 12:18:25.458750 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 74280.7us
I20260709 12:18:25.458559 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:25.447772 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:25.462275 23656 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:25.461686 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.467749 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.453266 28760 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:25.469328 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:25.474247 22895 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:18:25.469521 23493 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:25.481678 22900 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 20 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:25.483289 28915 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:25.483975 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.484633 28874 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:25.477176 29055 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:25.477264 28906 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:25.488071 22751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 1522) took 1661 ms (client timeout 1671 ms). Trace:
I20260709 12:18:25.489096 28906 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:25.491228 28856 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:18:25.491910 29051 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:25.500160 28958 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:25.500630 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:25.500774 28958 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:25.501544 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 1367) took 1286 ms. Trace:
I20260709 12:18:25.501740 28958 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:25.502099 22896 rpcz_store.cc:276] 0709 12:18:24.214830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.227013 (+ 12183us) service_pool.cc:224] Handling call
0709 12:18:25.501316 (+1274303us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b540057add4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:25.501448 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718726016}
I20260709 12:18:25.503257 28812 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:25.461326 29063 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:18:25.478394 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.508416 29033 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.414s	user 0.003s	sys 0.000s
I20260709 12:18:25.511305 28753 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:25.511881 28753 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:25.516780 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 47305.1us
W20260709 12:18:25.488762 22751 rpcz_store.cc:269] 0709 12:18:23.826886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.828136 (+  1250us) service_pool.cc:224] Handling call
0709 12:18:23.927403 (+ 99267us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf97450a0 00007fadf9744984 00007fadf2cbf6d4 00007fadf2cbf662
0709 12:18:25.487751 (+1560348us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54004065d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:25.487943 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2586707456}
W20260709 12:18:25.524834 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 155023us
I20260709 12:18:25.518586 23493 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:25.527765 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.528759 22749 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:25.523167 28753 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:25.454473 29046 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:25.540233 28896 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:25.541145 28896 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:18:25.543335 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 76155.3us
I20260709 12:18:25.544659 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.545847 28859 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:25.475908 28760 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:25.547341 29030 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:25.547937 29030 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:25.548926 29030 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:25.550096 29030 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:25.560349 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:25.566390 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.567719 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:25.576857 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.578670 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:25.582898 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.530040 29051 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:25.491910 28856 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:25.606204 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:25.594662 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.594738 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.599745 22744 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:18:25.565184 28968 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:25.605647 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:25.609767 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 107916us
W20260709 12:18:25.610953 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 161158us
I20260709 12:18:25.584786 28812 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:25.612114 22746 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:25.615618 22749 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:25.615928 22753 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:18:25.614022 23494 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 2.107s (SENT)
I20260709 12:18:25.566517 29063 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:25.618714 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:25.621768 29069 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:25.629174 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:25.623164 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 55584.3us
I20260709 12:18:25.599853 28620 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:25.601365 29051 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:25.638969 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.639461 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.592784 28896 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:18:25.616483 28812 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.611652 29049 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:18:25.646396 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:25.631609 28620 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.638713 29051 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:25.641180 28942 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:18:25.693449 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 54048.3us
I20260709 12:18:25.662262 28620 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:25.695592 29026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.013s	sys 0.037s
W20260709 12:18:25.721873 29026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.018s	sys 0.056s
I20260709 12:18:25.724403 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.726191 28942 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:25.727380 28942 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:25.638316 29069 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:25.728482 28942 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:25.650966 28948 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:25.731613 28948 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:25.732163 28948 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:25.643672 29043 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:25.735983 29043 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:25.737038 29043 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:25.734409 28968 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:25.700248 29012 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:25.740824 22894 raft_consensus.cc:606] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.741343 22894 raft_consensus.cc:614] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:25.741955 29012 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:25.714952 22825 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:18:25.716784 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.750437 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:25.751259 22894 raft_consensus.cc:606] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:25.751425 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:25.751972 29072 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:25.752637 29072 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:25.669744 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.662706 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:25.759944 29063 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:25.760399 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.761255 22753 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:25.731802 29069 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:25.767760 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:25.768515 22748 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:18:25.715721 28885 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:25.771555 22892 raft_consensus.cc:2368] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 13.
W20260709 12:18:25.782742 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 173580us
W20260709 12:18:25.699307 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.772179 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.787665 22896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:25.788636 22896 raft_consensus.cc:606] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:25.785686 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:25.753739 28968 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:25.798467 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:25.799607 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 142149us
I20260709 12:18:25.654066 28812 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:25.807063 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:25.808576 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.657680 28603 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:25.831132 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 50476.3us
I20260709 12:18:25.785599 28861 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:25.835389 23674 raft_consensus.cc:2393] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 18: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:25.825595 22894 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:25.694402 28525 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:25.843873 22748 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 22.
W20260709 12:18:25.861377 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.876070 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:25.885262 22825 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:25.886186 22898 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:25.888777 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:25.908258 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:25.887805 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:26.001210 22900 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 22: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:25.888357 22901 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:18:25.998018 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 111115us
I20260709 12:18:25.882637 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:25.894448 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.806245 29040 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:25.897919 29076 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:18:25.798372 29056 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:25.899430 28726 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:18:25.831300 29012 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 12:18:25.894647 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:26.052891 22899 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:26.001920 22894 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:26.003922 22823 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:25.663288 28856 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:26.013605 22897 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:18:26.013797 22895 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:18:26.019773 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:26.026175 22893 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:26.021420 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:26.031850 22898 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:18:26.048730 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 50823.1us
I20260709 12:18:26.051028 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:26.061148 22822 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:26.022864 29048 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 12:18:26.069000 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.066478 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:26.036108 28753 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.505s	user 0.016s	sys 0.000s
I20260709 12:18:26.080627 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:26.023792 29028 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.084862 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:26.089892 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:25.911096 29038 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.164s
I20260709 12:18:26.090726 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:26.101577 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 98113.8us
W20260709 12:18:26.102979 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.912312 28525 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:26.030139 29040 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:26.120301 22897 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:26.052958 29056 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:26.121457 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:26.124933 28525 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:25.889521 29072 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:26.143237 28968 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:26.144589 29072 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:26.145892 22752 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:26.053078 28620 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:26.149425 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.053690 28760 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:26.152727 28760 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:26.136516 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47673.7us
I20260709 12:18:26.099923 28753 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:26.163622 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:26.120661 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.170490 22899 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:26.103404 29028 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:26.173810 29028 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:26.179015 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:26.141718 22900 raft_consensus.cc:2376] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 23. Re-sending same reply.
I20260709 12:18:26.168068 22822 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:26.157104 28726 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:18:26.184157 28726 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.184682 28726 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:26.185694 28948 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:26.187125 29080 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:26.189666 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:26.191824 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:26.193931 28525 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:18:26.195192 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.197041 29040 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:26.135048 29012 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.198295 29012 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:26.201682 29012 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:26.202479 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.202925 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:26.203629 22752 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:18:26.204347 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:26.204743 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:26.205438 22746 raft_consensus.cc:2376] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 13. Re-sending same reply.
I20260709 12:18:26.192286 28811 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:26.193081 29080 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:18:26.174593 29028 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:26.212244 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:26.223205 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:26.219732 22751 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
W20260709 12:18:26.225589 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 393930us
I20260709 12:18:26.237447 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:26.238410 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:26.239156 22899 raft_consensus.cc:2368] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 22. Current term is 23.
I20260709 12:18:26.237843 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:26.217149 28811 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:26.246698 22752 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 22: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:26.250983 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:26.252146 22748 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:26.227967 28958 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:26.258340 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:26.233490 29040 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:26.275377 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 209012us
I20260709 12:18:26.274497 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:26.276499 22745 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:26.278434 22750 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:26.255683 29075 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:26.270249 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:26.256757 29080 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:26.302150 22896 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:18:26.262319 28620 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:26.241772 28716 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:18:26.264029 28874 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:26.318532 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 53215us
I20260709 12:18:26.322451 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:26.323462 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:26.340811 22750 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:26.343976 28760 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.287740 29075 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.354216 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:26.286765 28958 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:26.291211 28603 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:26.358493 22822 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
I20260709 12:18:26.360677 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:26.363516 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:26.365003 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.366683 22824 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:26.308761 28968 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:26.374039 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:26.268505 29040 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:26.364976 29075 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:26.339712 28811 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:26.405819 22745 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
W20260709 12:18:26.408048 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 51207.8us
I20260709 12:18:26.415983 28915 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:26.417012 28915 consensus_queue.cc:1243] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:18:26.352564 28874 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:26.416471 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:26.424630 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 188408us
W20260709 12:18:26.426290 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.428704 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:26.397799 28603 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:26.365622 28760 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:26.455948 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:26.464637 22823 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:18:26.458927 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.407126 29080 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:26.476001 22825 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:26.421569 29014 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:18:26.507598 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 224516us
I20260709 12:18:26.487382 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:26.455559 28603 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.475401 28915 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.141s
I20260709 12:18:26.487660 29014 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:26.621146 29014 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:26.623225 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:26.624105 22823 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
W20260709 12:18:26.515755 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.627884 29083 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:26.629907 28856 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:26.634575 29026 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:26.635226 29026 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:26.636423 29026 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:26.638257 29026 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:26.639585 29089 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
W20260709 12:18:26.642647 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.519456 22745 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:26.581005 22822 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:26.487032 28811 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:26.579945 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 70955.4us
I20260709 12:18:26.652333 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:26.441978 29031 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:26.475953 28525 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:26.485190 28753 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:26.661650 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.589803 28885 raft_consensus.cc:993] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: : Instructing follower e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:26.643460 29056 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:26.672643 29056 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:18:26.661511 22894 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.607s	user 0.014s	sys 0.000s
W20260709 12:18:26.589444 29088 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 12:18:26.681166 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:26.619846 29030 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.069s	user 0.014s	sys 0.003s
I20260709 12:18:26.612237 28874 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:26.616418 28812 consensus_meta.cc:287] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.770s	user 0.013s	sys 0.000s
I20260709 12:18:26.667327 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:26.667551 29084 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:18:26.667403 22827 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:26.660236 29083 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:26.595836 28620 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.667723 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:26.667327 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:26.668684 29040 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:26.670183 28760 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:26.675747 22894 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:26.694413 22821 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:26.676113 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:26.696993 22823 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:26.676582 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:26.678274 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:26.642342 29080 raft_consensus.cc:2764] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 12:18:26.683665 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0277826729998196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 12:18:26.489917 28927 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:26.618505 28942 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.890s	user 0.009s	sys 0.004s
I20260709 12:18:26.652222 29014 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:26.686034 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 374743us
I20260709 12:18:26.511284 28861 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.184s
I20260709 12:18:26.654587 28603 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:26.431769 29087 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.237s
I20260709 12:18:26.656227 29031 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:26.674569 29056 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 12:18:26.699970 22717 connection.cc:256] RPC call timeout handler was delayed by -1.0196826729998065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
I20260709 12:18:26.707850 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:26.708370 22827 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:26.694311 29012 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:26.713709 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.658947 28525 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.715246 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:26.726096 22824 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:18:26.726666 22824 pending_rounds.cc:85] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 11
I20260709 12:18:26.726939 22824 pending_rounds.cc:107] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:18:26.727210 22824 raft_consensus.cc:2889] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:26.728109 29012 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:26.730527 29012 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:26.731329 28525 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:26.704958 29040 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:26.737565 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1759) took 1505 ms. Trace:
I20260709 12:18:26.738248 22747 rpcz_store.cc:276] 0709 12:18:25.232453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.232605 (+   152us) service_pool.cc:224] Handling call
0709 12:18:26.737288 (+1504683us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54004060d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:26.737480 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3353584512}
I20260709 12:18:26.716732 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:26.703372 28716 raft_consensus.cc:1081] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Signalling peer e5f99cf1fbc740e3895959adc4f3d10e to start an election
I20260709 12:18:26.748946 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:26.755543 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 46176.6us
I20260709 12:18:26.763072 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:26.758699 22895 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:26.693111 28812 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:26.717563 29031 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:26.774565 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:26.698540 28620 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:26.786475 22749 raft_consensus.cc:2368] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20.
I20260709 12:18:26.761816 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:26.760524 28942 raft_consensus.cc:2764] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:18:26.517266 28958 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:26.760304 29040 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:26.774235 28861 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.811698 28861 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:26.802747 28726 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.618s	user 0.014s	sys 0.000s
W20260709 12:18:26.812178 29086 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:18:26.813710 23674 raft_consensus.cc:1240] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:26.820981 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:26.834076 22899 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:26.835299 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:26.836218 22826 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:26.843209 28861 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:26.844902 28812 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:26.847064 29040 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:26.848613 29056 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:26.849704 29056 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:26.850075 29056 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:26.851112 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:26.850997 29056 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:26.851761 22825 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:26.852243 29056 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:26.826040 28726 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:26.857476 28726 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:26.860111 28525 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:26.862663 28525 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:26.720227 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:26.867449 29083 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:26.872596 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:26.872676 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:26.873281 29075 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:26.873656 22895 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:26.874872 29097 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:26.875473 29097 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:26.877691 29097 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:26.882380 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.885097 22826 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
W20260709 12:18:26.888918 29090 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:26.889233 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:26.890130 22894 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:26.798471 29094 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:18:26.891631 29094 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:26.892030 29094 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:26.885600 29096 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.811216 29093 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:26.888613 28927 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:26.836455 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:26.914037 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 77683.6us
I20260709 12:18:26.908586 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:26.911649 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:26.770895 29046 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:18:26.914674 22894 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:18:26.914991 23682 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:26.918174 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:26.931902 29093 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:26.932126 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:26.932695 22899 raft_consensus.cc:2410] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 21 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:18:26.932961 22752 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:18:26.933166 29093 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:26.921200 28874 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:26.935998 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:26.938097 28874 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:26.939527 28874 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:26.943421 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:26.944144 28620 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:26.912981 29051 consensus_meta.cc:287] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.149s	user 0.011s	sys 0.004s
I20260709 12:18:26.944525 22749 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:26.945398 29051 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:26.948391 28760 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:26.948611 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:26.949506 29051 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:26.950330 29051 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:26.952347 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:26.928424 29096 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:26.954643 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:26.961424 22790 leader_election.cc:400] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20.
I20260709 12:18:26.961948 22790 leader_election.cc:403] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 12:18:26.964860 22717 connection.cc:256] RPC call timeout handler was delayed by -1.1469421059998695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
I20260709 12:18:26.967293 22824 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:26.967119 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:26.967970 22825 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:26.968736 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:26.972292 22752 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:26.974114 23493 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:26.989517 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:26.969652 29038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.013s	sys 0.038s
I20260709 12:18:27.000602 22823 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:18:27.007357 29096 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:27.008947 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:27.010210 22752 raft_consensus.cc:2410] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 20 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:18:26.967398 29094 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:27.012549 29094 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:27.018910 28812 consensus_queue.cc:1175] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" responder_term: 19 status { last_received { term: 19 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 19 index: 10 } }
W20260709 12:18:26.955444 29028 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.004s
W20260709 12:18:27.039422 22865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.008s	sys 0.009s
W20260709 12:18:27.040123 22865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.009s
I20260709 12:18:26.985474 28525 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:27.023674 22791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.009s
W20260709 12:18:27.044921 22791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.006s	sys 0.010s
W20260709 12:18:27.045426 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 558091us
I20260709 12:18:26.959082 28760 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:18:27.050901 22573 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43984 (request call id 158) took 65730 ms (client timeout 15000 ms). Trace:
W20260709 12:18:27.055830 22865 connection.cc:256] RPC call timeout handler was delayed by -1.8515911249999135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 12:18:27.056576 22865 connection.cc:256] RPC call timeout handler was delayed by -1.6103911249999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
I20260709 12:18:26.957844 29051 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:27.057165 22865 connection.cc:256] RPC call timeout handler was delayed by -1.4312911249999161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 12:18:27.058048 22864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.010s	sys 0.009s
W20260709 12:18:27.058506 22864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.010s	sys 0.009s
W20260709 12:18:27.058904 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 631325us
I20260709 12:18:27.022264 22575 catalog_manager.cc:5697] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 15 to 16, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 16 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:27.000309 28948 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:18:27.048363 29038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.014s	sys 0.038s
I20260709 12:18:27.084578 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.085654 22822 raft_consensus.cc:2368] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:18:27.045051 29028 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:18:27.057770 22865 connection.cc:256] RPC call timeout handler was delayed by -1.3457911250000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 12:18:27.075742 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:27.097154 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.102600 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.064886 29051 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:27.063234 29096 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.078821 22575 catalog_manager.cc:5697] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 14 to 16, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 16 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:27.080825 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.114370 22824 raft_consensus.cc:2376] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20. Re-sending same reply.
I20260709 12:18:27.117549 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.124672 22822 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:27.128170 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:27.128964 23682 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:27.131031 23660 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:18:27.106181 28948 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 22 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:27.134718 22745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5"
dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:42860
W20260709 12:18:27.139330 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.140707 22745 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:18:27.141180 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.141395 22745 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:27.078130 22866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.004s	sys 0.017s
W20260709 12:18:27.151963 22866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.004s	sys 0.017s
W20260709 12:18:27.154006 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.143219 22575 catalog_manager.cc:5697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 14 to 18, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 18 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:27.056295 22573 rpcz_store.cc:269] 0709 12:17:21.320569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.320797 (+   228us) service_pool.cc:224] Handling call
0709 12:18:27.050802 (+65730005us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:24.839226 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:24.992436 (+153210us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:24.992512 (+    76us) write_op.cc:435] Acquired schema lock
0709 12:18:24.992555 (+    43us) tablet.cc:662] Decoding operations
0709 12:18:24.993180 (+   625us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:25.020411 (+ 27231us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:25.030102 (+  9691us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:25.083674 (+ 53572us) tablet.cc:701] Row locks acquired
0709 12:18:25.083742 (+    68us) write_op.cc:260] PREPARE: finished
0709 12:18:25.093743 (+ 10001us) write_op.cc:270] Start()
0709 12:18:25.123577 (+ 29834us) write_op.cc:276] Timestamp: P: 1783599505083923 usec, L: 0
0709 12:18:25.123616 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:18:25.129019 (+  5403us) log.cc:844] Serialized 543 byte log entry
0709 12:18:25.480964 (+351945us) op_driver.cc:464] REPLICATION: finished
0709 12:18:25.759701 (+278737us) write_op.cc:301] APPLY: starting
0709 12:18:25.759795 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:25.766260 (+  6465us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:25.766373 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:25.788041 (+ 21668us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:25.788232 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:18:25.788279 (+    47us) write_op.cc:312] APPLY: finished
0709 12:18:25.788526 (+   247us) log.cc:844] Serialized 24 byte log entry
0709 12:18:25.788747 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:25.788857 (+   110us) write_op.cc:454] Released schema lock
0709 12:18:25.788912 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:25.797692 (+  8780us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:25.797738 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":93024,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":278456,"apply.run_cpu_time_us":4001,"apply.run_wall_time_us":29638,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8311,"num_ops":1,"prepare.queue_time_us":126742,"prepare.run_cpu_time_us":24603,"prepare.run_wall_time_us":361142,"raft.queue_time_us":178979,"raft.run_cpu_time_us":12457,"raft.run_wall_time_us":123691,"replication_time_us":357147,"thread_start_us":392448,"threads_started":4,"wal-append.queue_time_us":122588,"wal-append.run_cpu_time_us":44992,"wal-append.run_wall_time_us":1833746}]]}
W20260709 12:18:27.160913 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.161482 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 63588.9us
I20260709 12:18:27.161957 22575 catalog_manager.cc:5697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 12 to 18, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 18 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:27.063880 29031 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:27.132524 28906 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.006s	sys 0.068s
I20260709 12:18:27.156816 22825 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:27.165110 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:27.168581 22826 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:27.166258 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:27.169391 23660 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 24: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:27.155927 28861 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.172170 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:27.172976 22822 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:27.135401 29046 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.169116 22575 catalog_manager.cc:5697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 9 to 14, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 14 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:27.186832 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.159008 29075 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:27.167722 28906 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.007s	sys 0.068s
W20260709 12:18:27.190184 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 127855us
I20260709 12:18:27.195709 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:27.202070 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.133482 29096 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:27.170222 29026 consensus_queue.cc:1059] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:18:27.221100 22822 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:27.225176 22745 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:27.235913 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:27.237075 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:27.238624 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 272927us
I20260709 12:18:27.238740 22825 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 12:18:27.231714 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 345045us
I20260709 12:18:27.240111 22575 catalog_manager.cc:5697] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:27.249818 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:27.250862 23682 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 22: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:27.251212 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:27.252678 23660 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:18:27.253134 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:27.252749 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:27.254827 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:27.255595 23672 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:27.158118 28760 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:27.255367 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:27.185711 28861 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:27.267148 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:27.269471 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:27.298110 23695 raft_consensus.cc:2393] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 22: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:27.298923 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:27.279048 22575 catalog_manager.cc:5697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 14 to 15, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 15 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:27.280351 23685 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:27.213826 29030 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:18:27.267190 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:27.300427 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 63517.4us
I20260709 12:18:27.190948 29046 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:27.213439 29100 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:27.293322 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.273895 22826 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:18:27.237957 28942 raft_consensus.cc:476] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Not starting pre-election -- already a leader
I20260709 12:18:27.300900 23674 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:27.335907 22745 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:27.259773 28812 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.260809 29026 consensus_queue.cc:1243] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:27.308589 23672 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:27.308808 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:27.291023 29038 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:27.348533 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47240.7us
W20260709 12:18:27.314715 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.339582 23656 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:18:27.358301 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 111723us
I20260709 12:18:27.351960 22575 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:27.311393 22820 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:18:27.307657 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:27.302754 29028 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:27.239573 28948 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:27.375850 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:27.380788 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.337002 29095 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:18:27.384717 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.396029 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 88489.4us
I20260709 12:18:27.397274 23494 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:27.398479 29087 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:27.399009 29087 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.399402 29087 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:27.382632 28885 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:27.400966 29108 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:18:27.400759 28885 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:27.334605 28620 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:18:27.399367 29099 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:18:27.403492 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.407166 23685 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:27.363435 29103 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:27.424886 22820 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:27.448271 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:27.449625 22575 catalog_manager.cc:5697] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 10 to 16, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 16 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:27.362323 28812 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:27.454166 22575 catalog_manager.cc:5697] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:27.344285 29100 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:27.410190 29099 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.423725 29043 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.499118 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:27.501852 22826 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:27.371484 29038 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:27.479748 28874 consensus_queue.cc:1059] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:18:27.511911 28885 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:27.513175 22575 catalog_manager.cc:5697] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
W20260709 12:18:27.523808 29105 log.cc:927] Time spent T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 12:18:27.467206 29031 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:27.544283 29046 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:27.551442 28861 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:27.552927 29080 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:27.565304 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 292394us
I20260709 12:18:27.541082 29040 raft_consensus.cc:3055] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:27.597309 29040 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:27.597184 29080 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:27.598529 29040 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:27.501199 29095 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:27.492050 29099 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:27.592471 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.600956 22825 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:27.601858 29080 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:27.602802 28603 consensus_meta.cc:287] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.846s	user 0.011s	sys 0.003s
I20260709 12:18:27.604789 22826 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:27.617194 22575 catalog_manager.cc:5697] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 4 to 15, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 15 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:27.624003 22575 catalog_manager.cc:5697] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 11 to 14, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 14 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:27.638931 22826 raft_consensus.cc:1240] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:18:27.649946 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1507) took 1183 ms. Trace:
I20260709 12:18:27.563494 29043 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:27.651561 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 243592us
I20260709 12:18:27.650583 22818 rpcz_store.cc:276] 0709 12:18:26.456842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.457034 (+   192us) service_pool.cc:224] Handling call
0709 12:18:26.487299 (+ 30265us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:27.046853 (+559554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.046892 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:27.063028 (+ 16136us) log.cc:844] Serialized 52 byte log entry
0709 12:18:27.349808 (+286780us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:27.638342 (+288534us) log.cc:844] Serialized 14 byte log entry
0709 12:18:27.639637 (+  1295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.639759 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.639814 (+    55us) raft_consensus.cc:1685] finished
0709 12:18:27.639832 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.640046 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":199757,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":29028,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":903040,"threads_started":3,"wal-append.queue_time_us":434061}
I20260709 12:18:27.659226 29028 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:27.658650 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.636381 29014 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.927s	user 0.016s	sys 0.001s
W20260709 12:18:27.666337 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.627278 29092 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.669430 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1560) took 1432 ms. Trace:
I20260709 12:18:27.675393 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.606444 29046 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
W20260709 12:18:27.703888 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 276240us
W20260709 12:18:27.705636 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.621321 28603 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:27.684466 22746 rpcz_store.cc:276] 0709 12:18:26.236732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.236858 (+   126us) service_pool.cc:224] Handling call
0709 12:18:26.251582 (+ 14724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.457897 (+206315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.457946 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.493820 (+ 35874us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.050220 (+556400us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:27.050282 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.054098 (+  3816us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.669099 (+615001us) raft_consensus.cc:1685] finished
0709 12:18:27.669130 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.669344 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2201,"raft.queue_time_us":28888,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":13494,"thread_start_us":618545,"threads_started":2,"wal-append.queue_time_us":572932}
W20260709 12:18:27.715945 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.723197 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 120707us
I20260709 12:18:27.725152 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.726347 22820 raft_consensus.cc:2410] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:18:27.690097 28958 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:27.717345 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.727557 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:27.743242 22827 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
I20260709 12:18:27.669773 29087 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:27.703383 28768 raft_consensus.cc:3055] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:18:27.739202 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.744287 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.744262 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 73744.2us
I20260709 12:18:27.688692 29096 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:27.758178 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:27.758047 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 100653us
W20260709 12:18:27.760097 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.723094 28968 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:18:27.723335 29139 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.697959 29092 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:27.723548 29131 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.760176 22820 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:27.769342 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:27.770341 22898 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:27.773407 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:27.775665 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:27.777678 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.778411 22820 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:27.756670 28768 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:27.781247 23494 leader_election.cc:336] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.553s (SENT)
I20260709 12:18:27.781875 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:27.783766 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 59568.6us
I20260709 12:18:27.741967 29101 consensus_queue.cc:1059] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:18:27.787807 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:27.788600 22899 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:27.790256 29101 raft_consensus.cc:3055] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:27.775768 29131 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:27.791647 29123 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:18:27.754594 28958 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:27.793210 28760 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:27.794709 29100 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:27.795267 28958 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:27.770256 29139 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:27.797551 29040 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:27.799605 29139 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:27.808226 29092 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:27.808811 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.809341 28768 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:27.810716 29043 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:27.766201 29028 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:27.811172 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.811509 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:27.808841 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:27.812278 29038 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:27.813200 28812 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:27.814158 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.815433 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:27.810725 28768 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:27.780035 29075 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:27.818017 29075 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.818658 29075 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:27.820345 29117 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:18:27.823113 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.825621 22826 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:27.823264 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.826372 22822 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
W20260709 12:18:27.836544 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.822247 22827 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:27.840297 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:27.841066 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:27.844051 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.836246 29101 raft_consensus.cc:740] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:27.850327 29112 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.446s	user 0.001s	sys 0.005s
I20260709 12:18:27.850561 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.852217 22821 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:27.853904 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:27.857287 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:27.858007 22895 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:27.859923 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:27.862412 22820 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:27.865833 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:27.866729 22745 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:27.855561 29099 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:27.869194 29133 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.869443 28874 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:27.875440 22899 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:27.879994 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:27.879999 29133 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:27.881693 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 97038.4us
W20260709 12:18:27.884382 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 103185us
I20260709 12:18:27.885221 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:27.851300 29101 consensus_queue.cc:260] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:27.889036 22827 raft_consensus.cc:2410] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:18:27.895015 29101 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:27.889601 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:27.873944 29124 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:18:27.893698 29133 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:27.898455 22820 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:27.856634 28948 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.871941 29092 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:27.844157 29103 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:18:27.910909 22827 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:27.891271 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:27.912343 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:27.913527 22748 raft_consensus.cc:2410] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:18:27.913874 29099 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:27.912343 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:27.919498 22753 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:18:27.929553 22826 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:27.918802 29125 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:18:27.931653 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.910521 28948 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:27.932658 28603 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:27.906172 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.941758 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50622.1us
I20260709 12:18:27.942848 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:27.943756 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:27.944123 29131 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:27.944705 22717 leader_election.cc:400] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 22. Current term is 23.
W20260709 12:18:27.906172 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 60971.9us
I20260709 12:18:27.909876 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.946043 22820 raft_consensus.cc:2368] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17.
I20260709 12:18:27.947021 29125 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:27.941828 28948 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:27.949913 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:27.952025 22898 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
I20260709 12:18:27.952813 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:27.945139 22717 leader_election.cc:403] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:18:27.923679 22750 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:27.958089 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:27.958141 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:27.968024 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.974112 22818 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:27.961373 22895 raft_consensus.cc:2410] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 12:18:27.924010 29094 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.909s	user 0.018s	sys 0.000s
W20260709 12:18:27.924362 29051 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.791s	user 0.016s	sys 0.000s
I20260709 12:18:27.979256 22827 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:27.979722 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:27.942694 28525 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.888s	user 0.016s	sys 0.000s
I20260709 12:18:27.986025 29144 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:18:27.986765 28948 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:28.002270 28948 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.002740 28948 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:27.979266 29092 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 22. Current term is 23.
W20260709 12:18:27.995350 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50777.7us
I20260709 12:18:28.008020 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:28.009200 29092 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:28.009646 29075 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:28.012028 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:27.967692 29143 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:28.019824 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:28.023921 22823 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:28.019889 29125 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:28.030936 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.031356 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.032855 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:28.033481 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:27.997408 22745 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:28.034678 22820 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:28.035761 23493 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:28.000198 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.015336 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:28.016513 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:28.037354 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 57726.1us
I20260709 12:18:28.017027 28525 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20.
I20260709 12:18:27.996423 29087 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:28.017409 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.018935 22824 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:28.039508 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.020964 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:28.034283 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:28.045763 22819 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:28.043210 28874 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:18:28.052935 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 295037us
I20260709 12:18:28.055756 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.048576 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:28.056115 22825 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:28.057637 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.012050 29075 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:28.066957 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.062332 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:28.050181 29099 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:28.049558 29126 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:28.069705 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:28.073613 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.053149 29140 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:28.057737 28874 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.018847 29051 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:28.069708 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.060220 29093 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:28.047827 29040 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:18:28.079342 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.068087 29091 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:28.070222 28885 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:18:28.056370 29028 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:18:28.055016 28768 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:18:28.071978 29139 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:28.135780 28874 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:28.124594 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45355.6us
I20260709 12:18:28.085047 29075 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:18:28.077876 29140 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:28.072336 29144 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:28.144922 29043 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:18:28.153288 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.177276 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.083359 29046 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:28.183534 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:28.146812 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 77168.8us
I20260709 12:18:28.189697 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:28.194909 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 117633us
I20260709 12:18:28.197093 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.121068 29099 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:28.144984 29134 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.185684 29139 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:28.123296 28948 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:28.171614 29097 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:28.084510 28968 consensus_queue.cc:1059] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 12:18:28.190385 22819 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:28.197335 22824 raft_consensus.cc:2376] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15. Re-sending same reply.
I20260709 12:18:28.200412 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:28.136453 29132 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.188759 29140 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:28.226388 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.195643 29043 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.209785 29134 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:28.249276 22823 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
W20260709 12:18:28.232677 23494 leader_election.cc:336] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 2.038s (SENT)
I20260709 12:18:28.233762 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:28.250386 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.228993 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.206241 29099 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:28.239037 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:28.260380 22749 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:18:28.241912 23672 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:18:28.207047 28885 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:28.247115 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:28.261934 22899 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:28.212567 29139 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:28.238369 29144 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:28.232622 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:28.271626 22894 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:28.193954 29028 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:28.238123 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:28.254603 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.257392 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.257779 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:28.218142 29093 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:28.249195 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:28.305923 23682 raft_consensus.cc:2410] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:18:28.263245 29046 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:28.315869 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:28.317662 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 85037.8us
W20260709 12:18:28.319710 23494 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 2.859s (SENT)
W20260709 12:18:28.273633 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.286245 22825 raft_consensus.cc:2393] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 14: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:28.287391 22818 raft_consensus.cc:2410] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:18:28.245728 23695 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:28.295785 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:28.230063 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.286521 23660 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:28.285367 22826 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:28.246325 29043 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:28.315730 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.237689 29132 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:28.309959 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 112187us
I20260709 12:18:28.265189 28885 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.325517 22819 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
W20260709 12:18:28.323769 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.337220 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:28.303928 29075 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:18:28.338661 29093 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:28.340022 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:28.340730 22896 raft_consensus.cc:2376] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19. Re-sending same reply.
I20260709 12:18:28.342177 22897 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:18:28.331843 22899 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:28.339156 29091 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:28.333813 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:28.349931 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:28.351725 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:28.311177 29040 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:28.356134 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:28.356588 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.343057 29046 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:28.368229 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.371462 22819 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:28.372124 22819 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:28.333706 29103 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.345534 28885 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:28.309597 29157 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 12:18:28.377262 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:28.380712 22824 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:28.351540 29091 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:28.377751 23672 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: []
W20260709 12:18:28.382583 22717 connection.cc:256] RPC call timeout handler was delayed by -1.2931935849999263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 12:18:28.382951 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.384069 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.388837 22823 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
W20260709 12:18:28.388023 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 68359.3us
I20260709 12:18:28.391260 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.392307 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:28.395516 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.396713 22818 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:28.401830 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:28.379333 29051 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:28.403038 23682 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:28.377655 28942 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:28.407435 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.408624 22825 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:28.386695 28768 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:18:28.411435 29075 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:28.373131 22819 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:28.414870 22819 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:28.420710 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:28.428654 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:28.373946 29092 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:28.375177 29144 raft_consensus.cc:2764] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:18:28.376881 29165 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:28.452500 29156 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:18:28.466698 22824 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:28.435808 29101 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:28.381345 29103 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:28.386324 29026 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:18:28.478075 22819 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 12:18:28.478629 22819 pending_rounds.cc:85] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 10
I20260709 12:18:28.478966 22819 pending_rounds.cc:107] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:18:28.479244 22819 raft_consensus.cc:2889] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:28.446729 28768 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:28.480044 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:28.482599 22826 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:28.486706 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:28.488884 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.490628 22819 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:28.494031 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:28.492950 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:28.496562 22898 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:28.475603 29101 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:28.484442 28768 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:28.487008 29107 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:28.521018 23660 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
I20260709 12:18:28.465155 29165 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:28.493321 28948 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:28.512633 29151 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:18:28.511600 29101 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:28.454566 29028 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:28.532454 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.555787 22819 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:28.524057 29107 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:28.536429 29139 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:28.512104 29133 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:28.539525 22898 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:28.542346 29162 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:28.543550 29158 raft_consensus.cc:3055] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:28.551069 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:28.551779 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:28.552477 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:28.595517 22824 raft_consensus.cc:2376] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20. Re-sending same reply.
I20260709 12:18:28.517859 28768 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:28.574043 22826 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:28.598841 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.600575 22824 raft_consensus.cc:2376] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18. Re-sending same reply.
I20260709 12:18:28.603549 29168 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:28.605613 29168 consensus_queue.cc:1059] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:28.610508 22745 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:28.612704 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.613744 22824 raft_consensus.cc:2410] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:18:28.596526 29133 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:28.626437 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.627377 22824 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
I20260709 12:18:28.628831 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.629639 22824 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:18:28.631424 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 239134us
I20260709 12:18:28.632674 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.634433 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.587482 29132 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:28.542474 29091 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:28.597376 29158 raft_consensus.cc:740] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:28.600312 29163 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.584333 28874 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:28.665522 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.658883 22824 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:18:28.670675 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:28.679108 22746 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:28.607071 28968 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:18:28.636623 29030 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:28.696676 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.684728 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:28.698606 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.697803 22819 raft_consensus.cc:2376] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20. Re-sending same reply.
I20260709 12:18:28.664247 29134 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:28.599951 29162 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:28.703593 22892 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
W20260709 12:18:28.731935 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 97623.4us
W20260709 12:18:28.731860 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 133717us
I20260709 12:18:28.674070 29126 raft_consensus.cc:3055] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:28.736450 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:28.736563 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.744948 22824 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:28.745456 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:28.746304 22899 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:28.749251 22896 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:28.751732 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:28.752985 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:28.753850 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.757423 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:28.759111 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.761247 22819 raft_consensus.cc:2410] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:18:28.763878 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:28.761876 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:28.765091 22900 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:28.766189 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:28.769912 22821 raft_consensus.cc:1240] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:18:28.770834 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:28.762020 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:28.773471 23672 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:28.776259 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:28.777258 22826 raft_consensus.cc:2376] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18. Re-sending same reply.
W20260709 12:18:28.752913 29125 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.004s
I20260709 12:18:28.740134 29161 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:28.798075 23682 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 20. Current term is 21. Ops: [18.12-20.13]
I20260709 12:18:28.738538 29126 raft_consensus.cc:740] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:28.739760 29030 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:28.795951 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:28.797169 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 47373.6us
W20260709 12:18:28.797096 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51057.5us
I20260709 12:18:28.672748 29163 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:28.753150 28968 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:28.812512 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:28.816341 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:28.816720 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.816900 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:28.713145 29043 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:28.824337 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:28.824985 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.757987 29134 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:18:28.800071 29125 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:28.832630 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:28.798296 29161 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:28.709921 29158 consensus_queue.cc:260] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:28.841382 22895 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:28.839268 29133 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:28.819360 28968 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.814340 29099 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.816377 29031 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:28.855882 29158 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:28.854022 29174 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:28.858604 29125 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:28.858883 29174 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.859156 29125 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:28.859292 29174 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:28.860255 29125 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:28.856083 29099 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:28.865212 29099 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:28.870262 29162 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:28.846204 28968 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:28.894392 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.844444 29165 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:28.909348 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:28.829604 29172 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 12:18:28.917672 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:28.925899 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 114840us
I20260709 12:18:28.917927 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:28.927019 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.927419 22899 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:28.917984 22894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:28.924326 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:28.928226 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.928536 22894 raft_consensus.cc:606] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.929066 22894 raft_consensus.cc:614] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:28.936358 22791 connection.cc:256] RPC call timeout handler was delayed by -2.1058031100001244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 12:18:28.937191 22791 connection.cc:256] RPC call timeout handler was delayed by -1.9807031100001495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 12:18:28.937609 22791 connection.cc:256] RPC call timeout handler was delayed by -1.920403110000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 12:18:28.938019 22791 connection.cc:256] RPC call timeout handler was delayed by -1.6738031100001081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 12:18:28.938407 22791 connection.cc:256] RPC call timeout handler was delayed by -1.5739031100001739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260709 12:18:28.874858 29139 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:28.939203 22791 connection.cc:256] RPC call timeout handler was delayed by -1.5712031100001695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 12:18:28.942263 22791 connection.cc:256] RPC call timeout handler was delayed by -1.4830031100000269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 12:18:28.943553 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:28.940748 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.946764 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:28.947275 22897 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 22.
I20260709 12:18:28.858198 29031 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:28.947754 22791 connection.cc:256] RPC call timeout handler was delayed by -1.4506031099999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2264s for a response
I20260709 12:18:28.938936 28942 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:28.958596 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 126080us
I20260709 12:18:28.962608 23689 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:18:28.958087 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.939543 28874 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:28.968613 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:28.964829 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.970220 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.972414 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:28.950567 29134 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:28.955137 29181 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.984843 23695 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:28.985262 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:28.986033 22821 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:28.987389 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:28.990182 22897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:28.992605 22897 raft_consensus.cc:606] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.993024 22897 raft_consensus.cc:614] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:28.993883 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:28.994629 22819 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:28.857254 29126 consensus_queue.cc:260] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:28.982434 22823 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:28.954977 29179 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:28.979069 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:28.990679 23659 raft_consensus.cc:1275] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:28.974473 29133 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:18:28.975487 22717 leader_election.cc:336] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.072s (SENT)
I20260709 12:18:29.009557 22826 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:18:28.983080 29030 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:28.990854 23682 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 21: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:28.954085 29101 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:28.978749 29144 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:28.997540 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:29.020781 23674 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:28.998400 23695 raft_consensus.cc:1275] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:18:29.009546 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:28.986884 28525 raft_consensus.cc:2764] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:18:29.016979 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.022589 23659 raft_consensus.cc:2393] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 17: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:29.023563 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.029130 23679 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:18:29.030543 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.041070 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:29.041942 22819 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
W20260709 12:18:29.044982 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 69523.7us
I20260709 12:18:29.017120 29075 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.052965 22892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:29.053946 22892 raft_consensus.cc:606] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.035117 29126 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:29.029146 29163 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:29.059239 29133 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:29.042624 29179 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:18:29.065454 29179 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:29.065999 29179 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:29.067559 29175 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:18:29.069031 29178 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:29.069674 29178 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:29.070161 29178 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:28.963595 29161 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:29.044027 29030 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:28.990706 29181 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:29.040529 28942 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:29.059218 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:29.081696 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 58250.5us
I20260709 12:18:29.081929 22821 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:29.082600 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:29.055245 22892 raft_consensus.cc:614] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:29.087534 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:29.089023 22819 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:29.032194 29171 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:29.052475 29162 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:29.100811 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.090880 29133 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:29.106837 22826 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:18:29.108985 22826 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:29.113416 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:29.115463 22822 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:29.118435 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:29.120751 23682 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:29.057525 29075 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.182749 22892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:29.183843 22892 raft_consensus.cc:606] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Received request to transfer leadership to TS a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:29.110446 29133 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:18:29.208770 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.099486 29139 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:18:29.224449 29139 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:29.117086 29162 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.129518 29031 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:29.235272 29101 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:29.248543 29190 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:18:29.116228 29179 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.251017 29181 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:29.233829 29183 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:18:29.243453 29075 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:29.227005 29189 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:29.305281 29189 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:29.306710 29189 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:29.259625 29161 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:29.260107 22892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e"
dest_uuid: "2c3a0d56045540b7802937559599f09c"
mode: GRACEFUL
new_leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
 from {username='slave'} at 127.0.0.1:46530
I20260709 12:18:29.311748 22892 raft_consensus.cc:606] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Received request to transfer leadership to TS e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.211071 28874 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:29.263070 28768 consensus_meta.cc:287] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.636s	user 0.012s	sys 0.004s
I20260709 12:18:29.263533 29171 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:29.242534 29187 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:29.241644 28968 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:29.241160 29166 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.716s	user 0.000s	sys 0.006s
I20260709 12:18:29.209931 29028 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:29.263800 28885 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.870s	user 0.007s	sys 0.007s
W20260709 12:18:29.279464 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.267233 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 152743us
I20260709 12:18:29.315637 28874 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:29.337136 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 306661us
I20260709 12:18:29.339778 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:18:29.332224 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.334116 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.344015 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.324898 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:29.329690 28768 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:29.366921 22901 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:29.363847 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:29.319123 29187 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:29.362972 29101 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:29.371047 29093 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.380198 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:29.372416 29174 consensus_meta.cc:287] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.005s
I20260709 12:18:29.372711 29193 consensus_queue.cc:1048] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:29.373847 29188 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:29.329427 29168 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:29.378885 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:29.367012 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 266235us
I20260709 12:18:29.371323 29134 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:29.382014 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:29.382232 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.392154 22894 raft_consensus.cc:2368] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 14.
I20260709 12:18:29.383306 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:29.383585 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.394903 22899 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:29.385569 29030 consensus_queue.cc:1048] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:18:29.396184 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.378264 29101 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.397006 22899 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:29.397181 29101 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:29.384666 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.401499 22900 raft_consensus.cc:2368] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16.
I20260709 12:18:29.403281 22900 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:29.403791 28968 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:29.404635 29199 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:18:29.385632 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.405834 22897 raft_consensus.cc:2376] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18. Re-sending same reply.
I20260709 12:18:29.378204 29187 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:29.393641 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.408041 28874 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:29.334652 29028 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.407774 22894 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:29.410674 29028 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:29.371099 29165 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:29.411906 29165 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:29.410713 22900 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:18:29.412021 22897 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:29.335358 28885 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:29.414592 29140 consensus_meta.cc:287] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.166s	user 0.011s	sys 0.005s
I20260709 12:18:29.390537 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.415144 29140 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:29.415619 28885 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:29.420277 22750 raft_consensus.cc:1240] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:29.388772 29093 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:29.424394 29093 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:29.426036 28768 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:29.426270 28603 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.413374 29162 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:29.416213 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1798) took 1069 ms. Trace:
I20260709 12:18:29.426842 28603 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:29.427052 22745 rpcz_store.cc:276] 0709 12:18:28.346975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.347855 (+   880us) service_pool.cc:224] Handling call
0709 12:18:28.364343 (+ 16488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:28.611051 (+246708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.415807 (+804756us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400413054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:29.416112 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565674880}
I20260709 12:18:29.420171 29158 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:18:29.428879 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:29.429616 28603 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:29.429781 22821 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:29.388998 29174 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:29.433200 29185 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.393s	user 0.004s	sys 0.007s
I20260709 12:18:29.433518 29174 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:29.417317 29140 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:29.394927 29168 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.439620 29107 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:29.440013 29168 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:29.412892 29165 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:29.418660 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:29.443125 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 53797.3us
I20260709 12:18:29.444891 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.419140 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:29.447701 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:29.448383 23656 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:29.450464 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:29.450819 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:29.451761 23679 raft_consensus.cc:2393] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:29.444975 23695 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 24.
I20260709 12:18:29.452630 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:29.451646 23672 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:29.457556 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:29.453454 29100 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:18:29.460687 29150 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:29.461134 29150 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:29.453850 29179 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:29.464463 29043 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:29.469449 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1319) took 1095 ms. Trace:
I20260709 12:18:29.469973 29199 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:29.469924 23689 rpcz_store.cc:276] 0709 12:18:28.373526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.374077 (+   551us) service_pool.cc:224] Handling call
0709 12:18:28.387806 (+ 13729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.963221 (+575415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.469113 (+505892us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400706f54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:29.469352 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321091968}
W20260709 12:18:29.473973 29191 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.394s	user 0.000s	sys 0.002s
I20260709 12:18:29.470433 29199 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:29.475660 29199 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.477272 29199 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:29.393597 29178 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:29.479245 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:29.480751 29162 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:29.481130 29162 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:29.481487 29162 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:29.484781 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.485455 22894 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
W20260709 12:18:29.491557 29170 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.693s	user 0.002s	sys 0.000s
I20260709 12:18:29.493125 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1800) took 1145 ms. Trace:
I20260709 12:18:29.493709 22751 rpcz_store.cc:276] 0709 12:18:28.347677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.347856 (+   179us) service_pool.cc:224] Handling call
0709 12:18:28.348378 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.361852 (+ 13474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.361901 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.392507 (+ 30606us) spinlock_profiling.cc:243] Waited 973 us on lock 0x7b2c000c1488. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:18:28.443635 (+ 51128us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.625344 (+181709us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:28.625393 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.625464 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.490718 (+865254us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:18:29.492797 (+  2079us) raft_consensus.cc:1685] finished
0709 12:18:29.492822 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.493038 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13869,"raft.queue_time_us":22881,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":13269,"spinlock_wait_cycles":10850816,"thread_start_us":122166,"threads_started":1,"wal-append.queue_time_us":236872}
I20260709 12:18:29.463430 29101 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.500176 22898 raft_consensus.cc:2368] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18.
I20260709 12:18:29.501950 29101 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:29.462059 29150 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:29.502473 23494 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.503350 29150 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:29.504330 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:29.506597 29096 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:29.507448 29096 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:29.506508 22895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40028 (request call id 1415) took 1307 ms (client timeout 1731 ms). Trace:
W20260709 12:18:29.508520 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.506667 22893 raft_consensus.cc:1240] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:29.509081 23494 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:29.508751 22895 rpcz_store.cc:269] 0709 12:18:28.199684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.199973 (+   289us) service_pool.cc:224] Handling call
0709 12:18:29.506247 (+1306274us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540057e9d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:29.506437 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435032960}
I20260709 12:18:29.511796 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.513047 29178 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:29.513583 29051 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:29.514168 29051 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:29.515110 29051 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:29.517958 29187 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:29.507980 29096 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:29.518379 28906 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:29.519942 23656 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:29.524281 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:29.532351 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:29.533073 22895 raft_consensus.cc:2376] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18. Re-sending same reply.
I20260709 12:18:29.533579 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:29.551424 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:29.557490 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46369.5us
I20260709 12:18:29.557845 22751 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 18: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:29.558941 23494 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.559372 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:29.560411 22744 raft_consensus.cc:2410] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 17 because replica has last-logged OpId of term: 16 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
I20260709 12:18:29.560518 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:29.559612 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1801) took 1140 ms. Trace:
I20260709 12:18:29.561138 22748 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 13.
I20260709 12:18:29.561293 22750 rpcz_store.cc:276] 0709 12:18:28.419299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.419564 (+   265us) service_pool.cc:224] Handling call
0709 12:18:28.420129 (+   565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.420782 (+1000653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.559371 (+138589us) spinlock_profiling.cc:243] Waited 1e+03 ms on lock 0x7b54004047d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:29.559558 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2299548544}
I20260709 12:18:29.569268 22894 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:18:29.570968 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:29.570184 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46105.4us
I20260709 12:18:29.535899 29103 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:29.588317 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.597339 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:29.598105 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:29.572289 29099 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:29.600894 22899 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:29.601761 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:29.598187 23656 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 21: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:29.584101 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:29.602423 22753 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:29.604703 22894 raft_consensus.cc:2393] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:29.604743 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.573827 28906 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:29.576294 29046 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:18:29.600134 23494 connection.cc:256] RPC call timeout handler was delayed by -1.0553496669999731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 12:18:29.615540 23494 connection.cc:256] RPC call timeout handler was delayed by -1.0427496669999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
W20260709 12:18:29.615806 23494 connection.cc:256] RPC call timeout handler was delayed by -1.0319496669999353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 12:18:29.616269 23494 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 2.872s (SENT) [suppressed 38 similar messages]
I20260709 12:18:29.613590 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.619726 22899 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:29.556865 29125 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:18:29.637254 22897 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 12:18:29.642956 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.656705 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.617993 29103 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:29.668323 22899 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
W20260709 12:18:29.682813 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.634488 29099 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:29.634078 29046 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:29.652094 29187 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:29.669411 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.666513 29178 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:29.668965 29173 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.855s	user 0.004s	sys 0.001s
I20260709 12:18:29.662583 29125 consensus_queue.cc:1243] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 24.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:18:29.706743 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.708222 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.623644 28958 consensus_queue.cc:1059] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:18:29.671334 29103 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:29.718391 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 102144us
I20260709 12:18:29.734205 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:29.735626 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:29.725210 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55958.4us
I20260709 12:18:29.731302 22746 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:18:29.739009 29100 raft_consensus.cc:3055] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:29.739521 29100 raft_consensus.cc:740] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:29.740368 29100 consensus_queue.cc:260] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:29.741680 29100 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:29.743366 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:29.744307 22900 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:29.744980 29162 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.736121 29103 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:29.750420 29097 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:29.731218 29178 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.751236 29097 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.745585 22900 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:29.752949 29178 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:29.753659 29097 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:29.755823 22717 leader_election.cc:400] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 12 pre-election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 12. Current term is 14.
I20260709 12:18:29.761673 22753 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:29.763797 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:29.731245 28768 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:29.775282 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:29.776774 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:29.778837 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:29.780027 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:29.780691 22894 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:29.781750 22745 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:18:29.782245 22745 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:29.782721 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:29.783435 22744 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:29.737867 29094 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.779804 29179 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:29.787803 29179 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:29.788792 29179 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.785907 29051 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:18:29.790910 29094 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:29.795938 22749 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:29.796698 22717 leader_election.cc:400] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16.
W20260709 12:18:29.797704 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.799176 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:29.799180 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:29.787833 29217 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:18:29.797683 22745 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.785840 29125 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:29.786089 29158 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:29.803614 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:29.808212 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.809569 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.811553 22744 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:29.807588 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:29.814581 22717 leader_election.cc:400] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18.
I20260709 12:18:29.823035 22894 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
W20260709 12:18:29.819866 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.802465 28906 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:29.841506 22717 leader_election.cc:403] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:18:29.805079 29162 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:29.796432 29096 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.804929 29158 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:29.801790 29131 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:18:29.814908 29187 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:29.814252 28958 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:18:29.860208 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 495040us
I20260709 12:18:29.795948 29099 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:29.860595 23659 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:18:29.861222 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:29.861497 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:29.864509 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 474030us
I20260709 12:18:29.867806 23679 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 14.
W20260709 12:18:29.866626 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 52183us
I20260709 12:18:29.815546 29134 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:29.871268 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:29.873991 29208 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:29.862443 29158 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:29.876101 22749 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:29.807369 29172 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:18:29.813853 29178 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 12:18:29.878597 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 79499.6us
W20260709 12:18:29.875213 29222 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:18:29.880923 23493 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:29.871762 28958 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.875592 29162 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18.
I20260709 12:18:29.894547 23494 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.813088 29199 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:18:29.891848 29040 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:18:29.890815 29133 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.899240 29096 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:29.903395 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.904827 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:29.906016 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:29.927279 22821 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:29.927489 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:29.866812 29187 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.875855 29134 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.877310 29094 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:29.884083 29189 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:18:29.803014 29046 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:29.911741 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:29.919114 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:29.877656 29125 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:18:29.979171 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:29.980039 22825 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:29.925074 22818 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 19. Current term is 20. Ops: [18.10-19.11]
I20260709 12:18:29.982971 23689 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:29.904780 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:29.986536 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:29.987304 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 82619.2us
I20260709 12:18:29.932152 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.936316 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:29.928332 22827 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:29.931115 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48515.2us
I20260709 12:18:29.936092 29051 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:29.942618 22791 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:29.946360 23493 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:29.949522 22821 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
I20260709 12:18:29.937000 29133 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:29.957556 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:29.952216 29026 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:29.907979 28958 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:29.920183 28603 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:29.926206 28525 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.936825 29107 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:18:29.964483 29162 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.929566 28874 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:18:29.969241 29165 raft_consensus.cc:993] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: : Instructing follower a89a4b420ea9496aab55475fc38bb6f7 to start an election
W20260709 12:18:29.889230 29216 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:18:29.987377 22818 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:29.888566 29194 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:29.917265 29224 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:18:29.993791 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 47633.2us
I20260709 12:18:29.923962 29157 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:18:29.969753 29134 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:29.970333 29187 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:30.003937 28603 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.971493 29181 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:18:30.005559 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 73619.1us
I20260709 12:18:30.007934 29131 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:30.069408 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:30.003525 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 61014.1us
I20260709 12:18:29.967088 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:30.010385 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:29.923583 29028 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:18:30.035806 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:30.012244 28525 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:30.037031 22825 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
I20260709 12:18:30.038187 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:29.990974 29040 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:30.045883 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1777) took 1684 ms. Trace:
I20260709 12:18:29.993429 29199 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:30.055100 22824 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:30.056609 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:30.062285 29206 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:30.003523 29026 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:29.977962 29130 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:18:30.013461 29171 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:18:30.044509 29222 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:18:30.105235 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1422) took 1626 ms. Trace:
I20260709 12:18:30.059682 22818 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:30.107887 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:30.067229 28603 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:30.072041 22821 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:30.093473 22865 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:30.093621 23689 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:30.071710 22826 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
I20260709 12:18:30.054476 29165 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:30.098440 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:30.072207 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:30.046401 29012 raft_consensus.cc:1081] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Signalling peer a89a4b420ea9496aab55475fc38bb6f7 to start an election
I20260709 12:18:30.091892 22893 rpcz_store.cc:276] 0709 12:18:28.333466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.333642 (+   176us) service_pool.cc:224] Handling call
0709 12:18:29.506435 (+1172793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.511449 (+  5014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.017637 (+506188us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540057e9d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:30.017815 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2648924928}
I20260709 12:18:30.105880 22901 rpcz_store.cc:276] 0709 12:18:28.478903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.479158 (+   255us) service_pool.cc:224] Handling call
0709 12:18:28.479502 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.375809 (+896307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.104906 (+729097us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54004ec854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:30.105158 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040361856}
W20260709 12:18:30.125547 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 54747.9us
I20260709 12:18:30.069578 29131 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.017676 29162 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:30.052982 29194 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:30.128805 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56679.5us
I20260709 12:18:30.097187 29075 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:30.095681 29206 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:30.129606 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:30.128837 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:30.072597 29181 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:30.094460 29099 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:30.137197 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:30.104893 29171 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:30.140859 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:30.159265 23672 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:30.143836 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:30.160887 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:30.147764 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:30.140434 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:30.157289 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 169015us
I20260709 12:18:30.155220 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:30.162839 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.164880 22821 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:30.168572 22818 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:30.117344 29199 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:30.179543 22894 raft_consensus.cc:2393] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:30.167444 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:30.136601 29131 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:30.186678 22752 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:30.151827 29232 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:18:30.175773 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:30.195972 22893 raft_consensus.cc:2410] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:18:30.157966 29181 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:30.150461 29132 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:30.182614 29178 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:30.149187 29040 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:18:30.188660 29096 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:30.129391 29165 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:30.158286 29150 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:30.221210 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:30.182737 28906 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:30.178648 29171 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:30.190166 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:30.198760 29097 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:30.235436 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:30.158692 29103 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:30.215523 29012 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.261276 29096 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:30.222153 29196 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:30.299202 22752 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:30.251405 29178 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:30.297853 22746 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:30.227558 29132 raft_consensus.cc:697] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:30.348196 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 127084us
I20260709 12:18:30.192240 29026 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:30.254961 29133 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:30.310981 29051 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:18:30.341153 29183 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:18:30.317934 29188 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.230109 29206 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:30.340606 29196 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:30.381044 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.304086 22827 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:30.360344 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:18:30.371369 29228 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:18:30.389340 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 199258us
I20260709 12:18:30.316454 29099 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:30.408476 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:30.390373 29231 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.327s	user 0.002s	sys 0.000s
W20260709 12:18:30.390758 29235 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.140s	user 0.002s	sys 0.000s
I20260709 12:18:30.339439 29012 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:30.369750 29154 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 12:18:30.456419 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 96179.5us
W20260709 12:18:30.407610 29208 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.006s
I20260709 12:18:30.469266 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:30.394084 29133 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.446648 29196 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:30.335911 29199 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:30.406762 29026 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:30.514626 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45493.8us
I20260709 12:18:30.563434 29051 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:30.561761 29133 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:30.469651 28906 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:18:30.604895 29247 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:18:30.605161 29165 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:30.454159 29236 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:30.595893 23689 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:30.569347 29097 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:30.639909 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:30.570179 28525 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:30.559773 29208 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:30.405404 29188 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:30.464380 29099 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:30.656679 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:30.455965 29096 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:30.626991 29230 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.450s	user 0.000s	sys 0.002s
I20260709 12:18:30.597231 29162 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:30.607120 29194 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:30.613735 28906 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:30.628497 29097 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:30.683867 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:30.608810 29051 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:30.516364 29132 consensus_queue.cc:237] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:30.670331 28525 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.689617 28906 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:30.590183 29178 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:30.692070 29097 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:30.689958 29162 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.703995 29091 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:30.709677 29194 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:18:30.724030 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 276521us
I20260709 12:18:30.739674 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:30.730062 22819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.012s	sys 0.014s
W20260709 12:18:30.742758 22819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.012s	sys 0.015s
I20260709 12:18:30.717907 28525 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:30.753402 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 96830.7us
I20260709 12:18:30.729274 29103 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:30.754720 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:30.758529 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:30.747027 29237 log.cc:927] Time spent T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.292s	user 0.001s	sys 0.001s
W20260709 12:18:30.749698 29243 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.353s	user 0.002s	sys 0.000s
I20260709 12:18:30.724529 29162 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:30.742547 29046 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:18:30.759121 29012 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:30.805864 22823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.013s	sys 0.012s
W20260709 12:18:30.809738 22823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.013s	sys 0.013s
W20260709 12:18:30.803361 29227 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.439s	user 0.002s	sys 0.000s
W20260709 12:18:30.808732 29134 consensus_meta.cc:287] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.746s	user 0.015s	sys 0.000s
W20260709 12:18:30.827056 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 111918us
W20260709 12:18:30.829413 22818 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.011s	sys 0.007s
W20260709 12:18:30.829855 22818 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.011s	sys 0.007s
I20260709 12:18:30.828094 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:30.831707 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:30.837374 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:30.843008 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:30.832405 29250 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:18:30.853566 29240 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.255s	user 0.002s	sys 0.000s
I20260709 12:18:30.843961 29188 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:30.855443 29248 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:30.856135 29255 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:18:30.856667 29239 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.213s	user 0.000s	sys 0.002s
W20260709 12:18:30.864382 29253 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:18:30.867213 29244 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:30.867786 29051 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:30.876503 29255 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:30.894578 29255 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:30.891968 29248 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:30.899479 29241 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:18:30.833139 29134 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:30.901328 29043 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:30.901897 29043 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:30.903167 29134 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:30.903899 29043 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:30.871142 23493 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:30.843587 29133 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:30.881559 29187 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.789s	user 0.004s	sys 0.006s
I20260709 12:18:30.905710 29187 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:30.909173 29206 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:30.912941 29256 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:30.913466 29171 consensus_meta.cc:287] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.002s
I20260709 12:18:30.899039 29248 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:30.917654 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:30.868124 29162 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:30.916196 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:30.918511 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 75614.2us
I20260709 12:18:30.918635 22821 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:30.919531 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:30.920908 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:30.921268 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:30.853652 29266 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:18:30.924325 29158 consensus_meta.cc:287] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.024s	user 0.014s	sys 0.002s
I20260709 12:18:30.930706 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:30.933607 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:30.933817 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:30.939493 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:30.925936 29043 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:18:30.923002 29131 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.004s
I20260709 12:18:30.877465 29099 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:30.941360 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:30.948777 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:30.931735 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:30.927587 29199 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:30.945030 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:30.946116 22893 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:30.946518 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:30.913926 29256 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:30.914017 29171 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:30.928846 29107 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:30.949064 22819 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:30.880746 29194 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:18:30.951457 28525 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:30.952571 22823 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:30.926980 29172 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
W20260709 12:18:30.950680 29181 consensus_meta.cc:287] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.005s
W20260709 12:18:30.959487 28603 consensus_meta.cc:287] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.817s	user 0.006s	sys 0.009s
I20260709 12:18:30.979347 22824 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:30.991254 28603 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:30.949556 29043 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:30.987509 29267 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:18:30.998378 22819 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:30.935391 29158 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:30.953824 29199 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:30.987231 28958 consensus_meta.cc:287] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.970s	user 0.009s	sys 0.005s
I20260709 12:18:30.957655 29012 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:30.983197 29242 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:31.021941 29252 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:31.022332 28603 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:31.006595 29101 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.023801 29101 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.026055 29101 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:30.977804 29107 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:31.016297 29199 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.027029 29257 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.027776 29257 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:30.950908 29131 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:31.027084 29107 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:31.030112 29257 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:31.033429 29131 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:31.027489 29043 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.035272 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:30.960930 29194 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:31.040845 22818 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:31.004136 29187 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:31.047551 22744 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:31.062995 22819 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:31.049250 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:31.067973 22897 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:31.048189 29194 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:31.000296 29181 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.040421 28958 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.087322 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:31.087786 22819 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:31.050663 29266 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.089718 22899 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:18:31.088303 22895 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:31.095083 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:31.095899 22899 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:31.099133 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:31.099879 22899 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:31.102176 22895 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:31.102808 22826 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:31.105860 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:31.106832 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:31.108448 29199 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.098479 29266 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.115646 29256 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:31.117019 28958 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:31.117844 29266 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:31.118927 22823 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:31.120103 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:31.120585 22892 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:31.120921 22895 raft_consensus.cc:2368] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15.
I20260709 12:18:31.121951 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:31.123701 22897 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:18:31.085899 29187 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:31.121284 29179 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.131922 29179 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.133422 29181 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:31.128037 29103 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:31.135330 29103 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:31.135852 29103 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:31.129218 29236 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:18:31.135332 29097 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.140275 22745 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:31.141347 29097 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:31.144483 22900 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:18:31.149971 22823 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:31.111781 29199 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.154008 22717 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:31.169582 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:31.172744 22745 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 12:18:31.173283 22745 pending_rounds.cc:85] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 12
I20260709 12:18:31.173498 22745 pending_rounds.cc:107] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 12:18:31.173714 22745 raft_consensus.cc:2889] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:31.174435 29174 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 12:18:31.175285 22819 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:18:31.177003 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1604) took 1411 ms. Trace:
I20260709 12:18:31.177536 22745 rpcz_store.cc:276] 0709 12:18:29.765294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.765468 (+   174us) service_pool.cc:224] Handling call
0709 12:18:29.781601 (+ 16133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.139741 (+1358140us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b58006323d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf46db0aa 00007fadf475d447 00007fadf4775fe7 00007fadf47777de 00007fadf4781b49 00007fadf4782416 00007fadf477ed8f 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4
0709 12:18:31.174218 (+ 34477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.176933 (+  2715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2547624320}
I20260709 12:18:31.187872 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:31.192806 22899 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:31.194624 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:31.195521 22818 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:31.143882 29255 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:31.103335 28906 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.184321 29181 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.183622 29252 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:31.129621 29168 consensus_queue.cc:1059] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
W20260709 12:18:31.202629 29196 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.628s	user 0.014s	sys 0.000s
I20260709 12:18:31.143666 29187 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:31.239609 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51832.9us
I20260709 12:18:31.239107 29181 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:31.248467 29277 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:18:31.241029 29171 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:31.195574 29199 raft_consensus.cc:2764] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:18:31.284157 28906 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:31.203433 29043 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:31.188045 29236 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:18:31.293962 22827 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 12:18:31.303591 22717 leader_election.cc:400] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15.
I20260709 12:18:31.317837 22827 pending_rounds.cc:85] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 12
I20260709 12:18:31.317961 22717 leader_election.cc:403] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:18:31.318419 22827 pending_rounds.cc:107] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:18:31.309494 29255 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:31.311188 29158 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.364256 29103 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.318770 22827 raft_consensus.cc:2889] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:31.302000 29107 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:31.366892 29171 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.367516 29171 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.367604 29194 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.369328 29187 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.304948 29161 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 12:18:31.304703 29275 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.100s	user 0.001s	sys 0.001s
I20260709 12:18:31.370775 29168 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:31.319267 29043 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.371731 29168 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.373631 29043 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:31.305820 29196 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.356617 29199 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:31.374935 29199 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.376585 29196 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.377143 29199 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.356834 29248 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:31.378484 29103 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.300760 29125 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:31.379276 29125 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.368528 29107 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:31.291858 29189 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:31.379964 29194 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.380155 29189 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.318807 29251 raft_consensus.cc:3055] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:31.292297 29157 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:31.377687 22820 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:18:31.379712 29125 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:31.382614 29157 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.382345 29251 raft_consensus.cc:740] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:31.384786 29157 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:31.300065 29206 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:31.385680 29206 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.385074 29181 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:31.387701 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1534) took 1483 ms. Trace:
I20260709 12:18:31.387909 29206 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:31.384136 29251 consensus_queue.cc:260] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.374660 29168 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:31.388149 22822 rpcz_store.cc:276] 0709 12:18:29.903822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.904022 (+   200us) service_pool.cc:224] Handling call
0709 12:18:29.904405 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:30.187578 (+283173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:30.187612 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:30.188263 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.311333 (+123070us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:30.311383 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.387290 (+1075907us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54005523d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:31.387342 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.387393 (+    51us) raft_consensus.cc:1685] finished
0709 12:18:31.387407 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.387639 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650480512,"thread_start_us":79241,"threads_started":1,"wal-append.queue_time_us":176728}
I20260709 12:18:31.405125 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:31.406085 22822 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:31.389470 29251 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:31.382469 29189 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.422299 29181 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:31.423307 29181 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.428510 29181 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.430292 29171 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.445137 22820 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:18:31.449383 22822 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
W20260709 12:18:31.450910 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 149897us
I20260709 12:18:31.451049 22865 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:31.453567 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:31.458905 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:31.460040 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:31.460739 22899 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:31.460611 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:31.462649 22819 raft_consensus.cc:1240] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:31.463006 22822 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:31.464607 22821 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:31.465726 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:31.454242 28768 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:31.471855 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:31.472880 22893 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:31.467958 29157 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:31.483026 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:31.471043 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:31.484337 22894 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:31.457013 29189 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:31.486331 22822 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 23.
I20260709 12:18:31.453437 29091 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:18:31.485510 29092 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.492703 29092 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:31.500262 29189 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:31.500861 29092 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:31.483767 29157 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.486537 28768 raft_consensus.cc:697] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:31.504043 28768 consensus_queue.cc:237] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.510921 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:31.501610 29189 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.519997 22894 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 23.
I20260709 12:18:31.491998 29174 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:31.523573 29092 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:18:31.546005 22790 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:31.547708 22896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56306 (request call id 1528) took 1407 ms (client timeout 1589 ms). Trace:
W20260709 12:18:31.548353 22896 rpcz_store.cc:269] 0709 12:18:30.140283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.147466 (+  7183us) service_pool.cc:224] Handling call
0709 12:18:31.538595 (+1391129us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54004ec854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:31.547604 (+  9009us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072553728}
W20260709 12:18:31.549674 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 54083.8us
I20260709 12:18:31.550007 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:31.551280 22896 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:31.526949 29174 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.604547 22893 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
W20260709 12:18:31.608254 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 57396.2us
W20260709 12:18:31.609330 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 854621us
I20260709 12:18:31.613049 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:31.560563 29174 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:31.554895 29093 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:31.551132 29289 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.554319 29171 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:31.558637 29162 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:31.630266 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 759162us
I20260709 12:18:31.618412 29093 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:31.636229 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:31.637019 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:31.637590 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:31.714150 22749 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:31.714656 22752 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:31.714874 23659 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:31.719569 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.729519 22746 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:31.646729 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:31.730882 22745 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:31.651599 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.652207 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.651793 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.732630 23672 raft_consensus.cc:2410] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:18:31.750653 23695 raft_consensus.cc:2393] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 22: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:31.751986 23656 raft_consensus.cc:2393] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 21: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:18:31.624966 29247 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:18:31.753255 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.753929 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.776520 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.749856 29096 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:31.764015 29199 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:31.640100 29051 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.132s
I20260709 12:18:31.765915 29157 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.644138 29091 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:31.627089 29289 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.644658 29028 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:31.770639 29248 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15.
I20260709 12:18:31.772596 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1611) took 1959 ms. Trace:
I20260709 12:18:31.774107 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1541) took 1663 ms. Trace:
I20260709 12:18:31.625171 29171 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.777382 23674 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:31.618625 29261 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:18:31.774595 29150 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:31.629626 29187 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:31.630220 29154 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:31.791335 22892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1778) took 2404 ms (client timeout 2114 ms). Trace:
I20260709 12:18:31.713400 29026 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.789307 29205 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:31.796566 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:31.839600 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:31.840283 23672 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:31.800832 22827 rpcz_store.cc:276] 0709 12:18:30.111039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.448179 (+337140us) service_pool.cc:224] Handling call
0709 12:18:30.472805 (+ 24626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.366385 (+893580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.773820 (+407435us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b5400301954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:31.774030 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875013888}
I20260709 12:18:31.799989 22744 rpcz_store.cc:276] 0709 12:18:29.813489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.813626 (+   137us) service_pool.cc:224] Handling call
0709 12:18:29.813978 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.066861 (+1252883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.772304 (+705443us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54005bb8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:31.772511 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2836417920}
I20260709 12:18:31.842315 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.834751 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:31.832135 29187 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.846274 29187 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:31.631903 29295 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.171s
I20260709 12:18:31.633183 29162 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:31.829131 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1474) took 1887 ms. Trace:
W20260709 12:18:31.830631 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 217626us
I20260709 12:18:31.876426 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:31.829876 22892 rpcz_store.cc:269] 0709 12:18:29.378183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.378375 (+   192us) service_pool.cc:224] Handling call
0709 12:18:31.781557 (+2403182us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540057bcd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:31.781719 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3961806720}
I20260709 12:18:31.796546 22745 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:31.878258 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:31.878715 28958 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.879480 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:31.834405 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.805424 29171 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:31.880204 22745 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:31.880985 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:31.881304 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.881992 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:31.842478 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:31.843938 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:31.827097 29096 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:31.808736 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:31.847997 23659 raft_consensus.cc:2393] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 14: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:31.840610 29097 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.849188 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:31.849704 29099 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:31.813839 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:31.791069 29125 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.851052 29242 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:31.853619 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:31.854591 29094 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:31.855652 29208 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.856714 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.857681 23672 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:31.876377 28603 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:31.879276 28958 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.807245 29157 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:31.836077 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.804441 29261 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:31.922767 29261 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:31.922560 29157 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.872252 23685 rpcz_store.cc:276] 0709 12:18:29.941797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.966134 (+ 24337us) service_pool.cc:224] Handling call
0709 12:18:29.975676 (+  9542us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:29.978249 (+  2573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.978285 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:30.007680 (+ 29395us) log.cc:844] Serialized 52 byte log entry
0709 12:18:30.260452 (+252772us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:30.608717 (+348265us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.671423 (+ 62706us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.559741 (+888318us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b18002d5b60. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf1694a40 00007fadf168f4e4 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287 00007fadf479a208
0709 12:18:31.803427 (+243686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.803518 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.828804 (+ 25286us) raft_consensus.cc:1685] finished
0709 12:18:31.828840 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.829047 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39595,"prepare.queue_time_us":375446,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":113,"raft.queue_time_us":1894990,"raft.run_cpu_time_us":536,"raft.run_wall_time_us":50264,"spinlock_wait_cycles":4474112,"thread_start_us":765414,"threads_started":4,"wal-append.queue_time_us":654233}
I20260709 12:18:31.882758 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.926400 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:31.926550 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.927796 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.927865 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:31.929255 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.792902 29199 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:31.931147 29298 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.931877 29298 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.904644 29242 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:31.891108 29234 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.938926 29199 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:31.930431 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.939517 22897 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:18:31.939117 29234 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:31.940188 23685 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 16: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:31.898386 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:31.897183 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:31.942687 22895 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:31.944083 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:31.946136 22900 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:18:31.901072 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:31.873485 29205 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.947460 22894 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:31.947763 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.948763 22894 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:31.948822 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.949548 29205 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.949774 23659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152"
dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
 from {username='slave'} at 127.0.0.1:45650
I20260709 12:18:31.871722 29260 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:31.801963 29091 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.903839 29130 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:18:31.950977 29260 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:31.951926 29130 consensus_queue.cc:1243] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:18:31.952533 29130 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:18:31.952617 29091 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:31.892278 23689 raft_consensus.cc:2368] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15.
I20260709 12:18:31.952998 29130 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:31.953878 29130 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.954149 23689 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:18:31.911667 28885 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:18:31.857400 29026 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.890184 23682 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:18:31.911206 29087 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:31.892098 29131 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:18:31.960232 29087 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:31.960722 28958 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:31.916337 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:31.961941 23656 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 23.
I20260709 12:18:31.954154 29260 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:31.960781 29087 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:31.918176 29208 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.919837 29289 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:31.832715 29150 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.921056 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:31.925275 29157 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:31.850178 29154 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:31.940693 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:31.958546 29026 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:31.904763 28906 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.906601 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:31.902609 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 49083.6us
I20260709 12:18:31.917505 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:31.990403 22746 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:31.969551 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:31.958072 29096 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.942276 29234 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:31.970463 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 243180us
I20260709 12:18:31.827050 29093 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:31.972988 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:32.007655 23674 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:31.974107 22751 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:31.905230 29097 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:31.972709 22895 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
W20260709 12:18:31.974351 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 353497us
I20260709 12:18:31.981247 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:32.012933 22901 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:31.904006 29099 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:32.015473 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:32.013463 22717 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:32.016700 22827 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:31.973934 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:31.983661 22898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1801) took 2244 ms. Trace:
I20260709 12:18:31.992257 29130 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:31.886804 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:31.991070 23493 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:32.020471 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:31.934717 29298 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:31.970666 29028 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:32.024396 29300 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:32.025177 29300 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:31.993767 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:31.998265 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:32.007141 29026 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:31.999054 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:31.998672 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:32.031387 22822 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:31.999678 22818 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: [18.12-20.13]
I20260709 12:18:32.002492 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.032826 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:31.998610 22819 raft_consensus.cc:1240] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:18:31.996618 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:32.005134 22820 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:18:31.973769 29199 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:31.950393 23659 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:32.040645 23659 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:31.981956 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1783) took 2004 ms. Trace:
I20260709 12:18:32.017760 22898 rpcz_store.cc:276] 0709 12:18:29.732750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.733108 (+   358us) service_pool.cc:224] Handling call
0709 12:18:31.781764 (+2048656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.797495 (+ 15731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:31.797547 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:31.797616 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:31.797667 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.797763 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.976498 (+178735us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b540057bcd0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:31.976673 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15641,"raft.queue_time_us":15848,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":6169,"spinlock_wait_cycles":4710466432}
I20260709 12:18:32.041266 22826 rpcz_store.cc:276] 0709 12:18:29.977564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.158204 (+180640us) service_pool.cc:224] Handling call
0709 12:18:30.197801 (+ 39597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.103435 (+905634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.981556 (+878121us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b5400301454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:31.981868 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080627584}
I20260709 12:18:31.942325 29261 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:31.996343 28906 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:32.059420 23695 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 25: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:32.059767 29261 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:32.060786 29125 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:31.981918 29094 consensus_queue.cc:1175] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2c3a0d56045540b7802937559599f09c" responder_term: 22 status { last_received { term: 18 index: 11 } last_committed_idx: 11 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:32.061738 22745 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:32.063107 22790 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:32.063337 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:32.063994 29260 raft_consensus.cc:2804] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:32.064527 29260 raft_consensus.cc:697] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:32.029560 29263 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:18:32.065850 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:32.025700 29300 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:32.067003 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.067826 22745 raft_consensus.cc:2393] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:32.068850 29234 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:31.994606 22744 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:18:32.071738 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.071907 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:32.072309 29099 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.027855 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:32.044219 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 47724.2us
I20260709 12:18:32.045262 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.045871 28885 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:32.046203 29150 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.047420 29162 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.049139 29097 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:32.049630 29178 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:32.021565 29093 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:32.054381 29302 raft_consensus.cc:2804] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:32.019297 29299 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:18:32.018072 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 44227.1us
I20260709 12:18:32.057148 29208 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:32.065392 29260 consensus_queue.cc:237] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:32.101987 23674 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:18:32.066679 22897 raft_consensus.cc:3060] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:32.072548 22744 raft_consensus.cc:2393] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:32.021087 23493 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:32.075886 22864 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:32.076503 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:32.106019 22819 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:32.077370 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:32.077705 22746 raft_consensus.cc:2410] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 18 because replica has last-logged OpId of term: 16 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
W20260709 12:18:32.043067 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 49409.6us
I20260709 12:18:32.107954 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:32.108302 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:32.036055 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:32.078301 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.111354 22822 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:32.073622 29256 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:32.082170 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:32.082599 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:32.119314 22900 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:32.083448 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.120026 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:32.120946 22898 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:32.122068 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:32.122848 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.123749 22751 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:32.095402 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:32.136034 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.137061 22745 raft_consensus.cc:2410] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:18:32.086043 22901 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:32.087329 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:32.088831 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:32.142388 22827 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:32.142911 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:32.066931 29263 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:32.095928 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:32.073652 29289 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:32.146975 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 125944us
I20260709 12:18:32.147440 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:32.148711 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:32.149267 22822 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: []
W20260709 12:18:32.150653 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 74887.9us
I20260709 12:18:32.151463 22864 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:32.125420 22790 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:32.152635 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:32.153373 22752 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:32.152547 22717 leader_election.cc:400] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15.
I20260709 12:18:32.154069 22717 leader_election.cc:403] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:18:32.158102 22898 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:32.158563 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.158882 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:32.159548 22744 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 15: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:32.159583 22895 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:32.161085 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:32.161322 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:32.147769 23493 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:32.163245 22892 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:32.176656 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.176015 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.179349 22744 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
I20260709 12:18:32.177850 22746 raft_consensus.cc:2410] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 18 because replica has last-logged OpId of term: 16 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
W20260709 12:18:32.213214 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:32.227638 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 75297.5us
I20260709 12:18:32.080293 29199 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:32.148384 28885 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.160089 29100 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.175848 29091 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:18:32.183019 29099 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:32.182916 29303 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:32.234423 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 139158us
W20260709 12:18:32.232971 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.227255 29178 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:32.156873 29150 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:32.237689 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:32.286850 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50365.5us
I20260709 12:18:32.288944 29256 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:32.288018 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:32.291859 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:32.293110 29301 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:32.294324 29301 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:32.294867 29301 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:32.296456 29242 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:32.299412 29256 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:32.300154 29256 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:32.300786 29256 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:32.242684 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:32.228713 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:32.303969 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:32.151340 29263 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:32.160286 29026 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.229983 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:32.181085 29299 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:32.188572 29205 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:32.176170 29043 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:32.231794 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:32.256278 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.258351 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:32.228600 29187 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 14. Current term is 15.
I20260709 12:18:32.146377 29302 raft_consensus.cc:697] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:32.236893 29298 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:32.262955 22898 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:32.279274 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:32.157099 28958 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 12:18:32.231070 29295 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.283936 29303 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:32.284668 29199 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:32.175858 29208 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:32.314162 22897 raft_consensus.cc:2468] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:32.306197 22895 raft_consensus.cc:2393] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 21: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:32.310681 22827 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:32.180380 29289 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:32.315325 22900 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 23.
I20260709 12:18:32.326288 29248 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:18:32.278147 29171 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:32.260813 29100 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:32.325137 22819 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:18:32.307686 23659 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:32.236699 29261 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:18:32.251753 29162 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
W20260709 12:18:32.370242 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 91110.3us
I20260709 12:18:32.304148 29099 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:32.255440 28885 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:32.321960 22753 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.008s	sys 0.011s
I20260709 12:18:32.254845 29307 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.118s
W20260709 12:18:32.255754 29174 consensus_meta.cc:287] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.004s
I20260709 12:18:32.329226 29299 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:32.443359 22827 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:32.446650 23685 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 21. Current term is 23. Ops: []
I20260709 12:18:32.360090 29172 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.396697 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:32.456245 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.323698 29026 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:32.464299 22753 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.008s	sys 0.011s
W20260709 12:18:32.465000 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 393133us
I20260709 12:18:32.485594 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:32.387123 29199 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:32.396000 29051 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:32.498390 29051 consensus_queue.cc:1059] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:32.500715 29154 raft_consensus.cc:3055] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:32.501036 28885 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.501267 29154 raft_consensus.cc:740] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:32.503466 29099 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:32.508945 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:32.510275 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:32.512059 22901 raft_consensus.cc:1275] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:32.513485 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:32.513768 29087 consensus_meta.cc:287] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.000s
W20260709 12:18:32.516381 29310 log.cc:927] Time spent T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:18:32.516598 29125 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:32.517011 29125 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:32.476123 23659 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:32.518932 23674 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:32.388434 29248 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:32.495981 29299 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:32.483287 29174 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:32.497054 29199 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:32.384608 29242 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:32.514271 29087 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:32.380393 29187 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 12:18:32.468261 29234 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:32.521773 22791 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:32.526705 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:32.540025 23674 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
I20260709 12:18:32.540584 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:32.477903 29261 consensus_queue.cc:1243] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:32.506557 28906 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.381825 29295 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:32.546928 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:32.527323 29248 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:32.520360 29179 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.485787 29300 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:32.559360 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:32.539505 29234 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:32.568773 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:32.455235 29263 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:32.571000 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 336790us
W20260709 12:18:32.577184 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.577189 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:32.492472 29172 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:32.537894 29178 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:32.562628 29162 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.578358 23659 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:32.585788 23674 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
W20260709 12:18:32.580582 23660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.014s	sys 0.009s
I20260709 12:18:32.521062 29125 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:32.552942 23679 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:32.571748 29316 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:32.594632 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:32.602901 23659 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:18:32.572736 29234 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:32.608711 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.623905 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1481) took 2376 ms. Trace:
I20260709 12:18:32.624428 23659 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:32.629855 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:32.652644 29314 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:18:32.533272 29302 consensus_queue.cc:237] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:32.654474 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.612937 29263 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:32.624362 23660 rpcz_store.cc:276] 0709 12:18:30.231134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.232164 (+  1030us) service_pool.cc:224] Handling call
0709 12:18:30.232502 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.232766 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:18:30.724886 (+492120us) log.cc:844] Serialized 14 byte log entry
0709 12:18:32.074459 (+1349573us) log.cc:844] Serialized 14 byte log entry
0709 12:18:32.607572 (+533113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:32.607626 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:32.607669 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.607764 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.607895 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":830582,"prepare.queue_time_us":628296,"prepare.run_cpu_time_us":178,"prepare.run_wall_time_us":41473,"raft.queue_time_us":857848,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":37224,"thread_start_us":1488437,"threads_started":5,"wal-append.queue_time_us":118385,"wal-append.run_cpu_time_us":2712,"wal-append.run_wall_time_us":1171713}
W20260709 12:18:32.592298 28603 consensus_queue.cc:1175] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2c3a0d56045540b7802937559599f09c" responder_term: 18 status { last_received { term: 18 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 18 index: 9 } }
I20260709 12:18:32.657207 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:32.666103 23660 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:18:32.664848 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 417682us
I20260709 12:18:32.668865 23679 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:32.670027 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:32.581681 29179 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:18:32.553210 29154 consensus_queue.cc:260] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:32.606565 29307 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:32.681917 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.663801 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:32.686468 23659 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:32.692581 23660 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:32.693260 23660 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:32.703547 29174 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.705415 29303 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:32.662264 29318 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:32.712894 29199 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.668671 29171 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:32.714372 29171 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:32.715699 29315 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:18:32.663923 28906 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.716495 28906 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:32.683229 28874 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:32.717550 28874 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.718058 28874 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:32.677111 23679 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 22. Current term is 23. Ops: []
I20260709 12:18:32.724464 29087 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.728309 29295 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:32.730050 29300 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.702924 29178 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:32.715353 29171 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:32.605326 29162 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:32.741686 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:32.761439 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:32.767434 22818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.005s	sys 0.008s
W20260709 12:18:32.767973 22818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.005s	sys 0.008s
I20260709 12:18:32.780712 22747 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
W20260709 12:18:32.784682 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.789516 29199 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:32.791579 29187 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:32.795681 29187 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:32.794121 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 272391us
I20260709 12:18:32.799573 29187 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:32.808624 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 313986us
I20260709 12:18:32.691524 29307 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:32.790448 29260 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.815366 29295 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:32.826187 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:32.826179 29026 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.850144 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:32.865221 29332 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:32.868384 29307 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:32.837965 29187 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:32.846967 29093 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.700s	user 0.003s	sys 0.009s
I20260709 12:18:32.835394 29330 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:18:32.839792 29295 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.829910 29161 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:18:32.841532 29099 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.880782 29248 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:32.958379 22749 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:18:32.988516 22748 raft_consensus.cc:2410] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:18:32.895488 23689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45634 (request call id 1519) took 1043 ms. Trace:
I20260709 12:18:32.966717 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:32.990769 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 120250us
I20260709 12:18:32.991720 23689 rpcz_store.cc:276] 0709 12:18:31.851668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.955376 (+103708us) service_pool.cc:224] Handling call
0709 12:18:31.955779 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.041269 (+ 85490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.041306 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:32.041357 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:32.041392 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.895085 (+853693us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b540073cb54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:32.895175 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.895409 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196060928}
I20260709 12:18:32.937968 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:32.972625 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:32.997977 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:32.871320 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 45281.3us
I20260709 12:18:32.833864 29260 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:33.010581 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:33.013123 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.022634 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:33.024077 22898 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:33.026373 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:33.027457 22896 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:33.028898 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:33.013305 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:32.900916 29130 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.864s	user 0.005s	sys 0.006s
W20260709 12:18:32.877955 29256 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.002s
W20260709 12:18:32.892524 29301 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.000s
I20260709 12:18:32.888465 29172 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:33.015825 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:33.016834 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:33.055275 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:33.056350 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:32.887334 29162 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:32.919803 29157 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:33.044601 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:32.987226 29295 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:32.920080 29339 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.058076 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:33.063303 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 47596.6us
I20260709 12:18:33.064766 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:33.006151 29302 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:33.074363 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1583) took 1265 ms. Trace:
I20260709 12:18:33.075376 22894 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:18:33.089393 22894 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:33.087072 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:33.083102 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:33.053282 29337 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:18:33.087319 22826 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:32.966203 29099 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:33.092410 22894 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:32.869872 29331 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.234s
I20260709 12:18:33.088860 22750 rpcz_store.cc:276] 0709 12:18:31.809482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.810180 (+   698us) service_pool.cc:224] Handling call
0709 12:18:31.810572 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.847098 (+ 36526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:31.847135 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:31.847185 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:31.847217 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.074086 (+1226869us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54001e8cd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:33.074140 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.074295 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83441408}
W20260709 12:18:33.079001 29208 consensus_meta.cc:287] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.003s
I20260709 12:18:33.095872 22822 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:18:33.084553 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:33.099802 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.107314 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:33.101428 22894 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:18:33.079118 29171 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:33.071352 29256 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:33.032963 29094 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:18:33.036556 29330 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:18:33.108542 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 309960us
I20260709 12:18:33.079921 29093 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:33.146126 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:33.041364 29096 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:18:33.075052 29157 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:33.041668 29332 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:18:33.160120 29332 consensus_queue.cc:1243] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:18:33.128798 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:33.131940 22822 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 24. Current term is 25. Ops: []
I20260709 12:18:33.084189 29338 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:33.136417 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:33.084923 29307 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:33.071137 29301 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:33.150952 22826 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:33.100749 29317 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:33.174878 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:33.175196 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:33.127326 29208 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:33.116820 29302 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:33.183007 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:33.160710 29332 raft_consensus.cc:3055] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:33.234719 22826 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:33.178625 29094 consensus_queue.cc:1243] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer 2c3a0d56045540b7802937559599f09c log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:18:33.095625 29339 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:33.258368 22894 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
I20260709 12:18:33.156162 29178 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:33.129868 29040 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:33.161239 29350 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:33.144826 29093 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:33.297519 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 122420us
I20260709 12:18:33.167049 29157 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:33.234532 29234 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.002s
I20260709 12:18:33.361068 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:33.161073 29356 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:33.166298 29162 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:33.227614 29332 raft_consensus.cc:740] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:33.223464 29317 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:33.353856 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:33.354665 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:33.364996 23656 raft_consensus.cc:1240] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 24. Current term is 25. Ops: []
I20260709 12:18:33.296753 29161 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:33.208485 29307 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:33.381304 23695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45634 (request call id 1518) took 1513 ms. Trace:
W20260709 12:18:33.353655 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 207606us
I20260709 12:18:33.399327 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:33.401209 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:33.398715 23695 rpcz_store.cc:276] 0709 12:18:31.851317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.927627 (+ 76310us) service_pool.cc:224] Handling call
0709 12:18:33.364514 (+1436887us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540073b9d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:33.364691 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300102400}
I20260709 12:18:33.411736 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:33.357209 29093 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:33.413519 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:33.414244 23695 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
W20260709 12:18:33.412039 29340 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.324s	user 0.001s	sys 0.001s
W20260709 12:18:33.415809 29363 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:18:33.416688 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
W20260709 12:18:33.418113 29325 log.cc:927] Time spent T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 12:18:33.186264 29338 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:33.418551 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:33.419534 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:33.419956 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:33.357084 29355 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:33.420897 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:33.403131 29356 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:33.422456 29181 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:33.421468 29355 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 23 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:33.421648 22826 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 23
W20260709 12:18:33.481598 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 71071.4us
I20260709 12:18:33.483165 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:33.382089 29162 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.455744 29181 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:33.501493 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:33.430037 29350 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:33.356942 29040 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:33.456892 29097 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.520560 22827 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 25: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:33.349040 29178 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:33.457146 29099 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:33.374328 29234 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:33.485039 29352 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:33.499325 29043 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:33.507022 29130 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:33.503999 29162 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:33.560268 29377 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.551539 29097 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:33.550962 29168 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 12:18:33.561621 29360 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:18:33.562739 29342 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 12:18:33.562014 29355 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:33.563822 28874 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.845s	user 0.013s	sys 0.002s
W20260709 12:18:33.567935 29366 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
W20260709 12:18:33.571610 29361 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:18:33.572806 29028 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:33.575937 29289 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:33.577389 29234 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:33.578299 29373 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:33.521502 29350 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:33.510684 29371 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:33.527171 29161 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:18:33.486135 29302 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:33.543210 29375 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.606700 29312 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.623579 29256 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:33.600087 29130 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:33.659353 29236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.572s	user 0.006s	sys 0.063s
I20260709 12:18:33.598354 29043 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:33.641283 29028 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:33.669065 29312 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:33.658757 29356 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:33.602942 29377 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:33.653558 29350 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:18:33.701894 29364 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.109s	user 0.000s	sys 0.002s
I20260709 12:18:33.703590 29377 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:33.657670 29157 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:33.704322 29297 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:33.554963 29332 consensus_queue.cc:260] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:33.601121 29181 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:33.679653 29097 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:33.706171 29181 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:33.682744 29321 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 1.028s	user 0.004s	sys 0.000s
I20260709 12:18:33.684109 29130 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:33.711092 29316 consensus_queue.cc:1175] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a89a4b420ea9496aab55475fc38bb6f7" responder_term: 18 status { last_received { term: 18 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:33.711786 29157 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:33.693080 29307 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:33.685909 29236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.599s	user 0.007s	sys 0.064s
I20260709 12:18:33.694890 29248 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 24 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:33.666669 29375 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:33.683705 29178 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:33.700995 29187 consensus_meta.cc:287] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.735s	user 0.007s	sys 0.004s
I20260709 12:18:33.718688 29100 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:33.678817 29354 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:33.719980 29354 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:33.721129 29154 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:33.719358 29375 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:33.684072 29339 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:33.680598 29365 log.cc:927] Time spent T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 12:18:33.704977 29297 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:33.730413 29297 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:33.731474 29297 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:33.663326 29301 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:33.740118 29263 consensus_meta.cc:287] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.069s	user 0.016s	sys 0.000s
W20260709 12:18:33.736865 29295 consensus_meta.cc:287] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.004s
I20260709 12:18:33.741927 29295 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:33.743116 29312 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:33.743690 29354 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:33.744169 29295 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:33.744761 29350 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:33.748538 29371 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:33.748680 29350 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:33.785398 22745 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:33.789484 22750 raft_consensus.cc:2368] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18.
I20260709 12:18:33.790596 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 1223) took 1780 ms. Trace:
I20260709 12:18:33.792603 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1620) took 2157 ms. Trace:
I20260709 12:18:33.793977 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1808) took 1639 ms. Trace:
I20260709 12:18:33.791538 22820 rpcz_store.cc:276] 0709 12:18:32.009963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.044297 (+ 34334us) service_pool.cc:224] Handling call
0709 12:18:32.044685 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:32.385780 (+341095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.385813 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:32.386404 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 12:18:32.840435 (+454031us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:33.050097 (+209662us) log.cc:844] Serialized 14 byte log entry
0709 12:18:33.094896 (+ 44799us) log.cc:844] Serialized 14 byte log entry
0709 12:18:33.423041 (+328145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.423138 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.715418 (+292280us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b18003714a0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf865358f 00007fadf1692571 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd
0709 12:18:33.789403 (+ 73985us) raft_consensus.cc:1685] finished
0709 12:18:33.789457 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.790065 (+   608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119603,"prepare.queue_time_us":962041,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":95,"raft.queue_time_us":640843,"raft.run_cpu_time_us":626,"raft.run_wall_time_us":78572,"spinlock_wait_cycles":30773632,"thread_start_us":1136923,"threads_started":4,"wal-append.queue_time_us":1110166}
I20260709 12:18:33.793310 22753 rpcz_store.cc:276] 0709 12:18:31.635460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.713395 (+ 77935us) service_pool.cc:224] Handling call
0709 12:18:31.720218 (+  6823us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:32.484045 (+763827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.484092 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:32.507208 (+ 23116us) log.cc:844] Serialized 52 byte log entry
0709 12:18:32.794042 (+286834us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:32.794086 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.794174 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.790712 (+996538us) raft_consensus.cc:1685] finished
0709 12:18:33.790765 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.792262 (+  1497us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47664,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":1014339,"threads_started":2,"wal-append.queue_time_us":1048605}
I20260709 12:18:33.805318 22824 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:33.794584 22818 rpcz_store.cc:276] 0709 12:18:32.154624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.183219 (+ 28595us) service_pool.cc:224] Handling call
0709 12:18:32.234468 (+ 51249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:32.783149 (+548681us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:32.876781 (+ 93632us) log.cc:844] Serialized 14 byte log entry
0709 12:18:33.089800 (+213019us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:33.093885 (+  4085us) log.cc:844] Serialized 26 byte log entry
0709 12:18:33.094090 (+   205us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:33.094128 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.094224 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.791226 (+697002us) raft_consensus.cc:1685] finished
0709 12:18:33.791279 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.793654 (+  2375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20504,"prepare.queue_time_us":316728,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":399096,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5702,"spinlock_wait_cycles":17363328,"thread_start_us":691012,"threads_started":3,"wal-append.queue_time_us":764882}
I20260709 12:18:33.807475 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1555) took 1040 ms. Trace:
I20260709 12:18:33.807710 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:33.809576 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:33.808197 22825 rpcz_store.cc:276] 0709 12:18:32.767203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.769905 (+  2702us) service_pool.cc:224] Handling call
0709 12:18:32.770461 (+   556us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:32.771004 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.771045 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:18:32.784817 (+ 13772us) log.cc:844] Serialized 78 byte log entry
0709 12:18:33.115938 (+331121us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:18:33.182812 (+ 66874us) log.cc:844] Serialized 14 byte log entry
0709 12:18:33.805479 (+622667us) log.cc:844] Serialized 14 byte log entry
0709 12:18:33.806397 (+   918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.806623 (+   226us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.806743 (+   120us) raft_consensus.cc:1685] finished
0709 12:18:33.806772 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.807237 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":877992,"prepare.queue_time_us":122101,"prepare.run_cpu_time_us":5528,"prepare.run_wall_time_us":17240,"raft.queue_time_us":306828,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":28060,"thread_start_us":367335,"threads_started":2,"wal-append.queue_time_us":601149}
W20260709 12:18:33.794581 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 433388us
I20260709 12:18:33.811939 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 1597) took 1047 ms. Trace:
I20260709 12:18:33.812974 22825 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:33.813862 22753 rpcz_store.cc:276] 0709 12:18:32.764434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.804258 (+1039824us) service_pool.cc:224] Handling call
0709 12:18:33.811782 (+  7524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:33.815589 22825 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:18:33.820803 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:33.813547 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:33.824715 22753 raft_consensus.cc:2410] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:18:33.822582 22825 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:18:33.827613 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:33.835752 22818 raft_consensus.cc:2393] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 17: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:33.826365 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:33.829416 22827 raft_consensus.cc:1240] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:18:33.798360 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:33.840145 22820 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:33.835768 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:33.842903 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.842963 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:33.574771 23689 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
W20260709 12:18:33.857591 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.858246 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1505) took 1127 ms. Trace:
I20260709 12:18:33.728879 29093 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:33.860026 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.639603 28874 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:33.860998 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.684849 28906 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:33.854753 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:33.863903 23659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1353) took 1025 ms. Trace:
I20260709 12:18:33.864691 23659 rpcz_store.cc:276] 0709 12:18:32.838142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.838336 (+   194us) service_pool.cc:224] Handling call
0709 12:18:32.838820 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:32.839290 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.839334 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:32.839996 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 12:18:33.076303 (+236307us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:33.076361 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.076463 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.863192 (+786729us) raft_consensus.cc:1685] finished
0709 12:18:33.863242 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.863629 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195,"raft.queue_time_us":3467,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":12149,"thread_start_us":235745,"threads_started":1,"wal-append.queue_time_us":519421}
I20260709 12:18:33.877053 29040 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:33.888535 29100 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:33.863875 29093 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:33.912204 29375 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:33.912647 29341 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:33.913916 28874 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:33.914319 29354 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:33.918658 29099 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.920035 29099 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:33.923115 29377 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.924165 29350 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.924005 29377 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:33.925232 29350 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:33.926250 29043 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:33.927147 29131 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.739104 29162 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:33.924005 29339 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:33.925815 29099 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:33.859061 23679 rpcz_store.cc:276] 0709 12:18:32.731076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.731294 (+   218us) service_pool.cc:224] Handling call
0709 12:18:32.731865 (+   571us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:32.737422 (+  5557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.737476 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:32.738352 (+   876us) log.cc:844] Serialized 52 byte log entry
0709 12:18:33.036081 (+297729us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:33.036279 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.036407 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.857343 (+820936us) raft_consensus.cc:1685] finished
0709 12:18:33.857412 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.857875 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16,"raft.queue_time_us":1324,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":244,"thread_start_us":296956,"threads_started":1,"wal-append.queue_time_us":853924}
I20260709 12:18:33.929358 29377 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:33.936965 29350 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:33.938266 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:18:33.939503 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 390824us
I20260709 12:18:33.890201 29100 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:33.936190 23672 raft_consensus.cc:3055] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:18:33.957325 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.914155 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1838) took 1172 ms. Trace:
I20260709 12:18:33.946664 22826 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
I20260709 12:18:33.936991 29172 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:33.927017 29097 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:33.977869 22753 rpcz_store.cc:276] 0709 12:18:32.741249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.912266 (+1171017us) service_pool.cc:224] Handling call
0709 12:18:33.913005 (+   739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.913571 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.913617 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:33.913698 (+    81us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:33.913793 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.913893 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.914056 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:33.956635 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:33.954818 29377 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:18:33.954411 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 59449.8us
I20260709 12:18:33.982862 29100 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:33.979629 23672 raft_consensus.cc:740] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:33.954275 29162 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:33.926977 29094 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:33.986255 29377 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:34.002967 29094 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:34.003666 23672 consensus_queue.cc:260] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:34.005420 23672 raft_consensus.cc:3060] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:34.006237 29094 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:33.951646 29131 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:33.992453 29372 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:34.001026 29377 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:34.036001 29028 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:34.041322 22747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1836) took 1433 ms (client timeout 1518 ms). Trace:
I20260709 12:18:34.044415 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1558) took 1254 ms. Trace:
I20260709 12:18:34.048952 22824 rpcz_store.cc:276] 0709 12:18:32.792651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.137635 (+344984us) service_pool.cc:224] Handling call
0709 12:18:33.174511 (+ 36876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.806534 (+632023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.043890 (+237356us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54007a1a54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:34.044298 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448372096}
I20260709 12:18:34.054057 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.055662 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:34.056167 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 56287.7us
I20260709 12:18:34.057287 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:34.057391 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:34.048748 22747 rpcz_store.cc:269] 0709 12:18:32.608040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.608297 (+   257us) service_pool.cc:224] Handling call
0709 12:18:34.040769 (+1432472us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54004047d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:34.041038 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393131776}
W20260709 12:18:34.058972 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 102617us
I20260709 12:18:34.006983 29097 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:34.059605 23656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1491) took 2141 ms. Trace:
I20260709 12:18:34.059779 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.060196 23656 rpcz_store.cc:276] 0709 12:18:31.918072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.962724 (+ 44652us) service_pool.cc:224] Handling call
0709 12:18:33.364795 (+1402071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.398383 (+ 33588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.059139 (+660756us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540073b9d0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477e8ad 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:34.059390 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3223520000}
I20260709 12:18:34.011026 29172 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:34.063431 29388 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:34.064307 29388 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:34.066859 22747 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 14.
I20260709 12:18:34.067209 29339 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:34.068032 29339 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:34.068176 29350 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:34.068997 29350 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:34.069609 23682 raft_consensus.cc:1275] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:18:34.070713 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1492) took 2152 ms. Trace:
I20260709 12:18:34.071156 23685 rpcz_store.cc:276] 0709 12:18:31.918318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.998369 (+ 80051us) service_pool.cc:224] Handling call
0709 12:18:32.021036 (+ 22667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.478145 (+457109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.070158 (+1592013us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54000221d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:34.070536 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":977980800}
I20260709 12:18:34.072021 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.074541 29350 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:34.065937 29388 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:34.062397 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.075919 23679 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:34.062326 29097 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:34.072029 23682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1502) took 1433 ms. Trace:
W20260709 12:18:34.014963 22718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.026s	sys 0.041s
I20260709 12:18:34.066327 29172 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:34.069329 29154 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:34.100948 29154 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.101922 29154 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:34.105865 29260 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:34.107887 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:34.110855 29260 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:18:34.111581 29260 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:34.113016 29260 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:34.079352 23660 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:34.094830 29162 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:34.114162 29162 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:34.116210 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:34.114171 23660 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:34.092840 29302 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.047075 29028 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:34.097487 23682 rpcz_store.cc:276] 0709 12:18:32.638333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.677528 (+ 39195us) service_pool.cc:224] Handling call
0709 12:18:32.677932 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.070119 (+1392187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.071634 (+  1515us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002913d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:34.071952 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3198339968}
I20260709 12:18:34.117100 29338 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:34.111889 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.123706 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1835) took 1611 ms. Trace:
I20260709 12:18:34.123984 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:34.124694 29172 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:34.125752 29172 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.125921 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:34.069533 29339 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:34.117074 29317 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:34.101004 29393 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:18:34.130522 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1817) took 2313 ms. Trace:
I20260709 12:18:34.131101 22751 rpcz_store.cc:276] 0709 12:18:31.817170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.125476 (+308306us) service_pool.cc:224] Handling call
0709 12:18:32.125721 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.278274 (+152553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.278305 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:32.278350 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:32.278384 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.129902 (+1851518us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001e69d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:34.129991 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.130271 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350335360}
I20260709 12:18:34.134140 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1814) took 1370 ms. Trace:
I20260709 12:18:34.117591 28603 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:18:34.119457 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1628) took 1951 ms. Trace:
I20260709 12:18:34.120445 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1837) took 1379 ms. Trace:
I20260709 12:18:34.119812 29330 consensus_queue.cc:1059] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:34.074851 22753 raft_consensus.cc:2393] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 15: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:34.119442 29297 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:34.142930 29092 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:34.143218 29297 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:34.117153 29162 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:34.095081 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.143956 29174 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:34.068409 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:34.107532 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:34.145851 23656 raft_consensus.cc:2368] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17.
I20260709 12:18:34.145712 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.122872 23672 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:18:34.110549 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:34.128662 29302 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:34.124209 22746 rpcz_store.cc:276] 0709 12:18:32.510259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.510996 (+   737us) service_pool.cc:224] Handling call
0709 12:18:32.511383 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:32.575554 (+ 64171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.575606 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:32.580201 (+  4595us) log.cc:844] Serialized 26 byte log entry
0709 12:18:32.960979 (+380778us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:32.961041 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.121228 (+1160187us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b54004056d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:34.121300 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.121369 (+    69us) raft_consensus.cc:1685] finished
0709 12:18:34.121390 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.121789 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130825,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"spinlock_wait_cycles":146255232,"thread_start_us":306282,"threads_started":1,"wal-append.queue_time_us":1067075}
I20260709 12:18:34.111557 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1562) took 1279 ms. Trace:
I20260709 12:18:34.137847 22748 rpcz_store.cc:276] 0709 12:18:32.740842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.741212 (+   370us) service_pool.cc:224] Handling call
0709 12:18:34.119940 (+1378728us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54004060d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:34.120255 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545028992}
I20260709 12:18:34.141384 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.137728 22749 rpcz_store.cc:276] 0709 12:18:32.167867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.179224 (+ 11357us) service_pool.cc:224] Handling call
0709 12:18:32.179621 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.989129 (+809508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.118878 (+1129749us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54003813d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:34.119245 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1790310272}
I20260709 12:18:34.143640 29092 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:34.144640 29174 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:34.147786 22753 raft_consensus.cc:2393] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 24: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:34.126392 29172 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:34.143795 29297 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:34.160794 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.161962 29376 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:34.165820 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.149827 22822 rpcz_store.cc:276] 0709 12:18:32.831867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.176123 (+344256us) service_pool.cc:224] Handling call
0709 12:18:33.176876 (+   753us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:33.457357 (+280481us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:18:33.457392 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:33.458291 (+   899us) log.cc:844] Serialized 26 byte log entry
0709 12:18:34.110863 (+652572us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:34.110943 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.111060 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.111115 (+    55us) raft_consensus.cc:1685] finished
0709 12:18:34.111129 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.111352 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":179940,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":11812,"thread_start_us":764742,"threads_started":2,"wal-append.queue_time_us":414038}
W20260709 12:18:34.171131 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 47672.7us
I20260709 12:18:34.171864 29131 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:34.173017 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.172232 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.177631 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.179091 29092 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:34.167870 29376 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:34.168901 29302 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:34.186107 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.188696 29092 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:34.191879 22749 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
W20260709 12:18:34.192612 29323 log.cc:927] Time spent T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 1.362s	user 0.004s	sys 0.001s
W20260709 12:18:34.193081 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 82877.3us
I20260709 12:18:34.198671 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:34.173056 29174 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:34.200742 29174 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:34.179867 29100 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.207324 22746 raft_consensus.cc:2393] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 20: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:34.208813 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1598) took 1443 ms. Trace:
I20260709 12:18:34.209636 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1599) took 1443 ms. Trace:
W20260709 12:18:34.197369 29335 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.824s	user 0.001s	sys 0.003s
I20260709 12:18:34.185187 29376 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:34.211930 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1634) took 1415 ms. Trace:
I20260709 12:18:34.212440 22748 rpcz_store.cc:276] 0709 12:18:32.796676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.210545 (+1413869us) service_pool.cc:224] Handling call
0709 12:18:34.211123 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.211572 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.211596 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:34.211635 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:34.211673 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.211722 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.211860 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:34.214111 22748 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:34.214510 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1630) took 2043 ms. Trace:
I20260709 12:18:34.195369 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1839) took 1453 ms. Trace:
I20260709 12:18:34.214752 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1635) took 1417 ms. Trace:
I20260709 12:18:34.227893 22748 rpcz_store.cc:276] 0709 12:18:32.797022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.213496 (+1416474us) service_pool.cc:224] Handling call
0709 12:18:34.213923 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.214505 (+   582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.214685 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:34.193183 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:34.215128 29316 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:34.228837 29316 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.229023 22749 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:34.229313 29316 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:34.229621 22821 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:18:34.230135 22821 pending_rounds.cc:85] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 10
I20260709 12:18:34.230430 22821 pending_rounds.cc:107] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:18:34.215205 22744 rpcz_store.cc:276] 0709 12:18:32.171338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.180213 (+  8875us) service_pool.cc:224] Handling call
0709 12:18:32.180532 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:32.477827 (+297295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.477861 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:32.478559 (+   698us) log.cc:844] Serialized 26 byte log entry
0709 12:18:32.792242 (+313683us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:32.792315 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.036258 (+1243943us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54001e64d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:34.036372 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.196297 (+159925us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:18:34.214022 (+ 17725us) raft_consensus.cc:1685] finished
0709 12:18:34.214052 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.214287 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20162,"raft.queue_time_us":246930,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":661391360,"thread_start_us":295444,"threads_started":1,"wal-append.queue_time_us":733975}
I20260709 12:18:34.233701 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.216006 22751 rpcz_store.cc:276] 0709 12:18:32.741666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.194229 (+1452563us) service_pool.cc:224] Handling call
0709 12:18:34.194628 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.194940 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.194971 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:34.195052 (+    81us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:34.195122 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.195189 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.195312 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:34.235677 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:34.236370 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.238032 22748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1636) took 1440 ms. Trace:
W20260709 12:18:34.240199 23689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 1355) took 1395 ms (client timeout 1771 ms). Trace:
W20260709 12:18:34.240790 23689 rpcz_store.cc:269] 0709 12:18:32.844910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.138760 (+293850us) service_pool.cc:224] Handling call
0709 12:18:34.239737 (+1100977us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b540073b254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:34.239952 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894823808}
I20260709 12:18:34.210219 22746 rpcz_store.cc:276] 0709 12:18:32.766428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.208426 (+1441998us) service_pool.cc:224] Handling call
0709 12:18:34.208929 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.209272 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.209303 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:34.209356 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:34.209391 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.209452 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.209572 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:34.245707 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1638) took 1447 ms. Trace:
I20260709 12:18:34.216714 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:34.248224 29043 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:34.248406 29125 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:34.250027 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 63698.2us
I20260709 12:18:34.217059 29131 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.251828 29131 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:34.252483 29332 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:34.253554 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:34.209287 22747 rpcz_store.cc:276] 0709 12:18:32.765183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.207705 (+1442522us) service_pool.cc:224] Handling call
0709 12:18:34.208155 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.208427 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.208459 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:34.208508 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:34.208541 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.208605 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.208743 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:34.218345 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:34.220533 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 1640) took 1420 ms. Trace:
I20260709 12:18:34.225612 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:34.238551 22748 rpcz_store.cc:276] 0709 12:18:32.797454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.236961 (+1439507us) service_pool.cc:224] Handling call
0709 12:18:34.237299 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.237651 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.237676 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:34.237743 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:34.237803 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.237863 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.237970 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:34.230723 22821 raft_consensus.cc:2889] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:34.258960 22750 rpcz_store.cc:276] 0709 12:18:32.800718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.154108 (+353390us) service_pool.cc:224] Handling call
0709 12:18:34.220301 (+1066193us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54000a8054. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:34.220471 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327762688}
I20260709 12:18:34.136711 22819 rpcz_store.cc:276] 0709 12:18:32.763377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.763607 (+   230us) service_pool.cc:224] Handling call
0709 12:18:32.801803 (+ 38196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.802082 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:18:32.876569 (+ 74487us) log.cc:844] Serialized 14 byte log entry
0709 12:18:34.133081 (+1256512us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b1800469000. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287
0709 12:18:34.133312 (+   231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:34.133443 (+   131us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:34.133567 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.133723 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.133948 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64110,"prepare.queue_time_us":320387,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":149168,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8514,"spinlock_wait_cycles":7803264,"thread_start_us":446178,"threads_started":3,"wal-append.queue_time_us":238818}
I20260709 12:18:34.260933 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49004 (request call id 1637) took 1463 ms. Trace:
I20260709 12:18:34.268947 22745 rpcz_store.cc:276] 0709 12:18:32.798137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.108342 (+310205us) service_pool.cc:224] Handling call
0709 12:18:34.260661 (+1152319us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400412b54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:34.260869 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431129984}
I20260709 12:18:34.273664 22823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1812) took 1669 ms. Trace:
I20260709 12:18:34.277118 22747 raft_consensus.cc:1240] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20. Ops: []
W20260709 12:18:34.279984 23674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 1343) took 2206 ms (client timeout 2140 ms). Trace:
W20260709 12:18:34.280545 23674 rpcz_store.cc:269] 0709 12:18:32.073119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.546448 (+473329us) service_pool.cc:224] Handling call
0709 12:18:34.279538 (+1733090us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5400704c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:34.279795 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64174336}
W20260709 12:18:34.283658 29392 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:18:34.200922 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:34.282394 29043 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:34.276280 22823 rpcz_store.cc:276] 0709 12:18:32.580554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.580729 (+   175us) service_pool.cc:224] Handling call
0709 12:18:32.601877 (+ 21148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.602193 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:18:32.861052 (+258859us) log.cc:844] Serialized 14 byte log entry
0709 12:18:34.249494 (+1388442us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b1800482800. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf43274bc 00007fadf167548b 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf1691c02 00007fadf431920b 00007fadf431ed23 00007fadf431f23a
0709 12:18:34.249852 (+   358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:34.249974 (+   122us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:34.250065 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.250150 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.250331 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":449588,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":5962,"raft.queue_time_us":11426,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3129,"spinlock_wait_cycles":22861696,"thread_start_us":475376,"threads_started":2,"wal-append.queue_time_us":384734}
I20260709 12:18:34.286504 22749 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:34.280231 22751 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:18:34.274362 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:34.295609 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1642) took 1465 ms. Trace:
I20260709 12:18:34.296041 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1641) took 1476 ms. Trace:
I20260709 12:18:34.296598 22751 rpcz_store.cc:276] 0709 12:18:32.817925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.261685 (+1443760us) service_pool.cc:224] Handling call
0709 12:18:34.279989 (+ 18304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.292452 (+ 12463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.293062 (+   610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:34.296417 22747 rpcz_store.cc:276] 0709 12:18:32.827542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.260655 (+1433113us) service_pool.cc:224] Handling call
0709 12:18:34.263161 (+  2506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.290050 (+ 26889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.290360 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:34.280243 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 1217) took 2282 ms. Trace:
I20260709 12:18:34.298538 23660 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:18:34.301455 23689 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:34.298297 22821 rpcz_store.cc:276] 0709 12:18:31.997514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.998939 (+  1425us) service_pool.cc:224] Handling call
0709 12:18:34.228477 (+2229538us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b5800011498. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aeee 000000000036eb39 00007fadf96ce1e0 00007fadf97970c4 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:18:34.228846 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.279868 (+ 51022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.280145 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6443776}
I20260709 12:18:34.207455 29100 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:34.308193 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:34.313762 29087 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 12:18:34.314373 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 96194.2us
I20260709 12:18:34.317073 23493 leader_election.cc:400] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18.
I20260709 12:18:34.326188 23493 leader_election.cc:403] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:18:34.319715 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.318252 29028 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:18:34.334081 23660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45650 (request call id 1503) took 1677 ms. Trace:
I20260709 12:18:34.303534 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:34.322675 29371 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:34.323783 22753 raft_consensus.cc:1240] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 22. Current term is 23. Ops: []
I20260709 12:18:34.324230 29372 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:34.318542 29172 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:34.314755 29377 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:34.246152 22746 rpcz_store.cc:276] 0709 12:18:32.798830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.244046 (+1445216us) service_pool.cc:224] Handling call
0709 12:18:34.244784 (+   738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.245309 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.245337 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:34.245382 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:34.245411 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.245476 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.245636 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8388}
I20260709 12:18:34.338279 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1840) took 1468 ms. Trace:
I20260709 12:18:34.373087 22753 rpcz_store.cc:276] 0709 12:18:32.869888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.286298 (+1416410us) service_pool.cc:224] Handling call
0709 12:18:34.323559 (+ 37261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.337956 (+ 14397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.338220 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:34.338850 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:34.353190 22745 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
W20260709 12:18:34.375672 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.354100 22821 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 21. Current term is 23. Ops: []
I20260709 12:18:34.377074 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:34.355156 22751 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:34.366986 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.367525 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:34.372220 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.348215 22748 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
W20260709 12:18:34.387784 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.334599 23660 rpcz_store.cc:276] 0709 12:18:32.656638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.691810 (+ 35172us) service_pool.cc:224] Handling call
0709 12:18:32.692354 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.066385 (+1374031us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b4c0001c380. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf2a4ba20 00007fadf2a5ca29 00007fadf2a22644 00007fadf2a49f2d 00007fadf2a49b93 00007fadf477a18b 00007fadf477acb5 00007fadf4775f30 00007fadf47777de 00007fadf4781b49 00007fadf4782416
0709 12:18:34.299647 (+233262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.333987 (+ 34340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104227200}
I20260709 12:18:34.382139 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1644) took 1090 ms. Trace:
I20260709 12:18:34.381544 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1643) took 1542 ms. Trace:
I20260709 12:18:34.394013 22751 rpcz_store.cc:276] 0709 12:18:33.291937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.304496 (+1012559us) service_pool.cc:224] Handling call
0709 12:18:34.354827 (+ 50331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.381811 (+ 26984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.382072 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:34.371443 22749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1600) took 1344 ms. Trace:
I20260709 12:18:34.395386 22822 raft_consensus.cc:2410] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:18:34.395830 22749 rpcz_store.cc:276] 0709 12:18:33.017741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.295918 (+1278177us) service_pool.cc:224] Handling call
0709 12:18:34.331123 (+ 35205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.351894 (+ 20771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.351935 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:34.351999 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:34.361366 (+  9367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.361459 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.361597 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3171,"raft.queue_time_us":8241,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":16503}
I20260709 12:18:34.359334 22744 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:34.370618 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.348112 29154 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:34.391762 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:34.392609 29380 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:34.369035 29377 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:34.394218 22745 rpcz_store.cc:276] 0709 12:18:32.839657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.291968 (+1452311us) service_pool.cc:224] Handling call
0709 12:18:34.338263 (+ 46295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:34.377246 (+ 38983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.381477 (+  4231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:34.399317 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.343848 29372 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.357251 29178 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:34.360539 29208 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.357110 29172 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:34.420501 23695 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:18:34.421033 22745 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:34.421618 29318 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:18:34.409269 29317 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.422556 29317 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:34.424407 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:34.425446 22824 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
W20260709 12:18:34.427711 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.360888 29028 consensus_queue.cc:1243] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:34.415292 22825 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
W20260709 12:18:34.432320 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 180959us
I20260709 12:18:34.417503 22823 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 15.
I20260709 12:18:34.427258 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:34.397599 29131 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:34.451155 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.436564 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:34.440618 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 81043.3us
I20260709 12:18:34.441833 29087 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:34.443615 29154 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:34.444334 29380 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:34.447121 29208 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:34.411110 28603 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:18:34.358994 29371 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:34.452646 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.418637 29372 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:34.425659 29317 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:34.417091 29178 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:34.449731 22821 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 18: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:34.477679 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:34.458230 29087 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.481922 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:34.481751 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:34.484009 22750 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:34.486696 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 125146us
I20260709 12:18:34.488353 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:34.489527 22790 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.490162 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:34.491530 29092 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:34.491360 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.492355 29092 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:34.493891 29396 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.187s	user 0.005s	sys 0.000s
I20260709 12:18:34.493582 29092 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:34.496794 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:34.502987 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 66668.3us
I20260709 12:18:34.491360 29352 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.506929 29172 consensus_queue.cc:1059] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:34.507591 29352 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:34.508627 29154 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:34.510053 29352 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:34.515285 29043 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:34.520592 29380 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:34.524286 29318 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:18:34.526228 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.481570 29178 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:34.479812 29316 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:34.529343 29131 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:34.529771 29316 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:34.530704 29131 consensus_queue.cc:1059] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:34.531929 28603 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:18:34.532239 29131 raft_consensus.cc:3055] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:34.532513 28603 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:34.532760 29131 raft_consensus.cc:740] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:34.506973 23660 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:18:34.535606 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 347113us
I20260709 12:18:34.495568 29087 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:34.546623 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.546108 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:34.548657 23689 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:34.501269 29377 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:34.537386 29154 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:34.545648 29338 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:34.564507 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:34.576792 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:34.577461 29100 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:34.578313 29100 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:34.533808 28603 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:34.579625 29100 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:34.580199 29100 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:34.582415 29100 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:34.583125 29154 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:34.584991 29260 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:34.545449 29376 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:34.579730 28603 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:34.589028 29376 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:34.590689 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.591351 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.552604 29097 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18.
I20260709 12:18:34.595378 29131 consensus_queue.cc:260] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:34.597220 29131 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:34.599227 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 132509us
I20260709 12:18:34.600023 29372 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:34.602432 29372 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:34.603521 29371 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:34.604053 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 114015us
I20260709 12:18:34.552757 29377 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.600406 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:34.615482 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.534370 29297 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:34.611183 23660 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 23.
I20260709 12:18:34.616379 22750 raft_consensus.cc:2468] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:34.619421 29352 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:34.620421 22819 raft_consensus.cc:1240] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 23. Current term is 24. Ops: []
I20260709 12:18:34.621677 22821 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:18:34.626259 23682 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:34.627249 29051 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:34.627876 29051 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:34.628877 29331 consensus_queue.cc:1048] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:18:34.629475 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:34.630232 22824 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:34.631224 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:34.632026 22818 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:34.632836 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:34.615617 29377 raft_consensus.cc:3060] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:34.635546 22752 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
W20260709 12:18:34.636937 22752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42860 (request call id 1841) took 1766 ms (client timeout 1676 ms). Trace:
W20260709 12:18:34.637365 22752 rpcz_store.cc:269] 0709 12:18:32.870203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.016461 (+146258us) service_pool.cc:224] Handling call
0709 12:18:34.636692 (+1620231us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54001e6ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:34.636862 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3634702080}
W20260709 12:18:34.631346 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 76405.4us
I20260709 12:18:34.638880 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:34.640463 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.643316 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.645063 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.645961 23685 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 23: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:34.646214 29174 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:34.643422 22864 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.194:36669 timed out after 1.676s (SENT) [suppressed 2 similar messages]
I20260709 12:18:34.647076 29174 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:34.650537 29087 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:34.652870 29260 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:34.662390 29100 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:34.663443 29100 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:34.662531 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.667227 23674 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
W20260709 12:18:34.669006 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.669212 29174 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:34.666491 29100 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:34.670238 29100 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:34.672382 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:34.672676 23682 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:34.673863 29208 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:34.674680 29332 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:18:34.676086 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 75871.7us
I20260709 12:18:34.676343 29299 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:34.677202 29299 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:34.678539 29299 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:34.681303 29299 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:34.673170 22826 raft_consensus.cc:3060] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:34.688853 22717 leader_election.cc:400] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17.
I20260709 12:18:34.689443 22717 leader_election.cc:403] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:18:34.697007 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.698385 23682 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:18:34.696601 29174 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285) with higher term. Message: Invalid argument: T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17.
I20260709 12:18:34.727847 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.713653 29100 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:18:34.706272 29125 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:18:34.745349 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.747443 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.752790 29051 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:34.756511 29051 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:34.760547 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:34.761379 22744 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:34.767374 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
W20260709 12:18:34.772377 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.773792 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:34.728785 29178 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:34.778434 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:34.781219 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.747581 29087 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:34.783190 22748 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:34.762400 29174 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:34.812507 22790 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.826205 22826 raft_consensus.cc:2468] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:34.829548 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.831020 29330 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.838945 29330 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:34.840405 29178 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:34.841346 29330 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:34.841917 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 76409.5us
I20260709 12:18:34.844015 22717 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.845201 22717 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.846179 29388 raft_consensus.cc:2804] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:34.847728 29189 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:34.841996 29339 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:34.851378 29339 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:34.851822 29339 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:34.814208 29174 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:34.855131 29174 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:34.859344 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:34.865399 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:34.846272 22717 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.769879 29100 consensus_queue.cc:1059] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 12:18:34.880332 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:34.901988 22744 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:34.898313 29376 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:34.903367 29376 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.903729 29376 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:34.903971 22752 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:34.906239 22748 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:34.908504 22750 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:34.877521 29297 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:34.913380 29172 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:34.919458 23674 raft_consensus.cc:1240] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:34.920958 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.922375 23660 raft_consensus.cc:2410] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:18:34.923468 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.924419 23685 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:34.925715 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:34.927734 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:34.928045 23695 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:34.928800 29208 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:34.930702 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:34.931669 29208 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:18:34.933727 29043 raft_consensus.cc:3055] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:18:34.934201 29043 raft_consensus.cc:740] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:34.935357 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:34.935786 22826 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:18:34.936088 23682 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:34.937737 22826 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:34.942335 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:34.943414 22826 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
W20260709 12:18:34.950049 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.945392 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:34.954041 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 52304.3us
W20260709 12:18:34.954183 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 310791us
I20260709 12:18:34.901275 29331 raft_consensus.cc:2804] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:34.841410 29178 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:18:34.928287 29100 raft_consensus.cc:3055] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:18:34.963783 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:34.965643 23689 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 22: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:34.969269 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:34.970580 23660 raft_consensus.cc:2393] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 19: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:34.973886 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:34.993361 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.994381 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.010722 22864 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:35.012900 22820 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 18: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:35.013700 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:35.015524 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:35.009647 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:35.040517 23674 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:34.968681 29100 raft_consensus.cc:740] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:35.023116 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:35.047991 22819 raft_consensus.cc:1275] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:18:35.029270 23685 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:35.043108 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:35.044473 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:35.044689 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:35.052421 22818 raft_consensus.cc:2393] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:35.052101 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:35.050738 23682 raft_consensus.cc:2468] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:35.058476 22748 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:18:35.060505 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:35.052052 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:35.069864 22751 raft_consensus.cc:2393] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 20: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:34.979720 29377 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:35.072160 29372 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:35.044814 28603 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:18:35.067240 29131 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:18:35.100160 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 205442us
I20260709 12:18:35.101423 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:35.105690 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.108779 22823 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:35.045071 29260 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:18:35.119117 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:35.124630 22820 raft_consensus.cc:2393] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 21: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:35.066738 29174 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:35.134177 29174 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:35.136698 29376 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:35.138765 22825 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:35.148034 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:35.148972 22820 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:35.151070 29100 consensus_queue.cc:260] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:35.097259 29131 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:35.153537 29131 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:35.154518 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.155076 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.131881 22575 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43984 (request call id 160) took 32400 ms (client timeout 15000 ms). Trace:
I20260709 12:18:35.108623 29380 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:35.163458 23494 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:35.173261 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:35.127548 29317 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.174157 22820 raft_consensus.cc:2468] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:35.180087 23685 raft_consensus.cc:2468] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 24.
I20260709 12:18:35.183099 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:35.081635 29043 consensus_queue.cc:260] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:35.189474 29404 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:18:35.191161 29406 log.cc:927] Time spent T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:18:35.165766 29380 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:35.193652 29377 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:35.195621 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 73529us
I20260709 12:18:35.195910 28603 raft_consensus.cc:2764] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:18:35.196398 29403 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:35.204802 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:35.219955 23682 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 14.
I20260709 12:18:35.206951 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:35.207118 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 445409us
I20260709 12:18:35.229754 22820 raft_consensus.cc:2393] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 22: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:18:35.230990 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 48040.6us
I20260709 12:18:35.232496 23685 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:18:35.235594 23674 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:35.233731 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1848) took 1030 ms. Trace:
I20260709 12:18:35.205121 29404 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:35.167960 29092 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:18:35.236783 22747 rpcz_store.cc:276] 0709 12:18:34.192072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.422302 (+230230us) service_pool.cc:224] Handling call
0709 12:18:34.422659 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.423326 (+   667us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:18:34.784424 (+361098us) log.cc:844] Serialized 14 byte log entry
0709 12:18:35.221692 (+437268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:35.221752 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:35.221807 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.221890 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.222001 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":488196,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":88,"thread_start_us":748488,"threads_started":2}
I20260709 12:18:35.256016 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:35.260062 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:35.260864 22750 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:35.230388 29352 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:35.267161 22748 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 16: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:35.268021 29028 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:35.268576 29404 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:35.269924 29404 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:35.258314 29299 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:35.276535 29299 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:35.279023 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.284691 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:35.285883 28603 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:35.207983 29317 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:35.245719 29189 raft_consensus.cc:697] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:35.299000 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:35.155643 22575 rpcz_store.cc:269] 0709 12:18:02.753445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.753763 (+   318us) service_pool.cc:224] Handling call
0709 12:18:35.131553 (+32377790us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:27.967353 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:27.990196 (+ 22843us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:27.995829 (+  5633us) write_op.cc:435] Acquired schema lock
0709 12:18:27.995856 (+    27us) tablet.cc:662] Decoding operations
0709 12:18:27.997092 (+  1236us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:27.997149 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:27.997183 (+    34us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:18:28.002165 (+  4982us) tablet.cc:701] Row locks acquired
0709 12:18:28.002185 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:18:28.002366 (+   181us) write_op.cc:270] Start()
0709 12:18:28.002503 (+   137us) write_op.cc:276] Timestamp: P: 1783599508002307 usec, L: 0
0709 12:18:28.002521 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:18:28.003494 (+   973us) log.cc:844] Serialized 5236 byte log entry
0709 12:18:28.343226 (+339732us) op_driver.cc:464] REPLICATION: finished
0709 12:18:28.597471 (+254245us) write_op.cc:301] APPLY: starting
0709 12:18:28.607916 (+ 10445us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:28.868765 (+260849us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:28.868901 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:29.077197 (+208296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:29.077560 (+   363us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:18:29.077631 (+    71us) write_op.cc:312] APPLY: finished
0709 12:18:29.078122 (+   491us) log.cc:844] Serialized 120 byte log entry
0709 12:18:29.095556 (+ 17434us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:29.115585 (+ 20029us) write_op.cc:454] Released schema lock
0709 12:18:29.123705 (+  8120us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:29.251541 (+127836us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:29.251584 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":226549,"apply.run_cpu_time_us":24597,"apply.run_wall_time_us":592842,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58519,"num_ops":13,"prepare.queue_time_us":102100,"prepare.run_cpu_time_us":32451,"prepare.run_wall_time_us":161222,"raft.queue_time_us":138927,"raft.run_cpu_time_us":87964,"raft.run_wall_time_us":156202,"replication_time_us":340520,"thread_start_us":268160,"threads_started":4,"wal-append.queue_time_us":136431,"wal-append.run_cpu_time_us":5085,"wal-append.run_wall_time_us":1939112}]]}
I20260709 12:18:35.286664 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:35.346118 29407 raft_consensus.cc:2804] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:35.347056 29407 raft_consensus.cc:697] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:35.350016 29352 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:35.351766 29407 consensus_queue.cc:237] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:35.355978 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 92352.3us
I20260709 12:18:35.356634 29352 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:35.357537 29100 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:35.357965 29372 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:35.358570 29372 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.358976 29372 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:35.252677 29403 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:35.359894 29299 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:35.362062 29403 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:35.290738 29339 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:35.365192 29339 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:35.287117 29380 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:35.204720 29154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.006s	sys 0.033s
W20260709 12:18:35.371357 22753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.037s	sys 0.039s
W20260709 12:18:35.372154 22753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.038s	sys 0.039s
W20260709 12:18:35.371925 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 85569.5us
I20260709 12:18:35.362672 29403 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.358043 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:35.387611 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.383646 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:35.359488 29040 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:35.371618 29154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.008s	sys 0.035s
I20260709 12:18:35.433519 23494 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:35.436712 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.438539 29412 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.001s
I20260709 12:18:35.388564 29299 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:35.359159 29171 consensus_queue.cc:1059] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:18:35.379899 29372 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:35.462015 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.466403 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.475847 22752 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:35.389457 29403 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:35.358938 29189 consensus_queue.cc:237] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:35.448005 29208 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:35.454567 29330 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:18:35.490568 29388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.035s	sys 0.047s
W20260709 12:18:35.526257 22745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.017s	sys 0.025s
I20260709 12:18:35.449873 29352 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:35.527959 22750 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
W20260709 12:18:35.536149 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.004s	sys 0.019s
I20260709 12:18:35.439852 29040 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:35.461020 29299 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:35.538599 22745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.018s	sys 0.026s
W20260709 12:18:35.544727 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.545188 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.004s	sys 0.020s
I20260709 12:18:35.503892 29208 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:35.492089 29331 raft_consensus.cc:697] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:35.564685 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 181372us
W20260709 12:18:35.538985 29388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.035s	sys 0.047s
I20260709 12:18:35.562304 29171 raft_consensus.cc:3055] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:35.568251 29208 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:35.572722 29388 raft_consensus.cc:697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:35.598611 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 365025us
I20260709 12:18:35.578505 29317 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:35.570928 29414 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:18:35.578962 29171 raft_consensus.cc:740] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:35.613204 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:35.613695 22821 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.010s	sys 0.020s
W20260709 12:18:35.614945 22821 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.011s	sys 0.020s
W20260709 12:18:35.618965 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 260976us
I20260709 12:18:35.626929 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1651) took 1679 ms. Trace:
I20260709 12:18:35.613430 29260 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:35.635293 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:35.646492 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:35.605479 29299 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:35.627653 22753 rpcz_store.cc:276] 0709 12:18:33.947800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.406134 (+458334us) service_pool.cc:224] Handling call
0709 12:18:34.409125 (+  2991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.470327 (+ 61202us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:18:34.808393 (+338066us) log.cc:844] Serialized 14 byte log entry
0709 12:18:35.622326 (+813933us) log.cc:844] Serialized 14 byte log entry
0709 12:18:35.626403 (+  4077us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:35.626478 (+    75us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:35.626542 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.626633 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.626853 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2567,"prepare.queue_time_us":413510,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":130,"raft.queue_time_us":234853,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":6119,"thread_start_us":1053722,"threads_started":3,"wal-append.queue_time_us":724211}
W20260709 12:18:35.677121 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 103666us
W20260709 12:18:35.678684 29422 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:18:35.645334 29339 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:35.679203 29028 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:35.686969 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.687829 22894 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
I20260709 12:18:35.688992 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.689340 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.690076 22893 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:35.663722 29371 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:35.691144 22899 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:18:35.692596 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.693321 22897 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:35.693121 29317 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:18:35.693702 29416 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:18:35.694523 29317 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:35.637084 29426 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:18:35.695171 29423 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:35.695490 29317 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:18:35.696323 29317 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:35.690603 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:35.690407 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.698809 28603 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:35.690979 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.704597 22893 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:35.695916 29423 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:35.690308 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.693161 22899 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:35.707950 22748 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:35.709312 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:35.694563 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:35.710721 22897 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:35.624653 29331 consensus_queue.cc:237] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:35.676592 29372 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:35.691206 29371 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:35.717509 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42860 (request call id 1851) took 1179 ms. Trace:
W20260709 12:18:35.719960 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 126107us
W20260709 12:18:35.719070 29417 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.210s	user 0.002s	sys 0.000s
I20260709 12:18:35.731747 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.732781 22895 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:35.732733 29439 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:35.736297 29439 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:35.737874 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:35.737715 29439 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:35.739861 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:35.731880 22896 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:35.740823 29125 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:35.741286 29125 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.741634 29125 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:35.745723 29371 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:35.747021 29371 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:35.739742 29439 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:35.751163 29040 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:35.752736 29420 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:18:35.755102 29436 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:35.755546 29436 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.755825 29171 consensus_queue.cc:260] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:35.757299 22899 raft_consensus.cc:1217] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Deduplicated request from leader. Original: 18.10->[20.11-20.11]   Dedup: 20.11->[]
I20260709 12:18:35.757963 22899 raft_consensus.cc:1240] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 12:18:35.722183 29413 log.cc:927] Time spent T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.203s	user 0.001s	sys 0.001s
I20260709 12:18:35.757387 29423 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:35.720448 22745 rpcz_store.cc:276] 0709 12:18:34.538014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.713280 (+175266us) service_pool.cc:224] Handling call
0709 12:18:34.862925 (+149645us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800148e98. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf165ab71 00007fadf165aa22 00007fadfa5738d9 00007fadf96cdee0 00007fadf97970ab 00007fadf9797131 00007fadf9758fc0 00007fadf9743929 00007fadf97433d2 00007fadf2cbabd4
0709 12:18:34.863219 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:34.863819 (+   600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.863863 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:34.864643 (+   780us) log.cc:844] Serialized 26 byte log entry
0709 12:18:35.547490 (+682847us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:35.547558 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.547685 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:35.711908 (+164223us) raft_consensus.cc:1685] finished
0709 12:18:35.711936 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.717381 (+  5445us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2473,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":14629,"spinlock_wait_cycles":2842368,"thread_start_us":682254,"threads_started":1,"wal-append.queue_time_us":729185}
I20260709 12:18:35.697690 29388 consensus_queue.cc:237] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:35.767581 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 114027us
I20260709 12:18:35.762610 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:35.768620 22791 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:35.751037 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.726541 29352 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:35.783649 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.787783 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.755883 29436 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:35.787786 22791 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:35.795027 29040 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:18:35.795975 29431 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.799870 29376 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:35.800956 29172 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.802493 28603 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:35.804207 29028 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:35.805990 29415 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:18:35.807243 29411 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:18:35.807720 29430 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:35.808630 29441 raft_consensus.cc:2804] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:35.810465 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1657) took 1132 ms. Trace:
I20260709 12:18:35.810663 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.775640 29403 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:35.820472 29404 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.006s
I20260709 12:18:35.823311 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.823814 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.825651 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:35.826967 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.828549 22892 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:18:35.885637 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.829149 29380 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:35.831547 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.717065 29339 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:35.835286 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 126116us
W20260709 12:18:35.834682 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47006.1us
W20260709 12:18:35.836910 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.840781 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.839834 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:35.863538 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 123738us
I20260709 12:18:35.862454 28603 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:35.881982 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.881362 22746 rpcz_store.cc:276] 0709 12:18:34.677799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.678091 (+   292us) service_pool.cc:224] Handling call
0709 12:18:34.678603 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:34.678963 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.678996 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:34.679689 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 12:18:35.093960 (+414271us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:35.093991 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.094046 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:35.810179 (+716133us) raft_consensus.cc:1685] finished
0709 12:18:35.810211 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.810385 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":413502,"threads_started":1,"wal-append.queue_time_us":751705}
W20260709 12:18:35.898124 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 58447.6us
I20260709 12:18:35.900490 22899 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:35.900902 28603 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:35.836387 29154 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:35.840569 29377 raft_consensus.cc:2804] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:18:35.912606 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.903594 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:35.905484 22894 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:35.907003 22790 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:35.917990 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.920720 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:35.924085 22895 raft_consensus.cc:2393] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:35.919201 22896 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:35.925750 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.883096 29330 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:35.929634 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:35.875234 29415 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:35.935164 28603 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:35.930370 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:35.926013 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.933387 23659 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:35.883935 29430 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:35.941819 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:35.947897 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 59597.1us
I20260709 12:18:35.913664 29441 raft_consensus.cc:697] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:35.950624 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:35.950476 28603 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:18:35.953995 28603 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.954376 28603 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:35.927163 29260 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:35.957928 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.958720 22893 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:35.883780 29172 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:35.962667 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:35.932044 29330 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:35.935365 29332 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.967684 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:35.948099 29131 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.974442 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.887981 29431 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:35.954632 29404 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:35.972520 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:35.951529 29430 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:35.950475 29377 raft_consensus.cc:697] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 24 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:35.981163 22749 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:35.981184 29331 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:35.925151 29154 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:35.985945 22746 raft_consensus.cc:2368] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 18. Current term is 19.
I20260709 12:18:35.941773 29352 consensus_queue.cc:1059] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:18:35.993592 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:35.982846 22892 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
W20260709 12:18:35.999773 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 49266.3us
I20260709 12:18:35.975984 29028 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.975746 29372 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.976055 29403 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:36.011101 29446 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:18:36.036424 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 49232.9us
I20260709 12:18:35.980274 29438 consensus_queue.cc:1048] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:18:36.016634 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:35.983279 29404 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.021016 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:35.982128 29260 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:35.979188 29131 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:36.048692 29431 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:36.050951 29404 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:36.051892 29451 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:18:36.051685 29178 consensus_queue.cc:1059] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 23.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:36.052771 29440 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:36.043949 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:35.991055 29331 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.057025 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:35.975847 29332 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:36.058987 28603 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:36.060704 22864 leader_election.cc:400] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 18. Current term is 19.
I20260709 12:18:36.090634 22864 leader_election.cc:403] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:36.054335 22893 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
W20260709 12:18:36.087231 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.087559 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.044579 29376 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.092100 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:36.061390 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 53794.4us
I20260709 12:18:36.094252 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:35.995222 29415 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:36.096830 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:36.095683 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:36.098978 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:36.035058 29028 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:36.039029 29372 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.081008 29446 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:36.099840 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:36.035866 29453 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:18:36.098498 23494 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.074693 29414 consensus_queue.cc:1059] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:18:36.111274 28603 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:36.117841 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.120836 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:36.064033 29208 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:36.102046 29051 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:18:36.125681 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 69466.9us
I20260709 12:18:36.141578 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:36.144874 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:36.145691 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.147454 22822 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 22: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:36.160166 29131 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:36.162024 29028 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:36.091897 29376 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.172688 22820 raft_consensus.cc:2393] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 22: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:18:36.172686 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 68883.1us
W20260709 12:18:36.174002 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 84211us
W20260709 12:18:36.176192 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.180474 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.151060 29403 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:18:36.143006 29051 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.075979 29330 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.184631 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:36.195307 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:36.201035 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 75450.8us
I20260709 12:18:36.201884 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:36.167207 29339 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:36.197170 23659 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:36.205343 28603 raft_consensus.cc:2764] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:18:36.196229 22900 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:36.199813 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:36.183879 29131 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:36.075109 29441 consensus_queue.cc:237] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:36.107389 29377 consensus_queue.cc:237] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:36.213287 22792 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.210323 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.188697 29051 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:36.103464 29440 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.216926 22893 raft_consensus.cc:2393] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:36.217530 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.195762 29415 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:36.204016 29423 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:36.206905 29172 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:36.237555 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.214066 29339 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:36.165884 29260 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:36.220566 29154 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:36.213595 29092 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:18:36.216390 29418 consensus_queue.cc:1059] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:18:36.243191 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.265826 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:36.296528 22897 consensus_meta.cc:287] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.008s
I20260709 12:18:36.305338 22897 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:36.306641 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.299364 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.310258 22899 raft_consensus.cc:1275] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:18:36.254171 29371 consensus_meta.cc:287] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.003s
W20260709 12:18:36.244509 29449 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 12:18:36.252660 29433 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:18:36.277189 29171 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:36.276607 29457 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.276340 29174 raft_consensus.cc:3055] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:18:36.337591 22821 raft_consensus.cc:2410] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 12:18:36.319733 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 76643us
I20260709 12:18:36.338991 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.339644 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:36.339954 22900 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:36.341060 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 242605us
W20260709 12:18:36.342182 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.328378 29440 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:36.333691 29436 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:36.318213 29332 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:36.335944 29454 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:18:36.331799 29380 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:36.322352 29331 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:36.318384 29459 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
W20260709 12:18:36.353960 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 241721us
I20260709 12:18:36.337062 29174 raft_consensus.cc:740] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:36.352696 29372 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:36.244307 29456 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 12:18:36.347872 29457 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:36.365094 29440 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:36.375200 29208 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:36.351203 29371 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:18:36.378373 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.395131 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.379361 29043 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:36.334628 29430 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:36.399144 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:36.383715 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 44193.8us
I20260709 12:18:36.400230 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:36.400547 29430 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:36.400975 29458 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:18:36.379487 29174 consensus_queue.cc:260] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.391248 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:36.369822 29376 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:36.399333 22899 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
W20260709 12:18:36.387203 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 171685us
I20260709 12:18:36.391716 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:36.408676 22898 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:36.411154 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:36.413525 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.420215 29436 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:36.422142 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:36.423193 22753 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:36.263952 29446 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:36.397795 29440 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:36.433260 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.431798 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:36.441135 29372 raft_consensus.cc:3055] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:36.426623 29423 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:36.467479 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:36.488332 22822 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 21: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:36.467782 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.468720 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.485035 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:36.453718 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:36.497051 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:36.497797 23659 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:36.475370 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.501644 23682 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:18:36.504168 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:36.506331 23660 raft_consensus.cc:1240] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:18:36.505584 22900 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:36.507488 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:36.510159 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 77052.8us
W20260709 12:18:36.467777 29439 consensus_meta.cc:287] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.006s
I20260709 12:18:36.514853 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.515527 22894 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:18:36.461974 29429 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.493s	user 0.000s	sys 0.003s
I20260709 12:18:36.442544 29440 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:36.449787 29125 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.708s	user 0.015s	sys 0.000s
I20260709 12:18:36.462467 29208 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:36.471910 29028 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.514173 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:36.455137 29100 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.097s	user 0.008s	sys 0.010s
I20260709 12:18:36.460912 29403 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 18. Current term is 19.
I20260709 12:18:36.517628 23674 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:36.516589 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.530009 23494 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.520320 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:36.458724 29462 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 12:18:36.459375 29372 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:18:36.468405 29472 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:18:36.451733 29457 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:36.541982 23659 raft_consensus.cc:2468] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:36.448333 29475 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:36.509112 29260 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:36.512015 29419 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:18:36.518225 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 327389us
I20260709 12:18:36.521272 23695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:36.532130 23685 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:36.536826 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.544823 23695 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:36.461731 29051 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:36.547313 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:18:36.547658 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 147498us
I20260709 12:18:36.540724 23689 raft_consensus.cc:1275] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:18:36.548640 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.520153 29430 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:36.554448 23660 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:18:36.531370 29028 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:36.555148 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.556505 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.557076 29174 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:36.544895 29260 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.558293 29260 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:36.542472 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 88837.5us
I20260709 12:18:36.456067 29404 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:36.561439 29404 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:36.551610 29051 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:36.553117 22901 raft_consensus.cc:3060] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:36.544822 29332 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:18:36.565323 29372 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:36.553406 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1830) took 1537 ms. Trace:
I20260709 12:18:36.566828 29372 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:36.566983 22824 rpcz_store.cc:276] 0709 12:18:35.016305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.016612 (+   307us) service_pool.cc:224] Handling call
0709 12:18:35.044275 (+ 27663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:35.091938 (+ 47663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.091975 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:35.158657 (+ 66682us) log.cc:844] Serialized 26 byte log entry
0709 12:18:35.610033 (+451376us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:35.610100 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.610943 (+   843us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:36.461126 (+850183us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:18:36.552994 (+ 91868us) raft_consensus.cc:1685] finished
0709 12:18:36.553028 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.553331 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10781,"raft.queue_time_us":12240,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":7884,"spinlock_wait_cycles":9182592,"thread_start_us":425098,"threads_started":1,"wal-append.queue_time_us":763536}
I20260709 12:18:36.570236 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.571774 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.572875 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.573441 22896 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:36.527982 22825 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:18:36.529630 29125 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.578872 22897 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:36.579087 29125 leader_election.cc:290] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:36.580129 22748 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 12:18:36.581080 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:36.584993 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.587612 29476 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.589504 29470 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.589704 29330 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:36.590198 29470 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.592680 29470 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:36.593226 29482 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:36.593559 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 44978.8us
I20260709 12:18:36.593864 29482 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:36.557628 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.588387 29476 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.596362 29482 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:36.582576 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.609036 22897 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 15.
I20260709 12:18:36.544286 29475 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:36.597226 29317 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:36.596254 29419 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:36.616539 29419 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:36.617911 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.600874 29438 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:36.619284 29438 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:36.620357 29438 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.621600 22753 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:36.622200 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:36.601742 29339 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:36.623705 29317 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:36.624397 29339 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.624543 29317 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:36.624965 29339 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.615422 29475 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:36.621694 29438 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:36.619207 29103 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.628544 29103 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:36.616659 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:36.589495 22901 raft_consensus.cc:2468] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:36.602027 22892 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:18:36.632922 22901 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 12:18:36.633028 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 73337.5us
I20260709 12:18:36.635516 29339 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:36.639957 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.641413 29421 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:36.557199 29028 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:36.645845 29103 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:36.597236 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:36.649236 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.649657 29426 raft_consensus.cc:3055] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:18:36.650072 29426 raft_consensus.cc:740] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:36.650344 29208 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:36.650979 29208 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.651448 29426 consensus_queue.cc:260] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:36.653401 29426 raft_consensus.cc:3060] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:36.654356 29297 raft_consensus.cc:2804] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:36.654964 29297 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.649997 29404 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:18:36.655776 29297 raft_consensus.cc:3060] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:36.633312 22892 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:18:36.664017 22901 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 12:18:36.664479 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 115059us
W20260709 12:18:36.665453 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 68293.1us
I20260709 12:18:36.664801 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.668366 22823 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
W20260709 12:18:36.667255 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 120628us
W20260709 12:18:36.664276 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 117493us
I20260709 12:18:36.669685 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.669962 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.671093 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:36.673045 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.669056 22893 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:36.674170 29380 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:18:36.675318 22570 catalog_manager.cc:5697] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 7 to 19, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 19 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:36.676015 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:36.688119 22745 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:36.680190 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.680775 29103 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:36.674175 22894 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
I20260709 12:18:36.685599 22892 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:36.685195 22898 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 23.
I20260709 12:18:36.697995 29470 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.668848 29171 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:18:36.698616 29470 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.701284 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.707774 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:36.727844 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:36.728852 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:36.704191 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:36.731580 22746 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
I20260709 12:18:36.687839 29339 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:36.732306 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:36.734602 22749 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:18:36.742074 22750 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:36.742223 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.673138 23695 raft_consensus.cc:2468] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:36.795382 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.796754 22897 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 19. Ops: []
I20260709 12:18:36.795747 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:36.797735 22748 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:36.798092 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.799763 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.800527 22900 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 23.
W20260709 12:18:36.795377 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 61546.1us
I20260709 12:18:36.796386 22892 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:36.703423 29421 raft_consensus.cc:2764] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:18:36.803573 22898 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 25.
I20260709 12:18:36.807158 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:36.708614 29171 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:36.709107 29380 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:36.816088 22823 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:18:36.834506 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:36.836465 22821 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:36.834889 22790 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:36.846673 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:36.709952 29208 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:36.849215 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:36.739012 29482 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.845813 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:36.852226 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:36.861927 22819 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:36.862142 22824 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:36.740079 29457 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:36.840488 22823 pending_rounds.cc:85] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 11
I20260709 12:18:36.863147 22823 pending_rounds.cc:107] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:18:36.858249 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:36.733997 29414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.027s	sys 0.024s
I20260709 12:18:36.863476 22823 raft_consensus.cc:2889] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:36.855782 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 185935us
I20260709 12:18:36.865576 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:36.866276 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:36.807052 29377 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:36.867820 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:36.878003 22894 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 23. Current term is 24. Ops: [21.12-23.13]
I20260709 12:18:36.878369 22893 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:36.867172 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:36.879566 22892 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:36.743391 29339 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:36.859661 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:36.807917 29439 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.876137 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:36.867486 23674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:36.889187 28603 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.889384 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:36.890686 23659 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 12:18:36.737880 29462 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 12:18:36.904932 28603 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:36.867004 29414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.027s	sys 0.024s
W20260709 12:18:36.907378 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.908520 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7"
I20260709 12:18:36.917117 23672 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:36.909122 22900 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:18:36.746187 29485 consensus_queue.cc:1048] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.165s
I20260709 12:18:36.838594 29171 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:36.845319 29051 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.899067 22825 raft_consensus.cc:2468] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:36.880282 29371 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:36.901312 23685 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 23. Current term is 24. Ops: []
I20260709 12:18:36.882257 29208 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:18:36.915311 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.909998 23660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:36.866403 29332 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:18:36.927253 23656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:36.808128 29189 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 12:18:36.875551 29482 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:36.945060 28603 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:36.946269 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:36.947120 29482 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:36.948108 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 58860.5us
I20260709 12:18:36.951651 23672 raft_consensus.cc:2468] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 22.
I20260709 12:18:36.953145 29467 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:18:36.929035 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 248793us
I20260709 12:18:36.905301 29339 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:36.940819 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:36.913657 23674 raft_consensus.cc:2410] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:18:36.976495 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:36.978633 23689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:36.979751 23689 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 25.
I20260709 12:18:36.978018 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:36.921182 29476 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:36.918913 29377 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:37.007599 29297 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:37.007773 29377 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:37.010404 29297 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:37.019531 29480 log.cc:927] Time spent T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.181s	user 0.002s	sys 0.000s
I20260709 12:18:36.988909 28603 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:36.971413 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:36.938148 29171 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:37.030354 22746 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:18:36.911955 29439 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:36.993490 23493 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:36.997980 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:37.037592 22748 raft_consensus.cc:2410] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:18:37.004112 29470 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:36.920480 22570 catalog_manager.cc:5697] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 16 to 20, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 20 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:37.027428 28603 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:18:37.027644 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 56372us
I20260709 12:18:37.038897 28603 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:37.039376 28603 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:37.039463 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:36.941766 29208 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.001484 29431 raft_consensus.cc:3055] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:37.059994 29431 raft_consensus.cc:740] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:37.061203 29431 consensus_queue.cc:260] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:36.959666 29051 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:37.059558 22570 catalog_manager.cc:5697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:37.042639 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 49256.2us
I20260709 12:18:37.053695 29371 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.053303 29456 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:36.995092 29299 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:18:37.082806 29040 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:37.056567 29439 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:37.058416 29260 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:37.059336 29208 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:18:37.148823 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 96454.7us
W20260709 12:18:37.154127 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.160864 22892 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
W20260709 12:18:37.186884 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.173082 29299 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.182072 29040 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.165455 29100 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:18:37.054602 22824 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
W20260709 12:18:37.166333 29174 consensus_meta.cc:287] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.013s
W20260709 12:18:37.157426 29440 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.616s	user 0.013s	sys 0.006s
I20260709 12:18:37.127962 29371 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:37.233172 29100 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:18:37.183782 29431 raft_consensus.cc:3060] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:37.173393 29414 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:37.233810 29100 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:37.236878 29414 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:37.226810 29476 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:18:37.241648 29476 consensus_queue.cc:1243] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:18:37.244982 29440 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:37.247679 29440 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:37.151268 29372 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.247991 29414 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:37.202994 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 353874us
I20260709 12:18:37.248682 29372 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:37.253789 29469 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.254364 29469 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:37.256699 22895 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:18:37.257521 29469 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:37.258841 22821 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
I20260709 12:18:37.260236 22895 raft_consensus.cc:3055] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:37.213663 22717 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:37.261186 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:37.237977 29100 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:37.220593 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.262929 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:37.262962 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:37.264523 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:37.266383 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:37.229592 29424 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:18:37.267293 22753 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:37.267382 29424 consensus_queue.cc:1243] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:18:37.270900 29426 consensus_meta.cc:287] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.010s
I20260709 12:18:37.223749 29421 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:37.275308 29421 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:37.275645 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:37.276696 29457 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:37.277386 29482 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:37.277530 29457 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:37.278471 29457 consensus_queue.cc:1243] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:18:37.260614 22895 raft_consensus.cc:740] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:37.212136 29299 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:37.279610 29485 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:18:37.280164 29485 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:37.279971 22895 consensus_queue.cc:260] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:37.281040 22895 raft_consensus.cc:3060] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:37.281181 29485 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:37.261303 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47751.8us
I20260709 12:18:37.262290 22892 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:37.282541 29485 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:37.278882 29421 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:37.262702 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:37.290926 22895 raft_consensus.cc:1275] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:18:37.291426 22748 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:37.292520 29421 consensus_queue.cc:1048] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:37.283815 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:37.168081 22864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.213135 22570 catalog_manager.cc:5697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:37.263675 29476 raft_consensus.cc:2804] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:37.295094 29424 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:37.295611 29476 raft_consensus.cc:697] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:37.263401 29100 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:37.295665 29424 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:37.296639 29476 consensus_queue.cc:237] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:37.297672 29174 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:18:37.298220 29475 consensus_meta.cc:287] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.002s
I20260709 12:18:37.298674 29418 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:37.293826 22790 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:37.150962 23493 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:37.300462 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 187722us
I20260709 12:18:37.305123 22717 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:37.225402 28603 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:37.274427 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:37.306409 22753 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 22.
I20260709 12:18:37.299410 22791 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:37.215611 29470 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:37.310832 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:37.228452 29040 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:37.317492 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:37.299142 29418 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:37.261058 29260 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:37.328786 22746 raft_consensus.cc:2393] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:37.333992 22570 catalog_manager.cc:5697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:37.325381 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:37.336740 22821 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:18:37.296434 29448 consensus_queue.cc:1048] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:18:37.340672 23672 pending_rounds.cc:85] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Aborting all ops after (but not including) 10
I20260709 12:18:37.341107 23672 pending_rounds.cc:107] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 12:18:37.341144 23689 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:18:37.341521 23672 raft_consensus.cc:2889] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:37.332156 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:37.342669 22826 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:37.299631 29424 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:37.330343 28603 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:37.331979 22717 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:37.308959 29297 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:37.364831 22821 raft_consensus.cc:1240] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 12:18:37.321228 29189 raft_consensus.cc:2804] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:37.371747 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:37.321317 29426 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:37.314627 29469 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:37.376027 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:37.376616 22717 leader_election.cc:304] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:37.321856 29376 raft_consensus.cc:2804] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:37.322031 29470 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.382714 22819 raft_consensus.cc:1275] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:18:37.388607 22570 catalog_manager.cc:5697] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 20 to 23, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 23 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:37.394423 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 120131us
I20260709 12:18:37.409387 22865 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:37.301049 29475 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:37.373150 29297 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.417018 29297 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:37.420439 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 60593.9us
I20260709 12:18:37.410225 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:37.413430 29376 raft_consensus.cc:697] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:37.413935 29470 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:37.388296 29469 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.356433 29440 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:37.452859 23674 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:37.322151 29388 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:18:37.384356 29092 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:18:37.442418 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 277643us
I20260709 12:18:37.374272 29372 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:37.448908 22892 raft_consensus.cc:1275] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 12:18:37.449332 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:37.463277 29414 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:37.450374 29469 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:37.464535 29482 consensus_queue.cc:1048] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:37.464824 29436 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:493: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
W20260709 12:18:37.465793 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.451917 29421 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:37.407183 29457 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:18:37.525511 22570 catalog_manager.cc:5697] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:37.488521 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:37.496280 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:37.496531 23689 raft_consensus.cc:1240] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:37.497223 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:37.419874 29189 raft_consensus.cc:697] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:37.513149 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:37.466264 29208 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:37.463948 29316 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:37.434850 29456 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:18:37.532812 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a89a4b420ea9496aab55475fc38bb6f7" is_pre_election: true
I20260709 12:18:37.546218 23660 raft_consensus.cc:1275] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:18:37.524348 29317 consensus_meta.cc:287] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.899s	user 0.014s	sys 0.002s
I20260709 12:18:37.549306 22899 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:37.550050 22895 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:37.551805 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:37.566694 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 78221.6us
W20260709 12:18:37.555836 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.568192 29051 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:37.569037 18407 tablet_server.cc:179] TabletServer@127.17.249.193:33285 shutting down...
I20260709 12:18:37.569329 29208 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:37.570086 22821 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:18:37.567751 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:37.585902 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:37.590487 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:37.591161 22892 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:37.557854 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.559952 23656 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:37.560290 22570 catalog_manager.cc:5697] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 20 to 22, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 22 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:37.601791 22819 raft_consensus.cc:2393] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:37.553603 23659 raft_consensus.cc:2393] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 20: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:37.510388 29092 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:37.616812 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1479) took 1134 ms. Trace:
I20260709 12:18:37.526120 29457 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:37.552978 29419 consensus_meta.cc:287] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.936s	user 0.016s	sys 0.010s
W20260709 12:18:37.633683 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 66004.9us
I20260709 12:18:37.636159 22570 catalog_manager.cc:5697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 15 to 20, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 20 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
W20260709 12:18:37.617537 29411 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:18:37.552461 29316 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.641673 23679 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:37.604317 29453 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:37.654615 28603 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:37.604557 29478 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:37.604038 29208 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:37.661278 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:37.642027 29171 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.002s
I20260709 12:18:37.654747 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:37.622957 22896 rpcz_store.cc:276] 0709 12:18:36.482024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.688046 (+206022us) service_pool.cc:224] Handling call
0709 12:18:36.688599 (+   553us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:36.689534 (+   935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.689585 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:36.734726 (+ 45141us) log.cc:844] Serialized 52 byte log entry
0709 12:18:37.305491 (+570765us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:37.338607 (+ 33116us) log.cc:844] Serialized 14 byte log entry
0709 12:18:37.339159 (+   552us) log.cc:844] Serialized 14 byte log entry
0709 12:18:37.339401 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.339499 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.616536 (+277037us) raft_consensus.cc:1685] finished
0709 12:18:37.616574 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.616748 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3433,"prepare.queue_time_us":356248,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":86,"raft.queue_time_us":335,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":20063,"spinlock_wait_cycles":16166656,"thread_start_us":415182,"threads_started":1,"wal-append.queue_time_us":625871}
I20260709 12:18:37.680044 28603 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:37.680826 28603 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:37.680868 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:37.674113 22892 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:37.644764 29457 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:37.691733 22892 raft_consensus.cc:1275] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 12:18:37.558279 29317 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:37.687216 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:37.687455 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:37.714646 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:37.715026 22893 raft_consensus.cc:2376] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20. Re-sending same reply.
I20260709 12:18:37.715446 22900 raft_consensus.cc:2376] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20. Re-sending same reply.
I20260709 12:18:37.715998 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:37.716642 22893 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:37.688891 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:37.701107 22570 catalog_manager.cc:5697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:37.688788 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:37.641306 29051 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:18:37.724354 28603 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:37.731305 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:37.671980 29316 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:37.651616 29493 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:37.683558 29339 consensus_meta.cc:287] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.658s	user 0.013s	sys 0.000s
I20260709 12:18:37.725338 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:37.744756 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:37.747550 22894 raft_consensus.cc:2376] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18. Re-sending same reply.
W20260709 12:18:37.724952 29438 consensus_meta.cc:287] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 1.097s	user 0.014s	sys 0.006s
I20260709 12:18:37.750136 22823 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:37.696826 29028 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:37.716545 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:37.701184 29478 raft_consensus.cc:697] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 22 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:37.800137 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 366192us
I20260709 12:18:37.658905 29419 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:37.804296 22893 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:37.832137 22570 catalog_manager.cc:5697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:37.796490 22895 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 22.
I20260709 12:18:37.703641 29171 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:37.842530 22570 catalog_manager.cc:5697] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 14 to 17, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 17 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:37.656777 29376 consensus_queue.cc:237] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:37.860131 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.862828 22748 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
W20260709 12:18:37.857941 29330 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.225s	user 0.010s	sys 0.007s
I20260709 12:18:37.846449 29388 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.857702 29483 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:37.760586 29339 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:37.884652 22827 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:37.898180 22570 catalog_manager.cc:5697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 10 to 15, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 15 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:37.891677 23682 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:37.894233 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:37.862537 29475 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:37.798882 29493 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:37.749289 29189 consensus_queue.cc:237] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:37.859983 29448 consensus_queue.cc:1048] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:18:37.929417 22822 raft_consensus.cc:1240] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:37.802102 29092 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:37.924614 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:37.937186 29260 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:37.937979 29260 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:37.940500 29260 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:37.912794 29431 consensus_meta.cc:287] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.000s
I20260709 12:18:37.951481 22570 catalog_manager.cc:5697] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 11 to 17, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 17 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:37.971733 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 522383us
I20260709 12:18:37.973364 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:37.975783 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:37.974718 22570 catalog_manager.cc:5697] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 15 to 20, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 20 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:37.941274 29501 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:18:37.892973 29388 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:37.992309 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:37.982724 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 88558.4us
I20260709 12:18:38.007905 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:38.009495 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.958226 29415 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.011193 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:38.015211 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.012017 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:38.062026 22895 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:38.061414 22570 catalog_manager.cc:5697] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 21 to 24, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 24 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:38.050678 22896 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:18:37.967857 29478 consensus_queue.cc:237] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:38.062134 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.067703 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.068229 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.060858 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 47276.6us
W20260709 12:18:38.070770 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 62952us
I20260709 12:18:38.076786 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:37.985813 29441 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:38.084895 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.999646 29260 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.999181 29431 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.077212 22570 catalog_manager.cc:5697] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:37.998697 29174 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:38.033262 29208 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:38.133072 22744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1682) took 1250 ms. Trace:
W20260709 12:18:38.118301 29501 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:18:38.133689 22744 rpcz_store.cc:276] 0709 12:18:36.883028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.883285 (+   257us) service_pool.cc:224] Handling call
0709 12:18:36.883756 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.884029 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:37.229055 (+345026us) log.cc:844] Serialized 14 byte log entry
0709 12:18:37.638677 (+409622us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.132546 (+493869us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:38.132642 (+    96us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:38.132704 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.132791 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.132999 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30269,"prepare.queue_time_us":68431,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":110,"raft.queue_time_us":135795,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":31238,"thread_start_us":1180729,"threads_started":3,"wal-append.queue_time_us":637392}
I20260709 12:18:38.114413 29317 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:38.154429 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 77758.8us
I20260709 12:18:38.079631 29482 consensus_queue.cc:1048] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 12:18:38.083364 29415 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:38.125687 29377 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:18:38.135262 29431 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:38.127532 29441 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:38.170166 22895 raft_consensus.cc:2468] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 24.
I20260709 12:18:38.142081 29448 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:38.282249 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:38.297377 22793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.005s	sys 0.013s
W20260709 12:18:38.237839 22818 consensus_meta.cc:287] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.558s	user 0.013s	sys 0.001s
W20260709 12:18:38.302162 23682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45644 (request call id 1382) took 1798 ms (client timeout 1660 ms). Trace:
W20260709 12:18:38.189446 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 464101us
I20260709 12:18:38.323194 22818 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
W20260709 12:18:38.322980 22793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.005s	sys 0.013s
W20260709 12:18:38.323355 23682 rpcz_store.cc:269] 0709 12:18:36.503660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.503821 (+   161us) service_pool.cc:224] Handling call
0709 12:18:38.298496 (+1794675us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002be8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:38.302071 (+  3575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3188921728}
I20260709 12:18:38.327025 23494 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:38.328277 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:38.329397 22895 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:38.330387 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:38.334013 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 167588us
I20260709 12:18:38.332286 28603 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:38.337646 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
W20260709 12:18:38.195115 29299 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.915s	user 0.015s	sys 0.000s
I20260709 12:18:38.335994 29515 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:38.416427 29517 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:18:38.417131 29470 consensus_meta.cc:287] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.950s	user 0.009s	sys 0.004s
W20260709 12:18:38.293481 29426 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.897s	user 0.010s	sys 0.006s
W20260709 12:18:38.270349 29371 consensus_meta.cc:287] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.038s	user 0.013s	sys 0.002s
I20260709 12:18:38.427954 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:38.263501 29505 log.cc:927] Time spent T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 12:18:38.257651 29516 log.cc:927] Time spent T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:18:38.258229 29514 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:18:38.168540 29174 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:38.294623 29493 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:38.258944 29508 log.cc:927] Time spent T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:18:38.295970 29485 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.985s	user 0.021s	sys 0.003s
W20260709 12:18:38.297092 29424 consensus_meta.cc:287] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.902s	user 0.014s	sys 0.000s
W20260709 12:18:38.256922 29509 log.cc:927] Time spent T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:18:38.170324 29051 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:38.141825 29260 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:38.203665 29171 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:38.253921 29339 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:38.229450 29511 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:18:38.435711 29487 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:38.439302 29523 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.440199 29174 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:38.440939 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:38.441015 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1846) took 1096 ms. Trace:
I20260709 12:18:38.317618 29448 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:38.443017 28603 raft_consensus.cc:2804] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:38.340955 29483 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:38.316594 29414 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:38.445739 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 108152us
W20260709 12:18:38.427603 29040 consensus_meta.cc:287] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.068s	user 0.009s	sys 0.005s
I20260709 12:18:38.232795 29419 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:38.436071 29426 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:18:38.462651 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.469578 29415 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:38.470322 29100 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.173s	user 0.013s	sys 0.004s
I20260709 12:18:38.435750 29524 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:38.436293 29371 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:38.482805 28603 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.484938 29448 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:38.519265 28603 raft_consensus.cc:3060] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:38.435230 29299 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:38.453042 29525 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.482606 22826 rpcz_store.cc:276] 0709 12:18:37.344781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.344983 (+   202us) service_pool.cc:224] Handling call
0709 12:18:37.384947 (+ 39964us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:37.385353 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:37.385385 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:18:37.436757 (+ 51372us) log.cc:844] Serialized 78 byte log entry
0709 12:18:38.009980 (+573223us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:38.010034 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.010128 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:38.440680 (+430552us) raft_consensus.cc:1685] finished
0709 12:18:38.440712 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.440933 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12302,"raft.queue_time_us":364,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":17657,"thread_start_us":490813,"threads_started":1,"wal-append.queue_time_us":800166}
I20260709 12:18:38.496963 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:38.341187 29521 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.157s
I20260709 12:18:38.453601 29528 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.437229 29470 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:38.470369 29530 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:38.453562 29423 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:18:38.438282 29515 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:38.494261 29174 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:38.606899 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1850) took 1216 ms. Trace:
I20260709 12:18:38.522456 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:38.609073 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:38.493294 29467 raft_consensus.cc:3055] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:18:38.546696 29529 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:18:38.539335 29457 consensus_meta.cc:287] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.805s	user 0.010s	sys 0.007s
W20260709 12:18:38.619967 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 51514.5us
I20260709 12:18:38.620548 23685 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: [15.8-17.9]
W20260709 12:18:38.518985 29440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.001s	sys 0.025s
I20260709 12:18:38.455088 29424 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:38.498801 29040 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:38.492061 29512 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:18:38.493481 29476 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:18:38.570813 22825 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:38.522352 29415 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:38.552678 29469 consensus_meta.cc:287] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.034s	user 0.006s	sys 0.011s
I20260709 12:18:38.492142 29487 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:38.578091 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:38.592221 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.607812 22822 rpcz_store.cc:276] 0709 12:18:37.390306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.407245 (+ 16939us) service_pool.cc:224] Handling call
0709 12:18:37.453594 (+ 46349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.936740 (+483146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.606467 (+669727us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b5400302854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:38.606803 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093565312}
I20260709 12:18:38.499547 29414 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:38.616945 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1583) took 1319 ms. Trace:
I20260709 12:18:38.556039 29525 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:38.552234 29404 consensus_queue.cc:1048] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:18:38.552822 29426 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:38.624830 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1392) took 1308 ms. Trace:
I20260709 12:18:38.657557 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 1261) took 1283 ms. Trace:
I20260709 12:18:38.632781 28603 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:38.633008 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:38.607653 29377 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.573828 29051 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:38.635736 22896 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:18:38.617172 29467 raft_consensus.cc:740] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:38.624194 29440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.002s	sys 0.025s
I20260709 12:18:38.634351 22892 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:38.624523 29339 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.492062 29523 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:38.647248 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 219402us
I20260709 12:18:38.658273 22821 rpcz_store.cc:276] 0709 12:18:37.374606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.376217 (+  1611us) service_pool.cc:224] Handling call
0709 12:18:37.411704 (+ 35487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.570596 (+158892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.657267 (+1086671us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54001261d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:38.657484 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363592960}
I20260709 12:18:38.645700 22901 rpcz_store.cc:276] 0709 12:18:37.260281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.260447 (+   166us) service_pool.cc:224] Handling call
0709 12:18:37.260758 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:37.261120 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:37.261147 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:37.261662 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:18:37.643761 (+382099us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:37.677076 (+ 33315us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.166997 (+489921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.167112 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:38.579872 (+412760us) raft_consensus.cc:1685] finished
0709 12:18:38.579906 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.580114 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7653,"prepare.queue_time_us":29575,"prepare.run_cpu_time_us":275,"prepare.run_wall_time_us":276,"raft.queue_time_us":269944,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":11886,"thread_start_us":862693,"threads_started":2,"wal-append.queue_time_us":713671}
I20260709 12:18:38.657904 23672 rpcz_store.cc:276] 0709 12:18:37.316132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.316293 (+   161us) service_pool.cc:224] Handling call
0709 12:18:37.340431 (+ 24138us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:37.383405 (+ 42974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:37.383474 (+    69us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:37.393649 (+ 10175us) log.cc:844] Serialized 52 byte log entry
0709 12:18:37.656002 (+262353us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:37.656046 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.656127 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:38.624505 (+968378us) raft_consensus.cc:1685] finished
0709 12:18:38.624538 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.624742 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7167,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13110,"thread_start_us":236668,"threads_started":1,"wal-append.queue_time_us":555415}
I20260709 12:18:38.639541 29431 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:38.640300 29533 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.681974 29533 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:38.578184 29530 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:38.637624 29419 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:38.669363 28603 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:38.571940 29528 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:38.672982 22826 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 22. Current term is 23. Ops: []
I20260709 12:18:38.650091 29100 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.626770 29457 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:38.666855 22895 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:38.647682 29469 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:38.721146 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1583) took 1209 ms. Trace:
I20260709 12:18:38.652016 29441 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:38.727495 28603 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:38.728088 28603 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:38.728533 28603 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:38.735504 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 113381us
I20260709 12:18:38.736630 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:38.737299 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:38.739902 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:38.723903 22826 rpcz_store.cc:276] 0709 12:18:37.512163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.649279 (+1137116us) service_pool.cc:224] Handling call
0709 12:18:38.665448 (+ 16169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.720571 (+ 55123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.721059 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:38.674124 29440 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:38.671855 29521 consensus_queue.cc:1048] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:18:38.743479 22822 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 21. Current term is 22. Ops: []
W20260709 12:18:38.723606 29421 consensus_meta.cc:287] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.197s	user 0.014s	sys 0.002s
I20260709 12:18:38.750803 22824 raft_consensus.cc:2368] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17.
I20260709 12:18:38.751819 22823 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 26: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:18:38.753684 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 265635us
I20260709 12:18:38.671417 29377 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:38.760703 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1845) took 1422 ms. Trace:
I20260709 12:18:38.761085 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:38.764326 22818 raft_consensus.cc:1240] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:38.796404 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1585) took 1235 ms. Trace:
I20260709 12:18:38.796769 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:38.796420 22748 raft_consensus.cc:1240] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20. Ops: []
W20260709 12:18:38.782359 22825 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1844) took 1444 ms (client timeout 1859 ms). Trace:
I20260709 12:18:38.799288 22791 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:38.771777 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 1253) took 2026 ms. Trace:
I20260709 12:18:38.685515 29339 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:38.794833 22827 rpcz_store.cc:276] 0709 12:18:37.338069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.338192 (+   123us) service_pool.cc:224] Handling call
0709 12:18:37.372289 (+ 34097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.907309 (+535020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.760400 (+853091us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54000f19d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:38.760622 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156242176}
W20260709 12:18:38.742313 29028 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.916s	user 0.012s	sys 0.005s
I20260709 12:18:38.731029 29536 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:38.758064 29297 consensus_meta.cc:287] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 1.340s	user 0.015s	sys 0.002s
I20260709 12:18:38.789893 22822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1582) took 1278 ms. Trace:
I20260709 12:18:38.823701 22822 rpcz_store.cc:276] 0709 12:18:37.511845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.648496 (+1136651us) service_pool.cc:224] Handling call
0709 12:18:38.669826 (+ 21330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.750375 (+ 80549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.789515 (+ 39140us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b5400124dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:38.789807 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168874240}
I20260709 12:18:38.791225 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1873) took 1102 ms. Trace:
I20260709 12:18:38.776767 23685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45644 (request call id 1393) took 1458 ms. Trace:
I20260709 12:18:38.826627 23685 rpcz_store.cc:276] 0709 12:18:37.318594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.318712 (+   118us) service_pool.cc:224] Handling call
0709 12:18:37.319096 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:38.621154 (+1302058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.776449 (+155295us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000a4454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:38.776691 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2992263936}
I20260709 12:18:38.807364 22818 rpcz_store.cc:276] 0709 12:18:37.560735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.763611 (+1202876us) service_pool.cc:224] Handling call
0709 12:18:38.764046 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.796015 (+ 31969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.796320 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:38.807860 22825 rpcz_store.cc:269] 0709 12:18:37.337626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.337772 (+   146us) service_pool.cc:224] Handling call
0709 12:18:38.782000 (+1444228us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400123ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:38.782226 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2726741888}
I20260709 12:18:38.785892 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1580) took 1284 ms. Trace:
I20260709 12:18:38.720176 29419 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:38.838104 28603 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:38.825706 22892 rpcz_store.cc:276] 0709 12:18:37.688790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.716311 (+ 27521us) service_pool.cc:224] Handling call
0709 12:18:38.790943 (+1074632us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54006ea854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:38.791104 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662818048}
I20260709 12:18:38.830546 22819 rpcz_store.cc:276] 0709 12:18:37.501366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.633848 (+132482us) service_pool.cc:224] Handling call
0709 12:18:37.660597 (+ 26749us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:37.947348 (+286751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:37.947407 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:37.960562 (+ 13155us) log.cc:844] Serialized 52 byte log entry
0709 12:18:38.340145 (+379583us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:38.450604 (+110459us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.464426 (+ 13822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.778604 (+314178us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b180035e9c0. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1 00007fadf1694779 00007fadf1694709 00007fadf16946d1 00007fadf16939cd 0000000000388634 0000000000388479 00007fadf167583a
0709 12:18:38.785343 (+  6739us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54005d8254. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:38.785424 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:38.785501 (+    77us) raft_consensus.cc:1685] finished
0709 12:18:38.785519 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.785803 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3385,"prepare.queue_time_us":109198,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":3424,"raft.queue_time_us":20878,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":16073,"spinlock_wait_cycles":678172800,"thread_start_us":279067,"threads_started":1,"wal-append.queue_time_us":494534}
I20260709 12:18:38.844827 22827 raft_consensus.cc:1275] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:38.800697 22820 rpcz_store.cc:276] 0709 12:18:36.745388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.745619 (+   231us) service_pool.cc:224] Handling call
0709 12:18:36.809107 (+ 63488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:37.151799 (+342692us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:18:37.283279 (+131480us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b1800271a80. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf1674e07 00007fadfa4cf9a9 00007fadf169169b 00007fadf168f93f 00007fadf168f455 00007fadf81773c7 00007fadf47899a7 00007fadf47990bf 00007fadf4799038
0709 12:18:37.614394 (+331115us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.142544 (+528150us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.142671 (+   127us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:38.143204 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:18:38.143332 (+   128us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:38.143367 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.771267 (+627900us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54007a3354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:38.771345 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:38.771427 (+    82us) raft_consensus.cc:1685] finished
0709 12:18:38.771450 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.771684 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":709689,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":125,"raft.queue_time_us":51532,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":29350,"spinlock_wait_cycles":615232640,"thread_start_us":769108,"threads_started":2,"wal-append.queue_time_us":569739}
W20260709 12:18:38.850445 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 354541us
I20260709 12:18:38.794270 29421 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:38.851634 22826 raft_consensus.cc:1240] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 12:18:38.726294 29100 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:38.669406 29418 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:38.838625 22895 raft_consensus.cc:2468] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
W20260709 12:18:38.859438 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 98447.3us
I20260709 12:18:38.794227 29260 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:38.862036 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:38.807624 29208 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.889146 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:38.819721 29028 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:38.756894 29404 consensus_queue.cc:1059] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 12:18:38.892078 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:38.895450 28603 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:38.896797 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:38.821688 29537 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:38.835520 29483 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:38.906095 22896 raft_consensus.cc:2468] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
I20260709 12:18:38.911630 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:38.905721 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:38.848591 29482 raft_consensus.cc:2804] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:18:38.913501 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:38.914502 22898 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 24.
I20260709 12:18:38.912833 22747 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:38.916111 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:38.918597 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:38.926460 22901 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
I20260709 12:18:38.852216 29299 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:38.850102 29485 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:38.932144 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:38.965580 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:38.958838 22790 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:38.967365 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:38.968214 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:38.969106 29538 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:18:38.968226 22901 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:38.970918 29535 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:18:38.972677 29544 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.972772 29299 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:38.973943 29040 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:38.973819 29299 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:38.899259 29208 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:38.979734 29487 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:38.980963 22824 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 21. Current term is 22. Ops: []
I20260709 12:18:38.893601 29519 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:38.983888 29299 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:38.846552 29297 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:38.950968 29493 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.985296 29493 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:38.987308 29297 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:38.988019 29493 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:38.959244 29533 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:38.948160 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:38.990757 29523 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:38.991346 22896 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:38.991762 29540 consensus_queue.cc:1059] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:38.993201 29540 raft_consensus.cc:3055] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:38.993619 29540 raft_consensus.cc:740] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:38.993834 22901 raft_consensus.cc:2468] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:38.995558 29525 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:38.904644 29438 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:38.984273 29543 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:18:38.858862 29376 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 12:18:38.902712 29470 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:39.017534 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 85479.7us
I20260709 12:18:38.927328 29418 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:39.022173 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:39.023173 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:38.821946 29467 consensus_queue.cc:260] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:38.928258 29424 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:38.929296 29371 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:38.944386 22900 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:38.837060 29536 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:39.038578 28603 consensus_queue.cc:1059] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:39.042616 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:38.948863 29388 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.001084 29521 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.958426 29441 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:39.050876 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:39.041823 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 358482us
I20260709 12:18:39.062510 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:39.063563 22901 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:39.049445 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:39.000838 29515 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:39.070024 22900 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:39.075013 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.046654 29493 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:39.103046 22820 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
I20260709 12:18:39.002056 29485 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:39.049892 29470 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.058437 29028 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.028257 29438 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:38.920521 29537 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:39.062239 29388 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:38.962639 29440 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:39.129439 22896 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:39.134208 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:39.119341 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.113896 22717 connection.cc:256] RPC call timeout handler was delayed by -1.1162860609999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 12:18:38.973459 29544 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:39.141356 22896 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:39.142895 29549 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:18:39.145013 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.079322 29441 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:39.114663 29423 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:39.179787 22901 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:39.106194 29493 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:39.206128 22821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.034s	sys 0.059s
I20260709 12:18:38.994596 29540 consensus_queue.cc:260] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:39.203868 29519 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:39.207355 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.207752 29523 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:39.215903 22900 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:39.121097 29470 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:39.119606 29028 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:39.223974 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:39.144001 29469 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:39.079733 29521 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:39.149245 29388 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:39.220037 22821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.035s	sys 0.059s
I20260709 12:18:39.208922 29549 consensus_queue.cc:1243] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:39.175402 29436 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:39.264835 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:39.222604 22744 raft_consensus.cc:1240] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:39.211515 29426 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.206611 29482 raft_consensus.cc:697] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:39.226248 29493 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:39.278298 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:39.228070 29125 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:39.284492 29528 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:39.276384 29523 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.254755 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:39.262473 29457 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:39.265452 29297 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.266129 29423 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:39.112044 29483 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:39.285007 29563 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:39.302707 29388 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:39.320798 29485 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:39.268121 29419 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.305212 29571 raft_consensus.cc:2804] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:18:39.321843 29571 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.272648 29100 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.301311 29545 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:39.304037 29470 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.300454 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:39.322279 29571 raft_consensus.cc:3060] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:39.320325 29563 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:39.314549 29316 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 1.517s	user 0.018s	sys 0.000s
I20260709 12:18:39.332679 29537 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:39.332753 29316 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:39.334197 29563 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:39.318816 29297 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:39.334997 22898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1872) took 1646 ms (client timeout 2034 ms). Trace:
I20260709 12:18:39.335529 29316 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:39.335466 22898 rpcz_store.cc:269] 0709 12:18:37.688484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.688641 (+   157us) service_pool.cc:224] Handling call
0709 12:18:39.334766 (+1646125us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540005fd54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:39.334928 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2724984064}
I20260709 12:18:39.336548 29297 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:39.318262 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 63640us
I20260709 12:18:39.336515 29519 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:39.336954 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:39.338142 22865 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:39.330304 29545 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:39.329025 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:39.331390 29558 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:18:39.339079 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:39.339421 29558 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:39.331224 29548 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:18:39.340373 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:39.311653 29482 consensus_queue.cc:237] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:39.341840 23494 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:39.342049 22895 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:18:39.343433 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1586) took 1708 ms. Trace:
I20260709 12:18:39.343881 22826 rpcz_store.cc:276] 0709 12:18:37.635318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.798830 (+1163512us) service_pool.cc:224] Handling call
0709 12:18:38.825551 (+ 26721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:38.859916 (+ 34365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.343170 (+483254us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b54007a2e54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:39.343370 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59163520}
I20260709 12:18:39.319766 29423 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.340114 29441 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:39.318819 29533 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:18:39.330883 29550 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 12:18:39.321907 29174 consensus_meta.cc:287] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.001s
I20260709 12:18:39.346722 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:39.349321 22865 leader_election.cc:400] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17.
I20260709 12:18:39.339908 29558 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:39.355176 22865 leader_election.cc:403] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:39.316632 29438 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:39.313601 29521 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.356163 29174 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:39.364477 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1590) took 1352 ms. Trace:
I20260709 12:18:39.366333 22747 raft_consensus.cc:2393] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:18:39.352977 29524 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.801s	user 0.007s	sys 0.006s
I20260709 12:18:39.296396 29436 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.298950 29426 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.354368 29525 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:39.351341 29100 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:39.392926 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:39.317082 29523 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.366364 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1589) took 1354 ms. Trace:
I20260709 12:18:39.358341 29297 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:18:39.365393 29539 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:18:39.364981 22899 rpcz_store.cc:276] 0709 12:18:38.012086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.012283 (+   197us) service_pool.cc:224] Handling call
0709 12:18:38.063456 (+ 51173us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:38.433476 (+370020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:38.433527 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:38.447823 (+ 14296us) log.cc:844] Serialized 52 byte log entry
0709 12:18:38.666559 (+218736us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:39.058599 (+392040us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.084621 (+ 26022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.363603 (+278982us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b180042e140. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419
0709 12:18:39.364139 (+   536us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400848354. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:39.364200 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.364247 (+    47us) raft_consensus.cc:1685] finished
0709 12:18:39.364261 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.364411 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37587,"prepare.queue_time_us":617519,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":133527,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":34991,"spinlock_wait_cycles":824425984,"thread_start_us":560082,"threads_started":2,"wal-append.queue_time_us":359916}
I20260709 12:18:39.394901 22894 rpcz_store.cc:276] 0709 12:18:38.011750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.011914 (+   164us) service_pool.cc:224] Handling call
0709 12:18:38.062346 (+ 50432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:38.481708 (+419362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:38.481756 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:38.497633 (+ 15877us) log.cc:844] Serialized 26 byte log entry
0709 12:18:38.889499 (+391866us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:38.889544 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.889627 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.366088 (+476461us) raft_consensus.cc:1685] finished
0709 12:18:39.366115 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.366291 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":225675,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":16746,"thread_start_us":741774,"threads_started":2,"wal-append.queue_time_us":596140}
I20260709 12:18:39.395529 22827 raft_consensus.cc:2368] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22.
I20260709 12:18:39.360814 29533 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:39.365001 29174 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:39.371104 29536 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:39.386500 29537 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:39.383976 29524 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:18:39.413326 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 201752us
I20260709 12:18:39.415993 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:39.399392 29525 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:39.425601 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1584) took 1913 ms. Trace:
I20260709 12:18:39.426288 22894 raft_consensus.cc:1275] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:18:39.426234 22821 rpcz_store.cc:276] 0709 12:18:37.512486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.679774 (+1167288us) service_pool.cc:224] Handling call
0709 12:18:38.680315 (+   541us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:38.680958 (+   643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:38.681003 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:38.681939 (+   936us) log.cc:844] Serialized 52 byte log entry
0709 12:18:39.283825 (+601886us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:39.283891 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.284057 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.425303 (+141246us) raft_consensus.cc:1685] finished
0709 12:18:39.425334 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.425518 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":158,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":116,"thread_start_us":601334,"threads_started":1,"wal-append.queue_time_us":632152}
I20260709 12:18:39.410982 29297 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:39.411895 29028 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:39.422830 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:39.438059 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:39.452358 29028 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.453027 29028 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:39.455526 22865 leader_election.cc:336] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:39.456128 22865 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:39.457506 22865 leader_election.cc:336] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:39.458237 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:39.464709 22865 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:39.467869 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:39.469379 28603 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:39.470253 28603 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:39.444562 29438 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:18:39.471931 22865 leader_election.cc:336] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:39.473517 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:39.475391 22865 leader_election.cc:336] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:39.476222 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:39.427742 29174 consensus_queue.cc:1059] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:18:39.462913 29523 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:39.465502 29404 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:39.451313 29388 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:18:39.471726 29431 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:39.474298 29438 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:39.462524 29561 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.126s
I20260709 12:18:39.486091 29297 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:39.506613 29551 consensus_queue.cc:1059] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:18:39.509126 22892 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 19. Current term is 20. Ops: [17.9-19.10]
I20260709 12:18:39.509394 29554 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:39.511860 22896 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 19. Current term is 20. Ops: [19.10-19.10]
W20260709 12:18:39.515905 29448 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.961s	user 0.012s	sys 0.005s
I20260709 12:18:39.516572 29448 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.517628 22750 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:39.521168 29482 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.522012 29482 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.494199 29438 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:39.476225 29533 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.531991 29482 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:39.535542 29436 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:39.536401 29436 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:39.536830 29436 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:39.537889 29436 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.482679 29525 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:39.473326 29559 consensus_queue.cc:1059] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 12:18:39.545903 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 53435.5us
I20260709 12:18:39.550566 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:39.556651 22825 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:39.556493 22717 leader_election.cc:336] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.034s (SENT)
I20260709 12:18:39.560178 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:39.549855 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:39.577698 22894 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: [15.8-17.9]
I20260709 12:18:39.584326 22894 raft_consensus.cc:1240] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
W20260709 12:18:39.548593 29526 log.cc:927] Time spent T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 1.003s	user 0.002s	sys 0.006s
I20260709 12:18:39.546919 29522 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:39.541692 29544 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:39.552332 29189 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:39.535498 29493 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:39.613595 29174 raft_consensus.cc:3055] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:39.632442 29174 raft_consensus.cc:740] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:39.633543 29418 consensus_meta.cc:287] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.589s	user 0.015s	sys 0.000s
I20260709 12:18:39.634491 29584 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:18:39.596608 29519 raft_consensus.cc:3055] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:39.638497 29174 consensus_queue.cc:260] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.661815 29493 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:39.662827 22826 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:39.604313 29189 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:39.649762 29558 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:39.686451 22825 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:39.598726 29436 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:39.677523 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 121087us
W20260709 12:18:39.699384 22717 leader_election.cc:336] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 2.168s (SENT)
I20260709 12:18:39.700039 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:39.670944 29519 raft_consensus.cc:740] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:39.740635 22825 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:39.689122 29388 consensus_queue.cc:1243] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer a89a4b420ea9496aab55475fc38bb6f7 log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:39.745533 22827 raft_consensus.cc:1240] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
W20260709 12:18:39.747150 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 55988.1us
I20260709 12:18:39.756404 29189 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.757965 29189 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:39.701205 29174 raft_consensus.cc:3060] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:39.760346 29438 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:39.760795 28603 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:39.764779 29208 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:39.765969 29545 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.766974 29584 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:18:39.771142 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.771842 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.771481 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 296090us
I20260709 12:18:39.762626 29438 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.764926 29558 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:39.799896 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.802819 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.805455 29571 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:39.806857 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:39.808339 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:39.809468 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:39.790261 29592 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.747191 29519 consensus_queue.cc:260] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.811545 22900 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:18:39.812441 29519 raft_consensus.cc:3060] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:39.812944 29421 raft_consensus.cc:3055] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:39.813576 29421 raft_consensus.cc:740] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:39.810767 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:39.794121 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:39.791074 22865 leader_election.cc:336] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:39.814574 29421 consensus_queue.cc:260] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:39.822943 29467 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:39.823571 29438 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:39.819299 29592 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:39.833478 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:39.836359 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.840586 22897 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:39.812886 29537 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17.
I20260709 12:18:39.789716 29487 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:39.836524 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:39.852381 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:39.853118 22750 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:39.853036 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:39.856339 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 65325.3us
W20260709 12:18:39.857263 22865 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:39.857614 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:39.858592 29591 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.858649 29597 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:39.859683 29591 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:39.861562 22865 leader_election.cc:336] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:39.862216 22865 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:39.859304 23494 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:39.862766 22865 consensus_peers.cc:597] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:39.867583 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:39.864377 29597 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:39.878688 29483 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:39.879029 29558 consensus_queue.cc:1059] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:39.881022 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:39.882194 22746 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:39.889519 29414 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.894934 29339 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:39.896914 29448 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:39.849706 29421 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:39.871009 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:39.899428 22865 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:39.899878 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:39.900988 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:39.901544 22865 consensus_peers.cc:597] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:39.902030 22865 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:39.869410 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:39.869356 29040 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:39.904282 22750 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 25.
W20260709 12:18:39.877780 22717 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 56 similar messages]
I20260709 12:18:39.854539 29388 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:39.854233 29584 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:39.911170 22897 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
W20260709 12:18:39.914300 22865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.915455 23494 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:39.916565 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:39.916967 22895 raft_consensus.cc:3055] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:39.917336 22895 raft_consensus.cc:740] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:39.918175 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:39.918766 22900 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:39.920635 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:39.921348 22748 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:39.922371 29524 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:18:39.921451 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:39.929358 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:39.930081 22717 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:39.923367 22895 consensus_queue.cc:260] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:39.930579 22750 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
W20260709 12:18:39.931233 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:39.864892 29189 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.923506 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:39.931483 22895 raft_consensus.cc:3060] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:39.935214 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:39.937207 22717 leader_election.cc:336] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:39.923507 29040 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:39.910945 29414 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:39.922451 29591 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:39.938915 22900 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:39.930015 29339 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.947817 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:39.948436 22900 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:39.949705 22900 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:39.937714 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:39.946372 22748 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:39.953025 22895 raft_consensus.cc:1275] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:18:39.955345 22717 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:39.955868 22748 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
W20260709 12:18:39.956094 22717 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:39.956460 22748 pending_rounds.cc:85] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 9
I20260709 12:18:39.956809 22748 pending_rounds.cc:107] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 19.10
W20260709 12:18:39.956835 22717 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:39.957211 22748 raft_consensus.cc:2889] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:39.958983 29028 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:39.961620 29592 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.946216 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:39.963501 22747 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 20: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:39.963299 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:39.964401 22895 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:39.966012 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:39.966511 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:39.967640 29028 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:39.968077 29028 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.968487 29028 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:39.972223 22744 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:39.974902 23493 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:39.975863 22824 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52398 (request call id 1587) took 2293 ms. Trace:
I20260709 12:18:39.976119 23493 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:39.976330 22824 rpcz_store.cc:276] 0709 12:18:37.682987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.813756 (+1130769us) service_pool.cc:224] Handling call
0709 12:18:38.814253 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.981503 (+167250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.975590 (+994087us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400301954. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:39.975790 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382748928}
I20260709 12:18:39.977555 29028 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:39.980274 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:39.979074 29558 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:39.981900 29558 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.982340 29554 raft_consensus.cc:3055] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:39.985924 29554 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:39.987836 29575 raft_consensus.cc:3055] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:18:39.988261 29575 raft_consensus.cc:740] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:39.989180 29575 consensus_queue.cc:260] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:39.993397 29426 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.936113 29524 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:39.995738 29524 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:39.907939 29388 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.002197 29388 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:40.006050 29421 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:39.927897 29584 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.007408 29040 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:40.009382 29584 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:39.979014 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:39.983049 28603 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:18:39.983299 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:39.983762 29525 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.984259 29572 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.984846 29545 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:39.982411 29558 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:39.990713 29575 raft_consensus.cc:3060] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:39.982990 29028 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:39.977124 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:40.011027 22746 raft_consensus.cc:2468] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:40.011520 28603 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 25 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:40.011953 29591 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:40.016372 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:39.986945 29554 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:39.955134 29571 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:40.019199 29545 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.938640 29189 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.026955 28603 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:40.029171 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.029698 22744 raft_consensus.cc:1240] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:40.012506 22900 raft_consensus.cc:1240] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:40.017655 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:40.030642 22895 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:40.030825 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.020896 29483 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:40.045526 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:40.008054 29540 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:40.007470 29339 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:40.021080 29572 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:40.053392 22717 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:40.047349 22900 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:40.019716 29525 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.044705 22748 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:40.037180 29545 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:40.034941 29561 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.054452 22717 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:40.021183 29421 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:40.056684 22864 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:40.056454 29571 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:40.091550 22895 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:40.060478 29476 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:40.097506 22900 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
W20260709 12:18:40.073858 29419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.015s	sys 0.014s
I20260709 12:18:40.072507 29092 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:40.051803 29388 consensus_queue.cc:1059] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 12:18:40.096465 29587 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 12:18:40.094332 29426 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:40.109591 22897 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:18:40.073030 29561 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:40.046517 29592 consensus_queue.cc:1048] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:18:40.116143 29421 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:40.117854 29525 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:40.118870 29600 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:18:40.122625 22820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 1262) took 1101 ms. Trace:
I20260709 12:18:40.155573 22820 rpcz_store.cc:276] 0709 12:18:39.021737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.021898 (+   161us) service_pool.cc:224] Handling call
0709 12:18:40.122437 (+1100539us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b54007a3854. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:40.122556 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178432256}
I20260709 12:18:40.125615 29377 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:40.128521 29339 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:40.120221 29028 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.146762 22790 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:40.143654 29476 raft_consensus.cc:697] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
W20260709 12:18:40.145370 29419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.016s	sys 0.015s
I20260709 12:18:40.163213 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.163504 29572 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:40.164206 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.164923 22824 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:40.166412 22824 raft_consensus.cc:1275] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:18:40.167323 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.168262 22823 raft_consensus.cc:2393] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 16: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:40.169302 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.163537 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:40.171698 22825 raft_consensus.cc:2393] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 21: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:40.172240 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:40.173275 22818 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 18: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:40.145687 29092 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:40.151925 29599 log.cc:927] Time spent T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 12:18:40.152226 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 85780us
I20260709 12:18:40.148149 29426 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:40.184032 22820 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 15: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:40.185451 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.188984 22824 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
I20260709 12:18:40.185967 22821 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:18:40.191886 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:40.251363 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 59559.2us
I20260709 12:18:40.158004 29189 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:40.254170 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.254575 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.260232 22824 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:40.260475 22827 raft_consensus.cc:2393] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:40.254741 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.255477 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.256773 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.261111 22750 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
W20260709 12:18:40.254869 29587 log.cc:927] Time spent T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:18:40.187124 29092 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:40.186965 29377 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:40.276289 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:40.277153 22900 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:40.268118 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:40.278452 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.278944 22897 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:40.279788 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:40.280400 22897 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 24: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
I20260709 12:18:40.190716 29426 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:40.281352 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.175258 29028 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.288097 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:40.255981 29525 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:18:40.290567 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.293833 22748 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:40.290158 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:40.297428 22897 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 24.
W20260709 12:18:40.298588 18407 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 23696)
I20260709 12:18:40.299873 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:40.299652 22899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1493) took 1359 ms. Trace:
I20260709 12:18:40.308471 22900 raft_consensus.cc:2468] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 26.
I20260709 12:18:40.309659 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:40.311725 29561 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:40.319772 22894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56316 (request call id 1886) took 1065 ms. Trace:
W20260709 12:18:40.320370 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.320504 22894 rpcz_store.cc:276] 0709 12:18:39.254378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.595165 (+340787us) service_pool.cc:224] Handling call
0709 12:18:39.612278 (+ 17113us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:39.612847 (+   569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:39.612895 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:39.622974 (+ 10079us) log.cc:844] Serialized 52 byte log entry
0709 12:18:39.924746 (+301772us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:39.924780 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.924835 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:40.319269 (+394434us) raft_consensus.cc:1685] finished
0709 12:18:40.319314 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.319651 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10078,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":4727,"thread_start_us":239900,"threads_started":1,"wal-append.queue_time_us":373858}
I20260709 12:18:40.256088 29572 consensus_queue.cc:1059] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:18:40.304863 22899 rpcz_store.cc:276] 0709 12:18:38.940617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.409989 (+469372us) service_pool.cc:224] Handling call
0709 12:18:39.418737 (+  8748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:39.419084 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:39.419115 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:39.428530 (+  9415us) log.cc:844] Serialized 26 byte log entry
0709 12:18:39.595560 (+167030us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:39.616578 (+ 21018us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.769370 (+152792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.770628 (+  1258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:40.009549 (+238921us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b18002cb840. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16602a6 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf16923f3 00007fadf16947c1
0709 12:18:40.127629 (+118080us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b48004f8558. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf96a8aa1 00007fadf969fb37 00007fadf969f9ca 00007fadf979726f 00007fadf9796f37 00007fadf97ab55c 00007fadf97ab508 00007fadf97ab488 00007fadf97ab443 00007fadf97aa6ec 00007fadf86d4a96
0709 12:18:40.299444 (+171815us) raft_consensus.cc:1685] finished
0709 12:18:40.299471 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.299592 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20723,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":9412,"raft.run_cpu_time_us":3635,"raft.run_wall_time_us":498052,"spinlock_wait_cycles":71305600,"thread_start_us":282398,"threads_started":2,"wal-append.queue_time_us":184686}
I20260709 12:18:40.326365 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:40.328461 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.331732 22827 raft_consensus.cc:2410] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:18:40.256026 29040 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:18:40.282123 29260 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.333632 22748 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:40.334625 22900 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:40.335724 29260 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.338007 29260 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:40.291752 29476 consensus_queue.cc:237] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:40.346742 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:40.347929 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.352042 22898 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:40.354727 22899 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 12:18:40.360350 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.361151 22827 raft_consensus.cc:2393] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:40.361913 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.362593 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.364082 29028 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:40.346323 29421 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:18:40.365124 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.366147 22821 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 26: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:40.366503 29545 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.367172 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.368093 22818 raft_consensus.cc:2393] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 21: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:40.364545 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.369598 22819 raft_consensus.cc:2393] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:40.368795 29545 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:40.374305 29530 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:40.362558 22820 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:40.379953 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:40.380614 22897 raft_consensus.cc:2468] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:40.390393 22791 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:40.399163 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.401333 22901 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:40.407346 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:40.408277 22901 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
I20260709 12:18:40.409808 22901 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:40.401273 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:40.410529 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:40.420614 22900 raft_consensus.cc:2468] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 22.
I20260709 12:18:40.422706 22819 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:40.384174 29260 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:40.431294 22897 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
I20260709 12:18:40.362493 29426 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:40.436957 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:40.437144 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:40.388439 29092 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:40.433413 29487 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.455930 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:40.451795 29388 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:40.421671 29448 consensus_queue.cc:1048] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:18:40.485231 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.486626 22750 raft_consensus.cc:2410] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
W20260709 12:18:40.498566 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.442597 29189 consensus_queue.cc:1059] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:18:40.462363 29388 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.442693 29260 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:40.505630 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:40.506620 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 116319us
I20260709 12:18:40.520669 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:40.521932 22750 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:40.488976 29519 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:40.459374 29419 consensus_queue.cc:1059] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:18:40.518922 29388 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:18:40.586844 29611 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:40.536473 29571 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:40.464944 29487 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.604503 29426 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:40.605051 29439 raft_consensus.cc:2804] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:40.605643 29439 raft_consensus.cc:697] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:40.606772 29439 consensus_queue.cc:237] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:40.611258 29448 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:40.611930 29448 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:40.613991 29448 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:40.614485 29448 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:40.614961 29431 consensus_queue.cc:1048] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:40.615247 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:40.631151 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.617224 22753 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:18:40.593246 29028 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.615752 29530 consensus_queue.cc:1059] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:40.632084 22749 raft_consensus.cc:2410] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
W20260709 12:18:40.617759 29575 consensus_meta.cc:287] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.003s
I20260709 12:18:40.497256 29558 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.642670 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:40.643934 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.644786 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:40.650887 29448 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:40.661986 22750 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:40.667490 22753 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20. Ops: []
W20260709 12:18:40.666468 22865 leader_election.cc:336] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:40.675036 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:40.677146 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.682541 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:40.680570 22865 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:40.684002 29530 consensus_queue.cc:1243] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:18:40.672158 29028 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:40.687444 22826 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52396 (request call id 1855) took 1629 ms (client timeout 1785 ms). Trace:
W20260709 12:18:40.687975 22826 rpcz_store.cc:269] 0709 12:18:39.057691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.344850 (+287159us) service_pool.cc:224] Handling call
0709 12:18:40.687231 (+1342381us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54005519d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:40.687372 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233637632}
I20260709 12:18:40.689383 29028 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:40.697103 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:40.697309 22865 leader_election.cc:336] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:40.697738 29208 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:40.698388 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.696873 29540 raft_consensus.cc:3055] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:18:40.697988 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:40.698436 29208 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:18:40.705767 22865 leader_election.cc:336] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:40.706214 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:40.703671 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:40.703990 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.719213 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:40.704869 29540 raft_consensus.cc:740] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:40.739853 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.709748 29530 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:40.742381 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.743105 22746 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 14.
I20260709 12:18:40.746047 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.746760 22749 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
W20260709 12:18:40.748744 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.751128 22744 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:40.739472 29092 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:40.746820 29260 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:40.769006 29530 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:40.766580 29575 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.762475 29540 consensus_queue.cc:260] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:40.781225 29558 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:40.782233 29487 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:40.760356 29208 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:40.783286 29525 raft_consensus.cc:3055] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:18:40.793562 22898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56316 (request call id 1884) took 1540 ms (client timeout 1547 ms). Trace:
I20260709 12:18:40.796008 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:40.840116 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 134378us
I20260709 12:18:40.830632 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:40.847240 22898 rpcz_store.cc:269] 0709 12:18:39.253487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.336631 (+ 83144us) service_pool.cc:224] Handling call
0709 12:18:40.793326 (+1456695us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540058e8d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:40.793484 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310010624}
I20260709 12:18:40.833957 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:40.833379 29575 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:40.848618 23493 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:40.851541 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:40.856834 22744 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:18:40.858081 29615 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:18:40.858265 29571 raft_consensus.cc:2804] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:40.858721 29571 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:40.859184 29571 raft_consensus.cc:3060] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:40.865741 29377 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.866382 29377 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:40.872054 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:40.872447 29578 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 1.395s	user 0.008s	sys 0.000s
W20260709 12:18:40.877235 29608 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.534s	user 0.001s	sys 0.000s
I20260709 12:18:40.878561 29551 raft_consensus.cc:3055] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:40.854431 29544 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:40.879094 29551 raft_consensus.cc:740] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:40.879351 29544 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:40.880079 29551 consensus_queue.cc:260] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:40.852181 29558 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:40.881182 29551 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:40.881438 29558 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.881830 29558 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:40.884799 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:40.885528 22748 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:40.854095 22865 leader_election.cc:336] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:40.887774 29448 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:40.847892 29540 raft_consensus.cc:3060] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:40.832245 29482 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
W20260709 12:18:40.889698 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 369112us
I20260709 12:18:40.880234 29544 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.891824 22744 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:40.892309 22791 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:40.895183 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.851482 29525 raft_consensus.cc:740] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:40.899835 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.841974 29260 consensus_queue.cc:1059] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:18:40.913203 22744 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:18:40.917106 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:40.932468 22898 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:18:40.882181 29571 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.834451 29439 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 12:18:40.934978 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:40.942453 22901 raft_consensus.cc:2393] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 26: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:40.898712 29339 raft_consensus.cc:2804] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:18:40.947646 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.916219 29519 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:40.953763 22901 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:18:40.893187 29482 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:40.955317 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 164016us
I20260709 12:18:40.961616 22748 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:40.963855 22894 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:40.961076 29028 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.964913 22901 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:18:40.987180 29626 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:18:40.965148 29519 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:40.980093 29028 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:41.000414 29571 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:40.976543 29482 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:41.002355 29616 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 12:18:41.007539 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55537.4us
I20260709 12:18:40.960551 29575 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:41.004946 29388 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:40.956493 29525 consensus_queue.cc:260] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:41.015407 22752 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 22. Current term is 23. Ops: []
I20260709 12:18:41.004992 29558 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:41.017295 22717 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:41.018159 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:41.021045 22717 leader_election.cc:336] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:41.022141 29388 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:41.021762 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:41.025080 29028 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:41.025578 22717 leader_election.cc:336] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:41.026288 22717 leader_election.cc:336] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:41.027294 22717 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:41.014956 29467 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.037267 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:41.042824 23494 leader_election.cc:400] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22.
I20260709 12:18:41.044382 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:41.044816 22717 consensus_peers.cc:597] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:41.046478 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:41.025146 29533 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.029052 29040 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.033989 29388 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:41.015795 29571 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 12:18:41.083909 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 184672us
I20260709 12:18:41.079957 29438 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.089848 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:41.060837 29606 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:18:41.049579 23493 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:41.043704 29483 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:18:41.042692 29467 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:41.052429 29572 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:18:41.102298 29602 raft_consensus.cc:3055] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:41.103049 29602 raft_consensus.cc:740] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:41.103988 29602 consensus_queue.cc:260] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:41.105206 29602 raft_consensus.cc:3060] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:41.106053 29530 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.106664 29530 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:41.110297 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:41.111740 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 62225.8us
I20260709 12:18:41.073833 22894 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:18:41.087415 29627 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:41.112407 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 185119us
W20260709 12:18:41.096236 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 45172.5us
I20260709 12:18:41.119613 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:41.083034 29040 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:41.119024 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:41.102555 22852 heartbeater.cc:646] Failed to heartbeat to 127.17.249.254:41671 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.249.254:41671 timed out after 15.000s (SENT)
W20260709 12:18:41.118352 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 71980.7us
I20260709 12:18:41.064422 29533 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:41.130054 22790 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:41.134675 22790 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:41.132556 22717 leader_election.cc:336] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:41.096662 29431 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:41.114146 29530 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:41.140651 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:41.139835 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:41.094101 29438 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:41.117235 29612 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:41.161708 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:41.196781 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.198233 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:41.197504 22750 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:41.200450 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 59930us
I20260709 12:18:41.200726 22749 raft_consensus.cc:3055] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:41.201563 22749 raft_consensus.cc:740] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:41.207947 22748 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:18:41.208765 22748 pending_rounds.cc:85] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 8
I20260709 12:18:41.151803 29483 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:41.209138 22748 pending_rounds.cc:107] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:18:41.230212 22748 raft_consensus.cc:2889] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:41.168848 29388 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:41.233212 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:41.232204 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 142390us
I20260709 12:18:41.125062 29627 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:41.207660 22749 consensus_queue.cc:260] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:41.239408 22749 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:41.240935 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:41.223462 29297 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:41.166393 29431 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:41.249627 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:41.209894 29612 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:41.242211 22750 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:41.262559 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:41.229729 29339 raft_consensus.cc:697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:41.203433 29377 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:41.264287 29448 raft_consensus.cc:2764] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 12:18:41.297998 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 57153.2us
I20260709 12:18:41.299125 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:41.301919 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.302093 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:41.298941 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:41.268155 29633 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:41.267809 29297 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:41.245959 29483 consensus_queue.cc:1059] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 12:18:41.305106 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 79227.4us
I20260709 12:18:41.278457 29521 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:41.312896 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:41.310145 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 98385.4us
I20260709 12:18:41.316354 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:41.319031 22749 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 12:18:41.319581 22749 pending_rounds.cc:85] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 12
I20260709 12:18:41.319998 22749 pending_rounds.cc:107] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:18:41.320348 22749 raft_consensus.cc:2889] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:41.324369 29640 log.cc:927] Time spent T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:18:41.307967 29643 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:41.329648 29643 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:41.330097 29643 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:41.330497 29299 consensus_queue.cc:1059] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:41.331714 29299 consensus_queue.cc:1059] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:41.332288 29028 raft_consensus.cc:3055] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:41.332871 29028 raft_consensus.cc:740] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:41.333804 29028 consensus_queue.cc:260] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:41.316370 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:41.277952 29634 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:41.342100 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:41.356014 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:41.344591 22826 raft_consensus.cc:1217] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Deduplicated request from leader. Original: 20.13->[21.14-21.14]   Dedup: 21.14->[]
W20260709 12:18:41.353380 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.335052 29467 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:41.331470 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:41.361737 22826 raft_consensus.cc:1240] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 12:18:41.307825 29633 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.411584 22746 raft_consensus.cc:2393] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 16: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
W20260709 12:18:41.421348 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 65454us
I20260709 12:18:41.352628 29652 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:41.295888 29621 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:18:41.425912 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:41.410163 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 78780.7us
I20260709 12:18:41.428983 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:41.434093 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:41.434684 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 135682us
I20260709 12:18:41.436443 22791 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:41.408664 29572 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:41.442942 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:41.420768 29028 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:41.410184 29634 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.425001 29299 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:41.409339 29592 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:41.425232 29628 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.428471 29633 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:41.329654 29533 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:41.426913 29448 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:41.336468 29512 consensus_queue.cc:1048] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 12:18:41.432929 29040 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:41.444665 29584 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:18:41.445060 29476 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 12:18:41.444856 29388 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:41.421952 29591 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:18:41.449293 29521 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.437985 29421 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:41.461292 29592 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:41.451433 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 106219us
I20260709 12:18:41.460392 29621 raft_consensus.cc:2764] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:18:41.409794 29612 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:41.460207 29634 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.469851 29483 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:18:41.476878 29584 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:41.432669 29339 consensus_queue.cc:237] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:41.563362 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:41.487843 29438 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:41.502803 29592 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:18:41.571676 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.580497 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 144100us
I20260709 12:18:41.583658 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:41.485913 29040 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 12:18:41.595387 29438 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:41.598650 29645 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:18:41.467759 29628 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:41.609732 22791 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:41.562109 29584 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:41.585745 29540 consensus_meta.cc:287] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.694s	user 0.014s	sys 0.000s
I20260709 12:18:41.527540 29659 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:18:41.471434 29297 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:41.627869 22791 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:41.587628 29627 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:41.659802 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:41.677227 22894 raft_consensus.cc:1275] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:18:41.648365 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:41.681247 22901 raft_consensus.cc:2393] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:41.690583 22895 raft_consensus.cc:1240] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:41.693778 22893 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:18:41.633984 29482 raft_consensus.cc:3055] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:18:41.704377 22791 connection.cc:256] RPC call timeout handler was delayed by -1.2039843990000918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 12:18:41.710953 22791 connection.cc:256] RPC call timeout handler was delayed by -1.175543394999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 12:18:41.711687 22791 connection.cc:256] RPC call timeout handler was delayed by -1.1179433949998838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 12:18:41.712230 22791 connection.cc:256] RPC call timeout handler was delayed by -1.0711433949998082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:18:41.713091 22791 connection.cc:256] RPC call timeout handler was delayed by -1.0518843990000732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 12:18:41.713814 22791 connection.cc:256] RPC call timeout handler was delayed by -1.0167843990000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
I20260709 12:18:41.626322 29635 raft_consensus.cc:2804] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:18:41.718357 22892 raft_consensus.cc:1275] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:18:41.629443 29431 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:41.739833 22717 leader_election.cc:336] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:41.781250 22717 leader_election.cc:336] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:41.744776 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 209034us
I20260709 12:18:41.661353 29439 raft_consensus.cc:2804] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:41.628726 29628 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:41.588568 29575 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 12:18:41.661104 29651 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:41.645359 29659 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.692504 29533 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.683516 29523 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:41.758217 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.760301 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:41.801380 22826 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:41.675741 29525 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.625939 29438 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:41.802940 22717 leader_election.cc:336] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:41.803547 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:41.492085 29421 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:41.782469 29602 consensus_meta.cc:287] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.010s
I20260709 12:18:41.787938 29558 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:41.788954 29554 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.838388 29530 consensus_queue.cc:1059] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:41.839419 29530 raft_consensus.cc:3055] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:41.839757 29530 raft_consensus.cc:740] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:41.840646 29530 consensus_queue.cc:260] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:41.841889 29530 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:41.790409 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:41.492594 29521 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:41.845041 29521 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:41.708575 29483 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:41.846278 29483 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:41.708703 29482 raft_consensus.cc:740] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:41.795873 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:41.662034 29260 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:18:41.812059 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:41.803470 29659 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:41.827037 29421 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:41.829174 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:41.830334 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:41.817847 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:41.858054 22752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1668) took 1146 ms. Trace:
I20260709 12:18:41.766741 29661 raft_consensus.cc:2804] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:41.858659 22752 rpcz_store.cc:276] 0709 12:18:40.712165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.712585 (+   420us) service_pool.cc:224] Handling call
0709 12:18:40.712964 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.020684 (+307720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.857717 (+837033us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54006798d4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:41.857974 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695076096}
W20260709 12:18:41.860319 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.862305 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 59402.2us
I20260709 12:18:41.869333 22865 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:41.864387 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 398335us
I20260709 12:18:41.851229 22821 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:41.751446 29643 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:41.876293 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:41.798341 29662 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:41.898015 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:41.896495 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.872668 28603 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:18:41.905673 28603 consensus_queue.cc:1243] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:41.908432 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:41.910508 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:41.846266 29639 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.612s	user 0.000s	sys 0.002s
I20260709 12:18:41.865981 22826 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
W20260709 12:18:41.918150 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:41.934823 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:41.935846 22826 raft_consensus.cc:2468] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
I20260709 12:18:41.812332 29572 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:41.812779 29523 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:41.874152 29602 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:41.866768 29652 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:41.947201 29654 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:41.947970 29660 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:41.948304 29658 log.cc:927] Time spent T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 12:18:41.951577 29664 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 12:18:41.959496 22717 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:41.959874 29633 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:41.960749 29592 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:41.813072 29533 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:41.980777 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.923028 29540 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:41.990105 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:41.924460 29662 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:41.996978 29662 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:41.925236 29661 raft_consensus.cc:697] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:41.998663 22753 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
I20260709 12:18:41.999204 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:42.000797 29438 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:41.913255 29628 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 12:18:42.000908 29260 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:42.003558 29540 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:42.004892 29482 consensus_queue.cc:260] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:41.982734 29656 log.cc:927] Time spent T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 12:18:41.986263 22717 consensus_peers.cc:597] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:41.978492 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:42.031615 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45410.2us
I20260709 12:18:41.984997 29649 consensus_queue.cc:1059] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 12:18:42.013953 29388 consensus_meta.cc:287] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.006s
I20260709 12:18:42.024725 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:42.012830 22819 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:42.012799 29624 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:42.036711 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.031836 22821 raft_consensus.cc:2468] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:42.039629 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:41.972790 29652 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:42.033713 29299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.014s	sys 0.012s
I20260709 12:18:42.018848 29260 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:42.013304 29584 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:41.985762 29660 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:42.039594 29482 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:42.058868 29388 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:18:42.095476 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.067587 29540 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:18:42.102994 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.076804 29299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.016s	sys 0.013s
I20260709 12:18:42.061513 29624 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:42.133019 29208 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:18:42.146219 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:42.147833 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:42.149183 29620 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:18:42.149644 29620 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:42.150563 29620 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:42.154495 29620 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:42.155222 29584 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:42.155941 29584 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.156417 29584 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:42.148561 22822 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:42.160275 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:42.153353 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:42.045866 29572 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:42.161214 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:42.119951 29540 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:42.158558 29584 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:42.163185 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:42.168076 22822 raft_consensus.cc:1240] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:18:42.162146 22746 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 25.
I20260709 12:18:42.166294 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:42.169806 22752 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:42.166728 22745 raft_consensus.cc:1275] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:18:42.135872 29299 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:42.123785 29648 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:42.173138 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:42.173449 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:42.179911 22821 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:18:42.166765 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 246790us
W20260709 12:18:42.168390 29613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.571s	user 0.017s	sys 0.019s
I20260709 12:18:42.072794 29661 consensus_queue.cc:237] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:42.198024 22745 raft_consensus.cc:1240] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:42.197883 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:42.207147 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:42.210887 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.201709 29613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.699s	user 0.018s	sys 0.020s
W20260709 12:18:42.216161 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 297101us
I20260709 12:18:42.224839 29299 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:42.227064 29533 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:42.227932 29533 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:42.228545 29533 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:42.230116 29673 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:18:42.179708 29260 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:42.232255 29633 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:42.235126 29260 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:42.237462 29028 consensus_meta.cc:287] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.002s
I20260709 12:18:42.194845 29635 raft_consensus.cc:697] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:42.251950 29635 consensus_queue.cc:237] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:42.201790 29523 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:42.212399 29483 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:18:42.220996 29540 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:42.216172 29525 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 12:18:42.266666 22819 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:42.273572 22753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42834 (request call id 1664) took 1577 ms. Trace:
I20260709 12:18:42.296355 22753 rpcz_store.cc:276] 0709 12:18:40.696161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.696759 (+   598us) service_pool.cc:224] Handling call
0709 12:18:42.273307 (+1576548us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400192dd4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:42.273477 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2991211904}
I20260709 12:18:42.297340 22746 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:42.298421 29523 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:42.299294 29523 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:42.282116 29643 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:42.285638 29533 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:42.279036 29606 raft_consensus.cc:3055] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:42.303716 29606 raft_consensus.cc:740] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:42.304759 29606 consensus_queue.cc:260] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:42.306157 29606 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:42.307449 29592 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:42.286517 29634 consensus_meta.cc:287] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.720s	user 0.006s	sys 0.007s
I20260709 12:18:42.319612 29634 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:42.320814 22822 raft_consensus.cc:1240] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:42.256784 29633 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
W20260709 12:18:42.289034 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.289968 29377 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:42.293989 22747 pending_rounds.cc:85] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 7
I20260709 12:18:42.327517 22747 pending_rounds.cc:107] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:18:42.327813 22747 raft_consensus.cc:2889] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:42.328325 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:42.328755 22746 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:42.329171 22825 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:42.322220 29634 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:42.278149 29540 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:42.332971 29467 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:42.294360 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:42.330193 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:42.338122 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:42.338721 22825 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:42.267324 29660 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:42.341173 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.341881 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.349620 22752 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
W20260709 12:18:42.363240 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 113163us
I20260709 12:18:42.365011 22821 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
W20260709 12:18:42.376499 23494 connection.cc:256] RPC call timeout handler was delayed by -1.2257669810001062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
I20260709 12:18:42.380586 22825 raft_consensus.cc:2468] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 23.
W20260709 12:18:42.364472 22791 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:42.381680 22790 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:42.381801 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:42.388335 22793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.387389 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 476949us
I20260709 12:18:42.383056 22790 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:42.391448 22717 leader_election.cc:336] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:42.394946 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:42.352136 29439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.007s	sys 0.035s
W20260709 12:18:42.404253 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.393505 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:42.409621 22717 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:42.398216 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:42.393299 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:42.358733 29339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.008s	sys 0.013s
W20260709 12:18:42.434193 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.438249 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:42.392006 29634 raft_consensus.cc:2764] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:18:42.406881 29612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.000s	sys 0.026s
W20260709 12:18:42.404531 29439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.007s	sys 0.035s
W20260709 12:18:42.439432 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46211.1us
I20260709 12:18:42.395113 29618 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:42.444491 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:42.406740 29633 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:18:42.457139 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.406569 29028 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.472900 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:42.475610 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:42.436233 29339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.009s	sys 0.013s
W20260709 12:18:42.476437 22791 leader_election.cc:336] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:42.440889 29438 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:18:42.475425 29612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.000s	sys 0.031s
I20260709 12:18:42.395475 29660 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:18:42.479990 29439 raft_consensus.cc:697] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:42.486313 29431 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:42.484897 29028 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:42.499890 29438 raft_consensus.cc:697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:42.497031 29633 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:18:42.535040 22791 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:42.536183 22791 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:42.537035 22791 leader_election.cc:336] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:42.537592 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:42.524757 29431 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:18:42.544883 29684 log.cc:927] Time spent T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:18:42.546581 29438 consensus_queue.cc:237] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:42.548213 29690 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.548815 29690 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:42.554342 29624 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:42.557981 29028 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:42.559684 29558 raft_consensus.cc:3055] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:18:42.560292 29558 raft_consensus.cc:740] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:42.561429 29558 consensus_queue.cc:260] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:42.562659 29431 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:42.563917 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:42.575039 22896 raft_consensus.cc:2410] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:18:42.578449 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:42.581327 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44322.4us
W20260709 12:18:42.583362 22791 leader_election.cc:336] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:42.584023 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:42.588560 22822 raft_consensus.cc:1240] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 21. Current term is 22. Ops: []
I20260709 12:18:42.594274 22822 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21. Ops: [20.13-20.13]
W20260709 12:18:42.595966 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.596628 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:42.539831 29421 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:42.597420 29652 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:42.598218 22901 raft_consensus.cc:2410] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 12:18:42.598456 22791 leader_election.cc:336] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:42.575587 29558 raft_consensus.cc:3060] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:42.611667 22791 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:42.612224 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.612293 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.615995 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:42.626410 22822 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:42.599491 29431 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.597641 29688 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:42.666033 22897 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:42.624887 29643 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:18:42.671296 29685 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:18:42.608839 29633 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:42.636754 29652 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:42.636041 29651 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:42.617981 29571 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.006s	sys 0.020s
I20260709 12:18:42.649080 29690 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:42.709789 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:42.715132 22824 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
W20260709 12:18:42.708612 29530 consensus_meta.cc:287] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.862s	user 0.016s	sys 0.012s
I20260709 12:18:42.605605 29439 consensus_queue.cc:237] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:42.723078 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.712131 29571 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.007s	sys 0.021s
I20260709 12:18:42.736542 22748 raft_consensus.cc:1240] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:42.669055 29431 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:42.741295 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.742107 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.713864 29651 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:42.762873 22864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.001s	sys 0.034s
W20260709 12:18:42.766332 22864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.002s	sys 0.034s
W20260709 12:18:42.766815 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 567052us
W20260709 12:18:42.777557 29299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.012s	sys 0.016s
W20260709 12:18:42.784176 29299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.012s	sys 0.016s
I20260709 12:18:42.789599 29651 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:42.791620 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.794029 29523 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:42.795234 29482 consensus_queue.cc:1059] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:42.795605 29662 consensus_queue.cc:1048] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:42.796301 29482 raft_consensus.cc:3055] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:42.796723 29482 raft_consensus.cc:740] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:42.797576 29482 consensus_queue.cc:260] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:42.798238 29662 consensus_queue.cc:1048] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:18:42.799269 29482 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:42.802345 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:42.803399 29431 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:42.804555 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:42.805346 22820 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:42.806674 29431 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:42.807464 29431 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:42.808820 29659 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.941s	user 0.016s	sys 0.000s
I20260709 12:18:42.809737 29431 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:42.809497 29659 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:42.810843 29431 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.811533 22822 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:42.811419 29431 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:42.813438 29431 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:42.815505 29691 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:18:42.819914 22820 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:42.820583 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:42.821225 22822 raft_consensus.cc:1240] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:42.821591 22864 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:42.823004 29431 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:18:42.823418 29431 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.823773 29431 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:18:42.831527 29682 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:18:42.839772 29694 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:18:42.849984 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:42.852943 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:42.854202 22895 raft_consensus.cc:2410] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:18:42.860977 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:42.863840 22892 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:18:42.780763 29643 consensus_queue.cc:1048] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 12:18:42.867676 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:42.869311 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:42.810860 22827 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:18:42.870709 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:42.893632 22897 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 12:18:42.899945 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:42.901150 22892 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:42.899968 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 522534us
I20260709 12:18:42.910985 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:42.890607 29421 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:18:42.894968 29661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.011s	sys 0.027s
W20260709 12:18:42.906754 29540 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.017s
W20260709 12:18:42.921463 22821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.005s	sys 0.030s
I20260709 12:18:42.905596 29525 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.926815 22894 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
W20260709 12:18:42.925472 22821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.005s	sys 0.030s
W20260709 12:18:42.925676 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.922551 29260 consensus_meta.cc:287] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.687s	user 0.015s	sys 0.000s
W20260709 12:18:42.921309 29661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.011s	sys 0.027s
I20260709 12:18:42.920610 29421 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:42.954638 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.968006 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.993551 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:42.938278 22753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.024s	sys 0.023s
I20260709 12:18:43.000428 22818 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22. Ops: []
W20260709 12:18:43.000665 22753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.024s	sys 0.024s
W20260709 12:18:42.943025 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 467486us
I20260709 12:18:43.007140 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:43.018034 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.023082 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:43.025936 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:43.025046 22825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.036s	sys 0.021s
W20260709 12:18:43.027247 22825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.036s	sys 0.021s
I20260709 12:18:42.985190 29421 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:43.037840 29709 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:18:43.038564 29572 raft_consensus.cc:2804] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:43.039223 29572 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.039604 29572 raft_consensus.cc:3060] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:18:43.044835 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.048666 22827 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 1278) took 1221 ms. Trace:
I20260709 12:18:43.049160 22827 rpcz_store.cc:276] 0709 12:18:41.827748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.827903 (+   155us) service_pool.cc:224] Handling call
0709 12:18:41.828258 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.871436 (+1043178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.048344 (+176908us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54007a1554. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:43.048586 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259201408}
I20260709 12:18:43.051215 29540 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:43.051786 29540 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.052148 29540 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:42.934808 29525 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:43.063059 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:43.034586 29051 raft_consensus.cc:2804] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:43.089254 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:43.025350 29028 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:43.099298 22900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.045s
W20260709 12:18:43.101831 22900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.009s	sys 0.045s
I20260709 12:18:43.103717 22900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1618) took 1407 ms. Trace:
I20260709 12:18:43.107400 22900 rpcz_store.cc:276] 0709 12:18:41.695982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.696205 (+   223us) service_pool.cc:224] Handling call
0709 12:18:41.696603 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.696865 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:18:42.117344 (+420479us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.103248 (+985904us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:43.103320 (+    72us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:18:43.103384 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.103479 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.103648 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42020,"prepare.queue_time_us":550792,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":188962,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3151,"thread_start_us":1342070,"threads_started":3,"wal-append.queue_time_us":557561}
I20260709 12:18:43.113790 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:43.032757 22892 raft_consensus.cc:2468] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:43.115837 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:43.144384 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:43.135527 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:43.093012 29051 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.114853 22894 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:43.099079 29698 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:43.091446 29690 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:18:43.099582 29028 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:43.163089 29702 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.163882 29702 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:43.164839 29028 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:43.166577 29704 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:18:43.167976 29533 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.168743 29533 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:43.171577 29702 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:43.173327 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:43.177037 29533 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:43.115482 29299 consensus_queue.cc:1059] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:18:43.179123 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:43.180858 22749 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:43.182328 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:43.183569 29533 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:43.184137 29533 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.184863 29533 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:43.154032 22900 raft_consensus.cc:2410] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 19 because replica has last-logged OpId of term: 18 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
I20260709 12:18:43.193437 22818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 1290) took 1347 ms. Trace:
I20260709 12:18:43.194100 22818 rpcz_store.cc:276] 0709 12:18:41.846349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.167423 (+321074us) service_pool.cc:224] Handling call
0709 12:18:42.167817 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.024743 (+856926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.193041 (+168298us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54005d8c54. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:43.193348 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914110208}
W20260709 12:18:43.210395 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.127724 29606 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.116614 29525 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:43.052102 29572 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:43.196892 29051 raft_consensus.cc:3060] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:43.101879 29523 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
W20260709 12:18:43.210079 29558 consensus_meta.cc:287] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.005s
I20260709 12:18:43.207958 29702 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.114634 29431 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:43.216696 29659 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:43.252545 22894 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 25. Current term is 26. Ops: [25.13-25.13]
W20260709 12:18:43.255177 22750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.023s
W20260709 12:18:43.255946 22750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.005s	sys 0.024s
W20260709 12:18:43.257009 22901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.004s	sys 0.027s
W20260709 12:18:43.257584 22901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.004s	sys 0.027s
W20260709 12:18:43.261327 22899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.023s	sys 0.014s
W20260709 12:18:43.262137 22899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.023s	sys 0.015s
I20260709 12:18:43.223981 29606 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:43.263109 22751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.016s	sys 0.033s
W20260709 12:18:43.263808 22751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.016s	sys 0.033s
I20260709 12:18:43.238183 29702 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:43.286296 29689 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.735s	user 0.001s	sys 0.006s
W20260709 12:18:43.288935 29688 consensus_meta.cc:287] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.004s
I20260709 12:18:43.297055 29571 raft_consensus.cc:3055] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:18:43.293790 29628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.009s	sys 0.022s
I20260709 12:18:43.318603 22898 raft_consensus.cc:1240] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
W20260709 12:18:43.322171 22746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.029s	sys 0.041s
W20260709 12:18:43.323014 22746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.030s	sys 0.041s
I20260709 12:18:43.327072 29592 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.327550 29572 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:43.327970 29592 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:43.330930 29592 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:43.332338 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.286684 29533 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:43.333039 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.337904 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.338395 22752 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:43.358983 22749 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 12:18:43.340107 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.339623 22744 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:18:43.309878 29688 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:43.363178 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.366282 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:43.317333 29571 raft_consensus.cc:740] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:43.373553 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1874) took 1339 ms. Trace:
W20260709 12:18:43.334656 29628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.010s	sys 0.023s
I20260709 12:18:43.374224 22821 rpcz_store.cc:276] 0709 12:18:42.034438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.370620 (+336182us) service_pool.cc:224] Handling call
0709 12:18:42.373798 (+  3178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.374100 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:18:42.418070 (+ 43970us) log.cc:844] Serialized 14 byte log entry
0709 12:18:42.931414 (+513344us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.372785 (+441371us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b180032d760. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadfa55aab1 00007fadfa567281 00007fadf160cc0a 00007fadfad4c219 00007fadf1694a40 00007fadf168f4e4 00007fadf168f455 00007fadf4777060 00007fadf4789716 00007fadf479a287 00007fadf479a208
0709 12:18:43.373032 (+   247us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:43.373109 (+    77us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:18:43.373178 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.373286 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.373463 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52789,"prepare.queue_time_us":44678,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":2906,"raft.queue_time_us":253,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":5074,"spinlock_wait_cycles":12025600,"thread_start_us":512192,"threads_started":1,"wal-append.queue_time_us":688413}
I20260709 12:18:43.396241 29571 consensus_queue.cc:260] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:43.398027 29717 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:18:43.399475 22825 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1877) took 1364 ms. Trace:
I20260709 12:18:43.400313 22825 rpcz_store.cc:276] 0709 12:18:42.035341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.381598 (+346257us) service_pool.cc:224] Handling call
0709 12:18:42.391727 (+ 10129us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.392657 (+   930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.392685 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.407559 (+ 14874us) log.cc:844] Serialized 26 byte log entry
0709 12:18:43.027742 (+620183us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:43.027806 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.027908 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.399067 (+371159us) raft_consensus.cc:1685] finished
0709 12:18:43.399110 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.399369 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":10470,"thread_start_us":598146,"threads_started":1,"wal-append.queue_time_us":859108}
I20260709 12:18:43.419608 29606 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:43.431946 29431 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:43.433431 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:43.434096 22744 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:43.439986 29702 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:43.363080 29592 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.442854 29592 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:43.443547 29692 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.900s	user 0.000s	sys 0.004s
I20260709 12:18:43.361310 29558 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.445087 29558 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:43.446099 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 615246us
I20260709 12:18:43.447355 29558 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:43.448829 29713 log.cc:927] Time spent T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.217s	user 0.002s	sys 0.000s
I20260709 12:18:43.448509 29519 consensus_queue.cc:1059] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:43.456398 29533 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:43.458302 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:43.459410 22748 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:43.460640 29551 raft_consensus.cc:3055] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:18:43.461153 29551 raft_consensus.cc:740] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:43.462007 29551 consensus_queue.cc:260] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:43.458588 29624 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:43.486969 29624 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:43.487932 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:43.489576 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.490011 29624 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:43.467840 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.492460 29540 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:43.494218 22893 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 19: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:18:43.490093 22791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.496649 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:43.499516 22744 raft_consensus.cc:2468] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 26.
W20260709 12:18:43.506536 22745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.018s	sys 0.048s
I20260709 12:18:43.539355 22749 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:18:43.539490 22745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.019s	sys 0.048s
W20260709 12:18:43.541025 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.547318 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.521255 22818 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:18:43.529507 22826 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58876 (request call id 1287) took 1697 ms. Trace:
I20260709 12:18:43.556175 22826 rpcz_store.cc:276] 0709 12:18:41.832092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.010225 (+178133us) service_pool.cc:224] Handling call
0709 12:18:43.529220 (+1518995us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b5400791154. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf47832fa 00007fadf9744b17 00007fadf2cbf6d4 00007fadf2cbf662 00007fadf2cbf591 00007fadf2cbf50c 00007fadf2cbe7c2 00007fadf2aba48c 00007fadf2ab98c6 00007fadf2ab926f
0709 12:18:43.529422 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071970176}
I20260709 12:18:43.533674 22827 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:18:43.512521 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.438398 29421 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:43.550509 22825 raft_consensus.cc:3055] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:43.558885 22825 raft_consensus.cc:740] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:43.551474 22864 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:43.554127 22821 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:18:43.571026 22750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1752) took 1235 ms. Trace:
I20260709 12:18:43.571697 22750 rpcz_store.cc:276] 0709 12:18:42.335935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.336101 (+   166us) service_pool.cc:224] Handling call
0709 12:18:42.336482 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.336730 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.336754 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.744769 (+408015us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b2c000c1488. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:18:42.745090 (+   321us) log.cc:844] Serialized 26 byte log entry
0709 12:18:43.256689 (+511599us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:43.256756 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.256881 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.570589 (+313708us) raft_consensus.cc:1685] finished
0709 12:18:43.570616 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.570934 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46833920,"thread_start_us":511170,"threads_started":1,"wal-append.queue_time_us":788821}
I20260709 12:18:43.577199 22753 raft_consensus.cc:1240] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:43.562186 22825 consensus_queue.cc:260] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:43.578517 22825 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:43.578769 23494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.007s	sys 0.061s
W20260709 12:18:43.579401 23494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.007s	sys 0.061s
W20260709 12:18:43.579768 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 545263us
I20260709 12:18:43.548681 29633 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.591354 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:43.592378 22827 raft_consensus.cc:1275] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:18:43.595577 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:43.595815 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:43.596693 22822 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 24.
I20260709 12:18:43.597571 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:43.599632 22895 raft_consensus.cc:2368] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20.
I20260709 12:18:43.603168 22791 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:43.603896 22897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.012s	sys 0.020s
W20260709 12:18:43.604997 22897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.013s	sys 0.020s
I20260709 12:18:43.606562 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:43.605034 22748 raft_consensus.cc:2468] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
W20260709 12:18:43.616890 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.616926 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:43.618247 22821 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:43.619354 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:43.622838 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:43.619642 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:43.577399 29702 raft_consensus.cc:2804] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:18:43.631559 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:43.533967 29638 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:18:43.615309 29028 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:43.642185 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:43.624858 29634 raft_consensus.cc:2804] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:18:43.631492 29439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.006s	sys 0.038s
I20260709 12:18:43.632683 29635 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:43.610481 29633 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:43.636188 29438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.076s	user 0.005s	sys 0.034s
W20260709 12:18:43.642087 29727 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:18:43.657068 22864 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:43.645816 29028 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.631906 29540 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:43.642536 29702 raft_consensus.cc:697] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 26 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:43.615516 29260 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
W20260709 12:18:43.663242 29722 log.cc:927] Time spent T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.095s	user 0.001s	sys 0.001s
W20260709 12:18:43.676608 22892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.026s	sys 0.021s
W20260709 12:18:43.677325 22892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.026s	sys 0.021s
I20260709 12:18:43.660704 29635 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:43.627110 29606 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 12:18:43.655560 29439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.007s	sys 0.039s
W20260709 12:18:43.666707 29438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.006s	sys 0.034s
I20260709 12:18:43.670501 29028 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:43.664479 29634 raft_consensus.cc:697] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:18:43.684784 22865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.007s	sys 0.040s
I20260709 12:18:43.671591 29688 raft_consensus.cc:2804] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:43.669411 29525 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:43.686239 29635 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:43.684788 29624 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:43.668488 23495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.013s	sys 0.069s
W20260709 12:18:43.720181 23495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.013s	sys 0.069s
I20260709 12:18:43.694104 22819 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: []
W20260709 12:18:43.695667 22865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.007s	sys 0.041s
I20260709 12:18:43.638267 29592 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:43.722800 29431 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:43.723693 29431 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:43.724361 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:43.725597 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:43.725721 29718 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.726205 29431 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:43.726413 29718 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:43.726763 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:43.729291 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:43.729895 22898 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:18:43.744776 22865 leader_election.cc:336] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:43.748023 22901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1527) took 1136 ms. Trace:
I20260709 12:18:43.749276 22901 rpcz_store.cc:276] 0709 12:18:42.611939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.612181 (+   242us) service_pool.cc:224] Handling call
0709 12:18:42.638381 (+ 26200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.638593 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.638617 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.650592 (+ 11975us) log.cc:844] Serialized 26 byte log entry
0709 12:18:43.258042 (+607450us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:43.258102 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.258200 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.747745 (+489545us) raft_consensus.cc:1685] finished
0709 12:18:43.747776 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.747948 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":538335,"threads_started":1,"wal-append.queue_time_us":870244}
I20260709 12:18:43.748154 22898 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 23.
I20260709 12:18:43.752153 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:43.753360 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:43.753897 22898 raft_consensus.cc:2376] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20. Re-sending same reply.
I20260709 12:18:43.754868 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:43.759750 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:43.761116 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.705888 29688 raft_consensus.cc:697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:43.720424 29299 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:43.700069 29558 consensus_queue.cc:1059] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:18:43.773936 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:43.779080 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:43.765803 29051 consensus_meta.cc:287] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.521s	user 0.018s	sys 0.000s
I20260709 12:18:43.763197 29530 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:43.782095 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:43.805380 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:43.806203 22901 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:43.807091 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:43.804723 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:43.808763 22825 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:43.774355 29421 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:43.753962 29624 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:43.820334 22901 raft_consensus.cc:1240] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21. Ops: []
W20260709 12:18:43.815728 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 434422us
I20260709 12:18:43.803520 29558 consensus_queue.cc:1243] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 23.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:18:43.807271 29592 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.830955 29688 consensus_queue.cc:237] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:43.832521 29633 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:43.802838 29051 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:43.805413 29634 consensus_queue.cc:237] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:43.834949 29718 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:43.835507 29730 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:18:43.835786 29624 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:43.836115 29729 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:18:43.755173 29702 consensus_queue.cc:237] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:43.865033 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.879375 22901 raft_consensus.cc:1240] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:18:43.880679 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:43.882369 22717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.011s	sys 0.044s
I20260709 12:18:43.883126 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:43.843037 29438 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:43.891319 22717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.011s	sys 0.045s
I20260709 12:18:43.891733 22821 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:43.859623 29633 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:43.891335 22901 raft_consensus.cc:1275] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:43.860826 29525 consensus_queue.cc:1059] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:18:43.844202 29592 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:43.891927 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 534003us
W20260709 12:18:43.913770 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 271686us
I20260709 12:18:43.915414 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:43.921545 22901 raft_consensus.cc:1240] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:18:43.921677 22747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1743) took 1629 ms. Trace:
I20260709 12:18:43.924023 22747 rpcz_store.cc:276] 0709 12:18:42.292640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.293242 (+   602us) service_pool.cc:224] Handling call
0709 12:18:42.293710 (+   468us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:42.328499 (+ 34789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.328534 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:42.865991 (+537457us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b2c000c1488. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:18:42.866727 (+   736us) log.cc:844] Serialized 52 byte log entry
0709 12:18:43.333666 (+466939us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:43.333734 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.336932 (+  3198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.917410 (+580478us) raft_consensus.cc:1685] finished
0709 12:18:43.917443 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.921567 (+  4124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":600,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"spinlock_wait_cycles":65504000,"thread_start_us":466414,"threads_started":1,"wal-append.queue_time_us":781887}
I20260709 12:18:43.899785 29540 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:18:43.918687 29438 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:43.932713 29720 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:18:43.885248 29606 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:18:43.893853 29558 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 12:18:43.936045 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 310009us
I20260709 12:18:43.894966 29260 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:43.937803 22900 raft_consensus.cc:1240] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 18. Current term is 19. Ops: []
W20260709 12:18:43.932933 29731 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:18:43.930706 29540 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.918192 29633 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:43.938006 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:43.939394 22745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 1685) took 1559 ms. Trace:
I20260709 12:18:43.916906 29624 consensus_queue.cc:1059] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:18:43.949326 22745 rpcz_store.cc:276] 0709 12:18:42.379872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.582024 (+202152us) service_pool.cc:224] Handling call
0709 12:18:42.594314 (+ 12290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.594897 (+   583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.594944 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.607282 (+ 12338us) log.cc:844] Serialized 26 byte log entry
0709 12:18:43.540113 (+932831us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:43.540162 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.540260 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.939161 (+398901us) raft_consensus.cc:1685] finished
0709 12:18:43.939183 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.939324 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":13409,"thread_start_us":900126,"threads_started":1,"wal-append.queue_time_us":1148572}
I20260709 12:18:43.932849 29741 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:18:43.963699 29741 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:43.946307 29260 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:43.966895 29738 log.cc:927] Time spent T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:18:43.968662 22896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1629) took 1035 ms. Trace:
I20260709 12:18:43.969069 22896 rpcz_store.cc:276] 0709 12:18:42.933478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.205348 (+271870us) service_pool.cc:224] Handling call
0709 12:18:43.205730 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:43.208150 (+  2420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:43.208187 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:43.208811 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 12:18:43.689686 (+480875us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:18:43.689748 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.689828 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.968401 (+278573us) raft_consensus.cc:1685] finished
0709 12:18:43.968425 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.968589 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1899,"raft.queue_time_us":2950,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7370,"thread_start_us":475195,"threads_started":1,"wal-append.queue_time_us":589031}
I20260709 12:18:43.970263 29260 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:43.971228 29732 log.cc:927] Time spent T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:18:43.972919 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1530) took 1067 ms. Trace:
I20260709 12:18:43.973306 22897 rpcz_store.cc:276] 0709 12:18:42.905300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.905466 (+   166us) service_pool.cc:224] Handling call
0709 12:18:42.918373 (+ 12907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.919146 (+   773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.919194 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.919824 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 12:18:43.609917 (+690093us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:43.646680 (+ 36763us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.666874 (+ 20194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.667002 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.972715 (+305713us) raft_consensus.cc:1685] finished
0709 12:18:43.972736 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.972862 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33810,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":4941,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":17173,"thread_start_us":621241,"threads_started":1,"wal-append.queue_time_us":876052}
I20260709 12:18:43.980218 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:43.940135 29438 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:43.947432 29540 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:43.993928 22791 leader_election.cc:400] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20.
W20260709 12:18:44.003149 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 65228.3us
W20260709 12:18:43.990724 29735 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 12:18:44.010072 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 84545.5us
I20260709 12:18:44.019676 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:44.020210 23494 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:44.005770 29661 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:44.007503 29718 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:44.036903 23494 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:44.039506 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 126414us
W20260709 12:18:44.039299 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 156054us
I20260709 12:18:44.015864 29051 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:44.017479 29606 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:44.049407 29737 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:18:44.047060 29624 consensus_queue.cc:1059] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 12:18:44.085829 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 44551.5us
I20260709 12:18:44.058768 29606 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:44.076193 29592 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:44.098246 29592 consensus_queue.cc:1048] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
W20260709 12:18:44.108518 29745 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:18:44.097520 29751 raft_consensus.cc:3060] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:44.112581 29633 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:44.112098 29759 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:44.126984 29571 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:44.131400 29606 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:44.127938 29754 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:44.134488 29726 log.cc:927] Time spent T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.449s	user 0.002s	sys 0.001s
W20260709 12:18:44.152519 29749 log.cc:927] Time spent T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:18:44.159132 29761 raft_consensus.cc:3055] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:44.159811 29761 raft_consensus.cc:740] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:44.160954 29761 consensus_queue.cc:260] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:44.147856 29754 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:44.173122 29754 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:44.175172 29761 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:44.175347 29734 raft_consensus.cc:3055] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:44.176113 29734 raft_consensus.cc:740] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:44.176981 29734 consensus_queue.cc:260] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:44.178138 29734 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:44.221393 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.225189 22746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49004 (request call id 1751) took 1889 ms. Trace:
I20260709 12:18:44.225979 22746 rpcz_store.cc:276] 0709 12:18:42.335561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.337066 (+  1505us) service_pool.cc:224] Handling call
0709 12:18:42.337393 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.338015 (+   622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.338041 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.726947 (+388906us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b2c000c1488. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf3078a11 00007fadf3088372 00007fadf47baa01 00007fadf477f43a 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2
0709 12:18:42.727502 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:18:43.323532 (+596030us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:43.323576 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.323644 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:44.133830 (+810186us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:18:44.224299 (+ 90469us) raft_consensus.cc:1685] finished
0709 12:18:44.224389 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.224897 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":53081216,"thread_start_us":563310,"threads_started":1,"wal-append.queue_time_us":890463}
W20260709 12:18:44.227640 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 179006us
I20260709 12:18:44.229743 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:44.238125 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 142659us
W20260709 12:18:44.239042 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 227572us
I20260709 12:18:44.243283 22892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1531) took 1334 ms. Trace:
W20260709 12:18:44.244079 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.258929 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.246913 22898 raft_consensus.cc:1240] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 17. Current term is 18. Ops: [15.8-17.9]
I20260709 12:18:44.251653 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:44.255232 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:44.257347 22819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52396 (request call id 1873) took 2223 ms. Trace:
I20260709 12:18:44.243860 22892 rpcz_store.cc:276] 0709 12:18:42.908898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.144734 (+235836us) service_pool.cc:224] Handling call
0709 12:18:43.163218 (+ 18484us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:43.163761 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:43.163798 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:43.164498 (+   700us) log.cc:844] Serialized 52 byte log entry
0709 12:18:43.678044 (+513546us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:43.678112 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.678232 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:44.242582 (+564350us) raft_consensus.cc:1685] finished
0709 12:18:44.242633 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.243033 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8660,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":512883,"threads_started":1,"wal-append.queue_time_us":678357}
I20260709 12:18:44.272799 22819 rpcz_store.cc:276] 0709 12:18:42.034094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.296391 (+262297us) service_pool.cc:224] Handling call
0709 12:18:42.296780 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.721339 (+1424559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.256359 (+535020us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54005d9654. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:44.257064 (+   705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3213006208}
I20260709 12:18:44.291318 29770 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:44.292891 29770 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:44.296624 29299 raft_consensus.cc:3055] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:18:44.296804 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:44.297601 29299 raft_consensus.cc:740] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:44.301250 29770 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:44.306136 29551 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:44.279582 29635 consensus_meta.cc:287] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.532s	user 0.014s	sys 0.001s
I20260709 12:18:44.311643 29635 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:44.317708 29688 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:44.318647 29688 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:44.321808 29688 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:44.330585 29768 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:44.330960 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 197932us
I20260709 12:18:44.332049 29768 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:44.335327 29572 consensus_queue.cc:1059] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:44.279528 29740 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:44.337190 29740 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.337391 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.337718 29740 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:44.337994 29606 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.338305 29702 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:44.339151 29606 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:44.343106 29431 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:44.344210 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 47759.5us
I20260709 12:18:44.347368 29523 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:44.351176 29764 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.339243 29702 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:44.352175 29764 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:44.355886 29702 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:44.337627 29572 raft_consensus.cc:3055] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:18:44.363984 29572 raft_consensus.cc:740] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:44.362244 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.363041 22893 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
W20260709 12:18:44.359885 22717 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.547s (SENT)
I20260709 12:18:44.366684 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:44.361734 22898 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:44.373512 29438 raft_consensus.cc:3055] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:44.374229 29438 raft_consensus.cc:740] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:44.344226 29431 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:44.375169 22573 catalog_manager.cc:5697] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 11 to 13, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 13 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:44.377815 29431 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:44.379189 29753 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:18:44.379920 29438 consensus_queue.cc:260] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:44.386446 29764 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:44.399042 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 53563.4us
I20260709 12:18:44.365688 29572 consensus_queue.cc:260] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:44.403585 29572 raft_consensus.cc:3060] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:44.404102 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.408674 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.409983 22896 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 20: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:44.378244 22573 catalog_manager.cc:5697] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 15 to 16, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 16 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.441017 22746 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:44.441347 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.382560 29606 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:44.386682 29438 raft_consensus.cc:3060] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:44.448035 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:44.426367 22717 leader_election.cc:336] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:44.455338 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.475611 29536 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.476748 29536 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:44.480058 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:44.480026 29536 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:44.491214 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.498438 29431 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:44.498193 29299 consensus_queue.cc:260] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:44.499346 29431 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:44.499765 29299 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:44.505520 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.507411 22893 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:44.542912 29592 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:44.544167 29592 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:44.547350 29780 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
W20260709 12:18:44.547499 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 121247us
I20260709 12:18:44.472451 29768 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:44.472198 29753 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:44.558642 29753 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:44.560456 29028 consensus_meta.cc:287] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.859s	user 0.010s	sys 0.018s
I20260709 12:18:44.560636 29661 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:44.560984 29028 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:44.561539 29661 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:44.548430 29780 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:44.565003 29780 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:44.566097 22749 raft_consensus.cc:1240] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 12:18:44.561335 29753 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:44.570210 29638 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.551602 22865 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:44.505326 29431 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:44.559885 29592 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:44.513881 29635 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:44.574677 29638 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:44.576016 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.580087 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.580502 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.581029 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.600051 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.597117 22748 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:44.603577 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:44.611543 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.612851 22900 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
W20260709 12:18:44.616453 22717 leader_election.cc:336] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:44.617303 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:44.618498 29592 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:18:44.623556 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.623994 29661 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:44.625545 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.626399 22749 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 17.
I20260709 12:18:44.629235 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:44.637032 29571 consensus_meta.cc:287] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.502s	user 0.014s	sys 0.000s
I20260709 12:18:44.614354 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.643546 29661 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:44.644150 29785 log.cc:927] Time spent T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.214s	user 0.005s	sys 0.000s
W20260709 12:18:44.644819 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 142213us
I20260709 12:18:44.650076 22896 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:44.651038 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:44.655519 22717 leader_election.cc:336] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:44.637912 29028 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:44.660007 22745 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:44.660794 22573 catalog_manager.cc:5697] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 16 to 19, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 19 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:44.662302 29740 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:44.679144 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.648991 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:44.692719 23494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.693473 22746 raft_consensus.cc:2468] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:44.692408 22751 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:44.701419 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.709888 22900 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 23.
I20260709 12:18:44.724340 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.719594 22573 catalog_manager.cc:5697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 18 to 20, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 20 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:44.739590 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.736768 29572 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.736825 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:44.745055 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:44.746447 29718 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:44.746879 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:44.748353 29688 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:44.749725 29688 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:44.750309 29688 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:44.713049 29661 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:44.750934 22750 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:18:44.753441 29661 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:44.754281 29519 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.755177 29519 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:44.756693 22752 raft_consensus.cc:1240] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:18:44.759637 29638 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:44.761039 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.761621 29740 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:44.747025 29718 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.763338 29718 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:44.767851 29028 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.768538 29028 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:44.769357 29755 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.741628 29572 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:44.770215 29755 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:44.769503 29779 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.772281 29779 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:44.772936 29592 raft_consensus.cc:493] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:44.773200 22753 raft_consensus.cc:1275] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:44.774039 29592 raft_consensus.cc:515] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:44.778264 29688 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:44.781038 29755 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:44.782410 29779 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:44.783037 29751 consensus_meta.cc:287] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.012s
I20260709 12:18:44.783881 29751 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:44.784473 29606 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:44.785108 29572 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:44.786190 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.787649 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.790966 22749 raft_consensus.cc:1275] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:18:44.791527 22749 pending_rounds.cc:85] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 8
I20260709 12:18:44.805498 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:44.811179 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.812258 22750 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 23.
I20260709 12:18:44.814050 22717 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:44.816541 22717 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:44.817555 29572 raft_consensus.cc:3060] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:44.819008 29770 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:44.819955 29770 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:44.820187 29768 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:44.821208 29770 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:44.821959 22717 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:44.822321 29741 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.822539 29754 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:44.823071 29741 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:44.824730 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:44.825820 29778 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:44.826192 29733 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:44.827445 29733 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.828006 29733 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:44.829114 29779 consensus_queue.cc:1059] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:44.796095 22749 pending_rounds.cc:107] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:18:44.831080 22749 raft_consensus.cc:2889] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:44.832903 29768 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:44.833740 29028 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:44.836261 29766 raft_consensus.cc:3055] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:44.837455 29766 raft_consensus.cc:740] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:44.839318 29766 consensus_queue.cc:260] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:44.840739 29766 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:44.841549 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.843796 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.844602 22751 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:44.844641 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:44.845721 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:44.847858 29761 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.672s	user 0.015s	sys 0.005s
I20260709 12:18:44.796128 22573 catalog_manager.cc:5697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:44.856591 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 65056.7us
I20260709 12:18:44.864923 29741 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:44.874624 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.876849 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 287587us
W20260709 12:18:44.913296 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.909471 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 46657.8us
W20260709 12:18:44.923607 22791 leader_election.cc:336] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 1.517s (SENT)
I20260709 12:18:44.927595 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:44.931988 22790 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:44.934531 29536 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:44.935020 29635 consensus_queue.cc:1059] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:44.935649 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:44.936371 29635 consensus_queue.cc:1048] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:44.935092 29536 raft_consensus.cc:493] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.937289 29536 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:44.942103 29702 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:44.942807 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.942823 29702 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:44.946062 29702 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:44.946568 29702 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:44.947206 29702 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:44.947636 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:44.948326 22791 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.249.193:33285 timed out after 1.766s (SENT) [suppressed 104 similar messages]
W20260709 12:18:44.949164 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 62140.4us
W20260709 12:18:44.949553 22791 leader_election.cc:336] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:44.950253 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:44.950356 29702 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:44.957950 22570 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 134) took 18879 ms (client timeout 15000 ms). Trace:
I20260709 12:18:44.961375 29536 raft_consensus.cc:515] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:44.962845 22819 raft_consensus.cc:2368] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 20. Current term is 21.
I20260709 12:18:44.969197 29260 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:18:44.971586 22791 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:44.972962 29519 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:44.980638 29688 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:44.981410 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:44.984984 29801 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:44.987802 23494 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:44.964525 29536 leader_election.cc:290] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:44.974560 22791 leader_election.cc:336] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:44.929127 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:44.950335 22717 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:44.904968 29592 leader_election.cc:290] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:44.922268 22573 catalog_manager.cc:5697] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:45.000402 22791 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:45.012238 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.999600 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.016969 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:45.016956 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 334154us
I20260709 12:18:44.938675 29635 raft_consensus.cc:3055] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:45.037014 22818 raft_consensus.cc:2393] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 25: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:45.028098 22896 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:45.038211 22901 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:45.025115 29801 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:45.055862 22900 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:18:45.057415 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.056473 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.017354 29431 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:45.023589 29592 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:45.061214 22826 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
I20260709 12:18:45.065748 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.027033 29635 raft_consensus.cc:740] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
W20260709 12:18:45.071388 22865 leader_election.cc:336] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.061033 29551 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:45.057647 29260 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:45.073738 29299 consensus_meta.cc:287] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.011s
I20260709 12:18:45.086313 22573 catalog_manager.cc:5697] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 17 to 20, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 20 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:45.075511 29702 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:18:45.100289 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 112570us
I20260709 12:18:45.100325 22864 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:45.101329 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:45.103287 29795 raft_consensus.cc:2804] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:45.103114 29260 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:45.104009 29795 raft_consensus.cc:697] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 20 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:45.104640 29523 consensus_queue.cc:1048] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:45.105823 29702 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.106092 29260 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:45.106365 29702 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:45.103282 29635 consensus_queue.cc:260] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:45.109441 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:45.110217 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:45.110955 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 160776us
W20260709 12:18:45.114495 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.114929 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.084477 22865 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:45.086211 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:45.110280 29635 raft_consensus.cc:3060] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:45.015515 29733 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:45.077713 29688 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:45.089109 29734 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:18:45.089378 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 114899us
I20260709 12:18:45.089601 22899 raft_consensus.cc:1240] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:45.090234 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.134425 22825 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:45.091159 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:45.091202 29540 consensus_meta.cc:287] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: Time spent flushing consensus metadata: real 1.076s	user 0.016s	sys 0.013s
I20260709 12:18:45.093307 29718 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:45.066757 29536 raft_consensus.cc:2749] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:18:45.141885 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:45.136217 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:45.140632 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:45.105065 29795 consensus_queue.cc:237] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:45.122766 22790 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.139712 22747 raft_consensus.cc:1275] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 12:18:45.147010 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:45.147665 22748 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:45.129962 29519 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.144155 22901 raft_consensus.cc:2468] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:45.148684 22745 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:45.156132 22753 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 12:18:45.156806 22753 pending_rounds.cc:85] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 12
I20260709 12:18:45.157099 22753 pending_rounds.cc:107] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:18:45.157387 22753 raft_consensus.cc:2889] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:45.138072 29734 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.162137 22818 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:45.171599 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:45.174111 29733 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:45.149528 29778 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:45.151850 29661 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:18:45.161234 22573 catalog_manager.cc:5697] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 15 to 16, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 16 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:45.211575 22791 leader_election.cc:336] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.212348 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:45.213442 29802 log.cc:927] Time spent T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 12:18:45.155730 29519 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:45.164201 29734 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:45.221078 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 149752us
I20260709 12:18:45.197285 29778 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.206972 29661 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.149699 29540 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:45.237247 22865 leader_election.cc:336] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.234951 29661 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:45.243691 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:45.244441 22744 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:45.250907 29638 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:18:45.255206 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46634.6us
I20260709 12:18:45.256385 29718 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:45.256706 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 45320.9us
I20260709 12:18:45.223742 29536 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:45.257599 22791 leader_election.cc:336] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.258045 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:45.257793 29536 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:45.260555 29536 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:45.258605 22744 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:45.262413 23493 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.264631 29801 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:45.265240 29801 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:44.958701 22570 rpcz_store.cc:269] 0709 12:18:26.078244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.078844 (+   600us) service_pool.cc:224] Handling call
0709 12:18:44.957605 (+18878761us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:38.980492 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:38.981301 (+   809us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:38.981362 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:18:38.981386 (+    24us) tablet.cc:662] Decoding operations
0709 12:18:39.121463 (+140077us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:39.204492 (+ 83029us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:39.209748 (+  5256us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:18:39.318263 (+108515us) tablet.cc:701] Row locks acquired
0709 12:18:39.318327 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:18:39.318528 (+   201us) write_op.cc:270] Start()
0709 12:18:39.318727 (+   199us) write_op.cc:276] Timestamp: P: 1783599519318449 usec, L: 0
0709 12:18:39.318770 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:18:39.319628 (+   858us) log.cc:844] Serialized 6796 byte log entry
0709 12:18:39.668955 (+349327us) op_driver.cc:464] REPLICATION: finished
0709 12:18:39.977890 (+308935us) write_op.cc:301] APPLY: starting
0709 12:18:39.978035 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:40.468936 (+490901us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:40.496604 (+ 27668us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:40.968874 (+472270us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:40.969228 (+   354us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 12:18:40.969293 (+    65us) write_op.cc:312] APPLY: finished
0709 12:18:40.969895 (+   602us) log.cc:844] Serialized 155 byte log entry
0709 12:18:41.196447 (+226552us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:41.229821 (+ 33374us) write_op.cc:454] Released schema lock
0709 12:18:41.243369 (+ 13548us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:41.308450 (+ 65081us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:41.310751 (+  2301us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16209,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":308531,"apply.run_cpu_time_us":40089,"apply.run_wall_time_us":1296034,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75255,"num_ops":17,"prepare.queue_time_us":433687,"prepare.run_cpu_time_us":22976,"prepare.run_wall_time_us":529243,"raft.queue_time_us":166167,"raft.run_cpu_time_us":43690,"raft.run_wall_time_us":255185,"replication_time_us":349873,"thread_start_us":827515,"threads_started":5,"wal-append.queue_time_us":471091,"wal-append.run_cpu_time_us":24792,"wal-append.run_wall_time_us":2213655}]]}
I20260709 12:18:45.273192 29540 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:45.277207 29572 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:18:45.279554 22897 raft_consensus.cc:1240] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:18:45.279309 29661 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:45.280177 22573 catalog_manager.cc:5697] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
W20260709 12:18:45.289106 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.291991 22896 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
W20260709 12:18:45.294270 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 145395us
I20260709 12:18:45.229681 29778 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:45.297186 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.307252 22748 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:45.294903 29536 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:18:45.315822 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 58295.8us
I20260709 12:18:45.266251 29801 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:45.322921 29519 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:45.324445 29661 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:45.325287 29661 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:45.325654 29661 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.325982 29661 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:45.300079 29438 consensus_queue.cc:1048] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 12:18:45.327170 29798 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.232s	user 0.001s	sys 0.004s
I20260709 12:18:45.328492 29638 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:45.319689 22573 catalog_manager.cc:5697] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:45.297675 29702 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:45.339955 22718 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.341321 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 119126us
W20260709 12:18:45.342450 22865 leader_election.cc:336] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:45.345944 22791 leader_election.cc:336] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.347488 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:45.354288 22865 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:45.363883 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 63088.2us
I20260709 12:18:45.368875 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:45.367347 22790 leader_election.cc:304] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.375459 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:45.372767 22573 catalog_manager.cc:5697] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 14 to 15, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 15 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:45.388540 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.391372 29702 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:45.393393 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.395695 29260 raft_consensus.cc:2804] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:45.396312 29260 raft_consensus.cc:697] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:45.397271 29260 consensus_queue.cc:237] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:45.410691 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 76262.1us
I20260709 12:18:45.399822 29536 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:45.411422 22573 catalog_manager.cc:5697] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 17 to 20, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 20 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:45.410003 29768 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:18:45.436723 22791 leader_election.cc:336] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.437153 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:45.441845 22573 catalog_manager.cc:5697] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 13 to 19, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 19 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:45.430322 29768 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:45.459954 22791 leader_election.cc:336] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.460583 29761 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:45.461336 22791 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:45.462734 22791 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:45.463250 29816 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
I20260709 12:18:45.463662 29299 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.461282 29761 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:45.464275 29299 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:45.466171 29761 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:45.463366 29635 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:45.467303 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:45.468212 29635 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:45.468271 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:45.469281 22752 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 15.
W20260709 12:18:45.469732 22791 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.470393 29779 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:45.470983 22791 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.471200 29779 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:45.471508 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:45.472440 29635 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:18:45.473860 22791 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:45.473529 29734 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:45.474546 22791 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.472909 29778 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:45.475081 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:45.474999 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:45.477056 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55505.2us
W20260709 12:18:45.479362 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.480979 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.482633 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.482965 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.483335 22825 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 16.
I20260709 12:18:45.483527 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.484058 22819 raft_consensus.cc:2393] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:45.485342 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:45.485980 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.486923 22825 raft_consensus.cc:2410] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:18:45.486699 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.486068 22823 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:45.477721 29635 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:45.470825 29768 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:45.495834 22573 catalog_manager.cc:5697] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 14 to 17, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 17 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:45.497931 29734 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:45.498416 22897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1537) took 1141 ms. Trace:
I20260709 12:18:45.498973 22897 rpcz_store.cc:276] 0709 12:18:44.356645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.367868 (+ 11223us) service_pool.cc:224] Handling call
0709 12:18:44.368458 (+   590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:45.293933 (+925475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.498123 (+204190us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b5400a83ed4. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:45.498346 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094290176}
W20260709 12:18:45.502498 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.500217 29551 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:45.504477 29551 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:45.507148 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.508347 22717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.500597 29778 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:45.498183 22573 catalog_manager.cc:5697] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 6 to 18. New cstate: current_term: 18 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
W20260709 12:18:45.501670 29789 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.440s	user 0.003s	sys 0.000s
I20260709 12:18:45.512284 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:45.513324 22751 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:45.478101 29299 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:45.529917 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.531137 22824 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
I20260709 12:18:45.550170 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.512321 22717 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:45.553524 22791 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:45.560871 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 259137us
W20260709 12:18:45.569300 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.531960 29811 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:45.552050 29814 raft_consensus.cc:493] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:45.572434 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:45.578856 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:45.571221 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 58993.4us
I20260709 12:18:45.583227 22752 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 21: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:18:45.583765 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 241325us
W20260709 12:18:45.585055 22865 leader_election.cc:336] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.585608 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:45.568953 29592 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:45.588992 22901 raft_consensus.cc:2393] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 21: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:45.565403 29572 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:18:45.597718 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 86712.6us
W20260709 12:18:45.604228 29827 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:18:45.589037 29801 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.595534 29572 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.596283 29702 raft_consensus.cc:2749] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:18:45.629863 22791 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.593427 29814 raft_consensus.cc:515] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:45.620222 29572 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:45.635128 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.598084 29818 consensus_queue.cc:1048] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:18:45.624060 29811 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:18:45.637082 29796 log.cc:927] Time spent T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.316s	user 0.002s	sys 0.000s
I20260709 12:18:45.641896 22717 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:45.652269 22895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1643) took 1239 ms. Trace:
I20260709 12:18:45.652045 29661 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:45.655421 29661 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:45.652897 22895 rpcz_store.cc:276] 0709 12:18:44.401535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.447948 (+ 46413us) service_pool.cc:224] Handling call
0709 12:18:44.543864 (+ 95916us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:44.544683 (+   819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.544740 (+    57us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:18:44.545859 (+  1119us) log.cc:844] Serialized 78 byte log entry
0709 12:18:44.734086 (+188227us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:45.016344 (+282258us) log.cc:844] Serialized 14 byte log entry
0709 12:18:45.016612 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.016704 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.500884 (+484180us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:18:45.640435 (+139551us) raft_consensus.cc:1685] finished
0709 12:18:45.640583 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.640810 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":320604,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":8729,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":4800,"spinlock_wait_cycles":176393472,"thread_start_us":400959,"threads_started":2,"wal-append.queue_time_us":374613}
I20260709 12:18:45.656312 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56306 (request call id 1644) took 1106 ms. Trace:
I20260709 12:18:45.656734 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
W20260709 12:18:45.657447 29826 log.cc:927] Time spent T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.168s	user 0.001s	sys 0.001s
I20260709 12:18:45.657609 22752 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:18:45.620023 29801 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:45.656949 22893 rpcz_store.cc:276] 0709 12:18:44.549710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.554835 (+  5125us) service_pool.cc:224] Handling call
0709 12:18:44.579288 (+ 24453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:44.598643 (+ 19355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.598689 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:44.704278 (+105589us) log.cc:844] Serialized 26 byte log entry
0709 12:18:45.061669 (+357391us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:45.061705 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.061962 (+   257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.502296 (+440334us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b4400022b4c. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf151adb1 00007fadf15b8c85 00007fadf15b96a2 00007fadf432b1db 00007fadf4326aaf 00007fadf431a86e 00007fadf4319bb6 00007fadf43197d8 00007fadf4323221 00007fadf43231d9 00007fadf4323169
0709 12:18:45.655896 (+153600us) raft_consensus.cc:1685] finished
0709 12:18:45.655932 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.656235 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78864768,"thread_start_us":326309,"threads_started":1,"wal-append.queue_time_us":441316}
W20260709 12:18:45.670874 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 85852.3us
W20260709 12:18:45.671692 22865 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.675873 29770 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:45.676376 29770 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:45.676743 29770 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:45.677556 29768 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:45.667330 29818 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:45.679445 29818 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:45.680612 29768 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:45.670298 22823 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
W20260709 12:18:45.684508 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 60913.3us
W20260709 12:18:45.685392 22791 leader_election.cc:336] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.685834 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:45.687145 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:45.687364 29825 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:45.687944 22748 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:45.681654 29818 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:45.696947 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.699198 29733 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:45.704324 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:45.699862 29733 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.708506 29733 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:45.708014 29814 leader_election.cc:290] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:45.710337 29819 log.cc:927] Time spent T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.322s	user 0.000s	sys 0.015s
I20260709 12:18:45.727792 22752 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:45.740146 29768 raft_consensus.cc:2764] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:18:45.730103 29733 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:45.745132 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:45.746734 29733 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:45.734184 22791 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:45.747699 22791 leader_election.cc:336] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.748328 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:45.753082 22753 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:45.757508 29551 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:45.761523 29551 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:45.759114 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:45.762575 29661 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:45.763091 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:45.763943 22893 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 21: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:18:45.764331 22791 leader_election.cc:336] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:45.765246 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 123393us
I20260709 12:18:45.765676 29801 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:45.766283 29779 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:45.737175 22790 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.742839 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:45.768584 22753 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:45.769892 22751 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:45.774292 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:45.773898 23493 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:45.771204 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 96057.9us
I20260709 12:18:45.771816 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:45.779028 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:45.781281 22865 leader_election.cc:336] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.781906 22865 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:45.778993 23493 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.792034 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.778770 29661 raft_consensus.cc:2804] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:45.812268 29825 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:18:45.815524 22865 leader_election.cc:336] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.816304 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:45.783288 29801 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:18:45.818262 29813 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:45.830919 29818 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:18:45.832572 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 68305.4us
I20260709 12:18:45.835054 29832 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:45.783243 29779 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:45.806277 29751 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:45.783782 29733 raft_consensus.cc:2804] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:45.848743 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.811049 29835 raft_consensus.cc:2764] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 12:18:45.843575 22865 leader_election.cc:336] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.780058 29734 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:18:45.843478 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 59210.8us
I20260709 12:18:45.856307 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:45.813970 29661 raft_consensus.cc:697] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:45.805974 29028 consensus_queue.cc:1059] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:18:45.859154 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.839294 29832 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:45.861192 22820 raft_consensus.cc:2410] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 12:18:45.864085 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:45.864610 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.864794 22824 raft_consensus.cc:2376] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22. Re-sending same reply.
I20260709 12:18:45.863688 22865 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:45.852690 29811 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:45.858397 29519 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:45.855818 29734 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.851989 29733 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.883366 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.862237 29832 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:45.864640 29751 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:45.881220 29839 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:45.879575 29814 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:45.893443 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.892089 22717 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:45.894291 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.882954 29519 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.882478 29818 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:45.883910 29734 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:45.899534 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 56105.2us
I20260709 12:18:45.900159 29814 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:45.886884 29733 raft_consensus.cc:3060] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:45.912372 22865 leader_election.cc:336] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:45.913084 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.917654 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.918406 22824 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:45.924338 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.928251 22751 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Rejecting Update request from peer cd93aceeb0e24bb78d4582d8ad55988d for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:45.929657 22865 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:45.902529 29519 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:45.935016 22820 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 23. Current term is 24. Ops: []
I20260709 12:18:45.899650 29831 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:45.884459 29811 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:45.939810 29571 consensus_queue.cc:1059] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:45.942468 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.952404 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:45.896858 29572 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:45.955525 22824 raft_consensus.cc:2410] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:18:45.955212 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.956032 22818 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:45.957527 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.936089 29779 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:45.965505 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:45.965723 22747 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:45.964272 29823 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:18:45.936308 29661 consensus_queue.cc:237] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:45.969540 29779 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:45.970463 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:45.972854 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 60530.3us
I20260709 12:18:45.959976 22825 raft_consensus.cc:2376] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20. Re-sending same reply.
W20260709 12:18:45.973796 22865 leader_election.cc:336] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:45.974237 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:45.982059 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 121713us
I20260709 12:18:45.955216 29818 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:45.983366 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:45.957448 29831 raft_consensus.cc:697] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:45.979627 29702 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:45.990360 29814 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:45.992264 29846 raft_consensus.cc:3055] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:18:45.993081 22820 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:18:45.992930 29846 raft_consensus.cc:740] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:46.003011 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.964869 29770 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:46.014734 29846 consensus_queue.cc:260] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:46.016145 29811 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:46.016356 29770 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:46.017321 23494 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.514s (SENT)
I20260709 12:18:46.018460 29847 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:46.018867 29834 log.cc:927] Time spent T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:18:46.020704 29831 consensus_queue.cc:237] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:45.980506 29751 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:46.026990 29846 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:46.000131 29813 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:18:46.019169 29847 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:46.031837 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.032064 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:46.032917 29847 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:46.034138 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 60368.4us
I20260709 12:18:46.034705 22823 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
W20260709 12:18:46.034950 22865 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.035496 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:46.035591 29572 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:46.036284 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.037084 22824 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:46.037214 22826 raft_consensus.cc:1217] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Deduplicated request from leader. Original: 16.10->[18.11-24.14]   Dedup: 18.11->[20.12-24.14]
I20260709 12:18:46.037601 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:46.036990 22865 leader_election.cc:336] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.043514 22826 raft_consensus.cc:1240] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 24. Current term is 25. Ops: [18.11-24.14]
W20260709 12:18:46.044009 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.053668 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.055181 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:46.054477 22819 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:46.063561 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.064002 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:46.064617 22819 raft_consensus.cc:2410] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:18:46.064975 22827 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:46.065938 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.067528 22826 pending_rounds.cc:85] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 8
I20260709 12:18:46.067879 22826 pending_rounds.cc:107] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 12:18:46.068120 22826 raft_consensus.cc:2889] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:46.069201 29635 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:46.069743 29635 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:46.053265 29813 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:46.071341 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.072106 22822 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 16.
I20260709 12:18:46.073105 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.074522 22822 pending_rounds.cc:85] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 13
I20260709 12:18:46.082818 22822 pending_rounds.cc:107] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 20.14
W20260709 12:18:46.084991 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.095654 29840 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.096506 29840 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:46.100855 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:46.102285 22748 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:18:46.084173 22822 raft_consensus.cc:2889] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:46.091427 29839 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 23 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:46.109356 29733 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:46.109654 29839 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:46.070689 29635 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:46.113196 29635 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:46.115336 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 78383us
I20260709 12:18:46.115701 29844 raft_consensus.cc:3055] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:18:46.116097 18407 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 23731)
I20260709 12:18:46.116345 29844 raft_consensus.cc:740] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:46.121356 22865 leader_election.cc:336] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:46.122666 22865 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.120878 29734 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:46.125157 22865 leader_election.cc:336] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.125555 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:46.126312 22865 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.126755 22865 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:46.128362 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:46.129359 29813 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:46.129305 29519 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:46.130771 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:46.131312 22865 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.131479 22824 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:46.132298 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.133334 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:46.134127 22825 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:46.129719 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.135614 22823 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 25.
I20260709 12:18:46.138634 22820 raft_consensus.cc:1240] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:18:46.158273 22747 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:18:46.162303 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:46.163208 22819 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:46.165747 22827 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
W20260709 12:18:46.171592 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 217798us
W20260709 12:18:46.181190 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 49905.8us
I20260709 12:18:46.189668 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:46.196519 22753 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:18:46.193773 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 52494.2us
I20260709 12:18:46.207274 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.230412 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:46.229221 22791 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:46.229071 22717 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:46.248360 22717 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:46.252781 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.254268 22748 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
W20260709 12:18:46.250227 22717 leader_election.cc:336] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.260733 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.262852 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:46.269109 29734 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:46.271226 29838 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.342s	user 0.003s	sys 0.000s
W20260709 12:18:46.274915 29848 log.cc:927] Time spent T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.132s	user 0.003s	sys 0.001s
I20260709 12:18:46.284597 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76cb1231be0940089338c6aeb27ce69f" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.295616 22824 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:46.297968 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:46.326819 22820 raft_consensus.cc:1275] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 12:18:46.282164 29702 raft_consensus.cc:493] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.282239 29811 raft_consensus.cc:493] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:46.282253 29814 raft_consensus.cc:493] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:46.328385 22820 pending_rounds.cc:85] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 11
I20260709 12:18:46.342294 22820 pending_rounds.cc:107] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 12:18:46.342996 22820 raft_consensus.cc:2889] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:46.333312 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 83090.5us
W20260709 12:18:46.344185 22717 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.282419 29803 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:46.301692 29260 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:46.360420 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:46.362936 29519 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:46.364423 22717 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.364953 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:46.365806 29519 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:18:46.367624 22717 leader_election.cc:336] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.369681 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:46.370620 22896 raft_consensus.cc:3060] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:18:46.371132 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:46.371959 22895 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 15.
I20260709 12:18:46.373574 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:46.381844 22896 raft_consensus.cc:2468] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:46.383793 22745 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:18:46.387866 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:46.400110 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 122912us
I20260709 12:18:46.407210 23493 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:46.419790 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 249971us
I20260709 12:18:46.340236 29702 raft_consensus.cc:515] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:46.397240 29831 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:18:46.427660 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.353852 29811 raft_consensus.cc:515] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:46.435395 23494 leader_election.cc:336] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.556s (SENT)
I20260709 12:18:46.353719 29814 raft_consensus.cc:515] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:46.378342 29844 consensus_queue.cc:260] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:46.393826 22819 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:46.419435 29572 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:46.442906 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:46.454907 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:46.457787 22896 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:18:46.459151 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:46.464246 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 58675us
I20260709 12:18:46.464996 22901 raft_consensus.cc:2468] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:46.466315 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:46.406518 29438 consensus_queue.cc:1059] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 12:18:46.469432 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 67929us
I20260709 12:18:46.454241 29814 leader_election.cc:290] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:46.409511 29571 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:18:46.438539 29831 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.397874 29803 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:46.423983 29779 consensus_queue.cc:1059] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:18:46.495810 22896 raft_consensus.cc:2468] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 24.
W20260709 12:18:46.505952 22717 leader_election.cc:336] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.506579 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:46.514631 22896 raft_consensus.cc:1275] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:18:46.529521 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:46.472811 29734 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.487289 29831 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:46.480278 29572 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:46.549919 22895 raft_consensus.cc:1275] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:18:46.533633 29847 raft_consensus.cc:3055] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:18:46.490528 29438 consensus_queue.cc:1243] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:18:46.565927 22825 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:46.534379 29778 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:18:46.571974 29861 log.cc:927] Time spent T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:18:46.596602 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.597477 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:46.598475 22826 raft_consensus.cc:3060] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:46.541643 29638 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 12:18:46.616636 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.572365 29818 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:46.542292 29734 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:46.574156 29847 raft_consensus.cc:740] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:46.602632 29832 consensus_meta.cc:287] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.706s	user 0.011s	sys 0.003s
W20260709 12:18:46.680405 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 259744us
I20260709 12:18:46.597030 29850 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:46.702354 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:46.705513 23494 leader_election.cc:336] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.668s (SENT)
I20260709 12:18:46.706277 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:46.696826 29818 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:46.702903 29832 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:46.714395 29661 raft_consensus.cc:493] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.715257 29832 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:46.718072 22751 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17. Ops: []
W20260709 12:18:46.707299 29635 consensus_meta.cc:287] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.585s	user 0.014s	sys 0.001s
W20260709 12:18:46.720188 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 144951us
I20260709 12:18:46.715282 29818 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:46.756044 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 67236.5us
W20260709 12:18:46.756878 23494 leader_election.cc:336] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.728s (SENT)
I20260709 12:18:46.757306 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:46.757370 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 155322us
I20260709 12:18:46.732820 29571 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:46.715317 29661 raft_consensus.cc:515] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:46.723834 29850 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:46.765291 29856 log.cc:927] Time spent T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 12:18:46.766685 29853 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
W20260709 12:18:46.767813 29858 log.cc:927] Time spent T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 12:18:46.769629 29859 log.cc:927] Time spent T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:18:46.772277 29734 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:46.754640 29818 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:46.760694 29702 leader_election.cc:290] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:46.789211 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:46.809875 22818 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:46.798067 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:46.774382 29803 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:46.798439 22826 raft_consensus.cc:2468] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 23.
I20260709 12:18:46.824999 29803 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.740273 29572 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:46.821965 22717 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:46.799726 29811 leader_election.cc:290] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:46.825682 29803 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:46.840248 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:46.842736 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:46.821746 29846 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:46.752182 29847 consensus_queue.cc:260] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:46.890511 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:46.916968 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:46.816105 29818 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:46.921360 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 164528us
I20260709 12:18:46.922732 22898 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:46.853206 29840 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:46.851835 29661 leader_election.cc:290] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:46.932345 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc67a4479240b383ece839d37b7b58" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:46.933490 22896 raft_consensus.cc:2368] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21.
I20260709 12:18:46.868386 29886 raft_consensus.cc:2804] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:46.938526 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:46.939922 22751 raft_consensus.cc:2393] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 21: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:18:46.938858 23494 leader_election.cc:336] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Timed out: RequestConsensusVote RPC to 127.17.249.195:38963 timed out after 1.824s (SENT)
I20260709 12:18:46.935781 22826 raft_consensus.cc:1275] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:46.951493 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:46.953965 22892 raft_consensus.cc:2410] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
W20260709 12:18:46.955263 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.932746 29847 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:46.968246 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:46.971613 22900 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 24.
I20260709 12:18:46.977746 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:46.985014 22791 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:46.991693 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:46.958405 29886 raft_consensus.cc:697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:46.996001 22791 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:46.997686 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.962808 29830 consensus_queue.cc:1059] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 12:18:47.038977 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.043354 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2718d64abf84eb5b425ac4d5bd7217e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:47.060228 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:47.061051 22900 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:47.000735 29839 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:18:47.032058 29889 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:18:47.069008 22751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:47.035293 29661 raft_consensus.cc:2804] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:18:47.026393 29894 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:18:47.091161 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 141220us
I20260709 12:18:47.101626 22744 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:18:47.064213 29850 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:47.108558 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.092496 29894 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:47.112933 29894 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:47.112720 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
W20260709 12:18:47.116641 18407 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 23731)
I20260709 12:18:47.103356 29661 raft_consensus.cc:697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:47.125352 22865 leader_election.cc:400] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 20. Current term is 21.
I20260709 12:18:47.129704 22865 leader_election.cc:403] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:47.131640 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:47.131696 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:47.127734 29803 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:47.137907 29888 log.cc:927] Time spent T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:18:47.145399 22865 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.149151 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59fd6638f4a4b539acee7e61d0a1e9c" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:47.141990 22897 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 19.
I20260709 12:18:47.150596 29875 consensus_queue.cc:1048] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 12:18:47.138134 29733 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:47.134964 29818 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:47.162531 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:47.165524 29831 consensus_meta.cc:287] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.000s
I20260709 12:18:47.165993 29831 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:47.167423 22900 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:47.167438 22818 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:47.169607 22751 raft_consensus.cc:2393] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 20: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:47.170389 22900 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 23. Current term is 24. Ops: []
I20260709 12:18:47.149518 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:47.174376 22898 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:47.176986 22821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58876 (request call id 1333) took 1112 ms. Trace:
I20260709 12:18:47.177423 22821 rpcz_store.cc:276] 0709 12:18:46.064487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.090103 (+ 25616us) service_pool.cc:224] Handling call
0709 12:18:46.181515 (+ 91412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:46.428890 (+247375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:46.428938 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:46.468669 (+ 39731us) log.cc:844] Serialized 52 byte log entry
0709 12:18:46.922654 (+453985us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:47.176482 (+253828us) log.cc:844] Serialized 14 byte log entry
0709 12:18:47.176707 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.176771 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:47.176809 (+    38us) raft_consensus.cc:1685] finished
0709 12:18:47.176819 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:47.176933 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":260985,"raft.queue_time_us":75135,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5514,"thread_start_us":547477,"threads_started":2,"wal-append.queue_time_us":535860}
I20260709 12:18:47.181131 22893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40028 (request call id 1562) took 1142 ms. Trace:
I20260709 12:18:47.184048 22752 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:18:47.182705 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:47.184402 22893 rpcz_store.cc:276] 0709 12:18:46.039199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.048140 (+  8941us) service_pool.cc:224] Handling call
0709 12:18:46.050264 (+  2124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:46.085246 (+ 34982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:46.085283 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:46.131063 (+ 45780us) log.cc:844] Serialized 26 byte log entry
0709 12:18:46.414556 (+283493us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:46.414610 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.180467 (+765857us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b5400572454. stack: 00007fadf1660343 00007fadf1660240 00007fadf0fef1d4 00007fadfad2d304 00007fadfad2d299 00007fadf46e8571 00007fadf477fe01 00007fadf477e83e 00007fadf9743419 00007fadf2cbabd4 00007fadf2cbab62 00007fadf2cbaa91 00007fadf2cbaa0c 00007fadf2cb9cc2 00007fadf2aba48c 00007fadf2ab98c6
0709 12:18:47.180554 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:47.180645 (+    91us) raft_consensus.cc:1685] finished
0709 12:18:47.180668 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:47.181034 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7460,"raft.queue_time_us":7690,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":17276,"spinlock_wait_cycles":62257920,"thread_start_us":283010,"threads_started":1,"wal-append.queue_time_us":592065}
I20260709 12:18:47.172504 29831 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:47.185109 22898 raft_consensus.cc:2468] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:47.190042 22749 raft_consensus.cc:1240] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 22. Current term is 23. Ops: []
W20260709 12:18:47.197685 29900 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:47.197929 29843 raft_consensus.cc:3055] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:18:47.198371 29843 raft_consensus.cc:740] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:47.199417 29843 consensus_queue.cc:260] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:47.200629 29843 raft_consensus.cc:3060] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:47.204450 29875 consensus_queue.cc:1048] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:47.206192 22791 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:47.215108 29838 log.cc:927] Time spent T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:18:47.121811 29862 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:18:47.143556 29811 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963) with higher term. Message: Invalid argument: T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 20. Current term is 21.
W20260709 12:18:47.219651 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 57197us
I20260709 12:18:47.123245 29886 consensus_queue.cc:237] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:47.221103 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 75754.6us
I20260709 12:18:47.244540 22865 leader_election.cc:304] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.221884 29818 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:47.232036 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:47.232933 22747 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:47.234354 29733 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:18:47.241547 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.244952 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:47.262729 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.264096 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb4cae1a1914d1a94e203f082ef12e5" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.263017 29830 consensus_queue.cc:1048] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:18:47.268437 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28930436db4beaabf3941f9b136f22" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.269830 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.271077 29892 raft_consensus.cc:3055] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:47.262265 29850 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:18:47.272174 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9dd2cd94724707b7aafa424c43031d" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.262020 29896 raft_consensus.cc:2749] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:47.275719 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.276472 22825 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:47.271607 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.279434 29844 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:47.280138 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.240005 29875 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:18:47.289404 29865 log.cc:927] Time spent T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.812s	user 0.007s	sys 0.003s
I20260709 12:18:47.291376 29299 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:18:47.329504 22900 raft_consensus.cc:3060] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:47.271628 29892 raft_consensus.cc:740] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
W20260709 12:18:47.339047 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 97613.6us
I20260709 12:18:47.222100 29661 consensus_queue.cc:237] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:47.344209 22751 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:18:47.350081 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.352458 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:47.359562 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:47.370445 22900 raft_consensus.cc:1275] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:18:47.326753 29877 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.392338 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:47.397126 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:47.400190 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.378010 29801 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:18:47.406266 29902 log.cc:927] Time spent T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:18:47.407437 29911 log.cc:927] Time spent T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:18:47.423736 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
W20260709 12:18:47.464377 23498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.468155 22823 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:47.372138 29845 consensus_queue.cc:1059] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 12:18:47.437042 22717 leader_election.cc:336] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.547s (SENT)
I20260709 12:18:47.472020 22717 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:47.438422 22719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.439631 29571 consensus_queue.cc:1059] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:47.388150 29875 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.399649 29840 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:47.382722 29877 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:47.399910 29892 consensus_queue.cc:260] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:47.464377 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 67326.9us
W20260709 12:18:47.476300 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 181086us
I20260709 12:18:47.458734 29572 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:18:47.464820 29733 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:18:47.482745 22865 leader_election.cc:336] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:47.486645 22865 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:47.487753 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 164255us
W20260709 12:18:47.489529 22791 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.490212 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:47.494112 22865 leader_election.cc:336] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.494626 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.499881 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.477566 29770 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:18:47.536231 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:47.543601 29811 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:18:47.545120 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 51050.8us
W20260709 12:18:47.498586 29910 log.cc:927] Time spent T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:18:47.556217 23494 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:47.477701 29875 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:47.530587 29702 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:18:47.565199 23495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.569367 22823 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
W20260709 12:18:47.575157 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 138149us
W20260709 12:18:47.576339 22717 leader_election.cc:336] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425): Timed out: RequestConsensusVote RPC to 127.17.249.196:37425 timed out after 1.576s (SENT)
I20260709 12:18:47.576853 22717 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:47.579483 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 107558us
W20260709 12:18:47.579972 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 90485.1us
W20260709 12:18:47.582190 22791 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.582712 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.552786 29571 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:47.597420 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:47.602164 23494 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.604252 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:47.604961 22900 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:47.609377 22866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.610056 29887 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:47.613880 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:47.615872 29843 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:47.618579 22717 leader_election.cc:400] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21.
I20260709 12:18:47.619495 22717 leader_election.cc:403] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:18:47.620668 29592 raft_consensus.cc:2749] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425) with higher term. Message: Invalid argument: T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e for earlier term 20. Current term is 21.
I20260709 12:18:47.621730 22900 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:47.584215 29839 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:18:47.584573 29733 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:18:47.605911 29913 log.cc:927] Time spent T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.171s	user 0.001s	sys 0.001s
I20260709 12:18:47.645800 22901 raft_consensus.cc:1240] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:18:47.590672 29830 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:47.606307 29770 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:47.636701 29839 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:47.663363 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 45089.6us
I20260709 12:18:47.666841 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:47.653084 29572 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.654089 29863 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:47.653882 29733 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
W20260709 12:18:47.674849 22716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.675254 29886 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:18:47.657413 29845 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:18:47.664194 29839 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:47.699501 22717 leader_election.cc:304] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:47.700791 29831 raft_consensus.cc:2749] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:47.701036 22717 leader_election.cc:304] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:47.702484 29894 consensus_meta.cc:287] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.003s
I20260709 12:18:47.702811 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:47.689848 22790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.656684 29830 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:47.708424 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 126292us
I20260709 12:18:47.708444 29592 raft_consensus.cc:2749] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:18:47.709659 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:47.714176 22791 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.715874 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:47.681934 29886 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:47.710976 29831 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:18:47.711946 29915 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:18:47.711894 29840 raft_consensus.cc:3055] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:18:47.676371 29572 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:47.726366 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:47.725865 22901 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:18:47.721268 29831 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:47.678483 29863 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:47.758402 29863 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:47.734486 29823 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:47.736774 29840 raft_consensus.cc:740] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:47.759711 29823 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:47.760371 29840 consensus_queue.cc:260] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:47.761623 29840 raft_consensus.cc:3060] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:47.762079 29823 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:47.764670 29847 consensus_meta.cc:287] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.003s
W20260709 12:18:47.742465 29922 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:18:47.744356 29830 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:47.709542 29894 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:47.744359 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:47.752554 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:47.775830 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 170830us
W20260709 12:18:47.777071 22791 leader_election.cc:336] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:47.777619 29918 log.cc:927] Time spent T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:18:47.777695 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:47.771246 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 221258us
I20260709 12:18:47.754740 29875 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:47.755412 29877 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:47.725667 29928 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:18:47.741779 29733 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:47.722112 29886 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:18:47.798983 22791 leader_election.cc:336] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.800649 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.780928 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.785576 22826 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:47.786746 29894 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:47.806419 23494 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:47.788990 29923 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.137s	user 0.003s	sys 0.000s
I20260709 12:18:47.804852 22865 leader_election.cc:304] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:47.811393 22791 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.812330 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:47.813798 22865 leader_election.cc:304] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.782567 29863 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:47.816144 22748 raft_consensus.cc:1240] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:47.817991 22865 leader_election.cc:304] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:47.821522 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 85726.8us
I20260709 12:18:47.818037 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:47.813568 29830 raft_consensus.cc:2749] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:47.825032 22893 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:47.825661 29877 raft_consensus.cc:2749] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:47.828372 29572 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:47.829583 29831 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:47.831480 29877 raft_consensus.cc:2749] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:47.813728 29925 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:47.835307 29925 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:47.835340 29875 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:18:47.843693 22865 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.859057 22893 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
I20260709 12:18:47.860661 22717 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:47.861374 29892 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:47.861826 22867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.864701 29817 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.865523 29817 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:47.867055 29896 raft_consensus.cc:2764] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:18:47.867885 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.868899 29896 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:18:47.869935 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:47.870749 22865 leader_election.cc:336] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.877132 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:47.875005 22865 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.881454 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:47.881517 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:47.885353 22818 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:47.819067 29928 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:47.834579 29702 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:47.889256 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.883149 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:47.889475 22865 leader_election.cc:336] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.891633 22865 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:47.892526 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.893571 22824 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 23.
I20260709 12:18:47.818207 29929 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:47.896250 22820 raft_consensus.cc:2410] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
W20260709 12:18:47.896525 22865 leader_election.cc:336] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.897578 22865 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.900048 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.873885 29572 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.901248 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.906191 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:47.907536 22820 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:47.908450 29803 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:18:47.908828 22865 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.872910 29894 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:18:47.909289 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:47.895251 29877 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:47.916262 22824 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:18:47.907295 22821 raft_consensus.cc:2468] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:47.916457 22825 raft_consensus.cc:1240] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 LEADER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 23. Current term is 24. Ops: [23.13-23.13]
W20260709 12:18:47.915335 22865 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.938751 22827 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:18:47.941567 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:47.890832 29875 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:47.903447 29896 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:47.956499 22827 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:18:47.910125 29592 raft_consensus.cc:2804] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:47.955202 22818 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 17.
I20260709 12:18:47.958801 22821 raft_consensus.cc:1240] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:18:47.952726 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:47.963153 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47828.6us
I20260709 12:18:47.963404 22899 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 25.
I20260709 12:18:47.915428 29803 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:18:47.965487 22865 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:47.980821 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:47.982613 29803 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:18:47.991726 29817 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:47.992667 29930 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:47.993302 29930 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:47.957011 29875 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:47.994755 22819 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:18:47.914173 29845 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:18:48.005869 22819 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:18:47.913657 29572 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:48.024138 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 151647us
I20260709 12:18:47.919250 29894 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:48.035984 22717 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:48.041421 22717 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:47.976912 29702 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:18:47.895313 29925 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:47.963822 29661 consensus_queue.cc:1048] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:18:47.977582 29592 raft_consensus.cc:697] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:48.051929 29943 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:48.067229 29930 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:48.071821 29875 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:48.074395 29572 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:48.079087 29940 consensus_queue.cc:1048] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:48.079869 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:48.081452 29940 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:48.081890 29924 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:18:48.082345 29894 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:48.082655 29924 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.083205 29924 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:48.088225 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:48.051054 29928 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:48.098639 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 210376us
W20260709 12:18:48.102265 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 150881us
I20260709 12:18:48.104765 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:48.081977 29940 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:48.111455 29702 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:18:48.091859 29801 raft_consensus.cc:3055] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:18:48.117185 18407 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 23731)
I20260709 12:18:48.108199 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:48.122030 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 174316us
I20260709 12:18:48.070111 29592 consensus_queue.cc:237] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:48.132678 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 91347.8us
W20260709 12:18:48.140028 22865 leader_election.cc:336] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.140779 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:48.122625 29702 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.145538 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:48.125360 29801 raft_consensus.cc:740] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:48.132797 29892 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:48.130496 29862 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:48.149115 22865 leader_election.cc:336] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.153380 22865 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:48.192085 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.120682 29839 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:48.196556 22753 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:18:48.198673 22791 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:48.199033 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 50136.5us
I20260709 12:18:48.146910 29702 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:48.203289 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:48.148000 29877 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:48.107963 29928 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:48.211283 22865 leader_election.cc:336] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.150054 29892 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:48.199179 29943 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:48.222038 29892 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:48.222700 29943 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:48.223121 29940 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:48.219918 29949 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:48.231066 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.205334 29803 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:18:48.215116 22865 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:48.251771 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:48.199460 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:48.259385 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 48140.5us
W20260709 12:18:48.263176 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 105952us
W20260709 12:18:48.264956 22791 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.265596 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:48.267000 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:48.270288 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 67129.6us
W20260709 12:18:48.272378 22791 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.273219 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:48.274155 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:48.238363 29840 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:48.260854 22865 leader_election.cc:336] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.281955 22865 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:48.283409 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:48.278143 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 142467us
I20260709 12:18:48.210956 29862 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:48.257342 29941 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:48.269733 29896 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:48.303059 29862 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:48.304800 22865 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.287056 29845 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.010s
W20260709 12:18:48.309094 22865 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.271076 29867 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:48.279786 29930 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:48.281800 29949 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:48.280081 29863 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:48.324651 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:48.325464 22823 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
I20260709 12:18:48.304417 29818 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:48.346745 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:48.347275 22752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.348184 22818 raft_consensus.cc:1275] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:18:48.323484 29941 raft_consensus.cc:2804] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:48.299286 29840 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:48.355242 22897 raft_consensus.cc:2393] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 18: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:48.369566 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.350122 29299 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.268234 29801 consensus_queue.cc:260] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:48.357452 22791 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.359673 29941 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.360819 29863 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:48.385186 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:48.437916 29958 log.cc:927] Time spent T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:18:48.439862 29954 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:48.443396 29801 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:48.443746 29960 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:18:48.382714 29299 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:48.450927 29936 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260709 12:18:48.451735 29299 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:48.453141 29936 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:48.453599 29936 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:48.443837 22750 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:18:48.386534 29941 raft_consensus.cc:3060] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:48.354414 29949 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:18:48.468727 22790 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:48.482331 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.485883 29874 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:48.486979 29874 consensus_queue.cc:1243] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Peer e5f99cf1fbc740e3895959adc4f3d10e log is divergent from this leader: its last log entry 23.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:18:48.493582 22750 pending_rounds.cc:85] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting all ops after (but not including) 12
I20260709 12:18:48.494019 22750 pending_rounds.cc:107] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 12:18:48.494637 22750 raft_consensus.cc:2889] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:48.493893 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 180002us
I20260709 12:18:48.496313 29925 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:48.497327 29839 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:48.431171 29863 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:48.540225 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 148792us
I20260709 12:18:48.500401 29894 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:18:48.542038 22717 leader_election.cc:336] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:48.547392 22717 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.547887 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:48.550133 22717 leader_election.cc:336] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.454578 29936 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:48.528328 29928 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:48.553344 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:48.550930 22717 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:48.558764 22826 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:48.543448 29734 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:48.553815 29886 consensus_meta.cc:287] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: Time spent flushing consensus metadata: real 0.744s	user 0.016s	sys 0.000s
I20260709 12:18:48.575925 29886 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:48.576381 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:48.577003 22897 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:48.577913 22748 raft_consensus.cc:1240] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:18:48.578534 29886 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:48.578390 29863 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:48.578564 29734 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:48.592065 29734 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:48.570385 29924 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:48.572001 29840 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:48.575050 29966 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:48.593103 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:48.565050 29945 log.cc:927] Time spent T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.273s	user 0.002s	sys 0.000s
I20260709 12:18:48.580744 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.595826 29936 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:48.596705 22900 raft_consensus.cc:1275] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:18:48.598325 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:48.599112 22900 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 25: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
W20260709 12:18:48.614065 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 63985.2us
W20260709 12:18:48.614912 22717 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:48.616631 22717 leader_election.cc:336] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:48.617543 22717 leader_election.cc:336] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:48.620080 22717 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.620527 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:48.551635 29592 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:48.627132 22717 leader_election.cc:336] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.633571 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:48.636637 22894 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:18:48.628300 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 102152us
W20260709 12:18:48.640625 22717 consensus_peers.cc:597] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:48.643085 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:48.639954 29892 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:48.646185 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:48.647083 29892 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:48.648206 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.649818 22896 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:18:48.627884 29846 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.651259 29846 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:48.653312 29846 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:48.656596 22901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:48.657197 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.658185 22898 raft_consensus.cc:1275] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:18:48.653345 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:48.662885 22791 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:48.669493 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:48.673058 22826 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 26.
I20260709 12:18:48.677722 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2d5308b787c474aa407e2d08bb254b9" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.694228 22826 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:18:48.640276 29843 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:18:48.669405 29592 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:48.673559 29925 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.715358 23493 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:48.713791 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:48.673799 29863 raft_consensus.cc:2749] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:48.642390 29702 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:48.729846 29886 consensus_queue.cc:1048] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:48.731882 29924 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:48.732744 29770 consensus_queue.cc:1048] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:48.731755 29862 consensus_queue.cc:1048] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:48.739817 22819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:48.686003 29951 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:18:48.752796 22892 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:18:48.726344 29926 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:48.714607 29850 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:18:48.737042 29969 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.737709 29260 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:48.716837 29734 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:18:48.725744 29925 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:48.750591 29949 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.779124 22819 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:48.779371 29968 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.780112 29968 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:48.782466 29968 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:48.783211 29970 raft_consensus.cc:493] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:48.784099 29972 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:18:48.765524 29260 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.790570 29702 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:48.791934 29973 log.cc:927] Time spent T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:18:48.832355 23493 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:48.792783 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:48.793442 29949 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:48.795576 29925 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:48.800072 29941 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:48.768241 29969 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:48.802340 29843 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:18:48.809530 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 79065.9us
I20260709 12:18:48.815619 22894 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 26.
W20260709 12:18:48.842549 22865 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.856793 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:48.851387 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:48.837817 29260 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:48.861251 22865 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:48.867314 23493 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:48.871201 23494 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:48.852129 29571 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:48.894479 22825 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:48.863632 29830 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:18:48.893137 29839 consensus_queue.cc:1059] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:18:48.903411 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:48.904909 22822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:48.905457 22822 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:18:48.843133 29970 raft_consensus.cc:515] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:48.912556 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.914625 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.915599 22745 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 23.
I20260709 12:18:48.916621 29941 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:48.888177 29572 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:18:48.917436 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:48.921319 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:48.923635 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:48.923965 29572 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 26 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:48.925226 29892 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:18:48.925174 29572 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:48.927978 22818 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:18:48.918391 22823 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 22.
I20260709 12:18:48.947093 22900 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:48.879799 29850 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:48.943586 29951 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:18:48.951269 29733 raft_consensus.cc:3055] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:18:48.953763 29969 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:48.957494 22823 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:18:48.970616 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:48.979025 22822 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 26.
I20260709 12:18:48.970589 29733 raft_consensus.cc:740] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:49.002852 22753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:49.005690 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:48.978447 29966 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:18:49.008692 29970 leader_election.cc:290] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:49.009902 29982 log.cc:927] Time spent T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:49.012735 29733 consensus_queue.cc:260] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:49.015889 22791 leader_election.cc:336] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:49.016400 22791 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.018224 22745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:48.999760 29734 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 12:18:49.030522 22791 leader_election.cc:336] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:49.033519 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:49.037356 29949 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:49.040331 29941 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:49.041153 29941 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:49.044225 29941 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:49.045958 23493 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.047243 29925 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:49.001931 29839 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:18:49.058745 29592 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:49.031654 29989 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:49.023603 23494 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:49.102226 29894 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:18:49.103477 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 80216us
I20260709 12:18:49.148697 23494 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:49.150808 29892 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:49.151510 29892 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:49.104031 29968 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:18:49.153122 29968 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.153517 29968 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:18:49.101848 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 71354us
W20260709 12:18:49.125855 18407 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 23731)
W20260709 12:18:49.155336 22791 leader_election.cc:336] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:49.155879 22791 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.157147 22900 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:18:49.157456 29733 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:18:49.127008 22717 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:49.157168 22791 leader_election.cc:336] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:49.158349 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:49.158551 22791 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.159425 29989 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:49.160090 29843 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:18:49.163504 22892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:49.128679 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 80782.6us
I20260709 12:18:49.066350 29260 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:49.138571 22896 raft_consensus.cc:1240] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:18:49.164804 23493 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.096014 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5e2a8f5b814b18a53ee5c8af767da0" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:49.143483 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:49.074414 22745 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:49.165383 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:49.165755 22899 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:49.166059 22894 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 18.
I20260709 12:18:49.169531 29942 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:18:49.172948 29926 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:49.172940 29942 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:49.174228 29953 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:49.174486 29942 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:49.154021 29892 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:49.178391 23494 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.193980 29968 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:49.197988 22791 leader_election.cc:336] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:49.198554 22791 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:49.200213 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:49.209209 22826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:49.210129 22826 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 19: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:49.222059 22899 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 26.
W20260709 12:18:49.225005 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46704us
W20260709 12:18:49.229580 22791 leader_election.cc:336] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:49.232805 22825 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:18:49.231390 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:49.225847 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:49.241772 29260 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:49.255223 22717 consensus_peers.cc:597] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:49.236634 29927 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:49.233306 29934 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:18:49.264498 22791 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:49.272475 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:49.241775 29968 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:49.223433 29966 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:18:49.276908 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:49.283123 29894 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:49.299132 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:49.299589 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:49.303423 22892 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:49.311136 23493 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:49.311710 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:49.264393 29823 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:49.257296 29734 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:18:49.278746 29989 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:49.278391 29987 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.341284 29942 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:49.342108 29942 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.342595 29942 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:49.348474 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 84899.1us
I20260709 12:18:49.349900 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:49.363364 29931 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:18:49.364464 29931 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.365039 29931 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:49.369014 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:49.369709 22749 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:49.371181 29844 consensus_queue.cc:1059] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:49.372288 29941 raft_consensus.cc:3055] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:18:49.372783 29941 raft_consensus.cc:740] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:49.375391 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:49.376252 22820 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 24
W20260709 12:18:49.373971 30003 log.cc:927] Time spent T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:49.373940 29941 consensus_queue.cc:260] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:49.381695 29941 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:49.382457 29984 log.cc:927] Time spent T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:18:49.385694 22749 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
W20260709 12:18:49.382165 29925 consensus_queue.cc:1175] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" responder_term: 19 status { last_received { term: 19 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 19 index: 9 } }
W20260709 12:18:49.386704 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.397558 22865 leader_election.cc:304] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.395375 23493 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:49.382254 29994 log.cc:927] Time spent T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:18:49.425330 22895 raft_consensus.cc:1240] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Rejecting Update request from peer a89a4b420ea9496aab55475fc38bb6f7 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:18:49.407100 29969 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:18:49.434216 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:49.409631 29571 raft_consensus.cc:3055] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:18:49.352511 29987 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:49.411098 30009 raft_consensus.cc:2749] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:49.417165 29702 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:49.431177 29962 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:49.451963 30007 log.cc:927] Time spent T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:18:49.442700 29571 raft_consensus.cc:740] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:49.430914 29839 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:18:49.482023 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:49.452665 29969 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:49.425356 29942 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:49.450608 29988 consensus_queue.cc:1059] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:18:49.464725 29931 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:49.463855 29702 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:49.469515 29962 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:49.560796 29969 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:49.606760 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:49.639530 22897 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:49.641731 29987 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:49.642252 29962 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:49.644727 22820 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
W20260709 12:18:49.647290 30013 log.cc:927] Time spent T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:18:49.652822 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:49.653281 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 318920us
I20260709 12:18:49.664929 29962 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.677659 29962 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:49.683339 29925 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:49.684866 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 249244us
W20260709 12:18:49.699553 22865 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:49.701278 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:49.712081 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:49.713801 22900 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:18:49.698448 29925 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:49.718941 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 64682.4us
I20260709 12:18:49.721921 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:49.722833 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:49.735862 29702 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:49.743146 22897 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:49.721410 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:49.748600 22746 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:49.748417 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:49.751149 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.713213 30009 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:49.760905 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:49.763552 29734 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.771775 23494 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:49.774735 29931 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:18:49.775059 29988 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:49.775943 29988 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:49.778113 23493 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.755054 29702 raft_consensus.cc:493] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:49.762710 29661 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.766741 29734 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:49.785435 29931 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:49.777086 29988 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:49.751142 29571 consensus_queue.cc:260] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:49.789074 29874 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:18:49.773425 29966 consensus_queue.cc:1059] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:18:49.798151 29734 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:49.850020 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 59020.7us
I20260709 12:18:49.790074 29702 raft_consensus.cc:515] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:49.865854 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:49.864698 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 81448us
W20260709 12:18:49.862210 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 78047.8us
I20260709 12:18:49.849632 29571 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:18:49.798458 29661 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:49.848075 30011 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:18:49.874788 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 90131.9us
I20260709 12:18:49.873993 22746 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:49.872515 30009 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:18:49.887959 22791 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:49.889741 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.902400 30023 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:49.886672 29927 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:49.921952 30020 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:18:49.922163 29969 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.878957 30011 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:49.942512 29927 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:49.937350 22864 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.950337 29962 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:49.952701 29955 raft_consensus.cc:3055] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:18:49.953094 29702 leader_election.cc:290] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:49.968961 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 77792.1us
W20260709 12:18:49.975756 22791 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 110 similar messages]
I20260709 12:18:49.975998 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:49.974361 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 182865us
I20260709 12:18:49.930720 29942 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:49.936733 29925 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:49.975131 30010 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:49.974915 29955 raft_consensus.cc:740] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:49.988168 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:49.990584 22896 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:49.981858 30026 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.992157 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:49.993656 23494 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:49.996273 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:49.991359 30026 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:49.992408 29925 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.998499 29925 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:49.999830 30026 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:50.000769 29925 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:49.994390 29942 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:49.970353 29969 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:50.020422 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b331b9ec19453b8cd59bd6d61760dd" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:50.024014 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:50.024269 22825 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:18:50.026942 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:50.023904 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:50.028149 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:50.029057 22827 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 19.
I20260709 12:18:50.031239 22749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:50.031306 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:50.030608 22865 leader_election.cc:304] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:50.034377 30009 raft_consensus.cc:2749] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:50.042163 29927 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:50.047770 29661 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:50.025367 30021 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:18:50.050760 29847 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:50.071538 30011 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:50.073348 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:50.074054 22744 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
I20260709 12:18:50.075443 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:50.080509 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:50.082741 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:50.083084 29969 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:50.083580 22898 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:50.084887 22824 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:50.087073 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:50.061686 29955 consensus_queue.cc:260] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:50.093606 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:50.082124 30019 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.353s	user 0.004s	sys 0.000s
I20260709 12:18:50.081385 30011 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:50.099364 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:50.100782 29962 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:50.104467 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:50.108443 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:50.096954 29874 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:50.095352 29955 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:50.110714 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:50.110124 30031 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:50.119266 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:50.134167 29962 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:18:50.145685 29962 consensus_queue.cc:1243] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Peer cd93aceeb0e24bb78d4582d8ad55988d log is divergent from this leader: its last log entry 23.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:18:50.143369 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:50.112123 29874 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.148257 29874 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:50.144043 30031 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.151958 30031 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:50.151896 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:50.112442 30026 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:50.152850 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:50.153932 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:50.154623 18407 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 23731)
W20260709 12:18:50.157456 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 48620.6us
I20260709 12:18:50.158579 22896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:50.132215 30009 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:18:50.160148 30009 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:50.163059 30009 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:50.169273 30029 log.cc:927] Time spent T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:18:50.174608 22865 leader_election.cc:336] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:50.177335 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:50.173272 22570 catalog_manager.cc:5697] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:50.174055 23493 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:50.191572 29962 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:50.191666 22570 catalog_manager.cc:5697] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 20 to 21, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 21 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:50.196121 22573 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43984 (request call id 161) took 22800 ms (client timeout 15000 ms). Trace:
I20260709 12:18:50.196722 22570 catalog_manager.cc:5697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 17 to 19, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 19 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:50.197949 22865 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:50.199575 22570 catalog_manager.cc:5697] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 21 to 24, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 24 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:50.133155 29942 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:50.202353 22570 catalog_manager.cc:5697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:50.205552 22823 raft_consensus.cc:1240] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Rejecting Update request from peer e5f99cf1fbc740e3895959adc4f3d10e for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:18:50.205219 22570 catalog_manager.cc:5697] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 15 to 21, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 21 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.211162 22570 catalog_manager.cc:5697] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 15 to 16, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 16 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.106153 30011 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:50.227666 22570 catalog_manager.cc:5697] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 23 to 24, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 24 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:50.233084 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:50.233274 22570 catalog_manager.cc:5697] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:50.236373 22824 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:18:50.234820 22570 catalog_manager.cc:5697] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 23 to 24, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 24 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:50.240993 22570 catalog_manager.cc:5697] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 16 to 20, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 20 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:50.242558 22570 catalog_manager.cc:5697] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 14 to 24, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 24 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:50.244155 22570 catalog_manager.cc:5697] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.246114 29942 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.218232 30009 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:50.246765 29942 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:50.239251 30011 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:50.251452 22897 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
W20260709 12:18:50.196694 22573 rpcz_store.cc:269] 0709 12:18:27.395720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.399762 (+  4042us) service_pool.cc:224] Handling call
0709 12:18:50.196013 (+22796251us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:45.955795 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:46.019770 (+ 63975us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:46.019843 (+    73us) write_op.cc:435] Acquired schema lock
0709 12:18:46.019869 (+    26us) tablet.cc:662] Decoding operations
0709 12:18:46.021657 (+  1788us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:46.021789 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:46.021819 (+    30us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:18:46.060811 (+ 38992us) tablet.cc:701] Row locks acquired
0709 12:18:46.060873 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:18:46.061106 (+   233us) write_op.cc:270] Start()
0709 12:18:46.061308 (+   202us) write_op.cc:276] Timestamp: P: 1783599526061027 usec, L: 0
0709 12:18:46.061352 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:18:46.062300 (+   948us) log.cc:844] Serialized 6018 byte log entry
0709 12:18:47.148699 (+1086399us) op_driver.cc:464] REPLICATION: finished
0709 12:18:47.622977 (+474278us) write_op.cc:301] APPLY: starting
0709 12:18:47.646860 (+ 23883us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:47.762732 (+115872us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:47.762948 (+   216us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:48.459942 (+696994us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:48.460355 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:18:48.460431 (+    76us) write_op.cc:312] APPLY: finished
0709 12:18:48.460982 (+   551us) log.cc:844] Serialized 138 byte log entry
0709 12:18:48.751832 (+290850us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:48.767652 (+ 15820us) write_op.cc:454] Released schema lock
0709 12:18:48.767760 (+   108us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:48.847637 (+ 79877us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:48.850091 (+  2454us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":297299,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":334252,"apply.run_cpu_time_us":65544,"apply.run_wall_time_us":1231393,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66887,"num_ops":15,"prepare.queue_time_us":67864,"prepare.run_cpu_time_us":39428,"prepare.run_wall_time_us":412686,"raft.queue_time_us":168990,"raft.run_cpu_time_us":138078,"raft.run_wall_time_us":351213,"replication_time_us":1071780,"thread_start_us":847365,"threads_started":5,"wal-append.queue_time_us":837376,"wal-append.run_cpu_time_us":26054,"wal-append.run_wall_time_us":2497298}]]}
I20260709 12:18:50.259029 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:50.259917 22570 catalog_manager.cc:5697] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:50.263243 22820 raft_consensus.cc:1217] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Deduplicated request from leader. Original: 16.10->[18.11-26.15]   Dedup: 18.11->[20.12-26.15]
I20260709 12:18:50.263792 22820 pending_rounds.cc:85] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Aborting all ops after (but not including) 11
I20260709 12:18:50.264106 22820 pending_rounds.cc:107] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:18:50.264336 22820 raft_consensus.cc:2889] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:50.264670 22820 pending_rounds.cc:107] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 12:18:50.264900 22820 raft_consensus.cc:2889] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:50.265600 22750 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:18:50.261526 22570 catalog_manager.cc:5697] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 19 to 21, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 21 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:50.249377 29942 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:50.284548 29571 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:50.273375 22570 catalog_manager.cc:5697] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 20 to 22, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 22 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:50.295607 22570 catalog_manager.cc:5697] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 14 to 18, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 18 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:50.298738 22570 catalog_manager.cc:5697] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 14 to 19, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 19 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:50.308040 23494 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:50.316695 22570 catalog_manager.cc:5697] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 13 to 19, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 19 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:50.278384 29949 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:50.323413 22570 catalog_manager.cc:5697] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 20 to 23, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 23 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:50.326448 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:50.330524 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:50.262979 30031 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:50.335089 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:50.326854 22570 catalog_manager.cc:5697] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.348299 22570 catalog_manager.cc:5697] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 17 to 19, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 19 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:50.353544 30031 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:50.342473 29733 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:50.348709 29572 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:50.326577 29930 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:50.357872 29930 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:50.359903 29930 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:50.361565 22791 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:50.365566 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:50.371197 22570 catalog_manager.cc:5697] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 16 to 20, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 20 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:50.374282 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:50.375335 22898 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:50.334661 29926 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:18:50.374652 22570 catalog_manager.cc:5697] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 14 to 26, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 26 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.396255 29874 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:50.413709 22898 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:50.403352 22570 catalog_manager.cc:5697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 15 to 17, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 17 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:50.421011 22570 catalog_manager.cc:5697] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.334976 29941 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:18:50.429639 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:50.422504 22570 catalog_manager.cc:5697] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 20 to 22, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 22 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:50.432232 22570 catalog_manager.cc:5697] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 24 to 26, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 26 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:50.433619 22570 catalog_manager.cc:5697] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:50.436957 22898 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:18:50.430122 30026 raft_consensus.cc:493] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.435086 22570 catalog_manager.cc:5697] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 13 to 19, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 19 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:50.438431 30026 raft_consensus.cc:515] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:50.441306 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:50.442207 22824 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a89a4b420ea9496aab55475fc38bb6f7 in current term 20: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:50.439813 22570 catalog_manager.cc:5697] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 6 to 18. New cstate: current_term: 18 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:50.442603 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:50.401657 30028 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:50.447636 22570 catalog_manager.cc:5697] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 19 to 20, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 20 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:50.437400 22899 raft_consensus.cc:2393] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 20: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:50.453296 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:50.478909 23494 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:50.447485 30026 leader_election.cc:290] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:50.433606 29847 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:18:50.486207 29803 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:50.527208 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 195383us
W20260709 12:18:50.535953 22717 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:50.536991 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:50.537945 22717 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:50.542362 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 155403us
I20260709 12:18:50.518568 29927 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:50.548998 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c267ff17b26d4fd08c09792a0ccb9b43" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:50.579284 30039 log.cc:927] Time spent T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:18:50.534668 29803 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:50.563241 29874 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:50.523175 29949 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:18:50.594643 29803 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:50.595347 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 48068.3us
I20260709 12:18:50.596050 29927 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:50.597090 29927 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:50.597776 23493 leader_election.cc:304] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:50.599673 30031 raft_consensus.cc:2749] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:50.597090 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:50.602212 22717 consensus_peers.cc:597] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:50.611570 29572 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:50.599828 30011 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:50.621811 30011 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:50.625610 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:50.680151 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:50.694366 22824 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:18:50.777129 22897 raft_consensus.cc:2393] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 20: Already voted for candidate a89a4b420ea9496aab55475fc38bb6f7 in this term.
W20260709 12:18:50.697947 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 59492.8us
W20260709 12:18:50.688145 30043 log.cc:927] Time spent T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
I20260709 12:18:50.720862 22747 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 16.
W20260709 12:18:50.675585 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 111420us
W20260709 12:18:50.742602 22791 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:50.790732 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:50.794535 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:50.796578 22823 raft_consensus.cc:2393] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 16: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:18:50.797670 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 55099.6us
I20260709 12:18:50.800215 22747 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:18:50.793802 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:50.795951 22864 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:50.660916 30017 log.cc:927] Time spent T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.174s	user 0.003s	sys 0.002s
I20260709 12:18:50.691357 29844 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.838904 29844 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:50.808606 29661 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:50.813912 29946 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:50.849392 29946 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:50.803505 29877 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:50.840488 22717 consensus_peers.cc:597] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:50.818912 29942 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:18:50.813223 30010 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:50.853404 30010 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:50.854962 29877 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:50.858495 29877 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:50.859236 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:50.862054 22748 raft_consensus.cc:2393] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 25: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:50.859753 29968 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.863328 29968 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:50.865530 29968 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:50.874311 29844 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:50.854574 30010 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:50.875537 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:50.876441 22895 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
I20260709 12:18:50.878074 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:50.882409 29968 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:18:50.889370 29968 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.890050 29968 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:50.903002 29946 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:50.887302 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 76029.3us
W20260709 12:18:50.918413 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 88682.2us
I20260709 12:18:50.922518 29927 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:50.925289 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:50.927759 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:50.928529 22748 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 25.
I20260709 12:18:50.928696 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:50.935187 22898 raft_consensus.cc:2393] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 24: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:50.944073 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:50.948596 22791 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:50.949256 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:50.930158 29844 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.957115 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:50.957098 30031 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.959406 29862 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:18:50.966557 29844 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:50.989765 29844 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:50.998498 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:50.999315 22898 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
I20260709 12:18:50.966755 29661 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:51.000802 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
W20260709 12:18:50.998034 22791 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:50.998450 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 168074us
I20260709 12:18:50.968422 29850 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:18:51.013655 22791 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:51.012032 30026 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:18:50.979315 30031 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:51.033917 29968 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:51.064930 30031 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:51.067723 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:51.068475 22895 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:18:51.068903 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:51.069624 22898 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:51.070669 29823 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.071179 30026 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.071244 29823 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:51.057771 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:51.072996 29862 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:18:51.073138 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 67055.6us
I20260709 12:18:51.073736 29823 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:51.071771 30026 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:51.077176 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:51.079056 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:51.079826 22744 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:51.077939 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:51.080391 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:51.078055 22746 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 16.
W20260709 12:18:51.055723 22865 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:51.089510 22790 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:51.064970 29968 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:51.097874 22825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:51.098443 22898 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:51.098652 22825 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 20.
I20260709 12:18:51.089532 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:51.093726 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:51.082378 29962 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:51.102012 29962 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.103876 29962 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:51.104774 29988 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:51.105916 29862 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:51.106865 22827 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 24.
I20260709 12:18:51.099996 29934 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:51.107947 29934 raft_consensus.cc:493] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.108333 29934 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:51.103173 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47491.7us
I20260709 12:18:51.118185 22895 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 26.
I20260709 12:18:51.122251 23494 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:51.121858 30050 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:51.129782 30031 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:18:51.144904 30031 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:51.145982 30031 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:51.149016 29949 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.159616 29949 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:51.162077 29949 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:51.155094 18407 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 23731)
I20260709 12:18:51.163993 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:51.164582 29934 raft_consensus.cc:515] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:51.184175 29962 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:51.188279 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:51.188772 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 74654.3us
I20260709 12:18:51.192428 22744 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 26.
I20260709 12:18:51.199060 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:51.216459 23494 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:51.228217 30026 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:51.230935 29968 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:18:51.249262 30055 log.cc:927] Time spent T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:18:51.250859 30026 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:51.251066 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:51.251668 22818 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:51.261741 22818 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 25.
I20260709 12:18:51.265247 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:51.265877 22748 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:51.267482 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b793d48d6b4e5db13d9e6811d51310" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:51.270813 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:51.271551 22895 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:51.279315 23494 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:51.279543 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:51.268430 29934 leader_election.cc:290] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:51.286468 22818 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:18:51.286939 29844 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:18:51.291328 29844 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 25 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:51.292362 29844 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:51.296663 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:51.288936 22865 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:51.297894 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:51.303479 22895 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 25.
W20260709 12:18:51.307067 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:51.286108 22791 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:51.317728 29962 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:51.307209 30011 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:51.321821 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:51.337553 22748 raft_consensus.cc:2468] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:51.338006 22898 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:51.332525 22717 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:51.335873 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 49821.4us
I20260709 12:18:51.343823 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:51.344444 22820 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:51.346618 29988 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:18:51.352216 22790 leader_election.cc:304] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c
I20260709 12:18:51.359077 29862 raft_consensus.cc:2804] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:51.359689 29862 raft_consensus.cc:697] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:51.360603 29862 consensus_queue.cc:237] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:51.368737 29962 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.372256 22898 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:51.373955 23494 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7; no voters: 
I20260709 12:18:51.375013 29850 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:51.372370 22820 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a89a4b420ea9496aab55475fc38bb6f7 in term 21.
I20260709 12:18:51.369521 29962 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:51.376796 29850 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Becoming Leader. State: Replica: a89a4b420ea9496aab55475fc38bb6f7, State: Running, Role: LEADER
I20260709 12:18:51.387840 29850 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:51.392185 22744 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:51.394158 30011 consensus_queue.cc:1059] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:51.395005 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:51.397732 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d52bb84350d4c4ebd55acd59d333846" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:51.401948 29962 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:51.407096 23494 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:51.395169 30011 raft_consensus.cc:3055] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:51.412505 30011 raft_consensus.cc:740] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:51.413468 30011 consensus_queue.cc:260] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:51.414742 30011 raft_consensus.cc:3060] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:51.417806 29968 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:51.474514 22820 raft_consensus.cc:1240] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Rejecting Update request from peer 2c3a0d56045540b7802937559599f09c for earlier term 16. Current term is 17. Ops: []
W20260709 12:18:51.485357 22791 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:51.533004 22791 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:51.583914 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:51.599208 22571 catalog_manager.cc:5697] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:51.603847 22571 catalog_manager.cc:5697] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 17 to 20, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 20 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.611344 29988 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:51.612078 29988 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:51.614428 29988 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:51.616508 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:51.616641 22570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 135) took 5784 ms. Trace:
I20260709 12:18:51.617219 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:51.619684 22571 catalog_manager.cc:5697] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 16 to 18, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 18 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:51.621446 23493 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:51.628961 29850 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:51.625757 29988 raft_consensus.cc:493] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.629951 29988 raft_consensus.cc:515] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:51.617594 22570 rpcz_store.cc:276] 0709 12:18:45.832262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.833059 (+   797us) service_pool.cc:224] Handling call
0709 12:18:51.616541 (+5783482us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:50.993664 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:50.994267 (+   603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:50.994307 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:18:50.994326 (+    19us) tablet.cc:662] Decoding operations
0709 12:18:51.028999 (+ 34673us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:51.029092 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:51.029123 (+    31us) tablet.cc:685] Acquiring locks for 32 operations
0709 12:18:51.047704 (+ 18581us) tablet.cc:701] Row locks acquired
0709 12:18:51.047731 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:18:51.047941 (+   210us) write_op.cc:270] Start()
0709 12:18:51.048078 (+   137us) write_op.cc:276] Timestamp: P: 1783599531047881 usec, L: 0
0709 12:18:51.048101 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:18:51.048963 (+   862us) log.cc:844] Serialized 12661 byte log entry
0709 12:18:51.401747 (+352784us) op_driver.cc:464] REPLICATION: finished
0709 12:18:51.439648 (+ 37901us) write_op.cc:301] APPLY: starting
0709 12:18:51.439781 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:51.504864 (+ 65083us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:51.505010 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:51.533658 (+ 28648us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:51.534594 (+   936us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=64,key_file_lookups=64,delta_file_lookups=0,mrs_lookups=0
0709 12:18:51.534645 (+    51us) write_op.cc:312] APPLY: finished
0709 12:18:51.538190 (+  3545us) log.cc:844] Serialized 275 byte log entry
0709 12:18:51.539240 (+  1050us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:51.539557 (+   317us) write_op.cc:454] Released schema lock
0709 12:18:51.539644 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:51.545700 (+  6056us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:51.545792 (+    92us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30068,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":37560,"apply.run_cpu_time_us":44444,"apply.run_wall_time_us":105656,"cfile_cache_hit":130,"cfile_cache_hit_bytes":138015,"num_ops":32,"prepare.queue_time_us":107635,"prepare.run_cpu_time_us":20641,"prepare.run_wall_time_us":204634,"raft.queue_time_us":103655,"raft.run_cpu_time_us":6201,"raft.run_wall_time_us":33658,"replication_time_us":353467,"thread_start_us":279683,"threads_started":4,"wal-append.queue_time_us":171992}]]}
I20260709 12:18:51.633905 29988 leader_election.cc:290] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:51.635568 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:51.636951 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a3e6a508714389b60c10fd4363972c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:51.638106 29940 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.638697 29940 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:51.641016 29940 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:51.644021 23494 leader_election.cc:304] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:51.645370 29988 raft_consensus.cc:2749] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:51.647356 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:51.645000 22571 catalog_manager.cc:5697] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:51.648092 22820 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
I20260709 12:18:51.649325 22571 catalog_manager.cc:5697] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:51.653128 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:51.656505 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:51.660267 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:51.663093 22898 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:18:51.673710 29886 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:51.674166 29886 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.674507 29886 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:51.676290 29988 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:51.685303 29886 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:51.689622 22748 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:18:51.690478 30011 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:51.706672 30011 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:51.708138 29988 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:51.709688 30011 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:51.702811 22717 consensus_peers.cc:597] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:51.713613 29886 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:51.715237 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:51.720829 22823 raft_consensus.cc:2393] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 22: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:51.715916 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:51.722064 22894 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:18:51.716827 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:51.722932 22744 raft_consensus.cc:2368] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 22. Current term is 23.
I20260709 12:18:51.717370 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:51.724519 22864 leader_election.cc:400] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 22. Current term is 23.
I20260709 12:18:51.724882 22864 leader_election.cc:403] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:51.745318 22894 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 23.
I20260709 12:18:51.746163 30050 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669) with higher term. Message: Invalid argument: T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c for earlier term 22. Current term is 23.
I20260709 12:18:51.748805 22717 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:51.751233 29940 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:51.754493 29940 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:51.755592 29940 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:51.799162 29850 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.805792 29850 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:51.808168 29850 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:51.809963 22898 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 12:18:51.814173 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:51.818192 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:51.815752 29962 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
W20260709 12:18:51.831261 22571 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43994 (request call id 153) took 25714 ms (client timeout 15000 ms). Trace:
I20260709 12:18:51.854524 22744 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:51.856205 30042 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:51.855273 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:51.843631 22576 catalog_manager.cc:5697] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 6 to 16. New cstate: current_term: 16 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:51.874661 22898 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 12:18:51.833081 22571 rpcz_store.cc:269] 0709 12:18:26.122971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.123208 (+   237us) service_pool.cc:224] Handling call
0709 12:18:51.831165 (+25707957us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:51.704555 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:51.705159 (+   604us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:51.705195 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:18:51.705215 (+    20us) tablet.cc:662] Decoding operations
0709 12:18:51.705931 (+   716us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:51.705990 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:51.706023 (+    33us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:18:51.706603 (+   580us) tablet.cc:701] Row locks acquired
0709 12:18:51.706624 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:18:51.706804 (+   180us) write_op.cc:270] Start()
0709 12:18:51.706927 (+   123us) write_op.cc:276] Timestamp: P: 1783599531706730 usec, L: 0
0709 12:18:51.706951 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:18:51.707630 (+   679us) log.cc:844] Serialized 2108 byte log entry
0709 12:18:51.710146 (+  2516us) op_driver.cc:464] REPLICATION: finished
0709 12:18:51.711003 (+   857us) write_op.cc:301] APPLY: starting
0709 12:18:51.711118 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:51.714237 (+  3119us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:51.714355 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:51.735659 (+ 21304us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:51.735948 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:18:51.735993 (+    45us) write_op.cc:312] APPLY: finished
0709 12:18:51.736244 (+   251us) log.cc:844] Serialized 56 byte log entry
0709 12:18:51.743013 (+  6769us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:51.751181 (+  8168us) write_op.cc:454] Released schema lock
0709 12:18:51.751251 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:51.779753 (+ 28502us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:51.780388 (+   635us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":164949,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":614,"apply.run_cpu_time_us":9430,"apply.run_wall_time_us":46350,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20920,"num_ops":5,"prepare.queue_time_us":150,"prepare.run_cpu_time_us":3379,"prepare.run_wall_time_us":3379,"replication_time_us":3034}]]}
I20260709 12:18:51.868074 29962 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:18:51.918897 30031 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.905325 29850 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:18:51.933491 29988 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:52.018955 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 141496us
I20260709 12:18:52.035802 22898 raft_consensus.cc:1275] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:18:52.036409 22898 pending_rounds.cc:85] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Aborting all ops after (but not including) 9
I20260709 12:18:52.036711 22898 pending_rounds.cc:107] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:18:52.037021 22898 raft_consensus.cc:2889] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:51.963153 30031 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:52.044517 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 78741.2us
I20260709 12:18:52.058490 30031 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:51.992009 29988 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:52.116537 29988 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:52.132539 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:52.154996 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 123208us
I20260709 12:18:52.156957 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:52.161136 22750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:52.163460 18407 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 23731)
I20260709 12:18:52.161772 30042 consensus_queue.cc:1048] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:18:52.201807 30076 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.202556 30076 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:52.204895 30076 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:52.208511 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 116074us
I20260709 12:18:52.226889 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790207f3e8474996938608fcdf438660" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:52.229043 30075 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.229697 30075 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:52.231082 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:52.235275 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:52.239331 30075 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:52.253000 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:52.256108 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:52.268334 22823 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 12:18:52.277478 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:52.297302 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 113515us
I20260709 12:18:52.300168 22820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff1852979a471a8510052b7ba98faa" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:52.305588 23494 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:52.314561 23494 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:52.298426 30098 raft_consensus.cc:493] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.317739 29988 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:18:52.386755 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 72310.4us
W20260709 12:18:52.388499 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 69152.7us
W20260709 12:18:52.385584 30066 log.cc:927] Time spent T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 12:18:52.396574 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 84636.3us
I20260709 12:18:52.398039 30075 raft_consensus.cc:493] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.401834 30075 raft_consensus.cc:515] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:52.395293 30074 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:52.404301 30075 leader_election.cc:290] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:52.385915 30098 raft_consensus.cc:515] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:52.415140 22570 catalog_manager.cc:5697] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 19 to 24, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 24 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:52.416875 22570 catalog_manager.cc:5697] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 16 to 17, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 17 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:52.419001 22570 catalog_manager.cc:5697] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 13 to 17, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 17 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:52.410569 30098 leader_election.cc:290] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:52.431530 22897 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:18:52.456755 23493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 61573.8us
I20260709 12:18:52.467725 22823 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:52.470927 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:52.475608 30103 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:18:52.473430 29988 raft_consensus.cc:493] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.479193 29988 raft_consensus.cc:515] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:52.481308 29988 leader_election.cc:290] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:52.491176 22570 catalog_manager.cc:5697] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:52.496129 22570 catalog_manager.cc:5697] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 17 to 21, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 21 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:52.497619 22570 catalog_manager.cc:5697] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 22 to 26, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 26 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:52.498917 22570 catalog_manager.cc:5697] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 13 to 16, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 16 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:52.501046 22570 catalog_manager.cc:5697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 17 to 20, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 20 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:52.502625 22570 catalog_manager.cc:5697] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 18 to 21, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 21 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:52.506376 22570 catalog_manager.cc:5697] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:52.507908 22570 catalog_manager.cc:5697] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 20 to 21, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 21 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:52.510093 22570 catalog_manager.cc:5697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:52.511518 22570 catalog_manager.cc:5697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 17 to 21, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 21 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
I20260709 12:18:52.514530 22570 catalog_manager.cc:5697] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 14 to 21, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 21 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
W20260709 12:18:52.518026 22717 consensus_peers.cc:597] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:52.523476 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:52.524019 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 109275us
I20260709 12:18:52.516433 22570 catalog_manager.cc:5697] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
W20260709 12:18:52.523531 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:52.526352 22823 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:18:52.529597 30083 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:52.534204 22823 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Refusing update from remote peer a89a4b420ea9496aab55475fc38bb6f7: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:18:52.535729 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fa6d7d4a74fa3bf4c3beda5687094" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:52.537849 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50db8803bc44d8eaab7195399b5ec5f" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
W20260709 12:18:52.539062 22576 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57362 (request call id 58) took 56911 ms (client timeout 15000 ms). Trace:
I20260709 12:18:52.540179 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:52.542106 30106 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.542900 30106 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:52.545518 30106 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:52.548372 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:52.558118 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ff31dcb5814f3c8cae392bb13ee152" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:52.561466 30085 raft_consensus.cc:493] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.566704 30085 raft_consensus.cc:515] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:52.574621 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26ab285f3946aaa4009cfc56fb98fc" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:52.539497 22576 rpcz_store.cc:269] 0709 12:17:55.623912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.624205 (+   293us) service_pool.cc:224] Handling call
0709 12:18:52.535072 (+56910867us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:51.926380 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:52.045100 (+118720us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:52.047359 (+  2259us) write_op.cc:435] Acquired schema lock
0709 12:18:52.047387 (+    28us) tablet.cc:662] Decoding operations
0709 12:18:52.047942 (+   555us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:52.048027 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:52.048069 (+    42us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:52.048318 (+   249us) tablet.cc:701] Row locks acquired
0709 12:18:52.048363 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:18:52.048614 (+   251us) write_op.cc:270] Start()
0709 12:18:52.048768 (+   154us) write_op.cc:276] Timestamp: P: 1783599532048536 usec, L: 0
0709 12:18:52.048798 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:18:52.049649 (+   851us) log.cc:844] Serialized 543 byte log entry
0709 12:18:52.053024 (+  3375us) op_driver.cc:464] REPLICATION: finished
0709 12:18:52.053663 (+   639us) write_op.cc:301] APPLY: starting
0709 12:18:52.053774 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:52.055047 (+  1273us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:52.055184 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:52.056205 (+  1021us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:52.056441 (+   236us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:18:52.056507 (+    66us) write_op.cc:312] APPLY: finished
0709 12:18:52.056780 (+   273us) log.cc:844] Serialized 24 byte log entry
0709 12:18:52.057014 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:52.057118 (+   104us) write_op.cc:454] Released schema lock
0709 12:18:52.057165 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:52.057649 (+   484us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:52.078211 (+ 20562us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4297438,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":319,"apply.run_cpu_time_us":3939,"apply.run_wall_time_us":3938,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":309,"prepare.run_cpu_time_us":4258,"prepare.run_wall_time_us":132953,"replication_time_us":4046}]]}
I20260709 12:18:52.562578 22570 catalog_manager.cc:5697] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 20 to 21, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 21 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:52.619573 30098 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:52.622684 23494 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:52.623879 30076 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:52.626274 30092 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:18:52.626704 23494 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:52.627628 29844 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:52.628816 23494 leader_election.cc:304] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:52.629664 30092 raft_consensus.cc:2749] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:52.630759 30085 leader_election.cc:290] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:52.640710 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b51f118bc481dbf774ac4738c9617" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:52.669823 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:52.680454 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35aee871f0b41e48335c0260a873076" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:52.688823 23494 leader_election.cc:304] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:52.690173 23494 leader_election.cc:304] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:52.692153 30095 raft_consensus.cc:2749] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:52.700827 30085 raft_consensus.cc:2749] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:18:52.727217 22717 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:52.733385 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:52.745637 22717 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:52.747056 23494 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:52.748620 30095 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:52.748668 23494 leader_election.cc:304] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:52.757094 30095 raft_consensus.cc:2749] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:18:52.798229 22717 consensus_peers.cc:597] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:52.923383 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:53.021380 22570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43998 (request call id 136) took 1293 ms. Trace:
I20260709 12:18:53.021974 22570 rpcz_store.cc:276] 0709 12:18:51.728877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.731054 (+  2177us) service_pool.cc:224] Handling call
0709 12:18:53.021267 (+1290213us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:52.698903 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:52.699661 (+   758us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:52.699699 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:18:52.699721 (+    22us) tablet.cc:662] Decoding operations
0709 12:18:52.701081 (+  1360us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:52.701178 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:52.701212 (+    34us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:18:52.723132 (+ 21920us) tablet.cc:701] Row locks acquired
0709 12:18:52.723151 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:18:52.723380 (+   229us) write_op.cc:270] Start()
0709 12:18:52.723521 (+   141us) write_op.cc:276] Timestamp: P: 1783599532723259 usec, L: 0
0709 12:18:52.723543 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:18:52.739430 (+ 15887us) log.cc:844] Serialized 6405 byte log entry
0709 12:18:52.768014 (+ 28584us) op_driver.cc:464] REPLICATION: finished
0709 12:18:52.833972 (+ 65958us) write_op.cc:301] APPLY: starting
0709 12:18:52.834060 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:52.862737 (+ 28677us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:52.917451 (+ 54714us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:52.951818 (+ 34367us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:52.952082 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 12:18:52.952126 (+    44us) write_op.cc:312] APPLY: finished
0709 12:18:52.952496 (+   370us) log.cc:844] Serialized 147 byte log entry
0709 12:18:52.952710 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:52.952882 (+   172us) write_op.cc:454] Released schema lock
0709 12:18:52.952937 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:52.953372 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:52.953401 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77277,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":44517,"apply.run_cpu_time_us":21108,"apply.run_wall_time_us":119412,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71071,"num_ops":16,"prepare.queue_time_us":38432,"prepare.run_cpu_time_us":5310,"prepare.run_wall_time_us":57601,"replication_time_us":44054,"thread_start_us":86142,"threads_started":2}]]}
I20260709 12:18:53.099495 30076 raft_consensus.cc:493] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.100098 30076 raft_consensus.cc:515] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:53.102516 30076 leader_election.cc:290] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:53.104385 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:53.106967 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600c0eed9d234060b395482bb7c21cb8" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:53.108412 23494 leader_election.cc:304] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:53.109637 30076 raft_consensus.cc:2749] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:53.119797 22570 catalog_manager.cc:5697] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } }
I20260709 12:18:53.122434 22570 catalog_manager.cc:5697] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 16 to 21, leader changed from 2c3a0d56045540b7802937559599f09c (127.17.249.196) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 21 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:53.124033 22570 catalog_manager.cc:5697] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 15 to 17, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 17 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:53.125588 22570 catalog_manager.cc:5697] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } }
I20260709 12:18:53.127112 22570 catalog_manager.cc:5697] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 20 to 25, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 25 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } }
W20260709 12:18:53.128427 22717 consensus_peers.cc:597] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:53.164575 18407 thread.cc:527] Waited for 8000ms trying to join with heartbeat (tid 23731)
W20260709 12:18:53.163386 22569 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43994 (request call id 152) took 46735 ms (client timeout 15000 ms). Trace:
W20260709 12:18:53.167419 22569 rpcz_store.cc:269] 0709 12:18:06.428472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.428770 (+   298us) service_pool.cc:224] Handling call
0709 12:18:53.163255 (+46734485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":366564,"reported_tablets":44}
I20260709 12:18:53.221737 22572 catalog_manager.cc:5697] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 15 to 16, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 16 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.227098 22572 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:53.306770 22572 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57362 (request call id 59) took 36688 ms (client timeout 15000 ms). Trace:
W20260709 12:18:53.307371 22572 rpcz_store.cc:269] 0709 12:18:16.618011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.618544 (+   533us) service_pool.cc:224] Handling call
0709 12:18:53.252309 (+36633765us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.252345 (+    36us) write_op.cc:454] Released schema lock
0709 12:18:53.306687 (+ 54342us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:53.238014 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:53.238542 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:53.238579 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:18:53.238596 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:53.239013 (+   417us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:53.239066 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:53.239090 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:18:53.239435 (+   345us) tablet.cc:701] Row locks acquired
0709 12:18:53.239453 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:18:53.239624 (+   171us) write_op.cc:270] Start()
0709 12:18:53.239733 (+   109us) write_op.cc:276] Timestamp: P: 1783599533239576 usec, L: 0
0709 12:18:53.239754 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:18:53.240404 (+   650us) log.cc:844] Serialized 934 byte log entry
0709 12:18:53.244002 (+  3598us) op_driver.cc:464] REPLICATION: finished
0709 12:18:53.244394 (+   392us) write_op.cc:301] APPLY: starting
0709 12:18:53.244492 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:53.245960 (+  1468us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:53.246060 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:53.248850 (+  2790us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:53.249060 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:18:53.249103 (+    43us) write_op.cc:312] APPLY: finished
0709 12:18:53.249331 (+   228us) log.cc:844] Serialized 32 byte log entry
0709 12:18:53.249539 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.249647 (+   108us) write_op.cc:454] Released schema lock
0709 12:18:53.249697 (+    50us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":86331,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":117,"apply.run_cpu_time_us":4502,"apply.run_wall_time_us":5656,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8368,"num_ops":2,"prepare.queue_time_us":146,"prepare.run_cpu_time_us":2674,"prepare.run_wall_time_us":2674,"replication_time_us":4099}]]}
W20260709 12:18:53.379722 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:53.382289 30092 raft_consensus.cc:493] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.383008 30092 raft_consensus.cc:515] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:53.385281 30092 leader_election.cc:290] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:53.387614 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:53.394496 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b97aee66fb461a98eb4b2f92bb3c53" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:53.400336 23494 leader_election.cc:304] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:53.401978 30105 raft_consensus.cc:2749] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:53.409265 30092 raft_consensus.cc:493] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.410046 30092 raft_consensus.cc:515] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:53.413962 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:53.423854 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba50a8d617df425cbc405952d1742265" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:53.426326 23494 leader_election.cc:304] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:53.427269 30105 raft_consensus.cc:2749] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:53.428241 30092 leader_election.cc:290] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
W20260709 12:18:53.439193 22574 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57362 (request call id 57) took 77323 ms (client timeout 15000 ms). Trace:
I20260709 12:18:53.435653 22575 catalog_manager.cc:5697] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 20 to 23, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 23 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:53.441169 22575 catalog_manager.cc:5697] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 11 to 16, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 16 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.445791 22575 catalog_manager.cc:5697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 14 to 17, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 17 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.448813 22575 catalog_manager.cc:5697] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:53.447305 22574 rpcz_store.cc:269] 0709 12:17:36.115691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.116553 (+   862us) service_pool.cc:224] Handling call
0709 12:18:53.438955 (+77322402us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89,"reported_tablets":45}
I20260709 12:18:53.458098 22575 catalog_manager.cc:5697] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 14 to 15, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 15 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.463064 22575 catalog_manager.cc:5697] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.465116 22575 catalog_manager.cc:5697] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 17 to 19, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 19 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.471302 22575 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.522604 29844 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.523322 29844 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:53.526034 29844 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:53.528141 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:53.529245 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a6be884c6d4eeabbf042ccacf06ef6" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:53.531560 23493 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:53.533852 29844 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:53.566603 29844 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.567281 29844 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:53.571319 29844 leader_election.cc:290] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:53.574855 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:53.576474 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd458323e9194286800a7f592094802c" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:53.580474 23494 leader_election.cc:304] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:53.581413 29844 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:18:53.584841 22791 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:53.587512 30092 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.588279 30092 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:53.592775 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:53.600440 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca29e0a7a6342a2b2f2088587de1246" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:53.602316 23493 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:53.603349 29844 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:53.617389 22575 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57362 (request call id 60) took 9642 ms. Trace:
I20260709 12:18:53.618053 22575 rpcz_store.cc:276] 0709 12:18:43.974594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.975203 (+   609us) service_pool.cc:224] Handling call
0709 12:18:53.617263 (+9642060us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:53.499506 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:53.500262 (+   756us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:53.500312 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:18:53.500336 (+    24us) tablet.cc:662] Decoding operations
0709 12:18:53.504152 (+  3816us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:53.504232 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:53.504267 (+    35us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:18:53.505023 (+   756us) tablet.cc:701] Row locks acquired
0709 12:18:53.505048 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:18:53.505234 (+   186us) write_op.cc:270] Start()
0709 12:18:53.505367 (+   133us) write_op.cc:276] Timestamp: P: 1783599533505163 usec, L: 0
0709 12:18:53.505392 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:18:53.506134 (+   742us) log.cc:844] Serialized 3281 byte log entry
0709 12:18:53.508569 (+  2435us) op_driver.cc:464] REPLICATION: finished
0709 12:18:53.508983 (+   414us) write_op.cc:301] APPLY: starting
0709 12:18:53.509082 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:53.513048 (+  3966us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:53.513139 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:53.527595 (+ 14456us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:53.543376 (+ 15781us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:18:53.543413 (+    37us) write_op.cc:312] APPLY: finished
0709 12:18:53.543667 (+   254us) log.cc:844] Serialized 80 byte log entry
0709 12:18:53.543891 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.544036 (+   145us) write_op.cc:454] Released schema lock
0709 12:18:53.544089 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:53.544526 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.544563 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":115064,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":130,"apply.run_cpu_time_us":10612,"apply.run_wall_time_us":35513,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33472,"num_ops":8,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":4100,"prepare.run_wall_time_us":6956,"replication_time_us":3044}]]}
I20260709 12:18:53.626516 22568 catalog_manager.cc:5697] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 19 to 22, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 22 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:53.631059 30092 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:53.633533 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:53.635361 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:53.637149 18407 raft_consensus.cc:2243] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:18:53.639014 18407 raft_consensus.cc:2272] T 5085cb71870c4e7782244635c250487e P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:53.643868 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:53.637183 22568 catalog_manager.cc:5697] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:53.647914 18407 raft_consensus.cc:2243] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:18:53.652041 30092 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.652868 30092 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:53.656438 22791 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:53.658845 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:53.660442 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0e2e48cbc740c0a7fad7f513017008" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:53.661046 18407 raft_consensus.cc:2272] T 44cb46cd92c346879a120a3d3b95561a P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:53.664497 23494 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:53.671221 29844 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:53.656661 30092 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:53.676144 29844 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:18:53.676851 29844 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:53.679545 29844 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:53.683470 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:53.684188 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360a1924d3c4721bf24cc5f0f17a90b" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:53.684595 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:53.688083 23493 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:53.688799 18407 raft_consensus.cc:2243] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:53.689659 30105 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:18:53.690443 18407 pending_rounds.cc:70] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Trying to abort 1 pending ops.
I20260709 12:18:53.718073 18407 pending_rounds.cc:77] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 21 index: 11 } timestamp: 7305623603225522176 op_type: NO_OP noop_request { }
I20260709 12:18:53.718611 18407 raft_consensus.cc:2889] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:53.724753 18407 raft_consensus.cc:2272] T bd458323e9194286800a7f592094802c P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:53.740094 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:53.741185 18407 raft_consensus.cc:2243] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:18:53.742265 18407 raft_consensus.cc:2272] T 4cb67a71a0954b2bab724a9e4399cf13 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:53.733372 22567 catalog_manager.cc:5697] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 20 to 23, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 23 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.752872 22567 catalog_manager.cc:5697] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 16 to 23, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 23 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.757817 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:53.758905 18407 raft_consensus.cc:2243] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 12:18:53.775542 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:53.757822 22567 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:53.784391 22567 catalog_manager.cc:5697] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 16 to 17, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 17 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.779564 18407 raft_consensus.cc:2272] T 50b97aee66fb461a98eb4b2f92bb3c53 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:53.776469 22568 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43994 (request call id 154) took 8938 ms. Trace:
I20260709 12:18:53.791746 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:53.793355 18407 raft_consensus.cc:2243] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:18:53.787825 22567 catalog_manager.cc:5697] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 18 to 20, leader changed from cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195) to a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193). New cstate: current_term: 20 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:53.789140 22568 rpcz_store.cc:276] 0709 12:18:44.838060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.838519 (+   459us) service_pool.cc:224] Handling call
0709 12:18:53.776390 (+8937871us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:53.679077 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:53.679661 (+   584us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:53.679707 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:18:53.679723 (+    16us) tablet.cc:662] Decoding operations
0709 12:18:53.680144 (+   421us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:53.680202 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:53.680241 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:18:53.680566 (+   325us) tablet.cc:701] Row locks acquired
0709 12:18:53.680582 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:18:53.680732 (+   150us) write_op.cc:270] Start()
0709 12:18:53.680862 (+   130us) write_op.cc:276] Timestamp: P: 1783599533680684 usec, L: 0
0709 12:18:53.680881 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:18:53.681555 (+   674us) log.cc:844] Serialized 934 byte log entry
0709 12:18:53.683671 (+  2116us) op_driver.cc:464] REPLICATION: finished
0709 12:18:53.685555 (+  1884us) write_op.cc:301] APPLY: starting
0709 12:18:53.685675 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:53.687205 (+  1530us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:53.687313 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:53.688681 (+  1368us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:53.688856 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:18:53.688899 (+    43us) write_op.cc:312] APPLY: finished
0709 12:18:53.689129 (+   230us) log.cc:844] Serialized 32 byte log entry
0709 12:18:53.689321 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.690060 (+   739us) write_op.cc:454] Released schema lock
0709 12:18:53.690112 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:53.690509 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.690536 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15241,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":1628,"apply.run_cpu_time_us":4726,"apply.run_wall_time_us":4939,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8368,"num_ops":2,"prepare.queue_time_us":147,"prepare.run_cpu_time_us":2772,"prepare.run_wall_time_us":2771,"replication_time_us":2681}]]}
I20260709 12:18:53.794591 18407 raft_consensus.cc:2272] T 5444065d09a34471bca8963724a74d20 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:53.803325 22717 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:53.821470 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:53.822451 18407 raft_consensus.cc:2243] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:53.823388 18407 raft_consensus.cc:2272] T 19a3e6a508714389b60c10fd4363972c P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:53.832530 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:53.833525 18407 raft_consensus.cc:2243] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:53.834131 18407 raft_consensus.cc:2272] T d65fa6d7d4a74fa3bf4c3beda5687094 P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:53.845592 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:53.846546 18407 raft_consensus.cc:2243] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:53.847272 18407 pending_rounds.cc:70] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Trying to abort 1 pending ops.
I20260709 12:18:53.847568 18407 pending_rounds.cc:77] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 12 index: 8 } timestamp: 7305623534537097216 op_type: NO_OP noop_request { }
I20260709 12:18:53.847911 18407 raft_consensus.cc:2889] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:53.848245 18407 raft_consensus.cc:2272] T c267ff17b26d4fd08c09792a0ccb9b43 P a89a4b420ea9496aab55475fc38bb6f7 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:53.871590 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:53.950062 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:53.951362 18407 raft_consensus.cc:2243] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:53.952342 18407 raft_consensus.cc:2272] T fca29e0a7a6342a2b2f2088587de1246 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:54.010581 22791 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:54.015646 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:54.046622 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.048846 22567 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43984 (request call id 162) took 4861 ms. Trace:
I20260709 12:18:54.060135 22567 rpcz_store.cc:276] 0709 12:18:49.187248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.187514 (+   266us) service_pool.cc:224] Handling call
0709 12:18:53.866878 (+4679364us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.866910 (+    32us) write_op.cc:454] Released schema lock
0709 12:18:54.048744 (+181834us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:53.822969 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:53.823539 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:53.823579 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:18:53.823597 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:53.827517 (+  3920us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:53.827578 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:53.827612 (+    34us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:18:53.829311 (+  1699us) tablet.cc:701] Row locks acquired
0709 12:18:53.829336 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:18:53.829517 (+   181us) write_op.cc:270] Start()
0709 12:18:53.829639 (+   122us) write_op.cc:276] Timestamp: P: 1783599533829464 usec, L: 0
0709 12:18:53.829662 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:18:53.830356 (+   694us) log.cc:844] Serialized 2108 byte log entry
0709 12:18:53.838407 (+  8051us) op_driver.cc:464] REPLICATION: finished
0709 12:18:53.841089 (+  2682us) write_op.cc:301] APPLY: starting
0709 12:18:53.841175 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:53.844325 (+  3150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:53.844426 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:53.858307 (+ 13881us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:53.858501 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:18:53.858544 (+    43us) write_op.cc:312] APPLY: finished
0709 12:18:53.858824 (+   280us) log.cc:844] Serialized 56 byte log entry
0709 12:18:53.863183 (+  4359us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.863296 (+   113us) write_op.cc:454] Released schema lock
0709 12:18:53.863338 (+    42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":140562,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":2450,"apply.run_cpu_time_us":8319,"apply.run_wall_time_us":24272,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20920,"num_ops":5,"prepare.queue_time_us":673,"prepare.run_cpu_time_us":3482,"prepare.run_wall_time_us":40921,"replication_time_us":8594}]]}
I20260709 12:18:54.068560 18407 raft_consensus.cc:2243] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:54.073665 18407 raft_consensus.cc:2272] T 6d52bb84350d4c4ebd55acd59d333846 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:54.091288 22791 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:54.096190 22568 catalog_manager.cc:5697] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:54.100912 22568 catalog_manager.cc:5697] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:54.103336 22568 catalog_manager.cc:5697] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "a89a4b420ea9496aab55475fc38bb6f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } }
I20260709 12:18:54.122604 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.153067 18407 raft_consensus.cc:2243] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:18:54.157235 18407 raft_consensus.cc:2272] T 3ba57a7932934f629e6ed95148994535 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:54.161864 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:54.159232 22717 consensus_peers.cc:597] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:54.176839 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.177942 18407 raft_consensus.cc:2243] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:18:54.179148 18407 raft_consensus.cc:2272] T 036d0d4c85cb4c92bbe5eff5c95a2441 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.196475 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.213083 18407 raft_consensus.cc:2243] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:18:54.214294 18407 raft_consensus.cc:2272] T 4dd506104b9c45169fdf473e38bd2352 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.230909 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.239249 18407 raft_consensus.cc:2243] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:18:54.240705 18407 raft_consensus.cc:2272] T 7f3c57ac6e684973929b4e77a428cb1e P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.247987 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.248837 18407 raft_consensus.cc:2243] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:18:54.257453 18407 raft_consensus.cc:2272] T c25dfc24830b430e89a2abbfffe374ea P a89a4b420ea9496aab55475fc38bb6f7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.260803 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.261842 18407 raft_consensus.cc:2243] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:18:54.268952 18407 raft_consensus.cc:2272] T b5e170feadac4d27875b0a4c85b6d329 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.271767 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.272567 18407 raft_consensus.cc:2243] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:18:54.273845 18407 raft_consensus.cc:2272] T aaa4164beb3941b2bc2f8a103ac0e7fb P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.277225 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.278083 18407 raft_consensus.cc:2243] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:54.278761 18407 pending_rounds.cc:70] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Trying to abort 1 pending ops.
I20260709 12:18:54.279063 18407 pending_rounds.cc:77] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7305623632450109440 op_type: NO_OP noop_request { }
I20260709 12:18:54.279438 18407 raft_consensus.cc:2889] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:54.279815 18407 raft_consensus.cc:2272] T ba50a8d617df425cbc405952d1742265 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.327152 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.328142 18407 raft_consensus.cc:2243] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:18:54.329324 18407 raft_consensus.cc:2272] T 599b298e84934cc4969ad7fa2b906b26 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.332825 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.333813 18407 raft_consensus.cc:2243] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:54.426537 18407 pending_rounds.cc:70] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Trying to abort 1 pending ops.
I20260709 12:18:54.427628 18407 pending_rounds.cc:77] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 16 index: 11 } timestamp: 7305623642110369792 op_type: NO_OP noop_request { }
I20260709 12:18:54.446439 18407 raft_consensus.cc:2889] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:54.447556 18407 raft_consensus.cc:2272] T 17a6be884c6d4eeabbf042ccacf06ef6 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.453534 30105 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.467159 30105 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:54.483028 30105 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:54.487406 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:54.496273 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.512308 18407 raft_consensus.cc:2243] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:54.513779 18407 pending_rounds.cc:70] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Trying to abort 1 pending ops.
I20260709 12:18:54.514238 18407 pending_rounds.cc:77] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 25 index: 13 } timestamp: 7305623634290216960 op_type: NO_OP noop_request { }
I20260709 12:18:54.522509 30092 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.523484 30092 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:54.527105 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:54.532919 18407 raft_consensus.cc:2889] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:54.533569 18407 raft_consensus.cc:2272] T f50db8803bc44d8eaab7195399b5ec5f P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.536578 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:54.563743 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.577706 18407 raft_consensus.cc:2243] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:54.579607 30092 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:54.583145 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af65e8169664ec2afee890830d185cf" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:54.585836 23493 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:54.589635 29844 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:54.591630 18407 raft_consensus.cc:2272] T 790207f3e8474996938608fcdf438660 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.601395 23494 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:54.608098 30105 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:54.618418 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.627354 30091 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:54.628619 30091 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:54.643911 30091 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:54.646565 18407 raft_consensus.cc:2243] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:54.664176 18407 raft_consensus.cc:2272] T 3c0e2e48cbc740c0a7fad7f513017008 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.680681 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:54.693341 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.695536 18407 raft_consensus.cc:2243] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:54.697458 18407 raft_consensus.cc:2272] T 600c0eed9d234060b395482bb7c21cb8 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.730901 30010 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:54.731884 30010 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:54.735482 30010 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:54.752836 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
W20260709 12:18:54.760097 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:54.769316 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:54.769989 22865 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:54.770569 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:54.771907 30127 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:54.795298 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.796840 18407 raft_consensus.cc:2243] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:18:54.798362 18407 raft_consensus.cc:2272] T 22ef3fae5db64ba8b0eae0ce76950f51 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:54.820943 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:54.835829 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.837368 18407 raft_consensus.cc:2243] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:54.838225 18407 raft_consensus.cc:2272] T 4af65e8169664ec2afee890830d185cf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.842170 30010 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:54.843088 30010 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:54.849255 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:54.850220 22827 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 26.
I20260709 12:18:54.852057 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:54.853106 30127 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:18:54.853197 30010 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:54.853587 30127 raft_consensus.cc:493] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:54.854082 30127 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:18:54.871783 22865 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:54.873962 22791 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:54.874473 22791 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:54.875780 30091 raft_consensus.cc:2749] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:18:54.886211 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.886687 30127 raft_consensus.cc:515] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:54.888525 18407 raft_consensus.cc:2243] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:54.890269 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5085cb71870c4e7782244635c250487e" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:54.891016 22827 raft_consensus.cc:3060] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:18:54.897913 30121 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:54.898995 30121 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:54.903605 30121 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:54.904551 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:54.904963 30127 leader_election.cc:290] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:54.908349 22791 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:54.908839 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:54.912392 22827 raft_consensus.cc:2468] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 27.
W20260709 12:18:54.912972 22865 leader_election.cc:336] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:54.913524 30121 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:54.917498 18407 pending_rounds.cc:70] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Trying to abort 1 pending ops.
I20260709 12:18:54.925220 18407 pending_rounds.cc:77] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 16 index: 12 } timestamp: 7305623565587546112 op_type: NO_OP noop_request { }
I20260709 12:18:54.925868 18407 raft_consensus.cc:2889] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:54.926385 18407 raft_consensus.cc:2272] T b6ff1852979a471a8510052b7ba98faa P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:54.933606 22865 leader_election.cc:304] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:54.934755 30010 raft_consensus.cc:2804] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:18:54.935319 30010 raft_consensus.cc:697] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 27 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:54.937054 30010 consensus_queue.cc:237] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:54.936908 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.954171 29770 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:54.956723 29770 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:54.957598 18407 raft_consensus.cc:2243] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:54.963052 29770 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:54.965205 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:54.966509 22827 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:54.967083 18407 raft_consensus.cc:2272] T a2d5308b787c474aa407e2d08bb254b9 P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:54.965205 22717 consensus_peers.cc:597] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:54.971933 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:54.972143 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:54.973227 29770 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:54.973767 29770 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:54.974121 29770 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:54.974565 22717 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:54.973253 18407 raft_consensus.cc:2243] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:18:54.994378 22865 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 229 similar messages]
I20260709 12:18:54.997069 18407 raft_consensus.cc:2272] T c11f2301e6294b5ab1244e4784694274 P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:54.999125 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:54.999794 30119 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.000576 30119 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:55.003414 30119 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:55.010294 30010 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.011109 30010 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:55.013607 30010 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:55.018656 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:55.019485 22894 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:55.020836 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:18:55.023473 22717 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:55.025344 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:55.031271 30120 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:55.031730 30120 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.032150 30120 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:55.033458 22717 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:55.034523 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:55.034770 18407 tablet_replica.cc:333] stopping tablet replica
W20260709 12:18:55.039865 22865 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.040518 22865 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:55.037542 22567 catalog_manager.cc:5697] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 26 to 27, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 27 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.046612 30010 raft_consensus.cc:2749] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:55.050515 29770 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:55.053102 29770 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:55.054160 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cb67a71a0954b2bab724a9e4399cf13" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:55.054832 22827 raft_consensus.cc:3060] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:55.056677 18407 raft_consensus.cc:2243] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:18:55.058220 18407 raft_consensus.cc:2272] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.055361 30120 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:55.060956 30120 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:55.062871 22827 raft_consensus.cc:2468] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
I20260709 12:18:55.065389 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.066490 18407 raft_consensus.cc:2243] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:18:55.068018 18407 raft_consensus.cc:2272] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P a89a4b420ea9496aab55475fc38bb6f7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.072749 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.073783 18407 raft_consensus.cc:2243] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:55.075165 30092 raft_consensus.cc:493] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.075719 30092 raft_consensus.cc:515] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:55.077957 30092 leader_election.cc:290] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:55.081664 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:55.082743 22717 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:55.093447 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44cb46cd92c346879a120a3d3b95561a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:55.094494 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c887310d0efc43dbb01d55c7f99ff9a3" candidate_uuid: "a89a4b420ea9496aab55475fc38bb6f7" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:55.095739 22898 raft_consensus.cc:3060] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:55.099792 23494 leader_election.cc:304] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a89a4b420ea9496aab55475fc38bb6f7; no voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:55.101632 30092 raft_consensus.cc:2749] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:18:55.103065 30120 raft_consensus.cc:2804] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:55.103875 30120 raft_consensus.cc:697] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:55.105057 30120 consensus_queue.cc:237] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:55.106596 18407 pending_rounds.cc:70] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Trying to abort 2 pending ops.
I20260709 12:18:55.107082 18407 pending_rounds.cc:77] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 23 index: 14 } timestamp: 7305623616487403520 op_type: NO_OP noop_request { }
I20260709 12:18:55.119131 18407 raft_consensus.cc:2889] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:55.119539 18407 pending_rounds.cc:77] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7305623565830705152 op_type: NO_OP noop_request { }
I20260709 12:18:55.120739 18407 raft_consensus.cc:2889] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:55.121240 18407 raft_consensus.cc:2272] T a7ff31dcb5814f3c8cae392bb13ee152 P a89a4b420ea9496aab55475fc38bb6f7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.132690 30121 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.133483 30121 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:55.135946 30121 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:55.148797 22717 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.149931 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:55.161350 22898 raft_consensus.cc:2468] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
W20260709 12:18:55.162597 22791 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.166172 22791 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:55.169029 22717 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.171267 30091 raft_consensus.cc:2749] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:18:55.173632 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.173864 30121 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.174680 30121 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:55.175133 18407 raft_consensus.cc:2243] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:55.176106 18407 raft_consensus.cc:2272] T 0e65a9de2bca4c54a85a0988d17f1793 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.177138 30121 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:55.183192 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:55.184222 22894 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:18:55.194752 22717 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:55.197497 29770 raft_consensus.cc:2804] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:55.198136 29770 raft_consensus.cc:697] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 22 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:55.198872 30010 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.199357 29770 consensus_queue.cc:237] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:55.199626 30010 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:55.202000 30010 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:55.202986 18407 tablet_replica.cc:333] stopping tablet replica
W20260709 12:18:55.207460 22717 consensus_peers.cc:597] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:55.208526 18407 raft_consensus.cc:2243] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:55.205668 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:55.214972 22865 leader_election.cc:336] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.215593 18407 raft_consensus.cc:2272] T fb26ab285f3946aaa4009cfc56fb98fc P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.216804 30121 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:55.217335 30121 raft_consensus.cc:493] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.218664 30121 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:55.222743 22791 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.222940 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:55.224835 22865 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:55.226574 30010 raft_consensus.cc:2749] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:55.234506 22568 catalog_manager.cc:5697] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 21 to 22, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 22 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.260334 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.261758 18407 raft_consensus.cc:2243] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:55.267560 29770 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.268375 29770 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:55.269858 18407 pending_rounds.cc:70] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Trying to abort 2 pending ops.
I20260709 12:18:55.271566 18407 pending_rounds.cc:77] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 21 index: 12 } timestamp: 7305623609662857216 op_type: NO_OP noop_request { }
I20260709 12:18:55.271579 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:55.270679 30121 raft_consensus.cc:515] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:55.274580 29770 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:55.275851 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444065d09a34471bca8963724a74d20" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:55.276573 22894 raft_consensus.cc:3060] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:18:55.281108 22717 leader_election.cc:336] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.281724 22717 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:55.283003 29770 raft_consensus.cc:2749] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:18:55.272141 18407 raft_consensus.cc:2889] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:55.294454 22894 raft_consensus.cc:2468] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:55.296921 29770 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.297705 29770 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:55.298578 22791 leader_election.cc:304] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:55.299400 29770 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:55.299680 30091 raft_consensus.cc:2804] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:55.300240 30091 raft_consensus.cc:697] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:55.301700 29862 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.302299 29862 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:55.304095 29862 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:55.305629 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:55.306334 22744 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:55.306455 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:55.307065 22827 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:55.307415 30121 leader_election.cc:290] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:55.295693 18407 pending_rounds.cc:77] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 19 index: 11 } timestamp: 7305623576952881152 op_type: NO_OP noop_request { }
I20260709 12:18:55.308434 18407 raft_consensus.cc:2889] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:55.308610 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:55.308903 18407 raft_consensus.cc:2272] T c98b51f118bc481dbf774ac4738c9617 P a89a4b420ea9496aab55475fc38bb6f7 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.309540 30121 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:55.310175 30121 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.310654 30121 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:55.311157 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:55.311956 22791 leader_election.cc:336] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.312266 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:55.301311 30091 consensus_queue.cc:237] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:55.315241 22791 leader_election.cc:336] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.317211 29770 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:55.321735 29770 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.327013 29770 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:55.320604 30121 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:55.324644 22717 leader_election.cc:336] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.325675 30010 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.326134 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.342511 30010 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:55.343148 18407 raft_consensus.cc:2243] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:18:55.344915 18407 raft_consensus.cc:2272] T 2f5c847d65ef47b0b14af4905d5a5fdb P a89a4b420ea9496aab55475fc38bb6f7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.348012 30010 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:55.348850 22791 leader_election.cc:336] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.349109 29862 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.349203 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:55.348850 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:55.350208 29862 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:55.350250 30121 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:55.355916 22865 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.356375 22865 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:55.356910 29862 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:55.359612 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.363417 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:55.369270 30010 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:18:55.363543 18407 raft_consensus.cc:2243] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:18:55.373767 22717 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:55.380018 22568 catalog_manager.cc:5697] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 21 to 22, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 22 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:55.388079 18407 raft_consensus.cc:2272] T 9c2300ccd50e4d7c9ff19678d7e2519a P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.399397 29770 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:55.401467 29770 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:55.404394 22744 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 18: Already voted for candidate e5f99cf1fbc740e3895959adc4f3d10e in this term.
I20260709 12:18:55.408243 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:55.409638 30121 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:18:55.411130 22791 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.411629 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:55.416843 30121 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:18:55.417263 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:55.418304 22827 raft_consensus.cc:2393] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 18: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
W20260709 12:18:55.422194 22865 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:55.429447 22568 catalog_manager.cc:5697] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 20 to 21, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 21 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:55.431608 22717 leader_election.cc:336] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.393285 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.442106 22717 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:55.442737 18407 raft_consensus.cc:2243] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:18:55.443061 30120 raft_consensus.cc:2749] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:55.444293 18407 raft_consensus.cc:2272] T 87de87ebaff74d67abf876d88dc7a0e7 P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:55.447237 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:55.453994 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.455075 18407 raft_consensus.cc:2243] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:55.455734 18407 pending_rounds.cc:70] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Trying to abort 1 pending ops.
I20260709 12:18:55.455976 18407 pending_rounds.cc:77] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 19 index: 12 } timestamp: 7305623578045366272 op_type: NO_OP noop_request { }
I20260709 12:18:55.473129 29770 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.474016 29770 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:55.474990 22827 raft_consensus.cc:1275] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:18:55.476836 30010 consensus_queue.cc:1048] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:18:55.479256 29770 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:55.482160 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:55.482914 22898 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 26.
I20260709 12:18:55.484652 30010 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.485230 30010 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:55.485441 22717 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.487432 30010 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:55.490090 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:55.491181 29770 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:18:55.491591 29770 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.491959 29770 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:18:55.493187 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:55.493927 22823 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 25.
I20260709 12:18:55.491868 30120 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.496556 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:55.496912 30120 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:55.497504 30010 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:18:55.497947 30010 raft_consensus.cc:493] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.498314 30010 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:55.499361 30120 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:55.499866 22865 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.456394 18407 raft_consensus.cc:2889] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:55.501013 18407 raft_consensus.cc:2272] T a35aee871f0b41e48335c0260a873076 P a89a4b420ea9496aab55475fc38bb6f7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.505265 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.506099 18407 raft_consensus.cc:2243] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:18:55.512971 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:55.513828 22827 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 24.
I20260709 12:18:55.515336 29770 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:55.517531 29770 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 27 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:55.544670 30091 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.545622 30091 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:55.552403 30091 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:55.567229 22791 leader_election.cc:336] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.526921 30010 raft_consensus.cc:515] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:55.621291 22894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e170feadac4d27875b0a4c85b6d329" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:55.622459 22894 raft_consensus.cc:3060] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:18:55.638330 22894 raft_consensus.cc:2468] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 27.
I20260709 12:18:55.626470 30139 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.653458 30139 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:55.760692 30141 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.772934 30139 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:55.770974 30141 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:55.780236 30141 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:55.781457 30010 leader_election.cc:290] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:55.768174 23494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 115271us
I20260709 12:18:55.799135 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:55.800158 30120 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:18:55.800596 30120 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.801030 30120 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:55.816561 22717 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:55.817625 30130 raft_consensus.cc:2804] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:18:55.833003 30120 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:55.851424 30120 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:55.860569 30130 raft_consensus.cc:697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 27 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:55.861950 30130 consensus_queue.cc:237] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:55.864131 30146 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.864889 30146 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:55.863343 22717 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.881754 30146 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:18:55.887143 22717 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:55.917912 18407 raft_consensus.cc:2272] T 58484c2487d844518eb11323635fc3c0 P a89a4b420ea9496aab55475fc38bb6f7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.923003 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.924073 18407 raft_consensus.cc:2243] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:18:55.928690 18407 raft_consensus.cc:2272] T a655a30b57d84c3da5e562990d01f8fe P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.933272 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.935536 18407 raft_consensus.cc:2243] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:55.936476 18407 pending_rounds.cc:70] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Trying to abort 1 pending ops.
I20260709 12:18:55.936802 18407 pending_rounds.cc:77] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7: Aborting op as it isn't in flight: id { term: 24 index: 13 } timestamp: 7305623565640331264 op_type: NO_OP noop_request { }
I20260709 12:18:55.937228 18407 raft_consensus.cc:2889] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:55.937608 18407 raft_consensus.cc:2272] T c887310d0efc43dbb01d55c7f99ff9a3 P a89a4b420ea9496aab55475fc38bb6f7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.941242 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.942148 18407 raft_consensus.cc:2243] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:55.943081 18407 raft_consensus.cc:2272] T d360a1924d3c4721bf24cc5f0f17a90b P a89a4b420ea9496aab55475fc38bb6f7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.946974 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:55.947970 18407 raft_consensus.cc:2243] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:18:55.949054 18407 raft_consensus.cc:2272] T c2f844c714924331b8be9b262fed0ddf P a89a4b420ea9496aab55475fc38bb6f7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:55.975111 30146 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:55.976025 30146 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:55.978343 30146 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:56.068182 30145 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.069068 30145 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:56.082566 30145 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:56.090992 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:56.091871 22744 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:56.095630 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:56.096367 22744 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 22.
I20260709 12:18:56.098719 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:56.099659 30127 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:56.100188 30127 raft_consensus.cc:493] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.100607 30127 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:18:56.112284 22717 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:56.118892 22900 raft_consensus.cc:1275] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:18:56.119730 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:56.119885 30127 raft_consensus.cc:515] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:56.129141 30146 consensus_queue.cc:1048] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:56.160766 30127 leader_election.cc:290] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:56.166584 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd506104b9c45169fdf473e38bd2352" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:56.167619 22744 raft_consensus.cc:3060] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:56.181782 22575 catalog_manager.cc:5697] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 26 to 27, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 27 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.188481 30123 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:56.189322 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:56.189190 30123 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:56.190706 22865 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:56.195178 22865 leader_election.cc:336] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:56.196035 22865 leader_election.cc:336] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:56.196142 30123 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:56.201699 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:56.199015 22717 leader_election.cc:336] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:56.210129 30127 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.212922 30127 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:56.220672 30156 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:56.221565 30156 raft_consensus.cc:493] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.222256 30156 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:18:56.207197 22865 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:56.233191 22717 leader_election.cc:336] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:56.233688 22717 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
W20260709 12:18:56.244803 23493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.246411 22744 raft_consensus.cc:2468] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:56.252647 30151 raft_consensus.cc:2749] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:18:56.259261 22865 leader_election.cc:336] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:56.264830 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:56.268870 22864 leader_election.cc:304] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:56.264098 30151 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
W20260709 12:18:56.276412 22865 leader_election.cc:336] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:56.278213 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 76665.9us
I20260709 12:18:56.281229 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:56.281893 30142 raft_consensus.cc:2804] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:56.285759 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f3c57ac6e684973929b4e77a428cb1e" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:56.286371 22827 raft_consensus.cc:3060] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:18:56.285394 22746 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 18.
I20260709 12:18:56.288192 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:56.279014 30127 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:56.296001 22823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:56.306313 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:56.307097 22895 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 26.
W20260709 12:18:56.316535 22717 consensus_peers.cc:597] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:56.322249 30091 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.323015 30091 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:56.325654 30091 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:56.336556 22827 raft_consensus.cc:2468] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 25.
I20260709 12:18:56.337174 30157 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.291355 30151 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:56.302147 30127 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:56.342311 30156 raft_consensus.cc:515] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:56.363631 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 75517us
W20260709 12:18:56.365150 22717 consensus_peers.cc:597] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:56.375738 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 64984.4us
I20260709 12:18:56.368510 30127 raft_consensus.cc:493] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.379070 22823 raft_consensus.cc:2393] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5f99cf1fbc740e3895959adc4f3d10e in current term 23: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:56.380155 30151 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:56.380914 30127 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:56.385394 22899 raft_consensus.cc:1275] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:18:56.390103 22823 raft_consensus.cc:1275] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:18:56.393426 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:56.394342 22818 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 26.
I20260709 12:18:56.395190 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:56.395928 22900 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:56.397953 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c25dfc24830b430e89a2abbfffe374ea" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:56.398685 22818 raft_consensus.cc:3060] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:18:56.404165 30156 leader_election.cc:290] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:56.414924 22717 consensus_peers.cc:597] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:56.426057 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 47817.9us
I20260709 12:18:56.418892 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:56.420004 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:56.376042 30157 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:56.428735 30121 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:18:56.429462 30121 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.429996 30121 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:18:56.427481 22824 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 21.
I20260709 12:18:56.431393 30127 raft_consensus.cc:515] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:56.438164 22865 leader_election.cc:336] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:56.443275 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:56.444088 22899 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:56.430140 30157 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:56.449806 30130 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.450646 30130 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:56.453214 30130 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:56.455327 30164 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.456207 30164 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:56.459910 30156 consensus_queue.cc:1048] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:56.464823 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:56.466686 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:56.467597 22818 raft_consensus.cc:2468] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 26.
W20260709 12:18:56.465341 22865 leader_election.cc:336] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:56.472398 30162 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:56.473016 30162 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.473414 30162 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:56.475479 30119 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:56.476025 30119 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.476446 30119 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:56.461956 30142 raft_consensus.cc:697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 20 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:56.481942 30142 consensus_queue.cc:237] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:56.491379 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:56.492713 30161 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:18:56.493117 30161 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.493512 30161 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:18:56.495611 22899 raft_consensus.cc:1275] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:18:56.513940 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57a7932934f629e6ed95148994535" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:56.514744 22746 raft_consensus.cc:3060] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:56.523476 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:56.523579 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:56.528477 30145 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:56.529064 30145 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.529479 30145 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:56.533268 22746 raft_consensus.cc:2468] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 23.
I20260709 12:18:56.534827 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11f2301e6294b5ab1244e4784694274" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:56.535604 22744 raft_consensus.cc:3060] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:56.533972 30127 leader_election.cc:290] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:56.537137 30164 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:56.530776 30156 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.538218 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:56.539886 22746 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:56.540019 22717 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:56.540995 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:56.541791 30121 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:56.542140 30164 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:18:56.542841 30164 raft_consensus.cc:493] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.543318 30164 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:56.538172 30156 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:56.546694 22790 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:56.549863 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:56.550642 22899 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
I20260709 12:18:56.551810 22744 raft_consensus.cc:2468] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 19.
I20260709 12:18:56.553587 22717 leader_election.cc:304] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:56.554775 29770 raft_consensus.cc:2749] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:18:56.556344 22865 leader_election.cc:304] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:56.552273 30146 raft_consensus.cc:2804] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:18:56.510414 30161 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:56.582206 29770 consensus_queue.cc:1048] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:18:56.572784 30142 raft_consensus.cc:2804] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:18:56.558817 30121 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 27 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:56.601999 30156 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:56.602839 30155 raft_consensus.cc:2804] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:56.603042 30142 raft_consensus.cc:697] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 26 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:56.603523 30155 raft_consensus.cc:697] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:56.604480 30142 consensus_queue.cc:237] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:56.607259 30153 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.607962 30153 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:56.610350 30153 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:56.572782 30151 consensus_queue.cc:1048] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:18:56.644742 30146 raft_consensus.cc:697] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 25 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:56.651553 22864 leader_election.cc:304] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:56.604602 30155 consensus_queue.cc:237] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:56.655170 22791 consensus_peers.cc:597] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:56.675671 22791 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:56.681450 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:56.666630 30119 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:56.671810 30164 raft_consensus.cc:515] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:56.688683 30164 leader_election.cc:290] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:56.669365 30161 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:56.690765 22567 catalog_manager.cc:5697] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 19 to 20, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 20 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.697515 22899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:56.687068 30119 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:56.700515 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:56.701189 22744 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:56.680365 30127 raft_consensus.cc:2804] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:56.702993 22899 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 27: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:56.705744 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4b3aaf1b5e494ca5ea0e6f05bdf52b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:56.706625 22744 raft_consensus.cc:3060] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:18:56.712947 30145 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:56.699694 22717 connection.cc:769] client connection to 127.17.249.193:33285 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:18:56.715435 30145 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
W20260709 12:18:56.698467 22791 connection.cc:769] client connection to 127.17.249.193:33285 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:18:56.646458 30146 consensus_queue.cc:237] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:56.741683 22790 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:56.732304 30127 raft_consensus.cc:697] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:56.748270 30121 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:56.783651 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:56.784111 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:56.784525 22818 raft_consensus.cc:2393] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 27: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:56.781172 30121 raft_consensus.cc:493] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.785558 30121 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:56.787016 30162 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:56.788776 30127 consensus_queue.cc:237] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:56.793510 22827 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c3a0d56045540b7802937559599f09c in current term 22: Already voted for candidate cd93aceeb0e24bb78d4582d8ad55988d in this term.
I20260709 12:18:56.853636 22744 raft_consensus.cc:2468] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 20.
I20260709 12:18:56.834051 30119 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.854359 30155 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.863243 30155 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:56.847160 30130 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.869083 22864 leader_election.cc:304] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:56.870234 30175 raft_consensus.cc:2804] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:18:56.870967 30175 raft_consensus.cc:697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 20 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:56.872090 30175 consensus_queue.cc:237] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:56.883505 30130 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:56.889089 30130 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:56.875451 30119 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:56.892016 30119 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:56.896690 22893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab94770ad5c445e6bfb4a7fdd20ca0f2" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:56.897464 22893 raft_consensus.cc:3060] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:56.902170 30121 raft_consensus.cc:515] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:56.904960 22848 debug-util.cc:398] Leaking SignalData structure 0x7b0800192d20 after lost signal to thread 18410
W20260709 12:18:56.907104 22848 debug-util.cc:398] Leaking SignalData structure 0x7b08002814a0 after lost signal to thread 22610
W20260709 12:18:56.909252 22848 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe560 after lost signal to thread 22777
W20260709 12:18:56.915560 22848 debug-util.cc:398] Leaking SignalData structure 0x7b0800259da0 after lost signal to thread 22851
W20260709 12:18:56.917518 22848 debug-util.cc:398] Leaking SignalData structure 0x7b080015cc80 after lost signal to thread 22925
I20260709 12:18:56.879340 30162 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:56.925745 22893 raft_consensus.cc:2468] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
I20260709 12:18:56.939263 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:56.924659 30155 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:56.954353 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5c847d65ef47b0b14af4905d5a5fdb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:56.955541 22748 raft_consensus.cc:3060] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:56.963488 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:56.965139 30160 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:56.965569 30160 raft_consensus.cc:493] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:56.965963 30160 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:56.955104 30121 leader_election.cc:290] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:56.978868 22791 leader_election.cc:336] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:56.979934 22791 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:56.980317 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:56.980906 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:56.981834 22897 raft_consensus.cc:2393] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cd93aceeb0e24bb78d4582d8ad55988d in current term 22: Already voted for candidate 2c3a0d56045540b7802937559599f09c in this term.
I20260709 12:18:56.983630 30121 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:18:56.984283 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 90426.1us
W20260709 12:18:56.985051 22791 leader_election.cc:336] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:56.975044 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 100067us
W20260709 12:18:56.990837 22791 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:56.993274 22791 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:56.989127 22567 catalog_manager.cc:5697] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 22 to 23, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 23 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.006080 30158 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:57.006834 30158 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:57.011657 22746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:57.012476 22746 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:57.012945 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:57.015633 22748 raft_consensus.cc:2468] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:57.016896 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:57.009501 30158 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:57.055792 22865 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.013664 22824 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:57.056893 22821 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 20.
W20260709 12:18:57.061424 22717 consensus_peers.cc:597] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.071870 22790 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:57.075816 22865 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:57.079273 22717 leader_election.cc:336] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:57.079684 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 64298.1us
W20260709 12:18:57.080315 22865 leader_election.cc:336] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:57.080888 22865 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.081233 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:57.079711 22717 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
W20260709 12:18:57.084457 22717 leader_election.cc:336] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:57.085426 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:57.096664 30119 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:57.097373 30119 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:57.099244 30156 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:57.099737 30156 raft_consensus.cc:493] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:57.100104 30156 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:57.100248 22790 leader_election.cc:304] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:57.101106 30187 raft_consensus.cc:2804] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:57.101876 30187 raft_consensus.cc:697] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:57.103171 30187 consensus_queue.cc:237] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:57.106112 30119 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:57.083304 30127 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:18:57.083540 30174 raft_consensus.cc:2749] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:18:57.111374 22717 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:57.113058 22744 raft_consensus.cc:1275] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:18:57.094230 30120 raft_consensus.cc:2749] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:18:57.114950 30173 raft_consensus.cc:2804] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:57.115602 30173 raft_consensus.cc:697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:57.116695 30173 consensus_queue.cc:237] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:57.056797 30153 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:57.123596 22865 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:57.121565 22791 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:57.129225 30169 consensus_queue.cc:1048] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:57.091667 30160 raft_consensus.cc:515] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:57.134285 30160 leader_election.cc:290] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:57.140101 30153 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:57.141117 30161 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:57.142102 30161 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:57.145757 30161 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:57.151736 22744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:57.156847 22898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa4164beb3941b2bc2f8a103ac0e7fb" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:57.157713 22898 raft_consensus.cc:3060] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:18:57.157763 22791 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.158231 22791 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:57.163501 30121 raft_consensus.cc:2749] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:18:57.165647 22791 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.166868 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:57.164242 30174 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:57.171185 30174 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:57.173637 30174 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:57.176529 30121 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:18:57.190886 22791 leader_election.cc:336] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.191573 30153 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:57.192024 22791 leader_election.cc:336] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:57.193290 22791 leader_election.cc:336] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.193507 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" is_pre_election: true
I20260709 12:18:57.196389 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:57.196561 22898 raft_consensus.cc:2468] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:57.196950 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:57.193801 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:18:57.199201 22865 leader_election.cc:336] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.199790 22865 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:18:57.152288 30156 raft_consensus.cc:515] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:57.195577 22747 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:18:57.195659 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:57.203830 22575 catalog_manager.cc:5697] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 24 to 25, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 25 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.206454 30156 leader_election.cc:290] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:18:57.208693 22717 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
W20260709 12:18:57.209766 22791 leader_election.cc:336] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.213939 22748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87de87ebaff74d67abf876d88dc7a0e7" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:57.207115 22821 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 17.
I20260709 12:18:57.216041 30130 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:18:57.213303 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:57.214771 22748 raft_consensus.cc:3060] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:57.216678 30130 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:57.225078 30156 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:18:57.225293 30130 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:57.225698 30156 raft_consensus.cc:493] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.226202 30156 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:57.216820 30153 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:18:57.229875 30174 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:57.249594 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:57.228379 22568 catalog_manager.cc:5697] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 18 to 19, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 19 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.250927 30177 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:57.251405 30177 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:57.251834 30177 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:57.219079 22567 catalog_manager.cc:5697] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 18 to 19, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 19 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.259929 22567 catalog_manager.cc:5697] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 25 to 26, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 26 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.261750 22567 catalog_manager.cc:5697] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 19 to 20, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 20 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.249606 30156 raft_consensus.cc:515] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:57.268682 30156 leader_election.cc:290] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:18:57.279526 22865 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:57.258735 22717 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:57.280987 22717 leader_election.cc:336] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.284158 22865 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, cd93aceeb0e24bb78d4582d8ad55988d
I20260709 12:18:57.284420 22747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036d0d4c85cb4c92bbe5eff5c95a2441" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e5f99cf1fbc740e3895959adc4f3d10e"
I20260709 12:18:57.285276 22747 raft_consensus.cc:3060] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:18:57.282497 22717 leader_election.cc:336] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:57.286074 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:57.338124 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 52107.4us
W20260709 12:18:57.338399 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 55936.8us
I20260709 12:18:57.309877 22744 raft_consensus.cc:1275] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:18:57.338996 22717 leader_election.cc:336] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.322213 22748 raft_consensus.cc:2468] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 22.
I20260709 12:18:57.298573 22824 raft_consensus.cc:1275] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:18:57.285979 22791 leader_election.cc:304] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:18:57.353636 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 67746.7us
I20260709 12:18:57.354611 30162 raft_consensus.cc:2804] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:57.355175 30162 raft_consensus.cc:697] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:57.356166 30162 consensus_queue.cc:237] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:57.346978 30191 raft_consensus.cc:2764] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:18:57.348539 30177 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:57.356643 22791 leader_election.cc:336] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.349395 30130 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:57.297376 22747 raft_consensus.cc:2468] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 19.
I20260709 12:18:57.361984 30177 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:57.286309 30161 raft_consensus.cc:2749] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:18:57.368884 30153 consensus_queue.cc:1048] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:57.367523 30130 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:18:57.371574 22748 raft_consensus.cc:1275] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:18:57.382230 30178 consensus_queue.cc:1048] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:57.382699 22790 leader_election.cc:304] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:57.384644 30153 raft_consensus.cc:2804] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:57.385222 30153 raft_consensus.cc:697] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:57.387301 30153 consensus_queue.cc:237] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:57.375257 22791 leader_election.cc:336] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.376355 22567 catalog_manager.cc:5697] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 21 to 22, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 22 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:57.389091 22791 leader_election.cc:336] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:57.389703 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:57.391371 22791 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:57.392503 22717 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.394654 22790 leader_election.cc:304] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:57.403056 22818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58484c2487d844518eb11323635fc3c0" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:57.403851 22818 raft_consensus.cc:3060] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:57.410030 29862 raft_consensus.cc:2804] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:57.410766 29862 raft_consensus.cc:697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:57.411827 29862 consensus_queue.cc:237] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:57.425745 22717 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:57.426419 22717 leader_election.cc:336] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:57.435761 22717 consensus_peers.cc:597] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:57.436393 22717 consensus_peers.cc:597] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.433321 22748 raft_consensus.cc:1275] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:18:57.440516 30010 consensus_queue.cc:1048] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:57.448778 22824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2300ccd50e4d7c9ff19678d7e2519a" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:57.449506 22824 raft_consensus.cc:3060] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:18:57.455199 22827 raft_consensus.cc:1275] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:18:57.465843 22818 raft_consensus.cc:2468] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 18.
W20260709 12:18:57.477393 22791 leader_election.cc:336] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.480322 30161 consensus_queue.cc:1048] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:18:57.487888 22717 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:57.489243 30146 consensus_queue.cc:1048] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:57.491102 30146 raft_consensus.cc:2804] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:57.491604 30146 raft_consensus.cc:697] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:57.516050 29770 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:57.520951 22568 catalog_manager.cc:5697] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 17 to 18, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 18 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.533278 30146 consensus_queue.cc:237] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
W20260709 12:18:57.535311 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:57.542474 22865 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.549311 29770 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:18:57.558986 22865 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:57.554279 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:57.563041 22791 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:57.554231 22824 raft_consensus.cc:2468] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:57.590517 29770 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:57.592682 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:57.593788 22900 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 21.
I20260709 12:18:57.601382 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: 
I20260709 12:18:57.602290 29770 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:57.603219 29770 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:57.603502 29770 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:57.604919 22717 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:57.611322 30130 raft_consensus.cc:2804] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:18:57.617786 30130 raft_consensus.cc:697] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:57.618981 30130 consensus_queue.cc:237] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:18:57.631894 22567 catalog_manager.cc:5697] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 21 to 22, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 22 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:57.635468 22717 leader_election.cc:336] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.633893 22567 catalog_manager.cc:5697] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 17 to 19, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 19 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:57.655012 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:57.664108 22791 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:57.664835 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:57.683185 22791 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.690595 22575 catalog_manager.cc:5697] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 17 to 18, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 18 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:57.691854 22717 consensus_peers.cc:597] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.678721 29770 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:57.702404 22897 raft_consensus.cc:1275] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:18:57.702395 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f844c714924331b8be9b262fed0ddf" candidate_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:57.706346 29770 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:57.706876 22900 raft_consensus.cc:3060] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:57.732095 30146 consensus_queue.cc:1048] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:18:57.756619 18407 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23725)
I20260709 12:18:57.768368 22900 raft_consensus.cc:2468] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f99cf1fbc740e3895959adc4f3d10e in term 22.
W20260709 12:18:57.775424 22717 leader_election.cc:336] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.776708 22746 raft_consensus.cc:1275] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:18:57.777397 22568 catalog_manager.cc:5697] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 20 to 21, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 21 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.782335 22895 raft_consensus.cc:1275] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:57.801625 30153 consensus_queue.cc:1048] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:18:57.803061 22717 consensus_peers.cc:597] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:57.809544 30188 consensus_queue.cc:1048] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:57.816624 22717 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, e5f99cf1fbc740e3895959adc4f3d10e; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:57.818192 30173 raft_consensus.cc:2804] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:57.818885 30173 raft_consensus.cc:697] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 22 LEADER]: Becoming Leader. State: Replica: e5f99cf1fbc740e3895959adc4f3d10e, State: Running, Role: LEADER
I20260709 12:18:57.819950 30173 consensus_queue.cc:237] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:18:57.828653 30188 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:57.829286 30188 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:57.831594 30188 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:57.838196 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:57.839025 22900 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
I20260709 12:18:57.847903 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:57.850556 30188 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:18:57.850994 30188 raft_consensus.cc:493] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a89a4b420ea9496aab55475fc38bb6f7)
I20260709 12:18:57.851356 30188 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:18:57.861210 22748 raft_consensus.cc:1275] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:18:57.863088 22717 consensus_peers.cc:597] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:57.870682 22791 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.876386 30162 consensus_queue.cc:1048] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:18:57.878131 22791 consensus_peers.cc:597] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.882607 30188 raft_consensus.cc:515] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:18:57.885121 30188 leader_election.cc:290] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Requested vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:18:57.895920 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a655a30b57d84c3da5e562990d01f8fe" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:57.896653 22895 raft_consensus.cc:3060] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:18:57.908551 22791 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:57.923000 22791 leader_election.cc:336] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:57.906581 22895 raft_consensus.cc:2468] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 22.
I20260709 12:18:57.925563 22791 leader_election.cc:304] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:57.926400 30158 raft_consensus.cc:2804] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:18:57.926940 30158 raft_consensus.cc:697] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:57.927906 30158 consensus_queue.cc:237] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:18:57.947816 22717 consensus_peers.cc:597] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:57.997781 22575 catalog_manager.cc:5697] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e reported cstate change: term changed from 21 to 22, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194). New cstate: current_term: 22 leader_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:58.004638 22568 catalog_manager.cc:5697] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 21 to 22, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 22 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.034368 22824 raft_consensus.cc:1275] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:18:58.056352 22748 raft_consensus.cc:1275] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:18:58.086925 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:58.096261 30187 consensus_queue.cc:1048] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:58.088045 30130 consensus_queue.cc:1048] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
W20260709 12:18:58.105831 22791 consensus_peers.cc:597] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:58.120460 22717 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:58.133945 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:58.185432 22824 raft_consensus.cc:1275] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:18:58.193619 30172 consensus_queue.cc:1048] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:18:58.211606 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:58.232345 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 68308.8us
W20260709 12:18:58.278899 22717 consensus_peers.cc:597] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:58.279479 22717 consensus_peers.cc:597] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:58.287756 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:58.298293 22865 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:58.324589 22791 consensus_peers.cc:597] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:58.354180 22900 raft_consensus.cc:1275] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:18:58.355923 30156 consensus_queue.cc:1048] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:58.356868 22895 raft_consensus.cc:1275] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Refusing update from remote peer e5f99cf1fbc740e3895959adc4f3d10e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:18:58.359030 30146 consensus_queue.cc:1048] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:18:58.493250 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:58.562569 22717 consensus_peers.cc:597] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:58.643069 30222 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.643821 30222 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:58.664335 30222 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:58.665290 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:18:58.666162 22827 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 22.
I20260709 12:18:58.667923 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:58.670625 30222 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:18:58.671140 30222 raft_consensus.cc:493] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.671494 30222 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:18:58.673763 22865 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:58.674664 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:58.682765 30222 raft_consensus.cc:515] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:58.685835 30222 leader_election.cc:290] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 election: Requested vote from peers cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:58.701354 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ef3fae5db64ba8b0eae0ce76950f51" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d"
I20260709 12:18:58.702291 22827 raft_consensus.cc:3060] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:18:58.738994 22827 raft_consensus.cc:2468] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c3a0d56045540b7802937559599f09c in term 23.
W20260709 12:18:58.749841 22865 leader_election.cc:336] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:58.750736 22865 leader_election.cc:304] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:18:58.752951 30223 raft_consensus.cc:2804] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:18:58.753619 30223 raft_consensus.cc:697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 23 LEADER]: Becoming Leader. State: Replica: 2c3a0d56045540b7802937559599f09c, State: Running, Role: LEADER
I20260709 12:18:58.754658 30223 consensus_queue.cc:237] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:58.757220 18407 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23725)
W20260709 12:18:58.760007 22717 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:58.794247 22575 catalog_manager.cc:5697] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c reported cstate change: term changed from 21 to 23, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to 2c3a0d56045540b7802937559599f09c (127.17.249.196). New cstate: current_term: 23 leader_uuid: "2c3a0d56045540b7802937559599f09c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.941537 30162 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.942198 30162 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:58.944640 30162 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:58.946712 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:18:58.947688 22900 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 27.
I20260709 12:18:58.950299 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:58.954751 30162 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:18:58.955310 30162 raft_consensus.cc:493] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.955653 30162 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:18:58.962435 22791 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:18:58.964998 30162 raft_consensus.cc:515] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
I20260709 12:18:58.978114 30162 leader_election.cc:290] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 28 election: Requested vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:18:58.990705 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599b298e84934cc4969ad7fa2b906b26" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:18:58.991616 22900 raft_consensus.cc:3060] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:18:59.025671 22900 raft_consensus.cc:2468] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 28.
W20260709 12:18:59.027781 22717 consensus_peers.cc:597] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:59.097947 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 46501.6us
I20260709 12:18:59.098845 22791 leader_election.cc:304] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:18:59.099681 30156 raft_consensus.cc:2804] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:18:59.100440 30156 raft_consensus.cc:697] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 28 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:18:59.101569 30156 consensus_queue.cc:237] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:18:59.102451 22791 leader_election.cc:336] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:18:59.126720 22717 consensus_peers.cc:597] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:59.145479 22791 consensus_peers.cc:597] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:59.221410 22575 catalog_manager.cc:5697] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 26 to 28, leader changed from a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 28 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:59.233717 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:59.254735 22865 consensus_peers.cc:597] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:59.315681 22827 raft_consensus.cc:1275] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Refusing update from remote peer 2c3a0d56045540b7802937559599f09c: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:18:59.317389 30222 consensus_queue.cc:1048] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:18:59.350252 22717 consensus_peers.cc:597] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:59.421978 22865 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:59.552047 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:59.554821 22717 consensus_peers.cc:597] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:59.577751 22900 raft_consensus.cc:1275] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 28 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:18:59.579698 30236 consensus_queue.cc:1048] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:18:59.582998 22717 consensus_peers.cc:597] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:59.703665 22791 consensus_peers.cc:597] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:59.707275 22791 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:59.711895 22791 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:59.722616 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:59.744267 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:59.757767 18407 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 23725)
W20260709 12:18:59.768210 22791 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:59.799642 22865 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:59.878710 22791 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:59.884508 22865 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:59.921823 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:59.927517 22791 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:00.036145 22717 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111) [suppressed 386 similar messages]
W20260709 12:19:00.152654 22717 consensus_peers.cc:597] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:00.160840 22717 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:00.167379 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:00.175607 22717 consensus_peers.cc:597] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:00.309680 22791 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:00.345729 22717 consensus_peers.cc:597] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:00.352135 22717 consensus_peers.cc:597] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:00.423110 22791 consensus_peers.cc:597] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:00.456221 22791 consensus_peers.cc:597] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:00.477867 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:00.633028 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:00.641058 22791 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:00.692976 22717 consensus_peers.cc:597] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:00.708806 22865 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:00.739622 22791 consensus_peers.cc:597] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:00.747073 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:00.758442 18407 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 23725)
W20260709 12:19:00.788920 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:00.810225 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:00.862396 22717 consensus_peers.cc:597] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:00.863454 22717 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:00.915825 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:01.180423 22717 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:01.188635 22717 consensus_peers.cc:597] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:01.191990 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:01.285807 22717 consensus_peers.cc:597] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:01.408528 22791 consensus_peers.cc:597] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:01.481496 22865 consensus_peers.cc:597] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:01.519767 22717 consensus_peers.cc:597] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:01.627624 22717 consensus_peers.cc:597] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:01.759074 18407 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 23725)
W20260709 12:19:01.863451 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:01.905201 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:01.931509 22865 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:01.971971 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:02.105870 22791 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:02.144891 22791 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:02.145525 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:02.146020 22791 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:02.206605 22865 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:02.210559 22717 consensus_peers.cc:597] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:02.295399 22791 consensus_peers.cc:597] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:02.319540 22717 consensus_peers.cc:597] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:02.328827 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:02.336367 22791 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:02.525687 22865 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:02.561219 22717 consensus_peers.cc:597] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:02.580200 22791 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:02.581858 22717 consensus_peers.cc:597] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:02.599093 22791 consensus_peers.cc:597] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:02.613570 22717 consensus_peers.cc:597] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:02.666544 22791 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:02.695648 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:02.759641 18407 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 23725)
W20260709 12:19:02.800877 22717 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:02.843070 22791 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:02.907018 22717 consensus_peers.cc:597] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:02.911944 22717 consensus_peers.cc:597] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:02.927963 22791 consensus_peers.cc:597] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:03.003371 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:03.011387 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:03.076694 22717 consensus_peers.cc:597] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:03.114591 22865 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:03.128878 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:03.171156 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:03.202466 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:03.212728 22717 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:03.463584 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:03.559300 22717 consensus_peers.cc:597] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:03.571004 22791 consensus_peers.cc:597] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:03.611052 22717 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:03.760555 18407 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 23725)
W20260709 12:19:03.803395 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:03.843176 22717 consensus_peers.cc:597] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:03.951875 22791 consensus_peers.cc:597] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:04.100353 22717 consensus_peers.cc:597] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:04.190994 22865 consensus_peers.cc:597] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:04.196322 22717 consensus_peers.cc:597] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:04.220268 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 56010.8us
W20260709 12:19:04.353233 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:04.374091 22865 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:04.496446 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:04.529773 22791 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:04.533634 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:04.660425 22791 consensus_peers.cc:597] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:04.751690 22791 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:04.761996 18407 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 23725)
W20260709 12:19:04.817222 22791 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:04.844530 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:04.845727 22865 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:04.861073 22717 consensus_peers.cc:597] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:04.887524 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:04.930290 22791 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:04.937393 22717 consensus_peers.cc:597] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:04.959018 22791 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:04.977313 22717 consensus_peers.cc:597] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:05.048147 22865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111) [suppressed 454 similar messages]
W20260709 12:19:05.088085 22717 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:05.138962 22717 consensus_peers.cc:597] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:05.190474 22717 consensus_peers.cc:597] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:05.228363 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:05.244462 22865 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:05.247378 22791 consensus_peers.cc:597] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:05.291050 22791 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:05.303201 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:05.338088 22791 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:05.342396 22717 consensus_peers.cc:597] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:05.407601 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:05.433468 22717 consensus_peers.cc:597] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:05.574646 22791 consensus_peers.cc:597] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:05.608608 22717 consensus_peers.cc:597] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:05.667403 22865 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:05.705786 22717 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:05.722846 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:05.759550 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:05.762853 18407 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 23725)
W20260709 12:19:05.820205 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:05.967695 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:06.161060 22791 consensus_peers.cc:597] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:06.223484 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:06.281638 22717 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:06.403687 22717 consensus_peers.cc:597] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:06.440425 22717 consensus_peers.cc:597] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:06.453668 22717 consensus_peers.cc:597] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:06.512192 22791 consensus_peers.cc:597] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:06.556887 22865 consensus_peers.cc:597] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:06.764695 18407 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 23725)
W20260709 12:19:07.180420 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 466824us
W20260709 12:19:07.303241 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:07.305784 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 71791.4us
W20260709 12:19:07.313107 22865 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:07.348941 22865 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:07.390260 22791 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:07.436760 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 46571.6us
W20260709 12:19:07.450735 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 130591us
W20260709 12:19:07.472349 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:07.473958 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:07.474634 22791 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:07.479121 22791 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:07.537431 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:07.546531 22717 consensus_peers.cc:597] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:07.761797 22865 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:07.765434 18407 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 23725)
W20260709 12:19:07.779594 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:07.825160 22791 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:07.825685 22791 consensus_peers.cc:597] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:07.834736 22717 consensus_peers.cc:597] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:07.835727 22717 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:07.844012 22791 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:07.846727 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:07.877854 22717 consensus_peers.cc:597] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:07.890553 22791 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:07.942593 22717 consensus_peers.cc:597] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:08.032842 22791 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:08.095667 22717 consensus_peers.cc:597] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:08.120342 22607 debug-util.cc:398] Leaking SignalData structure 0x7b0800136a00 after lost signal to thread 18410
W20260709 12:19:08.121835 22607 debug-util.cc:398] Leaking SignalData structure 0x7b080030a8e0 after lost signal to thread 22610
W20260709 12:19:08.123396 22607 debug-util.cc:398] Leaking SignalData structure 0x7b0800008600 after lost signal to thread 22777
W20260709 12:19:08.124879 22607 debug-util.cc:398] Leaking SignalData structure 0x7b0800113bc0 after lost signal to thread 22851
W20260709 12:19:08.126428 22607 debug-util.cc:398] Leaking SignalData structure 0x7b0800303ce0 after lost signal to thread 22925
W20260709 12:19:08.164515 22717 consensus_peers.cc:597] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:08.175570 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:08.272022 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:08.231600 22717 consensus_peers.cc:597] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:08.291903 22791 consensus_peers.cc:597] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:08.312804 22865 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:08.369092 22791 consensus_peers.cc:597] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:08.379884 22717 consensus_peers.cc:597] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:08.505358 22717 consensus_peers.cc:597] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:08.537416 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:08.699151 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:08.715359 22717 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:08.758651 22791 consensus_peers.cc:597] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:08.766160 18407 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 23725)
W20260709 12:19:08.784578 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 50456.7us
W20260709 12:19:08.799202 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:08.868290 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:09.021183 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:09.073288 22865 consensus_peers.cc:597] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:09.225450 22717 consensus_peers.cc:597] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:09.287055 22717 consensus_peers.cc:597] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:09.339566 22791 consensus_peers.cc:597] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:09.412794 22717 consensus_peers.cc:597] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:09.470613 22791 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:09.495945 22717 consensus_peers.cc:597] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:09.592239 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:09.608032 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:09.664426 22791 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:09.766793 18407 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 23725)
W20260709 12:19:09.803124 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 111716us
W20260709 12:19:09.819391 22717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 164019us
W20260709 12:19:09.919611 22791 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:09.945068 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.195:38963, user_credentials={real_user=slave}} blocked reactor thread for 53438.9us
W20260709 12:19:10.020655 22865 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:10.021301 22865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.193:33285, user_credentials={real_user=slave}} blocked reactor thread for 73835.2us
W20260709 12:19:10.008895 22791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.196:37425, user_credentials={real_user=slave}} blocked reactor thread for 52205.9us
W20260709 12:19:10.037431 22790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 55050.5us
W20260709 12:19:10.039438 22865 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:10.039748 22717 consensus_peers.cc:597] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:10.044229 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:10.049058 22717 consensus_peers.cc:597] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:10.049124 22791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111) [suppressed 418 similar messages]
W20260709 12:19:10.061036 22717 consensus_peers.cc:597] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:10.075263 22717 consensus_peers.cc:597] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:10.304136 22791 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:10.444541 22865 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:10.464676 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:19:10.498559 22717 consensus_peers.cc:597] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:10.517004 22717 consensus_peers.cc:597] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:10.539878 22791 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:10.575028 22791 consensus_peers.cc:597] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:10.608916 22791 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:10.617918 22717 consensus_peers.cc:597] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:19:10.703816 22717 consensus_peers.cc:597] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:10.709930 22791 consensus_peers.cc:597] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:10.743919 22717 consensus_peers.cc:597] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:10.829533 22791 consensus_peers.cc:597] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:10.831317 22717 consensus_peers.cc:597] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:10.835912 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:10.853904 22791 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:10.906097 22717 consensus_peers.cc:597] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:19:10.907274 22865 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:10.976716 22717 consensus_peers.cc:597] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:19:11.006942 22717 consensus_peers.cc:597] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:19:11.013062 18407 tablet_server.cc:196] TabletServer@127.17.249.193:33285 shutdown complete.
W20260709 12:19:11.061517 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:19:11.083498 22717 consensus_peers.cc:597] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:11.110637 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:19:11.198226 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:19:11.357548 18407 tablet_server.cc:179] TabletServer@127.17.249.194:0 shutting down...
W20260709 12:19:11.391927 22790 consensus_peers.cc:597] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.422001 22864 consensus_peers.cc:597] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.469040 22790 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.491379 22717 consensus_peers.cc:597] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:11.501277 22864 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.502279 22790 consensus_peers.cc:597] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.516203 22717 consensus_peers.cc:597] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:19:11.526961 22864 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.532155 22791 consensus_peers.cc:597] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:11.545369 22790 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.553869 22864 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.565716 22717 consensus_peers.cc:597] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:19:11.570730 22864 consensus_peers.cc:597] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.572294 22790 consensus_peers.cc:597] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.601783 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:11.605342 18407 tablet_replica.cc:333] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.606623 18407 raft_consensus.cc:2243] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.608038 18407 raft_consensus.cc:2272] T c267ff17b26d4fd08c09792a0ccb9b43 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.620625 22791 consensus_peers.cc:597] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:11.634668 18407 tablet_replica.cc:333] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.636073 18407 raft_consensus.cc:2243] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.640089 18407 raft_consensus.cc:2272] T bd458323e9194286800a7f592094802c P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.641446 22790 consensus_peers.cc:597] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.643328 22790 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.644023 22790 consensus_peers.cc:597] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.653908 18407 tablet_replica.cc:333] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.655195 18407 raft_consensus.cc:2243] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.656813 18407 raft_consensus.cc:2272] T 6d52bb84350d4c4ebd55acd59d333846 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.667150 18407 tablet_replica.cc:333] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.668179 18407 raft_consensus.cc:2243] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.669073 18407 raft_consensus.cc:2272] T 3ba57a7932934f629e6ed95148994535 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.672797 18407 tablet_replica.cc:333] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.673735 18407 raft_consensus.cc:2243] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.675227 18407 raft_consensus.cc:2272] T fca29e0a7a6342a2b2f2088587de1246 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.678514 18407 tablet_replica.cc:333] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.679508 18407 raft_consensus.cc:2243] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.681859 18407 raft_consensus.cc:2272] T 91b331b9ec19453b8cd59bd6d61760dd P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.688679 18407 tablet_replica.cc:333] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.689755 18407 raft_consensus.cc:2243] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.691337 18407 raft_consensus.cc:2272] T 58484c2487d844518eb11323635fc3c0 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.695201 18407 tablet_replica.cc:333] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.696166 18407 raft_consensus.cc:2243] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:11.699046 22790 consensus_peers.cc:597] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.699268 18407 raft_consensus.cc:2272] T dcb4cae1a1914d1a94e203f082ef12e5 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.703217 18407 tablet_replica.cc:333] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.704471 18407 raft_consensus.cc:2243] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.711050 18407 raft_consensus.cc:2272] T 790207f3e8474996938608fcdf438660 P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.714645 18407 tablet_replica.cc:333] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.715633 18407 raft_consensus.cc:2243] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.717108 18407 raft_consensus.cc:2272] T 3c0e2e48cbc740c0a7fad7f513017008 P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.720449 22790 consensus_peers.cc:597] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.725181 18407 tablet_replica.cc:333] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.726449 18407 raft_consensus.cc:2243] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.727553 18407 raft_consensus.cc:2272] T 53fc67a4479240b383ece839d37b7b58 P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.731182 18407 tablet_replica.cc:333] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.732164 18407 raft_consensus.cc:2243] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.735491 18407 raft_consensus.cc:2272] T c98b51f118bc481dbf774ac4738c9617 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.739004 22790 consensus_peers.cc:597] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.744352 22790 consensus_peers.cc:597] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.746398 18407 tablet_replica.cc:333] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.748442 18407 raft_consensus.cc:2243] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.750818 18407 raft_consensus.cc:2272] T 4af65e8169664ec2afee890830d185cf P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.754412 18407 tablet_replica.cc:333] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.755358 18407 raft_consensus.cc:2243] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.756886 18407 raft_consensus.cc:2272] T 7f3c57ac6e684973929b4e77a428cb1e P e5f99cf1fbc740e3895959adc4f3d10e [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.758490 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:19:11.760133 18407 tablet_replica.cc:333] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.761163 18407 raft_consensus.cc:2243] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.761791 18407 raft_consensus.cc:2272] T e8b793d48d6b4e5db13d9e6811d51310 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.766160 18407 tablet_replica.cc:333] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
W20260709 12:19:11.773825 22790 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.775974 18407 raft_consensus.cc:2243] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.782450 18407 raft_consensus.cc:2272] T b6ff1852979a471a8510052b7ba98faa P e5f99cf1fbc740e3895959adc4f3d10e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.786032 18407 tablet_replica.cc:333] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.787065 18407 raft_consensus.cc:2243] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.788089 18407 raft_consensus.cc:2272] T c11f2301e6294b5ab1244e4784694274 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.791801 18407 tablet_replica.cc:333] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.792899 18407 raft_consensus.cc:2243] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.794309 18407 raft_consensus.cc:2272] T a2d5308b787c474aa407e2d08bb254b9 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.797638 18407 tablet_replica.cc:333] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.798482 18407 raft_consensus.cc:2243] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.802052 18407 raft_consensus.cc:2272] T f50db8803bc44d8eaab7195399b5ec5f P e5f99cf1fbc740e3895959adc4f3d10e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.805685 18407 tablet_replica.cc:333] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.806661 18407 raft_consensus.cc:2243] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.807994 18407 raft_consensus.cc:2272] T 17a6be884c6d4eeabbf042ccacf06ef6 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.811399 18407 tablet_replica.cc:333] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.812294 18407 raft_consensus.cc:2243] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.813263 18407 raft_consensus.cc:2272] T 7e5e2a8f5b814b18a53ee5c8af767da0 P e5f99cf1fbc740e3895959adc4f3d10e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.817621 18407 tablet_replica.cc:333] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
W20260709 12:19:11.818323 22790 consensus_peers.cc:597] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.818499 18407 raft_consensus.cc:2243] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.819943 18407 raft_consensus.cc:2272] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.828152 18407 tablet_replica.cc:333] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.829093 18407 raft_consensus.cc:2243] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.830008 18407 raft_consensus.cc:2272] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.833189 18407 tablet_replica.cc:333] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.834056 18407 raft_consensus.cc:2243] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.835772 18407 raft_consensus.cc:2272] T 4dd506104b9c45169fdf473e38bd2352 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.840766 18407 tablet_replica.cc:333] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.841614 18407 raft_consensus.cc:2243] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.842830 18407 raft_consensus.cc:2272] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.847673 22864 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.853312 22717 consensus_peers.cc:597] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:11.854244 22865 consensus_peers.cc:597] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:19:11.854013 18407 tablet_replica.cc:333] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.855937 18407 raft_consensus.cc:2243] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.857496 18407 raft_consensus.cc:2272] T 44cb46cd92c346879a120a3d3b95561a P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.861295 18407 tablet_replica.cc:333] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.862175 18407 raft_consensus.cc:2243] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.863415 18407 raft_consensus.cc:2272] T d360a1924d3c4721bf24cc5f0f17a90b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.866641 18407 tablet_replica.cc:333] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.867554 18407 raft_consensus.cc:2243] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.868981 18407 raft_consensus.cc:2272] T c2f844c714924331b8be9b262fed0ddf P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.872123 18407 tablet_replica.cc:333] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.872918 18407 raft_consensus.cc:2243] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.876611 18407 raft_consensus.cc:2272] T 2961a92dd3ac479293a445dd4ee87d3b P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.881565 18407 tablet_replica.cc:333] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.885857 18407 raft_consensus.cc:2243] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.886636 18407 raft_consensus.cc:2272] T af9dd2cd94724707b7aafa424c43031d P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.889717 18407 tablet_replica.cc:333] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.890722 18407 raft_consensus.cc:2243] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.897876 18407 raft_consensus.cc:2272] T e2718d64abf84eb5b425ac4d5bd7217e P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.915877 22864 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.935988 18407 tablet_replica.cc:333] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.939698 18407 raft_consensus.cc:2243] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.941004 18407 raft_consensus.cc:2272] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.954181 18407 tablet_replica.cc:333] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.955137 18407 raft_consensus.cc:2243] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.955873 18407 raft_consensus.cc:2272] T 036d0d4c85cb4c92bbe5eff5c95a2441 P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.958709 18407 tablet_replica.cc:333] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.959651 18407 raft_consensus.cc:2243] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.960307 18407 raft_consensus.cc:2272] T a59fd6638f4a4b539acee7e61d0a1e9c P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.963989 18407 tablet_replica.cc:333] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.964854 18407 raft_consensus.cc:2243] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.966274 18407 raft_consensus.cc:2272] T 4cb67a71a0954b2bab724a9e4399cf13 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.970112 18407 tablet_replica.cc:333] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.971027 18407 raft_consensus.cc:2243] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.971797 18407 raft_consensus.cc:2272] T 76cb1231be0940089338c6aeb27ce69f P e5f99cf1fbc740e3895959adc4f3d10e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.977736 18407 tablet_replica.cc:333] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.978677 18407 raft_consensus.cc:2243] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.980520 18407 raft_consensus.cc:2272] T 9c2300ccd50e4d7c9ff19678d7e2519a P e5f99cf1fbc740e3895959adc4f3d10e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.983917 18407 tablet_replica.cc:333] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:11.984592 18407 raft_consensus.cc:2243] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.985160 18407 raft_consensus.cc:2272] T 2f5c847d65ef47b0b14af4905d5a5fdb P e5f99cf1fbc740e3895959adc4f3d10e [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:12.045847 22865 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:12.153856 18407 tablet_replica.cc:333] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:12.154973 18407 raft_consensus.cc:2243] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:12.155831 18407 raft_consensus.cc:2272] T 87de87ebaff74d67abf876d88dc7a0e7 P e5f99cf1fbc740e3895959adc4f3d10e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.159209 18407 tablet_replica.cc:333] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:12.160053 18407 raft_consensus.cc:2243] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:12.160760 18407 raft_consensus.cc:2272] T 7e28930436db4beaabf3941f9b136f22 P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.164219 18407 tablet_replica.cc:333] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:12.165036 18407 raft_consensus.cc:2243] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:12.166160 18407 raft_consensus.cc:2272] T a7fc8b6794ba455388f13d7c3c76e77b P e5f99cf1fbc740e3895959adc4f3d10e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.170801 18407 tablet_replica.cc:333] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:12.171607 18407 raft_consensus.cc:2243] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:19:12.173065 18407 raft_consensus.cc:2272] T d65fa6d7d4a74fa3bf4c3beda5687094 P e5f99cf1fbc740e3895959adc4f3d10e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.176489 18407 tablet_replica.cc:333] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:12.177268 18407 raft_consensus.cc:2243] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:19:12.178694 18407 raft_consensus.cc:2272] T b5e170feadac4d27875b0a4c85b6d329 P e5f99cf1fbc740e3895959adc4f3d10e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.182709 18407 tablet_replica.cc:333] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e: stopping tablet replica
I20260709 12:19:12.183413 18407 raft_consensus.cc:2243] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:12.184075 18407 raft_consensus.cc:2272] T fb26ab285f3946aaa4009cfc56fb98fc P e5f99cf1fbc740e3895959adc4f3d10e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:12.273509 22719 connection.cc:466] server connection from 127.0.0.1:42834 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 2361) could send its response
W20260709 12:19:12.275586 22719 connection.cc:466] server connection from 127.0.0.1:42834 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 2362) could send its response
W20260709 12:19:12.276512 22719 connection.cc:466] server connection from 127.0.0.1:42834 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 2363) could send its response
W20260709 12:19:12.277369 22719 connection.cc:466] server connection from 127.0.0.1:42834 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 2364) could send its response
W20260709 12:19:12.291006 18407 connection.cc:466] server connection from 127.0.0.1:42834 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42834 (request call id 2360) could send its response
W20260709 12:19:12.321192 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:12.328183 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:19:12.328867 22791 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:12.329419 22791 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:19:12.373420 22791 consensus_peers.cc:597] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:19:12.412847 22865 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:12.740149 30303 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:12.740957 30303 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:12.743703 30303 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:12.747711 22791 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:12.748346 22790 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:12.748764 22790 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:12.749516 30303 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:12.790861 30308 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:12.791610 30308 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:12.794255 30308 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:12.799222 22864 leader_election.cc:336] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:12.799988 22865 leader_election.cc:336] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:12.800397 22865 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:12.801153 30308 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:19:12.807484 30303 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:12.808228 30303 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:12.810654 30303 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:12.813990 30308 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:12.814762 30308 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:19:12.816378 22791 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:12.818444 22790 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:12.820075 22790 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:12.819036 30308 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:12.822003 22865 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:12.824007 30312 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:19:12.825083 22864 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:12.825598 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:12.826665 30311 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:19:12.856424 30289 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:12.857065 30289 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:12.859643 30289 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:12.864754 22790 leader_election.cc:336] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:12.865849 22791 leader_election.cc:336] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:12.866359 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:12.867277 30289 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:12.885572 30308 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:12.886193 30308 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:12.888612 30308 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:12.890539 22865 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:12.894052 22865 leader_election.cc:336] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:12.894897 22864 leader_election.cc:336] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:12.895553 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:12.896349 30308 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:19:12.914666 22791 consensus_peers.cc:597] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:12.917277 30289 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:12.917968 30289 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:12.920215 30289 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:12.927368 22790 leader_election.cc:336] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:12.928148 22791 leader_election.cc:336] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:12.928562 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:12.929385 30289 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:19:12.957222 30308 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:12.958051 30308 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:12.959367 30311 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:12.959646 30301 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:12.960137 30311 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:19:12.960712 30308 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:12.960253 30301 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:19:12.962947 30311 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:19:12.963006 30301 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
I20260709 12:19:12.966753 30301 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:12.967023 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:19:12.967469 30301 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:12.967880 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:19:12.970121 30301 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:12.973790 22864 leader_election.cc:336] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:12.974347 22864 leader_election.cc:336] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:12.974740 22864 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:12.975703 30301 raft_consensus.cc:2749] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:19:12.975703 22864 leader_election.cc:336] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:12.976905 22864 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:19:12.977222 22865 leader_election.cc:336] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:12.977609 30308 raft_consensus.cc:2749] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:19:12.978770 22865 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:12.980950 30301 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:19:12.985714 22864 leader_election.cc:336] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:12.988322 22865 leader_election.cc:336] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:12.988869 22865 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:12.989724 30308 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:19:13.015144 22791 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:13.015887 30312 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.016337 30312 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:13.018334 30312 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:13.023543 22790 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:13.024166 22791 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:13.024600 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.025251 30312 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:19:13.041601 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:19:13.047925 22791 consensus_peers.cc:597] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:19:13.083112 30312 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.083703 30312 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:19:13.086186 30312 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:19:13.088017 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:19:13.088752 22897 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 20.
I20260709 12:19:13.090221 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:19:13.091348 30289 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:13.091794 30289 raft_consensus.cc:493] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.092855 30289 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:19:13.096527 22790 leader_election.cc:336] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.101343 30289 raft_consensus.cc:515] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:19:13.103792 30312 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.105396 30289 leader_election.cc:290] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:19:13.104506 30312 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:13.107306 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f073d198a4fd3a66aeb940d0b5ab1" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:19:13.107956 22900 raft_consensus.cc:3060] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:13.110630 30312 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:13.114401 22790 leader_election.cc:336] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:13.114491 22791 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:13.115650 22900 raft_consensus.cc:2468] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 21.
W20260709 12:19:13.117030 22790 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.117022 22791 leader_election.cc:304] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.117506 22790 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.118276 30312 raft_consensus.cc:2804] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:13.118453 30289 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:19:13.119596 30312 raft_consensus.cc:697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:19:13.120460 30312 consensus_queue.cc:237] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:19:13.133342 22567 catalog_manager.cc:5697] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 20 to 21, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 21 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:13.152145 22774 debug-util.cc:398] Leaking SignalData structure 0x7b0800205c20 after lost signal to thread 18410
W20260709 12:19:13.154328 22774 debug-util.cc:398] Leaking SignalData structure 0x7b0800153020 after lost signal to thread 22610
W20260709 12:19:13.155205 22774 debug-util.cc:398] Leaking SignalData structure 0x7b08000d18e0 after lost signal to thread 22777
W20260709 12:19:13.156837 22774 debug-util.cc:398] Leaking SignalData structure 0x7b080029b280 after lost signal to thread 22851
W20260709 12:19:13.158751 22774 debug-util.cc:398] Leaking SignalData structure 0x7b08000fbbc0 after lost signal to thread 22925
I20260709 12:19:13.163071 30308 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.163759 30308 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:13.165989 30308 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:13.176916 22865 leader_election.cc:336] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:13.179792 22864 leader_election.cc:336] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.180352 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.181025 30308 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:13.183502 30312 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.184247 30312 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:13.186596 30312 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:13.186802 30289 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.187533 30289 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:13.189885 30289 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:13.195715 22791 leader_election.cc:336] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:13.196062 30303 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
W20260709 12:19:13.196677 22791 leader_election.cc:336] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:13.196730 30303 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:13.198200 30308 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.198817 30308 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:13.199326 30303 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:13.201122 30308 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:13.205269 22790 leader_election.cc:336] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.205839 22790 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.208248 30289 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:19:13.211030 22865 leader_election.cc:336] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:13.212436 22790 leader_election.cc:336] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.214933 22790 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.216102 30303 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:19:13.217661 22790 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:13.218099 22864 leader_election.cc:336] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.229360 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.230355 30308 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:19:13.231062 22791 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:13.231570 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.232383 30303 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:13.249663 30303 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.250257 30303 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:19:13.252175 30303 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:19:13.253641 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:19:13.254622 22900 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 23.
I20260709 12:19:13.256208 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
I20260709 12:19:13.257105 30303 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:19:13.257161 22790 leader_election.cc:336] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.257473 30303 raft_consensus.cc:493] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.257954 30303 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:19:13.270285 30308 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.270668 30303 raft_consensus.cc:515] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:19:13.271057 30308 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:13.273407 30303 leader_election.cc:290] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:19:13.275152 30308 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:13.278604 22900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961a92dd3ac479293a445dd4ee87d3b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:19:13.279309 22900 raft_consensus.cc:3060] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:19:13.279928 22865 leader_election.cc:336] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:13.283070 30308 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.288244 30308 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:13.288816 22900 raft_consensus.cc:2468] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 24.
I20260709 12:19:13.294238 22791 leader_election.cc:304] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: 
W20260709 12:19:13.286113 22864 leader_election.cc:336] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.296717 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.290899 30308 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:13.295558 22865 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:13.299737 30301 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:13.300671 30312 raft_consensus.cc:2804] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:19:13.301270 30312 raft_consensus.cc:697] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 24 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:19:13.302161 30312 consensus_queue.cc:237] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:19:13.307986 18407 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22774)
W20260709 12:19:13.315523 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:19:13.325742 22790 leader_election.cc:336] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.334215 22567 catalog_manager.cc:5697] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 23 to 24, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 24 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:13.339414 22791 consensus_peers.cc:597] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:13.335023 22864 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.341480 22864 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.342345 30308 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:19:13.360786 22791 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:13.384449 22791 consensus_peers.cc:597] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:13.408291 30312 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.408856 30312 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:13.412915 30312 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:13.420539 22790 leader_election.cc:336] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:13.421301 22791 leader_election.cc:336] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:13.421777 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.423345 30312 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:19:13.424435 22865 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:13.443094 22791 consensus_peers.cc:597] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:19:13.501135 30308 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.501668 30308 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:13.503789 30308 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:13.507761 30308 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.509339 30308 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:19:13.509791 22865 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:13.510656 22864 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.511098 22864 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.511844 30311 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:19:13.511554 30308 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:19:13.519522 22864 leader_election.cc:336] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.521545 22821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
I20260709 12:19:13.531157 22865 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.532395 30311 raft_consensus.cc:2749] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:13.552537 22900 raft_consensus.cc:1275] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:19:13.554275 30312 consensus_queue.cc:1048] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:19:13.578588 22790 consensus_peers.cc:597] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.741153 30289 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.741768 30289 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:19:13.748067 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:19:13.749485 22897 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 17.
W20260709 12:19:13.750198 22790 leader_election.cc:336] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.751286 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.752259 30312 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:13.752694 30312 raft_consensus.cc:493] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting leader election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:13.753130 30312 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:13.748737 30289 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:19:13.764256 30312 raft_consensus.cc:515] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
I20260709 12:19:13.769717 22897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fc8b6794ba455388f13d7c3c76e77b" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c"
I20260709 12:19:13.770418 22897 raft_consensus.cc:3060] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:19:13.775662 22790 leader_election.cc:336] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:13.777149 30312 leader_election.cc:290] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Requested vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425)
I20260709 12:19:13.780829 22897 raft_consensus.cc:2468] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd93aceeb0e24bb78d4582d8ad55988d in term 18.
I20260709 12:19:13.782603 22791 leader_election.cc:304] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3a0d56045540b7802937559599f09c, cd93aceeb0e24bb78d4582d8ad55988d; no voters: e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:13.784097 30312 raft_consensus.cc:2804] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:13.784811 30312 raft_consensus.cc:697] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Becoming Leader. State: Replica: cd93aceeb0e24bb78d4582d8ad55988d, State: Running, Role: LEADER
I20260709 12:19:13.785920 30312 consensus_queue.cc:237] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:19:13.789549 22864 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:13.797943 22790 consensus_peers.cc:597] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.811725 22567 catalog_manager.cc:5697] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d reported cstate change: term changed from 17 to 18, leader changed from e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194) to cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195). New cstate: current_term: 18 leader_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:13.822374 22790 consensus_peers.cc:597] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:13.841903 22790 consensus_peers.cc:597] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:13.859175 22897 raft_consensus.cc:1275] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:19:13.860966 30312 consensus_queue.cc:1048] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:19:13.868512 22864 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:13.890551 22864 consensus_peers.cc:597] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:13.915433 22790 consensus_peers.cc:597] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.002498 22790 consensus_peers.cc:597] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.009582 22865 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:19:14.038151 22790 consensus_peers.cc:597] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.040834 22864 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.046733 22864 consensus_peers.cc:597] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.065881 22790 consensus_peers.cc:597] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.080227 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:19:14.151968 22790 consensus_peers.cc:597] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.197539 22790 consensus_peers.cc:597] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:14.198031 22790 consensus_peers.cc:597] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:14.250281 22897 raft_consensus.cc:1275] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Refusing update from remote peer cd93aceeb0e24bb78d4582d8ad55988d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:14.252350 30289 consensus_queue.cc:1048] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:19:14.298125 22790 consensus_peers.cc:597] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.308506 18407 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22774)
W20260709 12:19:14.323819 22790 consensus_peers.cc:597] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.336220 22790 consensus_peers.cc:597] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.386104 22790 consensus_peers.cc:597] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.392608 22790 consensus_peers.cc:597] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.407436 22790 consensus_peers.cc:597] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:14.429039 30289 raft_consensus.cc:493] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:14.429641 30289 raft_consensus.cc:515] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:14.431596 30289 leader_election.cc:290] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:14.436607 22790 leader_election.cc:336] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:14.451788 22864 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:14.529415 30312 raft_consensus.cc:493] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:14.530438 30312 raft_consensus.cc:515] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:14.538932 30312 leader_election.cc:290] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:14.566980 22864 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:14.567278 30311 raft_consensus.cc:493] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:14.587723 30311 raft_consensus.cc:515] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:14.591233 30311 leader_election.cc:290] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:14.702845 30311 raft_consensus.cc:493] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:14.634076 30301 raft_consensus.cc:493] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:14.703810 30301 raft_consensus.cc:515] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:14.706694 30301 leader_election.cc:290] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:14.760597 22865 consensus_peers.cc:597] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:14.766337 30311 raft_consensus.cc:515] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:14.769371 30311 leader_election.cc:290] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:14.773790 30331 raft_consensus.cc:493] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:14.774644 30331 raft_consensus.cc:515] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:14.778061 30331 leader_election.cc:290] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:14.794004 22865 leader_election.cc:336] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:14.808559 22865 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:14.840059 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 61935.1us
I20260709 12:19:15.280925 30335 raft_consensus.cc:493] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.282688 30335 raft_consensus.cc:515] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:15.286211 30335 leader_election.cc:290] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:15.287887 30334 raft_consensus.cc:493] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.288885 30334 raft_consensus.cc:515] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:15.291749 30334 leader_election.cc:290] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:15.302944 22865 leader_election.cc:336] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:15.304375 22865 consensus_peers.cc:597] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:15.305187 22865 leader_election.cc:336] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:15.310247 18407 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 22774)
W20260709 12:19:15.329299 22791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111) [suppressed 459 similar messages]
W20260709 12:19:15.333071 22864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:36669, user_credentials={real_user=slave}} blocked reactor thread for 492121us
I20260709 12:19:15.338876 30337 raft_consensus.cc:493] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.340145 30337 raft_consensus.cc:515] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:15.352607 30331 raft_consensus.cc:493] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.354225 30338 raft_consensus.cc:493] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.354096 30331 raft_consensus.cc:515] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:15.358136 30331 leader_election.cc:290] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:15.355504 30338 raft_consensus.cc:515] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:15.360909 30338 leader_election.cc:290] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:15.364005 30337 leader_election.cc:290] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:15.366011 30335 raft_consensus.cc:493] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.371645 30335 raft_consensus.cc:515] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:15.375454 30335 leader_election.cc:290] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:15.384406 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:19:15.389047 22865 leader_election.cc:336] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:15.389596 22865 leader_election.cc:336] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:15.390064 22865 leader_election.cc:336] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:15.390537 22865 consensus_peers.cc:597] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:19:15.399045 30338 raft_consensus.cc:493] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.400023 30338 raft_consensus.cc:515] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:15.402721 30338 leader_election.cc:290] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:15.403483 30334 raft_consensus.cc:493] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.404362 30334 raft_consensus.cc:515] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:15.406908 30334 leader_election.cc:290] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:15.407167 22865 leader_election.cc:336] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:15.408965 22864 leader_election.cc:336] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.409677 22864 leader_election.cc:304] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.411118 30338 raft_consensus.cc:2749] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:19:15.427119 22864 leader_election.cc:336] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.427935 22864 leader_election.cc:304] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.428952 30336 raft_consensus.cc:493] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.430115 30336 raft_consensus.cc:515] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:15.435333 30336 leader_election.cc:290] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:15.435886 30334 raft_consensus.cc:493] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2c3a0d56045540b7802937559599f09c)
I20260709 12:19:15.437204 30334 raft_consensus.cc:515] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } }
W20260709 12:19:15.438282 22865 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:19:15.429033 30338 raft_consensus.cc:2749] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:19:15.440415 22864 leader_election.cc:336] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.440836 30334 leader_election.cc:290] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2c3a0d56045540b7802937559599f09c (127.17.249.196:37425), a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285)
I20260709 12:19:15.441063 22864 leader_election.cc:304] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:19:15.442929 22864 leader_election.cc:336] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.443414 22864 leader_election.cc:304] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.444303 30331 raft_consensus.cc:2749] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:15.445180 30331 raft_consensus.cc:2749] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:19:15.447896 22864 leader_election.cc:336] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.448400 22864 leader_election.cc:304] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.449359 30338 raft_consensus.cc:2749] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:19:15.450572 22864 leader_election.cc:336] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.451058 22864 leader_election.cc:304] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.452005 30338 raft_consensus.cc:2749] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:15.454878 22864 leader_election.cc:336] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.455370 22864 leader_election.cc:304] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.456257 30338 raft_consensus.cc:2749] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:19:15.464279 22864 leader_election.cc:336] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.464821 22864 leader_election.cc:304] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.465672 30338 raft_consensus.cc:2749] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:19:15.466516 22790 leader_election.cc:336] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:15.468627 22790 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:15.469177 22790 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:15.469624 22790 leader_election.cc:336] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.475819 30333 raft_consensus.cc:493] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.476239 30335 raft_consensus.cc:493] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.477330 30335 raft_consensus.cc:515] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:15.476719 30333 raft_consensus.cc:515] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:15.480217 30335 leader_election.cc:290] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:15.480727 30333 leader_election.cc:290] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
I20260709 12:19:15.495944 30338 raft_consensus.cc:493] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd93aceeb0e24bb78d4582d8ad55988d)
I20260709 12:19:15.497064 30338 raft_consensus.cc:515] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } } peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } }
W20260709 12:19:15.501237 22790 leader_election.cc:336] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.502853 30338 leader_election.cc:290] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669), cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963)
W20260709 12:19:15.509791 22864 leader_election.cc:336] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:15.510727 22790 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:15.514968 22790 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.514639 22827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c64ab5c19940cdb7e24fb2a2c60bd7" candidate_uuid: "2c3a0d56045540b7802937559599f09c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" is_pre_election: true
W20260709 12:19:15.515688 22790 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:15.513900 22791 consensus_peers.cc:597] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:19:15.517172 22865 leader_election.cc:304] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: cd93aceeb0e24bb78d4582d8ad55988d, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.518567 30338 raft_consensus.cc:2749] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:15.519738 30338 raft_consensus.cc:493] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.520362 30338 raft_consensus.cc:515] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
W20260709 12:19:15.520754 22791 leader_election.cc:336] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.521493 22791 leader_election.cc:304] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.523772 30342 raft_consensus.cc:2749] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:15.525175 30338 leader_election.cc:290] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:15.529431 22864 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.529517 22895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e65a9de2bca4c54a85a0988d17f1793" candidate_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2c3a0d56045540b7802937559599f09c" is_pre_election: true
I20260709 12:19:15.533545 30342 raft_consensus.cc:493] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.534379 30342 raft_consensus.cc:515] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } } peers { permanent_uuid: "cd93aceeb0e24bb78d4582d8ad55988d" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 38963 } }
I20260709 12:19:15.538709 30342 leader_election.cc:290] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:15.538834 22791 leader_election.cc:336] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.539443 22791 leader_election.cc:304] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
W20260709 12:19:15.540902 22791 leader_election.cc:336] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.541361 22791 leader_election.cc:304] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.542146 30335 raft_consensus.cc:2749] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:19:15.542332 22791 leader_election.cc:336] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.542980 22791 leader_election.cc:304] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.543037 30335 raft_consensus.cc:2749] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:19:15.543488 22790 leader_election.cc:336] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
W20260709 12:19:15.544054 22791 leader_election.cc:336] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.544082 30335 raft_consensus.cc:2749] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:19:15.544597 22791 leader_election.cc:304] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.545518 30335 raft_consensus.cc:2749] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:19:15.545732 22791 leader_election.cc:336] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.546315 22791 leader_election.cc:304] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.547137 30342 raft_consensus.cc:2749] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:19:15.547374 22791 leader_election.cc:336] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.547803 22791 leader_election.cc:304] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.548631 30342 raft_consensus.cc:2749] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:19:15.550640 22865 leader_election.cc:336] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.554728 22865 leader_election.cc:304] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.555589 30338 raft_consensus.cc:2749] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:19:15.556041 22791 leader_election.cc:336] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.556641 22791 leader_election.cc:304] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: 2c3a0d56045540b7802937559599f09c, a89a4b420ea9496aab55475fc38bb6f7
I20260709 12:19:15.557493 30342 raft_consensus.cc:2749] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:19:15.557691 22791 leader_election.cc:336] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.558238 22791 leader_election.cc:304] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.559070 30342 raft_consensus.cc:2749] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:19:15.559278 22791 leader_election.cc:336] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.559798 22791 leader_election.cc:304] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.560706 30342 raft_consensus.cc:2749] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:19:15.563898 22791 leader_election.cc:336] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
I20260709 12:19:15.564388 22791 leader_election.cc:304] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd93aceeb0e24bb78d4582d8ad55988d; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.565200 30342 raft_consensus.cc:2749] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:19:15.684209 18407 tablet_server.cc:196] TabletServer@127.17.249.194:0 shutdown complete.
I20260709 12:19:15.713725 30338 raft_consensus.cc:493] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e5f99cf1fbc740e3895959adc4f3d10e)
I20260709 12:19:15.714668 30338 raft_consensus.cc:515] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3a0d56045540b7802937559599f09c" member_type: VOTER last_known_addr { host: "127.17.249.196" port: 37425 } } peers { permanent_uuid: "a89a4b420ea9496aab55475fc38bb6f7" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 33285 } } peers { permanent_uuid: "e5f99cf1fbc740e3895959adc4f3d10e" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36669 } }
I20260709 12:19:15.717607 30338 leader_election.cc:290] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285), e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669)
W20260709 12:19:15.725215 22865 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111)
W20260709 12:19:15.725801 22864 leader_election.cc:336] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111)
I20260709 12:19:15.726282 22864 leader_election.cc:304] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3a0d56045540b7802937559599f09c; no voters: a89a4b420ea9496aab55475fc38bb6f7, e5f99cf1fbc740e3895959adc4f3d10e
I20260709 12:19:15.727043 30338 raft_consensus.cc:2749] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:19:15.741592 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:19:15.772837 22791 consensus_peers.cc:597] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:19:15.881316 18407 tablet_server.cc:179] TabletServer@127.17.249.195:0 shutting down...
W20260709 12:19:15.902743 22865 consensus_peers.cc:597] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.931869 22865 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.938989 22865 consensus_peers.cc:597] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.967859 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:15.970145 18407 tablet_replica.cc:333] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:15.971562 18407 raft_consensus.cc:2243] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.972988 18407 raft_consensus.cc:2272] T 599b298e84934cc4969ad7fa2b906b26 P cd93aceeb0e24bb78d4582d8ad55988d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.975613 18407 tablet_replica.cc:333] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:15.976379 18407 raft_consensus.cc:2243] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.977056 18407 raft_consensus.cc:2272] T bd458323e9194286800a7f592094802c P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.980460 18407 tablet_replica.cc:333] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:15.981263 18407 raft_consensus.cc:2243] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.982530 18407 raft_consensus.cc:2272] T 5444065d09a34471bca8963724a74d20 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.984890 18407 tablet_replica.cc:333] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:15.985574 18407 raft_consensus.cc:2243] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.986034 18407 raft_consensus.cc:2272] T 22ef3fae5db64ba8b0eae0ce76950f51 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.988332 18407 tablet_replica.cc:333] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:15.989015 18407 raft_consensus.cc:2243] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.990105 18407 raft_consensus.cc:2272] T 3ba57a7932934f629e6ed95148994535 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.993623 18407 tablet_replica.cc:333] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:15.994580 18407 raft_consensus.cc:2243] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.996093 18407 raft_consensus.cc:2272] T b6ff1852979a471a8510052b7ba98faa P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.998895 18407 tablet_replica.cc:333] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:15.999648 18407 raft_consensus.cc:2243] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.000623 18407 raft_consensus.cc:2272] T aaa4164beb3941b2bc2f8a103ac0e7fb P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.002939 18407 tablet_replica.cc:333] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.003584 18407 raft_consensus.cc:2243] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.004541 18407 raft_consensus.cc:2272] T 91b331b9ec19453b8cd59bd6d61760dd P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.007125 18407 tablet_replica.cc:333] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.007810 18407 raft_consensus.cc:2243] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.008695 18407 raft_consensus.cc:2272] T c25dfc24830b430e89a2abbfffe374ea P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.011821 18407 tablet_replica.cc:333] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.012674 18407 raft_consensus.cc:2243] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.013430 18407 raft_consensus.cc:2272] T c98b51f118bc481dbf774ac4738c9617 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.015902 18407 tablet_replica.cc:333] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.016480 18407 raft_consensus.cc:2243] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.017498 18407 raft_consensus.cc:2272] T 53fc67a4479240b383ece839d37b7b58 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.020772 18407 tablet_replica.cc:333] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.021502 18407 raft_consensus.cc:2243] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.022326 18407 raft_consensus.cc:2272] T 58484c2487d844518eb11323635fc3c0 P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.024703 18407 tablet_replica.cc:333] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.025336 18407 raft_consensus.cc:2243] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.026257 18407 raft_consensus.cc:2272] T ba50a8d617df425cbc405952d1742265 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.028806 18407 tablet_replica.cc:333] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.029410 18407 raft_consensus.cc:2243] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.029917 18407 raft_consensus.cc:2272] T 9c2300ccd50e4d7c9ff19678d7e2519a P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.032471 18407 tablet_replica.cc:333] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.033269 18407 raft_consensus.cc:2243] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.034600 18407 raft_consensus.cc:2272] T 87de87ebaff74d67abf876d88dc7a0e7 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.037822 18407 tablet_replica.cc:333] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.038532 18407 raft_consensus.cc:2243] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.039738 18407 raft_consensus.cc:2272] T 2f5c847d65ef47b0b14af4905d5a5fdb P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.042388 18407 tablet_replica.cc:333] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.043156 18407 raft_consensus.cc:2243] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.043808 18407 raft_consensus.cc:2272] T 17a6be884c6d4eeabbf042ccacf06ef6 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.046361 18407 tablet_replica.cc:333] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.047880 18407 raft_consensus.cc:2243] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.048529 18407 raft_consensus.cc:2272] T 7f3c57ac6e684973929b4e77a428cb1e P cd93aceeb0e24bb78d4582d8ad55988d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.051376 18407 tablet_replica.cc:333] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.052044 18407 raft_consensus.cc:2243] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.053231 18407 raft_consensus.cc:2272] T e8b793d48d6b4e5db13d9e6811d51310 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.055572 18407 tablet_replica.cc:333] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.056203 18407 raft_consensus.cc:2243] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.057148 18407 raft_consensus.cc:2272] T 7e28930436db4beaabf3941f9b136f22 P cd93aceeb0e24bb78d4582d8ad55988d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.059333 18407 tablet_replica.cc:333] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.060210 18407 raft_consensus.cc:2243] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.061419 18407 raft_consensus.cc:2272] T a7fc8b6794ba455388f13d7c3c76e77b P cd93aceeb0e24bb78d4582d8ad55988d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.064793 18407 tablet_replica.cc:333] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.065689 18407 raft_consensus.cc:2243] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.066434 18407 raft_consensus.cc:2272] T d65fa6d7d4a74fa3bf4c3beda5687094 P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:16.067576 22791 consensus_peers.cc:597] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:19:16.069444 18407 tablet_replica.cc:333] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.070065 18407 raft_consensus.cc:2243] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.071075 18407 raft_consensus.cc:2272] T 19a3e6a508714389b60c10fd4363972c P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.073289 18407 tablet_replica.cc:333] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.073781 18407 raft_consensus.cc:2243] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.075098 18407 raft_consensus.cc:2272] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.077579 18407 tablet_replica.cc:333] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.078234 18407 raft_consensus.cc:2243] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.079545 18407 raft_consensus.cc:2272] T a35aee871f0b41e48335c0260a873076 P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.082123 18407 tablet_replica.cc:333] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.082734 18407 raft_consensus.cc:2243] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.083649 18407 raft_consensus.cc:2272] T af9dd2cd94724707b7aafa424c43031d P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.085897 18407 tablet_replica.cc:333] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.087160 18407 raft_consensus.cc:2243] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.087862 18407 raft_consensus.cc:2272] T e2718d64abf84eb5b425ac4d5bd7217e P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.090269 18407 tablet_replica.cc:333] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.091112 18407 raft_consensus.cc:2243] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.092088 18407 raft_consensus.cc:2272] T 5085cb71870c4e7782244635c250487e P cd93aceeb0e24bb78d4582d8ad55988d [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:16.093102 22791 consensus_peers.cc:597] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:16.095383 18407 tablet_replica.cc:333] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.096333 18407 raft_consensus.cc:2243] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.098227 18407 raft_consensus.cc:2272] T 2961a92dd3ac479293a445dd4ee87d3b P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.101437 18407 tablet_replica.cc:333] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.102226 18407 raft_consensus.cc:2243] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.103482 18407 raft_consensus.cc:2272] T a655a30b57d84c3da5e562990d01f8fe P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.105827 18407 tablet_replica.cc:333] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.106443 18407 raft_consensus.cc:2243] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.107056 18407 raft_consensus.cc:2272] T d360a1924d3c4721bf24cc5f0f17a90b P cd93aceeb0e24bb78d4582d8ad55988d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.109975 18407 tablet_replica.cc:333] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.110523 18407 raft_consensus.cc:2243] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.111549 18407 raft_consensus.cc:2272] T dcb4cae1a1914d1a94e203f082ef12e5 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.113899 18407 tablet_replica.cc:333] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.114444 18407 raft_consensus.cc:2243] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.115608 18407 raft_consensus.cc:2272] T 600c0eed9d234060b395482bb7c21cb8 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.117960 18407 tablet_replica.cc:333] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.118498 18407 raft_consensus.cc:2243] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.119007 18407 raft_consensus.cc:2272] T 50b97aee66fb461a98eb4b2f92bb3c53 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.121033 18407 tablet_replica.cc:333] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.121594 18407 raft_consensus.cc:2243] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.122545 18407 raft_consensus.cc:2272] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.124657 18407 tablet_replica.cc:333] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.125197 18407 raft_consensus.cc:2243] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.126385 18407 raft_consensus.cc:2272] T 036d0d4c85cb4c92bbe5eff5c95a2441 P cd93aceeb0e24bb78d4582d8ad55988d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.128834 18407 tablet_replica.cc:333] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.129383 18407 raft_consensus.cc:2243] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.130322 18407 raft_consensus.cc:2272] T 76cb1231be0940089338c6aeb27ce69f P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.132642 18407 tablet_replica.cc:333] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.133231 18407 raft_consensus.cc:2243] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.133793 18407 raft_consensus.cc:2272] T 4cb67a71a0954b2bab724a9e4399cf13 P cd93aceeb0e24bb78d4582d8ad55988d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.136557 18407 tablet_replica.cc:333] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.137214 18407 raft_consensus.cc:2243] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.137823 18407 raft_consensus.cc:2272] T a59fd6638f4a4b539acee7e61d0a1e9c P cd93aceeb0e24bb78d4582d8ad55988d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.140018 18407 tablet_replica.cc:333] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.140590 18407 raft_consensus.cc:2243] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.141484 18407 raft_consensus.cc:2272] T fb26ab285f3946aaa4009cfc56fb98fc P cd93aceeb0e24bb78d4582d8ad55988d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.143772 18407 tablet_replica.cc:333] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.144344 18407 raft_consensus.cc:2243] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.144873 18407 raft_consensus.cc:2272] T 0e65a9de2bca4c54a85a0988d17f1793 P cd93aceeb0e24bb78d4582d8ad55988d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.147320 18407 tablet_replica.cc:333] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.147866 18407 raft_consensus.cc:2243] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.149183 18407 raft_consensus.cc:2272] T a7ff31dcb5814f3c8cae392bb13ee152 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.151307 18407 tablet_replica.cc:333] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.151820 18407 raft_consensus.cc:2243] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.152688 18407 raft_consensus.cc:2272] T 7e5e2a8f5b814b18a53ee5c8af767da0 P cd93aceeb0e24bb78d4582d8ad55988d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.154768 18407 tablet_replica.cc:333] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d: stopping tablet replica
I20260709 12:19:16.155283 18407 raft_consensus.cc:2243] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.156131 18407 raft_consensus.cc:2272] T c887310d0efc43dbb01d55c7f99ff9a3 P cd93aceeb0e24bb78d4582d8ad55988d [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:16.193096 22865 consensus_peers.cc:597] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:16.223558 22922 debug-util.cc:398] Leaking SignalData structure 0x7b080022e1a0 after lost signal to thread 18410
W20260709 12:19:16.225971 22922 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1f20 after lost signal to thread 22610
W20260709 12:19:16.229007 22922 debug-util.cc:398] Leaking SignalData structure 0x7b08002ced00 after lost signal to thread 22851
W20260709 12:19:16.231202 22922 debug-util.cc:398] Leaking SignalData structure 0x7b08001628a0 after lost signal to thread 22925
W20260709 12:19:16.247639 22865 consensus_peers.cc:597] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.195:38963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:16.388361 22865 consensus_peers.cc:597] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:19:16.422922 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:19:16.443554 22865 consensus_peers.cc:597] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.195:38963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:16.465427 22865 consensus_peers.cc:597] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c -> Peer cd93aceeb0e24bb78d4582d8ad55988d (127.17.249.195:38963): Couldn't send request to peer cd93aceeb0e24bb78d4582d8ad55988d. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.195:38963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:16.484881 22864 consensus_peers.cc:597] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:16.696317 18407 tablet_server.cc:196] TabletServer@127.17.249.195:0 shutdown complete.
I20260709 12:19:16.815645 18407 tablet_server.cc:179] TabletServer@127.17.249.196:0 shutting down...
W20260709 12:19:16.856020 22864 consensus_peers.cc:597] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:16.864827 22864 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:16.877328 22864 consensus_peers.cc:597] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:16.888872 22865 consensus_peers.cc:597] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c -> Peer a89a4b420ea9496aab55475fc38bb6f7 (127.17.249.193:33285): Couldn't send request to peer a89a4b420ea9496aab55475fc38bb6f7. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:33285: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:19:16.915992 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:16.917275 18407 tablet_replica.cc:333] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.918404 18407 raft_consensus.cc:2243] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.919399 18407 raft_consensus.cc:2272] T 599b298e84934cc4969ad7fa2b906b26 P 2c3a0d56045540b7802937559599f09c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.923024 18407 tablet_replica.cc:333] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.923969 18407 raft_consensus.cc:2243] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.925308 18407 raft_consensus.cc:2272] T c267ff17b26d4fd08c09792a0ccb9b43 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.928768 18407 tablet_replica.cc:333] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.929669 18407 raft_consensus.cc:2243] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.930507 18407 raft_consensus.cc:2272] T 5444065d09a34471bca8963724a74d20 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.933689 18407 tablet_replica.cc:333] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.934564 18407 raft_consensus.cc:2243] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.935868 18407 raft_consensus.cc:2272] T 22ef3fae5db64ba8b0eae0ce76950f51 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.939319 18407 tablet_replica.cc:333] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.940196 18407 raft_consensus.cc:2243] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.941769 18407 raft_consensus.cc:2272] T f50db8803bc44d8eaab7195399b5ec5f P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.945060 18407 tablet_replica.cc:333] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.946043 18407 raft_consensus.cc:2243] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.947067 18407 raft_consensus.cc:2272] T 34c64ab5c19940cdb7e24fb2a2c60bd7 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.950362 18407 tablet_replica.cc:333] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.951357 18407 raft_consensus.cc:2243] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.952061 18407 raft_consensus.cc:2272] T 6d52bb84350d4c4ebd55acd59d333846 P 2c3a0d56045540b7802937559599f09c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.955544 18407 tablet_replica.cc:333] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.956465 18407 raft_consensus.cc:2243] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.957181 18407 raft_consensus.cc:2272] T fca29e0a7a6342a2b2f2088587de1246 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.960525 18407 tablet_replica.cc:333] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.961414 18407 raft_consensus.cc:2243] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.962102 18407 raft_consensus.cc:2272] T 91b331b9ec19453b8cd59bd6d61760dd P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.965354 18407 tablet_replica.cc:333] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.966190 18407 raft_consensus.cc:2243] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.967226 18407 raft_consensus.cc:2272] T 53fc67a4479240b383ece839d37b7b58 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.970463 18407 tablet_replica.cc:333] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.971478 18407 raft_consensus.cc:2243] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.973003 18407 raft_consensus.cc:2272] T c25dfc24830b430e89a2abbfffe374ea P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.976197 18407 tablet_replica.cc:333] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.977097 18407 raft_consensus.cc:2243] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.977792 18407 raft_consensus.cc:2272] T 4af65e8169664ec2afee890830d185cf P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.981021 18407 tablet_replica.cc:333] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.981940 18407 raft_consensus.cc:2243] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.982569 18407 raft_consensus.cc:2272] T ba50a8d617df425cbc405952d1742265 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.985678 18407 tablet_replica.cc:333] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.986550 18407 raft_consensus.cc:2243] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.987248 18407 raft_consensus.cc:2272] T e8b793d48d6b4e5db13d9e6811d51310 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.990247 18407 tablet_replica.cc:333] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.991086 18407 raft_consensus.cc:2243] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.992477 18407 raft_consensus.cc:2272] T c11f2301e6294b5ab1244e4784694274 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.996074 18407 tablet_replica.cc:333] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:16.996969 18407 raft_consensus.cc:2243] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.997754 18407 raft_consensus.cc:2272] T a2d5308b787c474aa407e2d08bb254b9 P 2c3a0d56045540b7802937559599f09c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.001003 18407 tablet_replica.cc:333] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.001917 18407 raft_consensus.cc:2243] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.002948 18407 raft_consensus.cc:2272] T 7e28930436db4beaabf3941f9b136f22 P 2c3a0d56045540b7802937559599f09c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.005982 18407 tablet_replica.cc:333] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.006865 18407 raft_consensus.cc:2243] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.007668 18407 raft_consensus.cc:2272] T a7fc8b6794ba455388f13d7c3c76e77b P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.010558 18407 tablet_replica.cc:333] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.011425 18407 raft_consensus.cc:2243] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.012378 18407 raft_consensus.cc:2272] T 19a3e6a508714389b60c10fd4363972c P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.015784 18407 tablet_replica.cc:333] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.016651 18407 raft_consensus.cc:2243] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.017439 18407 raft_consensus.cc:2272] T 2d3f073d198a4fd3a66aeb940d0b5ab1 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.020843 18407 tablet_replica.cc:333] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.021790 18407 raft_consensus.cc:2243] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.023084 18407 raft_consensus.cc:2272] T e2718d64abf84eb5b425ac4d5bd7217e P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.026225 18407 tablet_replica.cc:333] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.027221 18407 raft_consensus.cc:2243] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.028755 18407 raft_consensus.cc:2272] T 5085cb71870c4e7782244635c250487e P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.032393 18407 tablet_replica.cc:333] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.033398 18407 raft_consensus.cc:2243] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.034184 18407 raft_consensus.cc:2272] T af9dd2cd94724707b7aafa424c43031d P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.037437 18407 tablet_replica.cc:333] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.038282 18407 raft_consensus.cc:2243] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.039139 18407 raft_consensus.cc:2272] T a35aee871f0b41e48335c0260a873076 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.042344 18407 tablet_replica.cc:333] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.043174 18407 raft_consensus.cc:2243] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.043855 18407 raft_consensus.cc:2272] T 44cb46cd92c346879a120a3d3b95561a P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.046975 18407 tablet_replica.cc:333] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.047781 18407 raft_consensus.cc:2243] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.048436 18407 raft_consensus.cc:2272] T 76cb1231be0940089338c6aeb27ce69f P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.051595 18407 tablet_replica.cc:333] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.052479 18407 raft_consensus.cc:2243] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.053188 18407 raft_consensus.cc:2272] T dcb4cae1a1914d1a94e203f082ef12e5 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.056309 18407 tablet_replica.cc:333] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.057158 18407 raft_consensus.cc:2243] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.057906 18407 raft_consensus.cc:2272] T 790207f3e8474996938608fcdf438660 P 2c3a0d56045540b7802937559599f09c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.061146 18407 tablet_replica.cc:333] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.062001 18407 raft_consensus.cc:2243] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.062749 18407 raft_consensus.cc:2272] T 3c0e2e48cbc740c0a7fad7f513017008 P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.066274 18407 tablet_replica.cc:333] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.067148 18407 raft_consensus.cc:2243] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.067999 18407 raft_consensus.cc:2272] T 600c0eed9d234060b395482bb7c21cb8 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:17.069280 22864 consensus_peers.cc:597] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c -> Peer e5f99cf1fbc740e3895959adc4f3d10e (127.17.249.194:36669): Couldn't send request to peer e5f99cf1fbc740e3895959adc4f3d10e. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:17.071170 18407 tablet_replica.cc:333] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.072144 18407 raft_consensus.cc:2243] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.073787 18407 raft_consensus.cc:2272] T 0e65a9de2bca4c54a85a0988d17f1793 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.077071 18407 tablet_replica.cc:333] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.077921 18407 raft_consensus.cc:2243] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.078524 18407 raft_consensus.cc:2272] T a7ff31dcb5814f3c8cae392bb13ee152 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.081452 18407 tablet_replica.cc:333] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.082259 18407 raft_consensus.cc:2243] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.083843 18407 raft_consensus.cc:2272] T 7e5e2a8f5b814b18a53ee5c8af767da0 P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.087073 18407 tablet_replica.cc:333] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.087947 18407 raft_consensus.cc:2243] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.088631 18407 raft_consensus.cc:2272] T ab94770ad5c445e6bfb4a7fdd20ca0f2 P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.091988 18407 tablet_replica.cc:333] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.092873 18407 raft_consensus.cc:2243] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.094172 18407 raft_consensus.cc:2272] T 6c4b3aaf1b5e494ca5ea0e6f05bdf52b P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.097157 18407 tablet_replica.cc:333] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.098013 18407 raft_consensus.cc:2243] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.099397 18407 raft_consensus.cc:2272] T 4dd506104b9c45169fdf473e38bd2352 P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.102344 18407 tablet_replica.cc:333] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.103231 18407 raft_consensus.cc:2243] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.104547 18407 raft_consensus.cc:2272] T 50b97aee66fb461a98eb4b2f92bb3c53 P 2c3a0d56045540b7802937559599f09c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.107746 18407 tablet_replica.cc:333] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.108551 18407 raft_consensus.cc:2243] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.109712 18407 raft_consensus.cc:2272] T a59fd6638f4a4b539acee7e61d0a1e9c P 2c3a0d56045540b7802937559599f09c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.112895 18407 tablet_replica.cc:333] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.113780 18407 raft_consensus.cc:2243] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.114532 18407 raft_consensus.cc:2272] T aaa4164beb3941b2bc2f8a103ac0e7fb P 2c3a0d56045540b7802937559599f09c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.117771 18407 tablet_replica.cc:333] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.118584 18407 raft_consensus.cc:2243] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.119264 18407 raft_consensus.cc:2272] T b5e170feadac4d27875b0a4c85b6d329 P 2c3a0d56045540b7802937559599f09c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.122527 18407 tablet_replica.cc:333] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.123417 18407 raft_consensus.cc:2243] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.124208 18407 raft_consensus.cc:2272] T 2961a92dd3ac479293a445dd4ee87d3b P 2c3a0d56045540b7802937559599f09c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.127749 18407 tablet_replica.cc:333] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.128634 18407 raft_consensus.cc:2243] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.129393 18407 raft_consensus.cc:2272] T a655a30b57d84c3da5e562990d01f8fe P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.132798 18407 tablet_replica.cc:333] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.133637 18407 raft_consensus.cc:2243] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.134532 18407 raft_consensus.cc:2272] T c2f844c714924331b8be9b262fed0ddf P 2c3a0d56045540b7802937559599f09c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.137801 18407 tablet_replica.cc:333] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c: stopping tablet replica
I20260709 12:19:17.138583 18407 raft_consensus.cc:2243] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:17.139375 18407 raft_consensus.cc:2272] T c887310d0efc43dbb01d55c7f99ff9a3 P 2c3a0d56045540b7802937559599f09c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.556859 18407 tablet_server.cc:196] TabletServer@127.17.249.196:0 shutdown complete.
I20260709 12:19:17.638957 18407 master.cc:562] Master@127.17.249.254:41671 shutting down...
I20260709 12:19:17.680572 18407 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:17.681461 18407 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:17.681849 18407 tablet_replica.cc:333] T 00000000000000000000000000000000 P cca02bb097e24340a2d738fc4f06877d: stopping tablet replica
I20260709 12:19:17.893328 18407 master.cc:584] Master@127.17.249.254:41671 shutdown complete.
I20260709 12:19:17.944983 18407 test_util.cc:182] -----------------------------------------------
I20260709 12:19:17.945242 18407 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599138854584-18407-0
[  FAILED  ] LeaderRebalancerTest.RestartTserver (233090 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:19:17.948734 18407 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.249.254:32831
I20260709 12:19:17.949959 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:17.957104 30346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:17.957284 30347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:17.958149 30349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:17.958438 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:17.963795 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:17.964107 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:17.964259 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599557964245 us; error 0 us; skew 500 ppm
I20260709 12:19:17.964937 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:17.971840 18407 webserver.cc:533] Webserver started at http://127.17.249.254:46095/ using document root <none> and password file <none>
I20260709 12:19:17.972517 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:17.972759 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:17.973119 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:17.974634 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/master-0-root/instance:
uuid: "200c4f2a3ee0413a982a75d88fb91f26"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-7mcn"
I20260709 12:19:17.979547 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:17.983354 30354 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:17.984252 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:19:17.984663 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/master-0-root
uuid: "200c4f2a3ee0413a982a75d88fb91f26"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-7mcn"
I20260709 12:19:17.984988 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:18.003566 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:18.004827 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:18.050474 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.254:32831
I20260709 12:19:18.050659 30405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.254:32831 every 8 connection(s)
I20260709 12:19:18.055388 30406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.068334 30406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26: Bootstrap starting.
I20260709 12:19:18.074314 30406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.079512 30406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26: No bootstrap required, opened a new log
I20260709 12:19:18.082161 30406 raft_consensus.cc:359] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200c4f2a3ee0413a982a75d88fb91f26" member_type: VOTER }
I20260709 12:19:18.082629 30406 raft_consensus.cc:385] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.082913 30406 raft_consensus.cc:740] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200c4f2a3ee0413a982a75d88fb91f26, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.083600 30406 consensus_queue.cc:260] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200c4f2a3ee0413a982a75d88fb91f26" member_type: VOTER }
I20260709 12:19:18.084113 30406 raft_consensus.cc:399] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:18.084368 30406 raft_consensus.cc:493] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:18.084643 30406 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:18.090516 30406 raft_consensus.cc:515] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200c4f2a3ee0413a982a75d88fb91f26" member_type: VOTER }
I20260709 12:19:18.091209 30406 leader_election.cc:304] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 200c4f2a3ee0413a982a75d88fb91f26; no voters: 
I20260709 12:19:18.092684 30406 leader_election.cc:290] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:18.093353 30409 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:18.094980 30409 raft_consensus.cc:697] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [term 1 LEADER]: Becoming Leader. State: Replica: 200c4f2a3ee0413a982a75d88fb91f26, State: Running, Role: LEADER
I20260709 12:19:18.095762 30409 consensus_queue.cc:237] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200c4f2a3ee0413a982a75d88fb91f26" member_type: VOTER }
I20260709 12:19:18.096285 30406 sys_catalog.cc:565] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:18.100430 30410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "200c4f2a3ee0413a982a75d88fb91f26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200c4f2a3ee0413a982a75d88fb91f26" member_type: VOTER } }
I20260709 12:19:18.101230 30410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:18.100442 30411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 200c4f2a3ee0413a982a75d88fb91f26. Latest consensus state: current_term: 1 leader_uuid: "200c4f2a3ee0413a982a75d88fb91f26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200c4f2a3ee0413a982a75d88fb91f26" member_type: VOTER } }
I20260709 12:19:18.102030 30411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:18.104079 30416 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:18.113138 30416 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:18.118176 18407 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:18.125969 30416 catalog_manager.cc:1383] Generated new cluster ID: 8459336d29604caa9850825bc3d03f3a
I20260709 12:19:18.126354 30416 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:18.162088 30416 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:18.163647 30416 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:18.182487 30416 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26: Generated new TSK 0
I20260709 12:19:18.183233 30416 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:18.250443 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:18.258424 30427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:18.259941 30428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:18.261161 30430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:18.262717 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:18.265288 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:18.265520 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:18.265748 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599558265728 us; error 0 us; skew 500 ppm
I20260709 12:19:18.266396 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:18.269667 18407 webserver.cc:533] Webserver started at http://127.17.249.193:37243/ using document root <none> and password file <none>
I20260709 12:19:18.270262 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:18.270463 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:18.270874 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:18.272323 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-0-root/instance:
uuid: "fa21b1e7fa9948b584063d07e890ba90"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-7mcn"
I20260709 12:19:18.277966 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:19:18.282233 30435 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.283320 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:19:18.283725 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-0-root
uuid: "fa21b1e7fa9948b584063d07e890ba90"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-7mcn"
I20260709 12:19:18.284106 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:18.302488 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:18.303763 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:18.305461 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:18.308228 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:18.308426 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.308735 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:18.308928 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.359496 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.193:41967
I20260709 12:19:18.359670 30497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.193:41967 every 8 connection(s)
I20260709 12:19:18.366333 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:18.374709 30502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:18.375648 30503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:18.378849 30505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:18.379288 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:18.382117 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:18.382364 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:18.382603 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599558382586 us; error 0 us; skew 500 ppm
I20260709 12:19:18.383359 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:18.386436 18407 webserver.cc:533] Webserver started at http://127.17.249.194:45823/ using document root <none> and password file <none>
I20260709 12:19:18.387120 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:18.387322 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:18.387570 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:18.388827 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-1-root/instance:
uuid: "5116278a04214646817d79ecd9e626d8"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-7mcn"
I20260709 12:19:18.395584 30498 heartbeater.cc:344] Connected to a master server at 127.17.249.254:32831
I20260709 12:19:18.395661 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:19:18.396176 30498 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:18.397083 30498 heartbeater.cc:507] Master 127.17.249.254:32831 requested a full tablet report, sending...
I20260709 12:19:18.399964 30371 ts_manager.cc:194] Registered new tserver with Master: fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967)
I20260709 12:19:18.401149 30510 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.402379 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:19:18.402854 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-1-root
uuid: "5116278a04214646817d79ecd9e626d8"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-7mcn"
I20260709 12:19:18.402902 30371 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57766
I20260709 12:19:18.403348 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:18.431181 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:18.432669 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:18.434433 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:18.437248 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:18.437464 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.437847 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:18.438032 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.488615 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.194:36775
I20260709 12:19:18.488864 30572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.194:36775 every 8 connection(s)
I20260709 12:19:18.494279 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:18.502156 30576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:18.504518 30577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:18.508178 30579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:18.508419 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:18.510180 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:19:18.510241 30573 heartbeater.cc:344] Connected to a master server at 127.17.249.254:32831
W20260709 12:19:18.510602 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:18.510852 30573 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:18.510923 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599558510905 us; error 0 us; skew 500 ppm
I20260709 12:19:18.511833 30573 heartbeater.cc:507] Master 127.17.249.254:32831 requested a full tablet report, sending...
I20260709 12:19:18.511929 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:18.514782 30371 ts_manager.cc:194] Registered new tserver with Master: 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:18.515383 18407 webserver.cc:533] Webserver started at http://127.17.249.195:36689/ using document root <none> and password file <none>
I20260709 12:19:18.516021 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:18.516218 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:18.516510 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:18.516748 30371 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57778
I20260709 12:19:18.517721 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-2-root/instance:
uuid: "bc523387ced844c1beb7d8ce3bc03900"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-7mcn"
I20260709 12:19:18.523164 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:19:18.527242 30584 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.528362 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:19:18.528694 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-2-root
uuid: "bc523387ced844c1beb7d8ce3bc03900"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-7mcn"
I20260709 12:19:18.528976 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:18.553064 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:18.554297 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:18.555999 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:18.558414 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:18.558641 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.558961 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:18.559118 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.612978 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.195:35199
I20260709 12:19:18.613098 30646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.195:35199 every 8 connection(s)
I20260709 12:19:18.629544 30647 heartbeater.cc:344] Connected to a master server at 127.17.249.254:32831
I20260709 12:19:18.629945 30647 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:18.630877 30647 heartbeater.cc:507] Master 127.17.249.254:32831 requested a full tablet report, sending...
I20260709 12:19:18.633394 30371 ts_manager.cc:194] Registered new tserver with Master: bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:18.634262 18407 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017428769s
I20260709 12:19:18.635524 30371 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57786
I20260709 12:19:18.665835 30371 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57794:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:18.669258 30371 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:18.768201 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc62116945f494d83fd7480db664b41 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:18.769989 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc62116945f494d83fd7480db664b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.771500 30459 tablet_service.cc:1511] Processing CreateTablet for tablet 0c5d8b6d4c8a495e81eac9f3e5094a9e (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:18.771736 30462 tablet_service.cc:1511] Processing CreateTablet for tablet 159722b4e9d5438ebb8db37486c9546e (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:18.773483 30460 tablet_service.cc:1511] Processing CreateTablet for tablet daed3c44d1a242bfa9c852c047babec4 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:18.775154 30460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daed3c44d1a242bfa9c852c047babec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.777135 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5d8b6d4c8a495e81eac9f3e5094a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.778533 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159722b4e9d5438ebb8db37486c9546e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.769577 30461 tablet_service.cc:1511] Processing CreateTablet for tablet d6574f545d074bf0a8fe4425bbc9361e (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:18.780766 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6574f545d074bf0a8fe4425bbc9361e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.783725 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 38ca05e3138b4065902af82e9d0f6d5b (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:18.785725 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ca05e3138b4065902af82e9d0f6d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.783651 30537 tablet_service.cc:1511] Processing CreateTablet for tablet 159722b4e9d5438ebb8db37486c9546e (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:18.788754 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159722b4e9d5438ebb8db37486c9546e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.782194 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc62116945f494d83fd7480db664b41 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:18.791690 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc62116945f494d83fd7480db664b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.799957 30536 tablet_service.cc:1511] Processing CreateTablet for tablet d6574f545d074bf0a8fe4425bbc9361e (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:18.802099 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6574f545d074bf0a8fe4425bbc9361e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.804554 30535 tablet_service.cc:1511] Processing CreateTablet for tablet daed3c44d1a242bfa9c852c047babec4 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:18.806561 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daed3c44d1a242bfa9c852c047babec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.808455 30534 tablet_service.cc:1511] Processing CreateTablet for tablet 0c5d8b6d4c8a495e81eac9f3e5094a9e (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:18.814914 30534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5d8b6d4c8a495e81eac9f3e5094a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.811529 30533 tablet_service.cc:1511] Processing CreateTablet for tablet 38ca05e3138b4065902af82e9d0f6d5b (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:18.816779 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ca05e3138b4065902af82e9d0f6d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.835422 30457 tablet_service.cc:1511] Processing CreateTablet for tablet bf9ef2c236474d5e9f324f7b298e26f9 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:18.836951 30532 tablet_service.cc:1511] Processing CreateTablet for tablet bf9ef2c236474d5e9f324f7b298e26f9 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:18.838721 30456 tablet_service.cc:1511] Processing CreateTablet for tablet 528787a1f4894df08e46c6466f5d90d9 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:18.839882 30531 tablet_service.cc:1511] Processing CreateTablet for tablet 528787a1f4894df08e46c6466f5d90d9 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:18.842877 30455 tablet_service.cc:1511] Processing CreateTablet for tablet 257789f1397f490198e7b402b8406ccb (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:18.844321 30529 tablet_service.cc:1511] Processing CreateTablet for tablet 4a17b29e162e4760bc83b9cca1c54f3d (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:18.842505 30530 tablet_service.cc:1511] Processing CreateTablet for tablet 257789f1397f490198e7b402b8406ccb (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:18.837044 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9ef2c236474d5e9f324f7b298e26f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.848270 30454 tablet_service.cc:1511] Processing CreateTablet for tablet 4a17b29e162e4760bc83b9cca1c54f3d (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:18.849766 30454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a17b29e162e4760bc83b9cca1c54f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.851516 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9ef2c236474d5e9f324f7b298e26f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.855201 30455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257789f1397f490198e7b402b8406ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.855345 30531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528787a1f4894df08e46c6466f5d90d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.858587 30529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a17b29e162e4760bc83b9cca1c54f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.859302 30456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528787a1f4894df08e46c6466f5d90d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.861050 30530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257789f1397f490198e7b402b8406ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.872578 30611 tablet_service.cc:1511] Processing CreateTablet for tablet 159722b4e9d5438ebb8db37486c9546e (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:18.874744 30611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159722b4e9d5438ebb8db37486c9546e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.884739 30607 tablet_service.cc:1511] Processing CreateTablet for tablet 38ca05e3138b4065902af82e9d0f6d5b (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:18.889055 30607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ca05e3138b4065902af82e9d0f6d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.880398 30609 tablet_service.cc:1511] Processing CreateTablet for tablet daed3c44d1a242bfa9c852c047babec4 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:18.882513 30608 tablet_service.cc:1511] Processing CreateTablet for tablet 0c5d8b6d4c8a495e81eac9f3e5094a9e (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:18.878261 30612 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc62116945f494d83fd7480db664b41 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:18.900570 30606 tablet_service.cc:1511] Processing CreateTablet for tablet bf9ef2c236474d5e9f324f7b298e26f9 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:18.876665 30610 tablet_service.cc:1511] Processing CreateTablet for tablet d6574f545d074bf0a8fe4425bbc9361e (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:18.923132 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daed3c44d1a242bfa9c852c047babec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.924330 30608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5d8b6d4c8a495e81eac9f3e5094a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.927385 30612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc62116945f494d83fd7480db664b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.931334 30610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6574f545d074bf0a8fe4425bbc9361e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.940587 30606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9ef2c236474d5e9f324f7b298e26f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.942461 30604 tablet_service.cc:1511] Processing CreateTablet for tablet 257789f1397f490198e7b402b8406ccb (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:18.944690 30604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257789f1397f490198e7b402b8406ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.940079 30605 tablet_service.cc:1511] Processing CreateTablet for tablet 528787a1f4894df08e46c6466f5d90d9 (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:18.947481 30605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528787a1f4894df08e46c6466f5d90d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.950002 30603 tablet_service.cc:1511] Processing CreateTablet for tablet 4a17b29e162e4760bc83b9cca1c54f3d (DEFAULT_TABLE table=test-workload [id=6c78dd96d5564b928fec9cf357b0be0d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:18.951699 30603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a17b29e162e4760bc83b9cca1c54f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:19.042933 30665 tablet_bootstrap.cc:492] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8: Bootstrap starting.
I20260709 12:19:19.047472 30664 tablet_bootstrap.cc:492] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:19.076248 30666 tablet_bootstrap.cc:492] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900: Bootstrap starting.
I20260709 12:19:19.085287 30666 tablet_bootstrap.cc:654] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.090179 30664 tablet_bootstrap.cc:654] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.094652 30665 tablet_bootstrap.cc:654] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:19.112443 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:19.113569 30666 tablet_bootstrap.cc:492] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900: No bootstrap required, opened a new log
I20260709 12:19:19.114204 30666 ts_tablet_manager.cc:1403] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.018s
I20260709 12:19:19.117115 30665 tablet_bootstrap.cc:492] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8: No bootstrap required, opened a new log
I20260709 12:19:19.117479 30664 tablet_bootstrap.cc:492] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90: No bootstrap required, opened a new log
I20260709 12:19:19.117774 30665 ts_tablet_manager.cc:1403] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.005s
I20260709 12:19:19.118136 30664 ts_tablet_manager.cc:1403] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 12:19:19.118299 30666 raft_consensus.cc:359] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.119385 30666 raft_consensus.cc:385] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.119731 30666 raft_consensus.cc:740] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.120616 30666 consensus_queue.cc:260] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.120901 30664 raft_consensus.cc:359] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.121649 30664 raft_consensus.cc:385] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.122269 30664 raft_consensus.cc:740] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.121567 30665 raft_consensus.cc:359] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.122938 30665 raft_consensus.cc:385] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.123304 30665 raft_consensus.cc:740] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.123649 30647 heartbeater.cc:499] Master 127.17.249.254:32831 was elected leader, sending a full tablet report...
I20260709 12:19:19.123443 30664 consensus_queue.cc:260] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.124166 30666 ts_tablet_manager.cc:1434] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:19:19.124444 30665 consensus_queue.cc:260] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.125422 30666 tablet_bootstrap.cc:492] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900: Bootstrap starting.
I20260709 12:19:19.135462 30666 tablet_bootstrap.cc:654] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.149447 30666 tablet_bootstrap.cc:492] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900: No bootstrap required, opened a new log
I20260709 12:19:19.150281 30666 ts_tablet_manager.cc:1403] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 12:19:19.153569 30664 ts_tablet_manager.cc:1434] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.035s	user 0.018s	sys 0.016s
I20260709 12:19:19.154222 30665 ts_tablet_manager.cc:1434] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8: Time spent starting tablet: real 0.036s	user 0.021s	sys 0.012s
I20260709 12:19:19.154417 30666 raft_consensus.cc:359] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.155283 30666 raft_consensus.cc:385] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.155555 30573 heartbeater.cc:499] Master 127.17.249.254:32831 was elected leader, sending a full tablet report...
I20260709 12:19:19.155597 30666 raft_consensus.cc:740] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.157081 30666 consensus_queue.cc:260] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.159597 30666 ts_tablet_manager.cc:1434] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900: Time spent starting tablet: real 0.009s	user 0.012s	sys 0.000s
I20260709 12:19:19.159844 30498 heartbeater.cc:499] Master 127.17.249.254:32831 was elected leader, sending a full tablet report...
I20260709 12:19:19.160729 30666 tablet_bootstrap.cc:492] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900: Bootstrap starting.
I20260709 12:19:19.164677 30665 tablet_bootstrap.cc:492] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8: Bootstrap starting.
I20260709 12:19:19.165658 30664 tablet_bootstrap.cc:492] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:19.168857 30666 tablet_bootstrap.cc:654] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.174229 30665 tablet_bootstrap.cc:654] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.174223 30664 tablet_bootstrap.cc:654] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.181728 30666 tablet_bootstrap.cc:492] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900: No bootstrap required, opened a new log
I20260709 12:19:19.182417 30666 ts_tablet_manager.cc:1403] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:19:19.185623 30665 tablet_bootstrap.cc:492] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8: No bootstrap required, opened a new log
I20260709 12:19:19.186539 30665 ts_tablet_manager.cc:1403] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 12:19:19.187532 30666 raft_consensus.cc:359] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.188753 30666 raft_consensus.cc:385] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.189137 30666 raft_consensus.cc:740] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.190353 30665 raft_consensus.cc:359] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.190488 30666 consensus_queue.cc:260] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.192677 30665 raft_consensus.cc:385] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.193154 30665 raft_consensus.cc:740] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.194207 30665 consensus_queue.cc:260] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.194485 30664 tablet_bootstrap.cc:492] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90: No bootstrap required, opened a new log
I20260709 12:19:19.194538 30666 ts_tablet_manager.cc:1434] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:19:19.195494 30664 ts_tablet_manager.cc:1403] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.006s
I20260709 12:19:19.196311 30666 tablet_bootstrap.cc:492] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900: Bootstrap starting.
I20260709 12:19:19.196843 30665 ts_tablet_manager.cc:1434] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:19:19.198098 30665 tablet_bootstrap.cc:492] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8: Bootstrap starting.
I20260709 12:19:19.199172 30664 raft_consensus.cc:359] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.200065 30664 raft_consensus.cc:385] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.200404 30664 raft_consensus.cc:740] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.201395 30664 consensus_queue.cc:260] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.204183 30664 ts_tablet_manager.cc:1434] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:19.205447 30664 tablet_bootstrap.cc:492] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:19.205595 30665 tablet_bootstrap.cc:654] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.205783 30666 tablet_bootstrap.cc:654] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.214188 30664 tablet_bootstrap.cc:654] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.218735 30665 tablet_bootstrap.cc:492] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8: No bootstrap required, opened a new log
I20260709 12:19:19.219326 30665 ts_tablet_manager.cc:1403] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.002s
I20260709 12:19:19.222347 30665 raft_consensus.cc:359] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.223124 30665 raft_consensus.cc:385] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.223433 30665 raft_consensus.cc:740] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.224454 30665 consensus_queue.cc:260] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.227922 30665 ts_tablet_manager.cc:1434] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:19:19.228991 30665 tablet_bootstrap.cc:492] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8: Bootstrap starting.
I20260709 12:19:19.235803 30665 tablet_bootstrap.cc:654] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:19.243901 30574 tablet.cc:2406] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:19.247637 30672 raft_consensus.cc:493] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.248179 30672 raft_consensus.cc:515] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.250488 30672 leader_election.cc:290] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.250149 30664 tablet_bootstrap.cc:492] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90: No bootstrap required, opened a new log
I20260709 12:19:19.255823 30664 ts_tablet_manager.cc:1403] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.051s	user 0.030s	sys 0.014s
I20260709 12:19:19.256968 30666 tablet_bootstrap.cc:492] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900: No bootstrap required, opened a new log
I20260709 12:19:19.257983 30666 ts_tablet_manager.cc:1403] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.036s
I20260709 12:19:19.260062 30664 raft_consensus.cc:359] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.260996 30664 raft_consensus.cc:385] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.261358 30664 raft_consensus.cc:740] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.261801 30665 tablet_bootstrap.cc:492] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8: No bootstrap required, opened a new log
I20260709 12:19:19.262399 30665 ts_tablet_manager.cc:1403] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.007s
I20260709 12:19:19.262256 30664 consensus_queue.cc:260] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.262877 30666 raft_consensus.cc:359] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.263988 30666 raft_consensus.cc:385] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.264326 30666 raft_consensus.cc:740] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.265342 30666 consensus_queue.cc:260] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.266683 30665 raft_consensus.cc:359] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.267716 30665 raft_consensus.cc:385] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.268016 30665 raft_consensus.cc:740] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.269006 30665 consensus_queue.cc:260] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.265762 30664 ts_tablet_manager.cc:1434] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:19:19.270947 30664 tablet_bootstrap.cc:492] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:19.277297 30670 raft_consensus.cc:493] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.277902 30670 raft_consensus.cc:515] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.278469 30664 tablet_bootstrap.cc:654] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.283397 30666 ts_tablet_manager.cc:1434] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.004s
I20260709 12:19:19.284735 30665 ts_tablet_manager.cc:1434] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 12:19:19.285072 30666 tablet_bootstrap.cc:492] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900: Bootstrap starting.
I20260709 12:19:19.286155 30670 leader_election.cc:290] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:19.291718 30665 tablet_bootstrap.cc:492] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8: Bootstrap starting.
I20260709 12:19:19.301645 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257789f1397f490198e7b402b8406ccb" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:19.302595 30622 raft_consensus.cc:2468] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 0.
I20260709 12:19:19.303016 30666 tablet_bootstrap.cc:654] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.305160 30665 tablet_bootstrap.cc:654] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.305552 30513 leader_election.cc:304] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: 
I20260709 12:19:19.307251 30672 raft_consensus.cc:2804] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.307732 30672 raft_consensus.cc:493] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.308122 30672 raft_consensus.cc:3060] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.309608 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257789f1397f490198e7b402b8406ccb" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90" is_pre_election: true
W20260709 12:19:19.312280 30512 leader_election.cc:343] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.321246 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257789f1397f490198e7b402b8406ccb" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90" is_pre_election: true
I20260709 12:19:19.322762 30664 tablet_bootstrap.cc:492] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90: No bootstrap required, opened a new log
I20260709 12:19:19.322513 30672 raft_consensus.cc:515] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.323452 30664 ts_tablet_manager.cc:1403] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.008s
W20260709 12:19:19.323997 30586 leader_election.cc:343] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.326753 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257789f1397f490198e7b402b8406ccb" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
W20260709 12:19:19.328452 30512 leader_election.cc:343] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.328593 30664 raft_consensus.cc:359] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.329452 30664 raft_consensus.cc:385] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.329797 30664 raft_consensus.cc:740] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.330931 30665 tablet_bootstrap.cc:492] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8: No bootstrap required, opened a new log
I20260709 12:19:19.330827 30664 consensus_queue.cc:260] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.331156 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257789f1397f490198e7b402b8406ccb" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:19.331851 30665 ts_tablet_manager.cc:1403] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.023s
I20260709 12:19:19.333544 30664 ts_tablet_manager.cc:1434] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:19:19.334824 30664 tablet_bootstrap.cc:492] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:19.338195 30665 raft_consensus.cc:359] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.338919 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257789f1397f490198e7b402b8406ccb" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:19.339395 30665 raft_consensus.cc:385] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.339912 30548 raft_consensus.cc:2393] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc523387ced844c1beb7d8ce3bc03900 in current term 1: Already voted for candidate 5116278a04214646817d79ecd9e626d8 in this term.
I20260709 12:19:19.339939 30665 raft_consensus.cc:740] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.341104 30665 consensus_queue.cc:260] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.341760 30587 leader_election.cc:304] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900; no voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:19.342355 30664 tablet_bootstrap.cc:654] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.331911 30622 raft_consensus.cc:3060] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.350821 30666 tablet_bootstrap.cc:492] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900: No bootstrap required, opened a new log
I20260709 12:19:19.351429 30666 ts_tablet_manager.cc:1403] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.005s
I20260709 12:19:19.351730 30665 ts_tablet_manager.cc:1434] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 12:19:19.354525 30666 raft_consensus.cc:359] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.355492 30666 raft_consensus.cc:385] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.355798 30666 raft_consensus.cc:740] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.356902 30666 consensus_queue.cc:260] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.366428 30666 ts_tablet_manager.cc:1434] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 12:19:19.370085 30665 tablet_bootstrap.cc:492] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8: Bootstrap starting.
I20260709 12:19:19.370255 30672 leader_election.cc:290] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.374364 30666 tablet_bootstrap.cc:492] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900: Bootstrap starting.
I20260709 12:19:19.374663 30693 raft_consensus.cc:493] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.375814 30693 raft_consensus.cc:515] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.379630 30664 tablet_bootstrap.cc:492] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90: No bootstrap required, opened a new log
I20260709 12:19:19.380457 30664 ts_tablet_manager.cc:1403] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.023s
I20260709 12:19:19.380798 30665 tablet_bootstrap.cc:654] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.382143 30666 tablet_bootstrap.cc:654] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.384910 30664 raft_consensus.cc:359] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.385993 30664 raft_consensus.cc:385] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.389389 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6574f545d074bf0a8fe4425bbc9361e" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90" is_pre_election: true
I20260709 12:19:19.390182 30622 raft_consensus.cc:2468] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 1.
I20260709 12:19:19.390923 30670 raft_consensus.cc:2749] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:19.391144 30586 leader_election.cc:343] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.391714 30513 leader_election.cc:304] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:19.392858 30693 leader_election.cc:290] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:19.392910 30690 raft_consensus.cc:2804] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.393533 30664 raft_consensus.cc:740] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.393743 30690 raft_consensus.cc:697] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:19.395561 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6574f545d074bf0a8fe4425bbc9361e" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:19.395567 30664 consensus_queue.cc:260] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.396059 30690 consensus_queue.cc:237] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
W20260709 12:19:19.397775 30587 leader_election.cc:343] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.398330 30587 leader_election.cc:304] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900; no voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:19.399326 30670 raft_consensus.cc:2749] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.401544 30664 ts_tablet_manager.cc:1434] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.002s
I20260709 12:19:19.403074 30664 tablet_bootstrap.cc:492] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:19.404915 30665 tablet_bootstrap.cc:492] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8: No bootstrap required, opened a new log
I20260709 12:19:19.405831 30665 ts_tablet_manager.cc:1403] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.010s
I20260709 12:19:19.411204 30664 tablet_bootstrap.cc:654] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.415069 30666 tablet_bootstrap.cc:492] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900: No bootstrap required, opened a new log
I20260709 12:19:19.415923 30666 ts_tablet_manager.cc:1403] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.020s
I20260709 12:19:19.414906 30665 raft_consensus.cc:359] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.419160 30665 raft_consensus.cc:385] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.419795 30665 raft_consensus.cc:740] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.419998 30666 raft_consensus.cc:359] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.421098 30670 raft_consensus.cc:493] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.421666 30670 raft_consensus.cc:515] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.421784 30665 consensus_queue.cc:260] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.423988 30670 leader_election.cc:290] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:19.426131 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90" is_pre_election: true
I20260709 12:19:19.426429 30665 ts_tablet_manager.cc:1434] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 12:19:19.426972 30671 raft_consensus.cc:493] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:19.427829 30586 leader_election.cc:343] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.428462 30666 raft_consensus.cc:385] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.428903 30666 raft_consensus.cc:740] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.429196 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:19.427587 30671 raft_consensus.cc:515] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.428474 30665 tablet_bootstrap.cc:492] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8: Bootstrap starting.
I20260709 12:19:19.429831 30666 consensus_queue.cc:260] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
W20260709 12:19:19.431084 30587 leader_election.cc:343] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.431699 30587 leader_election.cc:304] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900; no voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:19.433152 30670 raft_consensus.cc:2749] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.436242 30664 tablet_bootstrap.cc:492] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: No bootstrap required, opened a new log
I20260709 12:19:19.436964 30664 ts_tablet_manager.cc:1403] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.016s
I20260709 12:19:19.434561 30671 leader_election.cc:290] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.439064 30665 tablet_bootstrap.cc:654] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.426487 30371 catalog_manager.cc:5697] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5116278a04214646817d79ecd9e626d8 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "5116278a04214646817d79ecd9e626d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.440878 30664 raft_consensus.cc:359] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.441812 30664 raft_consensus.cc:385] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.442158 30664 raft_consensus.cc:740] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.443192 30666 ts_tablet_manager.cc:1434] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 12:19:19.443233 30664 consensus_queue.cc:260] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.449931 30664 ts_tablet_manager.cc:1434] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:19:19.451566 30664 tablet_bootstrap.cc:492] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:19.459582 30664 tablet_bootstrap.cc:654] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.461796 30665 tablet_bootstrap.cc:492] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8: No bootstrap required, opened a new log
I20260709 12:19:19.462683 30665 ts_tablet_manager.cc:1403] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.008s
I20260709 12:19:19.471280 30666 tablet_bootstrap.cc:492] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900: Bootstrap starting.
W20260709 12:19:19.475401 30696 log.cc:927] Time spent T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:19:19.478432 30671 raft_consensus.cc:493] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.478477 30665 raft_consensus.cc:359] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.479558 30665 raft_consensus.cc:385] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.479303 30671 raft_consensus.cc:515] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.479892 30665 raft_consensus.cc:740] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.482030 30665 consensus_queue.cc:260] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.483549 30671 leader_election.cc:290] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.485234 30665 ts_tablet_manager.cc:1434] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:19:19.486747 30665 tablet_bootstrap.cc:492] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8: Bootstrap starting.
I20260709 12:19:19.491559 30664 tablet_bootstrap.cc:492] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90: No bootstrap required, opened a new log
I20260709 12:19:19.492384 30664 ts_tablet_manager.cc:1403] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.020s
I20260709 12:19:19.495100 30665 tablet_bootstrap.cc:654] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.496582 30664 raft_consensus.cc:359] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.497715 30664 raft_consensus.cc:385] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.498206 30664 raft_consensus.cc:740] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.499542 30690 raft_consensus.cc:493] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.499141 30664 consensus_queue.cc:260] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.500236 30690 raft_consensus.cc:515] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.501379 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc62116945f494d83fd7480db664b41" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:19.502946 30690 leader_election.cc:290] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.503773 30664 ts_tablet_manager.cc:1434] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:19:19.505232 30664 tablet_bootstrap.cc:492] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:19.505524 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ca05e3138b4065902af82e9d0f6d5b" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:19.506422 30622 raft_consensus.cc:2468] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 0.
I20260709 12:19:19.508083 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ca05e3138b4065902af82e9d0f6d5b" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90" is_pre_election: true
W20260709 12:19:19.510058 30512 leader_election.cc:343] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.511006 30513 leader_election.cc:304] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:19.503602 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daed3c44d1a242bfa9c852c047babec4" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
W20260709 12:19:19.513208 30438 leader_election.cc:343] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.513546 30690 raft_consensus.cc:2804] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.514117 30690 raft_consensus.cc:493] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.513291 30664 tablet_bootstrap.cc:654] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.514611 30690 raft_consensus.cc:3060] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.516271 30672 raft_consensus.cc:493] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.514204 30547 raft_consensus.cc:2468] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 0.
I20260709 12:19:19.517145 30672 raft_consensus.cc:515] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.518601 30438 leader_election.cc:304] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:19.520251 30671 raft_consensus.cc:2804] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.520802 30671 raft_consensus.cc:493] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.521273 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90" is_pre_election: true
W20260709 12:19:19.523833 30512 leader_election.cc:343] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.521297 30671 raft_consensus.cc:3060] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.527500 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
W20260709 12:19:19.529561 30513 leader_election.cc:343] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.530205 30513 leader_election.cc:304] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5116278a04214646817d79ecd9e626d8; no voters: bc523387ced844c1beb7d8ce3bc03900, fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:19.530726 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc62116945f494d83fd7480db664b41" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:19.531071 30672 leader_election.cc:290] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.531808 30672 raft_consensus.cc:2749] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:19.533844 30438 leader_election.cc:343] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.528555 30706 raft_consensus.cc:493] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.529812 30664 tablet_bootstrap.cc:492] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: No bootstrap required, opened a new log
I20260709 12:19:19.535868 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daed3c44d1a242bfa9c852c047babec4" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:19.536964 30622 raft_consensus.cc:2468] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 0.
I20260709 12:19:19.537003 30664 ts_tablet_manager.cc:1403] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.004s
I20260709 12:19:19.534669 30438 leader_election.cc:304] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa21b1e7fa9948b584063d07e890ba90; no voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900
I20260709 12:19:19.542309 30664 raft_consensus.cc:359] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.547514 30664 raft_consensus.cc:385] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.547983 30664 raft_consensus.cc:740] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.550751 30664 consensus_queue.cc:260] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.555078 30671 raft_consensus.cc:515] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.535899 30706 raft_consensus.cc:515] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.561537 30708 raft_consensus.cc:2749] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.563587 30706 leader_election.cc:290] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.565155 30690 raft_consensus.cc:515] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.559952 30666 tablet_bootstrap.cc:654] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.568295 30665 tablet_bootstrap.cc:492] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8: No bootstrap required, opened a new log
I20260709 12:19:19.570338 30665 ts_tablet_manager.cc:1403] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8: Time spent bootstrapping tablet: real 0.084s	user 0.030s	sys 0.043s
I20260709 12:19:19.570662 30690 leader_election.cc:290] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.558671 30671 leader_election.cc:290] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 election: Requested vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.572116 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ca05e3138b4065902af82e9d0f6d5b" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:19.571962 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ca05e3138b4065902af82e9d0f6d5b" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:19.573381 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daed3c44d1a242bfa9c852c047babec4" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:19.573860 30622 raft_consensus.cc:3060] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.574174 30547 raft_consensus.cc:3060] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:19.575340 30512 leader_election.cc:343] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.578339 30664 ts_tablet_manager.cc:1434] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.040s	user 0.016s	sys 0.012s
I20260709 12:19:19.579736 30664 tablet_bootstrap.cc:492] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:19.573845 30665 raft_consensus.cc:359] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.583660 30665 raft_consensus.cc:385] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.584285 30547 raft_consensus.cc:2468] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 1.
I20260709 12:19:19.584555 30665 raft_consensus.cc:740] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.584048 30622 raft_consensus.cc:2468] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 1.
I20260709 12:19:19.586072 30665 consensus_queue.cc:260] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.586935 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5d8b6d4c8a495e81eac9f3e5094a9e" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:19.587644 30548 raft_consensus.cc:2468] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 0.
I20260709 12:19:19.586997 30513 leader_election.cc:304] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:19.588754 30665 ts_tablet_manager.cc:1434] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:19:19.589046 30664 tablet_bootstrap.cc:654] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.589584 30690 raft_consensus.cc:2804] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.590200 30690 raft_consensus.cc:697] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:19.591159 30690 consensus_queue.cc:237] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.593196 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daed3c44d1a242bfa9c852c047babec4" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:19.594012 30622 raft_consensus.cc:3060] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.595108 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5d8b6d4c8a495e81eac9f3e5094a9e" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:19.591784 30438 leader_election.cc:304] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:19.596611 30438 leader_election.cc:304] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:19.592468 30665 tablet_bootstrap.cc:492] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8: Bootstrap starting.
I20260709 12:19:19.597795 30707 raft_consensus.cc:493] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.599599 30707 raft_consensus.cc:515] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.603375 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a17b29e162e4760bc83b9cca1c54f3d" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90" is_pre_election: true
I20260709 12:19:19.603977 30622 raft_consensus.cc:2468] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 1.
I20260709 12:19:19.604204 30473 raft_consensus.cc:2468] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 0.
I20260709 12:19:19.604480 30671 raft_consensus.cc:2804] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:19:19.604821 30438 leader_election.cc:343] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.605202 30671 raft_consensus.cc:697] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: Becoming Leader. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Running, Role: LEADER
I20260709 12:19:19.605958 30512 leader_election.cc:304] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:19.606105 30671 consensus_queue.cc:237] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.607677 30672 raft_consensus.cc:2804] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.608270 30672 raft_consensus.cc:493] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.608736 30672 raft_consensus.cc:3060] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.609858 30665 tablet_bootstrap.cc:654] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.610333 30708 raft_consensus.cc:2804] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.611545 30708 raft_consensus.cc:493] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.611953 30708 raft_consensus.cc:3060] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.613459 30707 leader_election.cc:290] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.613291 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a17b29e162e4760bc83b9cca1c54f3d" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
W20260709 12:19:19.615109 30513 leader_election.cc:343] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.621937 30708 raft_consensus.cc:515] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.627363 30706 raft_consensus.cc:493] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.628444 30706 raft_consensus.cc:515] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.630985 30707 raft_consensus.cc:493] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.631826 30707 raft_consensus.cc:515] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.635977 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5d8b6d4c8a495e81eac9f3e5094a9e" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:19.636530 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6574f545d074bf0a8fe4425bbc9361e" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90" is_pre_election: true
I20260709 12:19:19.637053 30547 raft_consensus.cc:3060] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:19.639243 30512 leader_election.cc:343] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.642378 30707 leader_election.cc:290] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.642688 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6574f545d074bf0a8fe4425bbc9361e" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:19.643589 30622 raft_consensus.cc:2468] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 0.
I20260709 12:19:19.646440 30513 leader_election.cc:304] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:19.652871 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5d8b6d4c8a495e81eac9f3e5094a9e" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:19.653662 30370 catalog_manager.cc:5697] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "fa21b1e7fa9948b584063d07e890ba90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:19.654815 30438 leader_election.cc:343] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.655503 30708 leader_election.cc:290] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 election: Requested vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.656073 30708 raft_consensus.cc:493] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.656525 30708 raft_consensus.cc:515] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.659719 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
W20260709 12:19:19.661772 30438 leader_election.cc:343] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.662045 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257789f1397f490198e7b402b8406ccb" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:19.663671 30706 leader_election.cc:290] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.664815 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257789f1397f490198e7b402b8406ccb" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:19.665789 30622 raft_consensus.cc:2393] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa21b1e7fa9948b584063d07e890ba90 in current term 1: Already voted for candidate 5116278a04214646817d79ecd9e626d8 in this term.
I20260709 12:19:19.667613 30438 leader_election.cc:304] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa21b1e7fa9948b584063d07e890ba90; no voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900
I20260709 12:19:19.669397 30709 raft_consensus.cc:3060] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.670120 30707 raft_consensus.cc:2804] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.670924 30707 raft_consensus.cc:493] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.671446 30707 raft_consensus.cc:3060] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.650454 30547 raft_consensus.cc:2468] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 1.
I20260709 12:19:19.677500 30438 leader_election.cc:304] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: bc523387ced844c1beb7d8ce3bc03900
I20260709 12:19:19.677336 30672 raft_consensus.cc:515] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.677789 30665 tablet_bootstrap.cc:492] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8: No bootstrap required, opened a new log
I20260709 12:19:19.679612 30665 ts_tablet_manager.cc:1403] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.014s
I20260709 12:19:19.680933 30666 tablet_bootstrap.cc:492] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900: No bootstrap required, opened a new log
I20260709 12:19:19.681620 30666 ts_tablet_manager.cc:1403] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900: Time spent bootstrapping tablet: real 0.211s	user 0.020s	sys 0.012s
I20260709 12:19:19.683066 30706 raft_consensus.cc:2804] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.685170 30706 raft_consensus.cc:697] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: Becoming Leader. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Running, Role: LEADER
I20260709 12:19:19.686237 30665 raft_consensus.cc:359] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.686496 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:19.686857 30706 consensus_queue.cc:237] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.688445 30622 raft_consensus.cc:2468] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 0.
I20260709 12:19:19.688553 30709 raft_consensus.cc:2749] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.687422 30708 leader_election.cc:290] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.689872 30665 raft_consensus.cc:385] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.689797 30438 leader_election.cc:304] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900, fa21b1e7fa9948b584063d07e890ba90; no voters: 5116278a04214646817d79ecd9e626d8
I20260709 12:19:19.690871 30665 raft_consensus.cc:740] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.691632 30709 raft_consensus.cc:2804] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.692072 30709 raft_consensus.cc:493] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.693034 30709 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.692585 30665 consensus_queue.cc:260] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.695578 30666 raft_consensus.cc:359] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.701010 30664 tablet_bootstrap.cc:492] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90: No bootstrap required, opened a new log
I20260709 12:19:19.701787 30664 ts_tablet_manager.cc:1403] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.122s	user 0.025s	sys 0.061s
I20260709 12:19:19.703454 30709 raft_consensus.cc:515] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.707620 30672 leader_election.cc:290] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.708328 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a17b29e162e4760bc83b9cca1c54f3d" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:19.709664 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a17b29e162e4760bc83b9cca1c54f3d" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
W20260709 12:19:19.709924 30513 leader_election.cc:343] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.710480 30473 raft_consensus.cc:3060] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.712946 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:19.713781 30547 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.712597 30370 catalog_manager.cc:5697] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5116278a04214646817d79ecd9e626d8 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "5116278a04214646817d79ecd9e626d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.721473 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:19.722405 30622 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.696885 30666 raft_consensus.cc:385] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.723362 30547 raft_consensus.cc:2468] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 1.
I20260709 12:19:19.725564 30665 ts_tablet_manager.cc:1434] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8: Time spent starting tablet: real 0.045s	user 0.014s	sys 0.011s
I20260709 12:19:19.725350 30438 leader_election.cc:304] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:19.726709 30665 tablet_bootstrap.cc:492] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8: Bootstrap starting.
I20260709 12:19:19.727531 30708 raft_consensus.cc:2804] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.728077 30708 raft_consensus.cc:697] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: Becoming Leader. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Running, Role: LEADER
I20260709 12:19:19.729067 30708 consensus_queue.cc:237] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.733769 30664 raft_consensus.cc:359] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.734452 30664 raft_consensus.cc:385] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.734699 30664 raft_consensus.cc:740] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.725725 30709 leader_election.cc:290] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 election: Requested vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.725947 30666 raft_consensus.cc:740] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.709889 30707 raft_consensus.cc:515] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.742087 30665 tablet_bootstrap.cc:654] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.744554 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6574f545d074bf0a8fe4425bbc9361e" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:19.742770 30666 consensus_queue.cc:260] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.746145 30709 raft_consensus.cc:493] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.747368 30664 consensus_queue.cc:260] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.748270 30622 raft_consensus.cc:2468] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 1.
I20260709 12:19:19.748468 30472 raft_consensus.cc:3060] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.742070 30473 raft_consensus.cc:2468] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 1.
I20260709 12:19:19.746757 30709 raft_consensus.cc:515] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.751467 30512 leader_election.cc:304] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: bc523387ced844c1beb7d8ce3bc03900
I20260709 12:19:19.752897 30716 raft_consensus.cc:2804] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.754374 30716 raft_consensus.cc:697] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:19.754673 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:19.755579 30622 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 0.
I20260709 12:19:19.757206 30438 leader_election.cc:304] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:19.758247 30708 raft_consensus.cc:2804] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.758671 30708 raft_consensus.cc:493] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.751863 30709 leader_election.cc:290] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.759114 30708 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.759114 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:19.771366 30666 ts_tablet_manager.cc:1434] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.004s
I20260709 12:19:19.771890 30547 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 0.
I20260709 12:19:19.773022 30666 tablet_bootstrap.cc:492] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900: Bootstrap starting.
I20260709 12:19:19.774313 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6574f545d074bf0a8fe4425bbc9361e" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:19.775067 30622 raft_consensus.cc:3060] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.768586 30716 consensus_queue.cc:237] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.777725 30707 leader_election.cc:290] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.783320 30708 raft_consensus.cc:515] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.777427 30472 raft_consensus.cc:2468] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 1.
I20260709 12:19:19.784652 30622 raft_consensus.cc:2468] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 1.
I20260709 12:19:19.785656 30370 catalog_manager.cc:5697] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "fa21b1e7fa9948b584063d07e890ba90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.789153 30513 leader_election.cc:304] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: 
I20260709 12:19:19.790120 30707 raft_consensus.cc:2804] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.791164 30707 raft_consensus.cc:697] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:19.793545 30666 tablet_bootstrap.cc:654] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.796234 30665 tablet_bootstrap.cc:492] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8: No bootstrap required, opened a new log
I20260709 12:19:19.796943 30665 ts_tablet_manager.cc:1403] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.009s
I20260709 12:19:19.797912 30708 leader_election.cc:290] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 election: Requested vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.800213 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:19.800956 30622 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.802640 30665 raft_consensus.cc:359] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.803426 30665 raft_consensus.cc:385] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.804893 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:19.805720 30547 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.807658 30664 ts_tablet_manager.cc:1434] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.105s	user 0.011s	sys 0.001s
I20260709 12:19:19.815816 30664 tablet_bootstrap.cc:492] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:19.818344 30547 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 1.
I20260709 12:19:19.820052 30438 leader_election.cc:304] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:19.821259 30706 raft_consensus.cc:2804] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.820394 30371 catalog_manager.cc:5697] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "fa21b1e7fa9948b584063d07e890ba90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.792101 30707 consensus_queue.cc:237] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.813382 30369 catalog_manager.cc:5697] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5116278a04214646817d79ecd9e626d8 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "5116278a04214646817d79ecd9e626d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.803695 30665 raft_consensus.cc:740] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.821867 30706 raft_consensus.cc:697] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: Becoming Leader. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Running, Role: LEADER
I20260709 12:19:19.810822 30622 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 1.
I20260709 12:19:19.825037 30665 consensus_queue.cc:260] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.825160 30706 consensus_queue.cc:237] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.827461 30665 ts_tablet_manager.cc:1434] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.001s
I20260709 12:19:19.829725 30664 tablet_bootstrap.cc:654] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.837525 30666 tablet_bootstrap.cc:492] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900: No bootstrap required, opened a new log
I20260709 12:19:19.838079 30666 ts_tablet_manager.cc:1403] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.018s
I20260709 12:19:19.840764 30666 raft_consensus.cc:359] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.848002 30666 raft_consensus.cc:385] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.848022 30664 tablet_bootstrap.cc:492] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90: No bootstrap required, opened a new log
I20260709 12:19:19.848419 30666 raft_consensus.cc:740] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.848757 30664 ts_tablet_manager.cc:1403] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.002s
I20260709 12:19:19.849221 30666 consensus_queue.cc:260] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.850154 30369 catalog_manager.cc:5697] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "fa21b1e7fa9948b584063d07e890ba90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.851814 30666 ts_tablet_manager.cc:1434] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 12:19:19.851626 30664 raft_consensus.cc:359] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.852519 30664 raft_consensus.cc:385] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.852813 30664 raft_consensus.cc:740] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.852972 30666 tablet_bootstrap.cc:492] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900: Bootstrap starting.
I20260709 12:19:19.853541 30664 consensus_queue.cc:260] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.856263 30664 ts_tablet_manager.cc:1434] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:19.859225 30666 tablet_bootstrap.cc:654] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.864200 30666 tablet_bootstrap.cc:492] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900: No bootstrap required, opened a new log
I20260709 12:19:19.864693 30666 ts_tablet_manager.cc:1403] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:19:19.864687 30371 catalog_manager.cc:5697] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5116278a04214646817d79ecd9e626d8 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "5116278a04214646817d79ecd9e626d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.868054 30666 raft_consensus.cc:359] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.868791 30666 raft_consensus.cc:385] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.869026 30666 raft_consensus.cc:740] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.869750 30666 consensus_queue.cc:260] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.871537 30666 ts_tablet_manager.cc:1434] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:19.872721 30666 tablet_bootstrap.cc:492] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900: Bootstrap starting.
I20260709 12:19:19.881696 30666 tablet_bootstrap.cc:654] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.886408 30666 tablet_bootstrap.cc:492] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900: No bootstrap required, opened a new log
I20260709 12:19:19.887005 30666 ts_tablet_manager.cc:1403] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 12:19:19.889186 30707 consensus_queue.cc:1048] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.889233 30666 raft_consensus.cc:359] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.890038 30666 raft_consensus.cc:385] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.890257 30666 raft_consensus.cc:740] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.890882 30666 consensus_queue.cc:260] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.892797 30666 ts_tablet_manager.cc:1434] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:19.904945 30707 consensus_queue.cc:1048] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.987996 30706 raft_consensus.cc:493] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.988574 30706 raft_consensus.cc:515] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:19.990665 30706 leader_election.cc:290] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:19.991671 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ca05e3138b4065902af82e9d0f6d5b" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:19.992120 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38ca05e3138b4065902af82e9d0f6d5b" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:19.992919 30622 raft_consensus.cc:2393] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa21b1e7fa9948b584063d07e890ba90 in current term 1: Already voted for candidate 5116278a04214646817d79ecd9e626d8 in this term.
I20260709 12:19:19.993878 30438 leader_election.cc:304] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa21b1e7fa9948b584063d07e890ba90; no voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900
I20260709 12:19:19.994683 30706 raft_consensus.cc:3060] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:20.001484 30706 raft_consensus.cc:2749] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:20.009822 30707 consensus_queue.cc:1048] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.023686 30690 consensus_queue.cc:1048] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.036257 30706 raft_consensus.cc:493] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.036933 30706 raft_consensus.cc:515] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:20.039191 30706 leader_election.cc:290] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:20.039950 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:20.040733 30547 raft_consensus.cc:2468] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 0.
I20260709 12:19:20.040948 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:20.041733 30438 leader_election.cc:304] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:20.041771 30622 raft_consensus.cc:2468] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 0.
I20260709 12:19:20.042622 30706 raft_consensus.cc:2804] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:20.043157 30706 raft_consensus.cc:493] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.043783 30706 raft_consensus.cc:3060] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:20.051301 30706 raft_consensus.cc:515] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:20.053104 30706 leader_election.cc:290] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 election: Requested vote from peers 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:20.054116 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:20.054275 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9" candidate_uuid: "fa21b1e7fa9948b584063d07e890ba90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:20.054747 30547 raft_consensus.cc:3060] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:20.055012 30622 raft_consensus.cc:3060] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:20.060765 30547 raft_consensus.cc:2468] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 1.
I20260709 12:19:20.061686 30622 raft_consensus.cc:2468] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa21b1e7fa9948b584063d07e890ba90 in term 1.
I20260709 12:19:20.061932 30438 leader_election.cc:304] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:20.062865 30706 raft_consensus.cc:2804] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:20.063375 30706 raft_consensus.cc:697] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: Becoming Leader. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Running, Role: LEADER
I20260709 12:19:20.064092 30706 consensus_queue.cc:237] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:20.073738 30622 raft_consensus.cc:3060] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:20.073392 30371 catalog_manager.cc:5697] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "fa21b1e7fa9948b584063d07e890ba90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.074568 30670 raft_consensus.cc:493] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.075145 30670 raft_consensus.cc:515] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:20.077463 30670 leader_election.cc:290] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:20.079674 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc62116945f494d83fd7480db664b41" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90" is_pre_election: true
I20260709 12:19:20.080446 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc62116945f494d83fd7480db664b41" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:20.080487 30472 raft_consensus.cc:2468] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 0.
I20260709 12:19:20.081336 30547 raft_consensus.cc:2468] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 0.
I20260709 12:19:20.082520 30587 leader_election.cc:304] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: 
I20260709 12:19:20.083446 30670 raft_consensus.cc:2804] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:20.083854 30670 raft_consensus.cc:493] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.084225 30670 raft_consensus.cc:3060] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:20.084332 30706 consensus_queue.cc:1048] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.092301 30670 raft_consensus.cc:515] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:20.095446 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc62116945f494d83fd7480db664b41" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:20.096107 30472 raft_consensus.cc:3060] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:20.098101 30671 consensus_queue.cc:1048] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.098742 30670 leader_election.cc:290] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:20.100067 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc62116945f494d83fd7480db664b41" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:20.100708 30547 raft_consensus.cc:3060] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:20.105225 30472 raft_consensus.cc:2468] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 1.
I20260709 12:19:20.106760 30586 leader_election.cc:304] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:20.107597 30670 raft_consensus.cc:2804] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:20.108049 30670 raft_consensus.cc:697] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 1 LEADER]: Becoming Leader. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:20.108803 30670 consensus_queue.cc:237] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
W20260709 12:19:20.114898 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:20.116876 30547 raft_consensus.cc:2468] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 1.
I20260709 12:19:20.118206 30371 catalog_manager.cc:5697] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "bc523387ced844c1beb7d8ce3bc03900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:20.136947 30671 consensus_queue.cc:1048] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.138337 30709 consensus_queue.cc:1048] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.152055 30671 consensus_queue.cc:1048] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.155220 30706 consensus_queue.cc:1048] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.179776 18407 ts_manager.cc:295] Set tserver state for fa21b1e7fa9948b584063d07e890ba90 to MAINTENANCE_MODE
I20260709 12:19:20.180681 18407 tablet_server.cc:179] TabletServer@127.17.249.193:0 shutting down...
I20260709 12:19:20.216571 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:20.217518 18407 tablet_replica.cc:333] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: stopping tablet replica
I20260709 12:19:20.218189 18407 raft_consensus.cc:2243] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.218945 18407 pending_rounds.cc:70] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Trying to abort 1 pending ops.
I20260709 12:19:20.219131 18407 pending_rounds.cc:77] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305623798030090240 op_type: NO_OP noop_request { }
I20260709 12:19:20.219429 18407 raft_consensus.cc:2889] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:19:20.219671 18407 raft_consensus.cc:2272] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.222631 18407 tablet_replica.cc:333] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90: stopping tablet replica
I20260709 12:19:20.223456 18407 raft_consensus.cc:2243] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.223896 18407 raft_consensus.cc:2272] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.226046 18407 tablet_replica.cc:333] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90: stopping tablet replica
I20260709 12:19:20.226672 18407 raft_consensus.cc:2243] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.227277 18407 raft_consensus.cc:2272] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.230662 18407 tablet_replica.cc:333] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90: stopping tablet replica
I20260709 12:19:20.231498 18407 raft_consensus.cc:2243] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.232079 18407 raft_consensus.cc:2272] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:20.232713 30512 consensus_peers.cc:597] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:20.235132 18407 tablet_replica.cc:333] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: stopping tablet replica
I20260709 12:19:20.235899 18407 raft_consensus.cc:2243] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.236608 18407 pending_rounds.cc:70] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Trying to abort 1 pending ops.
I20260709 12:19:20.236842 18407 pending_rounds.cc:77] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305623797055549440 op_type: NO_OP noop_request { }
I20260709 12:19:20.237136 18407 raft_consensus.cc:2889] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:19:20.237424 18407 raft_consensus.cc:2272] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.240043 18407 tablet_replica.cc:333] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90: stopping tablet replica
I20260709 12:19:20.240648 18407 raft_consensus.cc:2243] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.241070 18407 raft_consensus.cc:2272] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.243124 18407 tablet_replica.cc:333] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90: stopping tablet replica
I20260709 12:19:20.243676 18407 raft_consensus.cc:2243] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.244627 18407 raft_consensus.cc:2272] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.247450 18407 tablet_replica.cc:333] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90: stopping tablet replica
I20260709 12:19:20.248076 18407 raft_consensus.cc:2243] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:20.248529 18407 raft_consensus.cc:2272] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.250566 18407 tablet_replica.cc:333] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90: stopping tablet replica
I20260709 12:19:20.251205 18407 raft_consensus.cc:2243] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.252161 18407 raft_consensus.cc:2272] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.254732 18407 tablet_replica.cc:333] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90: stopping tablet replica
I20260709 12:19:20.255339 18407 raft_consensus.cc:2243] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:20.256253 18407 raft_consensus.cc:2272] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:20.264381 30670 raft_consensus.cc:493] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.265077 30670 raft_consensus.cc:515] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:20.267045 30670 leader_election.cc:290] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:20.268409 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a17b29e162e4760bc83b9cca1c54f3d" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
W20260709 12:19:20.271528 30586 leader_election.cc:336] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:20.272514 30586 leader_election.cc:304] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900; no voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:20.273720 30670 raft_consensus.cc:2749] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:20.291159 18407 tablet_server.cc:196] TabletServer@127.17.249.193:0 shutdown complete.
I20260709 12:19:20.295228 30690 consensus_queue.cc:1048] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:20.313897 30512 consensus_peers.cc:597] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:20.396507 30621 raft_consensus.cc:3060] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:20.398833 30512 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111) [suppressed 186 similar messages]
W20260709 12:19:20.401693 30512 consensus_peers.cc:597] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:20.403622 30716 consensus_queue.cc:1048] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:20.420360 30512 consensus_peers.cc:597] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:20.509215 30670 consensus_queue.cc:1048] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:20.528950 30586 consensus_peers.cc:597] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:21.116269 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:19:21.598603 30751 raft_consensus.cc:493] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa21b1e7fa9948b584063d07e890ba90)
I20260709 12:19:21.599241 30751 raft_consensus.cc:515] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.601078 30751 leader_election.cc:290] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:21.602295 30707 raft_consensus.cc:493] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa21b1e7fa9948b584063d07e890ba90)
I20260709 12:19:21.602473 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5d8b6d4c8a495e81eac9f3e5094a9e" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:21.602962 30707 raft_consensus.cc:515] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.604234 30548 raft_consensus.cc:2468] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 1.
I20260709 12:19:21.605218 30707 leader_election.cc:290] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:21.605605 30587 leader_election.cc:304] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: 
I20260709 12:19:21.606523 30751 raft_consensus.cc:2804] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:21.606930 30751 raft_consensus.cc:493] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa21b1e7fa9948b584063d07e890ba90)
I20260709 12:19:21.607048 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5d8b6d4c8a495e81eac9f3e5094a9e" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:21.607357 30751 raft_consensus.cc:3060] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:21.607236 30586 leader_election.cc:336] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
W20260709 12:19:21.610476 30512 leader_election.cc:336] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
I20260709 12:19:21.613574 30751 raft_consensus.cc:515] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.614646 30621 raft_consensus.cc:2393] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5116278a04214646817d79ecd9e626d8 in current term 2: Already voted for candidate bc523387ced844c1beb7d8ce3bc03900 in this term.
I20260709 12:19:21.615705 30751 leader_election.cc:290] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:21.616823 30513 leader_election.cc:304] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5116278a04214646817d79ecd9e626d8; no voters: bc523387ced844c1beb7d8ce3bc03900, fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:21.617221 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5d8b6d4c8a495e81eac9f3e5094a9e" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:21.617771 30707 raft_consensus.cc:3060] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:21.620175 30586 leader_election.cc:336] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
I20260709 12:19:21.624943 30707 raft_consensus.cc:2749] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:21.631300 30548 raft_consensus.cc:2468] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 2.
I20260709 12:19:21.633249 30587 leader_election.cc:304] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:21.634140 30751 raft_consensus.cc:2804] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:21.635251 30751 raft_consensus.cc:697] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Becoming Leader. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:21.636252 30751 consensus_queue.cc:237] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.644294 30370 catalog_manager.cc:5697] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 reported cstate change: term changed from 1 to 2, leader changed from fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193) to bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "bc523387ced844c1beb7d8ce3bc03900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:21.653748 30707 raft_consensus.cc:493] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa21b1e7fa9948b584063d07e890ba90)
I20260709 12:19:21.654423 30707 raft_consensus.cc:515] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.655544 30751 raft_consensus.cc:493] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa21b1e7fa9948b584063d07e890ba90)
I20260709 12:19:21.656054 30690 raft_consensus.cc:493] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa21b1e7fa9948b584063d07e890ba90)
I20260709 12:19:21.656147 30751 raft_consensus.cc:515] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.657153 30690 raft_consensus.cc:515] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.658553 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:21.659344 30621 raft_consensus.cc:2468] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 1.
I20260709 12:19:21.660854 30690 leader_election.cc:290] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:21.661379 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daed3c44d1a242bfa9c852c047babec4" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:21.661799 30751 leader_election.cc:290] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:21.662221 30548 raft_consensus.cc:2468] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 1.
I20260709 12:19:21.663879 30587 leader_election.cc:304] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: 
I20260709 12:19:21.664669 30513 leader_election.cc:304] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: 
I20260709 12:19:21.665162 30707 leader_election.cc:290] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:21.665555 30751 raft_consensus.cc:2804] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:21.665715 30690 raft_consensus.cc:2804] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:21.666078 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daed3c44d1a242bfa9c852c047babec4" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:21.666265 30690 raft_consensus.cc:493] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa21b1e7fa9948b584063d07e890ba90)
I20260709 12:19:21.667259 30690 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:21.666123 30751 raft_consensus.cc:493] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa21b1e7fa9948b584063d07e890ba90)
I20260709 12:19:21.668432 30751 raft_consensus.cc:3060] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:21.668604 30586 leader_election.cc:336] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
W20260709 12:19:21.670199 30512 leader_election.cc:336] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
W20260709 12:19:21.671131 30512 leader_election.cc:336] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
I20260709 12:19:21.674234 30690 raft_consensus.cc:515] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.676255 30690 leader_election.cc:290] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:21.676069 30751 raft_consensus.cc:515] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.677502 30621 raft_consensus.cc:2393] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5116278a04214646817d79ecd9e626d8 in current term 2: Already voted for candidate bc523387ced844c1beb7d8ce3bc03900 in this term.
I20260709 12:19:21.677675 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:21.678442 30751 leader_election.cc:290] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:21.678468 30622 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:21.679890 30513 leader_election.cc:304] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5116278a04214646817d79ecd9e626d8; no voters: bc523387ced844c1beb7d8ce3bc03900, fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:21.680631 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daed3c44d1a242bfa9c852c047babec4" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:21.681197 30690 raft_consensus.cc:3060] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:21.681757 30512 leader_election.cc:336] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
W20260709 12:19:21.686058 30586 leader_election.cc:336] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
I20260709 12:19:21.687834 30622 raft_consensus.cc:2468] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 2.
I20260709 12:19:21.689311 30513 leader_election.cc:304] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:21.689508 30690 raft_consensus.cc:2749] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:21.690302 30707 raft_consensus.cc:2804] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:21.690965 30707 raft_consensus.cc:697] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Becoming Leader. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:21.691880 30707 consensus_queue.cc:237] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.696539 30548 raft_consensus.cc:2468] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 2.
I20260709 12:19:21.698509 30587 leader_election.cc:304] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:21.699492 30751 raft_consensus.cc:2804] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:21.699973 30751 raft_consensus.cc:697] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Becoming Leader. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:21.700834 30751 consensus_queue.cc:237] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.700752 30370 catalog_manager.cc:5697] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 reported cstate change: term changed from 1 to 2, leader changed from fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193) to 5116278a04214646817d79ecd9e626d8 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "5116278a04214646817d79ecd9e626d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:21.712025 30368 catalog_manager.cc:5697] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 reported cstate change: term changed from 1 to 2, leader changed from fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193) to bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "bc523387ced844c1beb7d8ce3bc03900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:21.832489 30707 raft_consensus.cc:493] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.833230 30707 raft_consensus.cc:515] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.835350 30707 leader_election.cc:290] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:21.836745 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900" is_pre_election: true
I20260709 12:19:21.837507 30622 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 1.
I20260709 12:19:21.838744 30513 leader_election.cc:304] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: 
I20260709 12:19:21.839805 30707 raft_consensus.cc:2804] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:19:21.840132 30512 leader_election.cc:336] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
I20260709 12:19:21.840344 30707 raft_consensus.cc:493] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.840751 30707 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:21.846669 30707 raft_consensus.cc:515] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.848762 30707 leader_election.cc:290] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:21.850449 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:21.851374 30622 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:21.853245 30512 leader_election.cc:336] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
I20260709 12:19:21.857972 30622 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 2.
I20260709 12:19:21.859344 30513 leader_election.cc:304] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:21.860081 30707 raft_consensus.cc:2804] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:21.860594 30707 raft_consensus.cc:697] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Becoming Leader. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:21.861413 30707 consensus_queue.cc:237] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:21.870333 30368 catalog_manager.cc:5697] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 reported cstate change: term changed from 1 to 2, leader changed from fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193) to 5116278a04214646817d79ecd9e626d8 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "5116278a04214646817d79ecd9e626d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.007328 30751 raft_consensus.cc:493] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.007972 30751 raft_consensus.cc:515] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:22.010229 30751 leader_election.cc:290] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:22.011643 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8" is_pre_election: true
I20260709 12:19:22.012322 30548 raft_consensus.cc:2468] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 1.
I20260709 12:19:22.014072 30587 leader_election.cc:304] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: 
I20260709 12:19:22.015323 30751 raft_consensus.cc:2804] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:19:22.015693 30586 leader_election.cc:336] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
I20260709 12:19:22.015802 30751 raft_consensus.cc:493] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.016327 30751 raft_consensus.cc:3060] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:22.022917 30751 raft_consensus.cc:515] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:22.025177 30751 leader_election.cc:290] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:22.026547 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:22.027558 30548 raft_consensus.cc:3060] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:22.030260 30586 leader_election.cc:336] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111)
I20260709 12:19:22.034896 30548 raft_consensus.cc:2468] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 2.
I20260709 12:19:22.036476 30587 leader_election.cc:304] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: fa21b1e7fa9948b584063d07e890ba90
I20260709 12:19:22.037357 30754 raft_consensus.cc:2804] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:22.037868 30754 raft_consensus.cc:697] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Becoming Leader. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:22.038848 30754 consensus_queue.cc:237] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:22.047708 30368 catalog_manager.cc:5697] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 reported cstate change: term changed from 1 to 2, leader changed from fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193) to bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "bc523387ced844c1beb7d8ce3bc03900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:22.094410 30586 consensus_peers.cc:597] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:22.111793 30548 raft_consensus.cc:1275] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:22.113368 30754 consensus_queue.cc:1048] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:22.117434 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:19:22.131965 30548 raft_consensus.cc:1275] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:22.133630 30766 consensus_queue.cc:1048] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:22.135144 30586 consensus_peers.cc:597] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:22.214988 30622 raft_consensus.cc:1275] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Refusing update from remote peer 5116278a04214646817d79ecd9e626d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:22.216732 30707 consensus_queue.cc:1048] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:22.232148 30512 consensus_peers.cc:597] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:22.300405 30512 consensus_peers.cc:597] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:22.442924 30548 raft_consensus.cc:1275] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:22.445600 30766 consensus_queue.cc:1048] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:22.451152 30622 raft_consensus.cc:1275] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Refusing update from remote peer 5116278a04214646817d79ecd9e626d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:22.453150 30770 consensus_queue.cc:1048] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:19:22.468295 30586 consensus_peers.cc:597] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:22.640261 30512 consensus_peers.cc:597] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:22.796450 30512 consensus_peers.cc:597] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:22.833348 30586 consensus_peers.cc:597] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:22.885380 30512 consensus_peers.cc:597] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:23.060335 30512 consensus_peers.cc:597] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:23.119091 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:19:24.120440 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:19:24.476414 30586 consensus_peers.cc:597] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:24.590880 30512 consensus_peers.cc:597] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:24.809818 30586 consensus_peers.cc:597] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:24.854146 30586 consensus_peers.cc:597] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:24.889851 30512 consensus_peers.cc:597] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:25.121749 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:19:25.296838 30512 consensus_peers.cc:597] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:25.322050 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:25.332312 30779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:25.332382 30778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:25.334913 30781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:25.338747 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:25.340902 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:25.341181 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:25.341447 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599565341408 us; error 0 us; skew 500 ppm
I20260709 12:19:25.342168 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:25.346045 18407 webserver.cc:533] Webserver started at http://127.17.249.193:37243/ using document root <none> and password file <none>
I20260709 12:19:25.346771 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:25.347024 18407 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:19:25.352615 18407 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:19:25.358994 30786 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:25.360132 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:19:25.360677 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-0-root
uuid: "fa21b1e7fa9948b584063d07e890ba90"
format_stamp: "Formatted at 2026-07-09 12:19:18 on dist-test-slave-7mcn"
I20260709 12:19:25.361308 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599138854584-18407-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:25.378854 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:25.380362 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 12:19:25.381393 30512 consensus_peers.cc:597] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:25.382295 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:25.386893 30793 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:19:25.441840 30586 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111) [suppressed 96 similar messages]
W20260709 12:19:25.445602 30586 consensus_peers.cc:597] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:25.461936 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:19:25.462390 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.077s	user 0.004s	sys 0.000s
I20260709 12:19:25.462678 18407 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:19:25.470927 30793 tablet_bootstrap.cc:492] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:25.491483 30793 tablet_bootstrap.cc:492] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:19:25.492835 30793 tablet_bootstrap.cc:492] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap complete.
I20260709 12:19:25.493568 30793 ts_tablet_manager.cc:1403] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 12:19:25.497018 30793 raft_consensus.cc:359] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.498483 30793 raft_consensus.cc:740] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:25.499429 30793 consensus_queue.cc:260] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.502768 30793 ts_tablet_manager.cc:1434] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:19:25.503904 30793 tablet_bootstrap.cc:492] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
W20260709 12:19:25.519192 30512 consensus_peers.cc:597] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:25.523407 30793 tablet_bootstrap.cc:492] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.524537 30793 tablet_bootstrap.cc:492] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap complete.
I20260709 12:19:25.525405 30793 ts_tablet_manager.cc:1403] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:19:25.528720 30793 raft_consensus.cc:359] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.529484 30793 raft_consensus.cc:740] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:25.530304 30793 consensus_queue.cc:260] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.532732 30793 ts_tablet_manager.cc:1434] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:19:25.533705 30793 tablet_bootstrap.cc:492] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:25.545053 18407 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:19:25.545619 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.083s	user 0.066s	sys 0.015s
I20260709 12:19:25.554154 30793 tablet_bootstrap.cc:492] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.555588 30793 tablet_bootstrap.cc:492] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap complete.
I20260709 12:19:25.556478 30793 ts_tablet_manager.cc:1403] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 12:19:25.560778 30793 raft_consensus.cc:359] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.562013 30793 raft_consensus.cc:740] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:25.563133 30793 consensus_queue.cc:260] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.566454 30793 ts_tablet_manager.cc:1434] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:19:25.567836 30793 tablet_bootstrap.cc:492] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
W20260709 12:19:25.583581 30512 consensus_peers.cc:597] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:25.590857 30793 tablet_bootstrap.cc:492] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:19:25.591887 30793 tablet_bootstrap.cc:492] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Bootstrap complete.
I20260709 12:19:25.592495 30793 ts_tablet_manager.cc:1403] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.001s
I20260709 12:19:25.594772 30793 raft_consensus.cc:359] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.595588 30793 raft_consensus.cc:740] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:25.596318 30793 consensus_queue.cc:260] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.598152 30793 ts_tablet_manager.cc:1434] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:25.598960 30793 tablet_bootstrap.cc:492] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:25.615322 30793 tablet_bootstrap.cc:492] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.616117 30793 tablet_bootstrap.cc:492] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90: Bootstrap complete.
I20260709 12:19:25.616760 30793 ts_tablet_manager.cc:1403] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 12:19:25.619024 30793 raft_consensus.cc:359] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.619590 30793 raft_consensus.cc:740] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:25.620280 30793 consensus_queue.cc:260] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.621912 30793 ts_tablet_manager.cc:1434] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:25.622385 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.193:41967
I20260709 12:19:25.622654 30793 tablet_bootstrap.cc:492] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:25.622486 30855 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.193:41967 every 8 connection(s)
I20260709 12:19:25.632018 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:25.642277 30793 tablet_bootstrap.cc:492] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.643513 30793 tablet_bootstrap.cc:492] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90: Bootstrap complete.
I20260709 12:19:25.644253 30793 ts_tablet_manager.cc:1403] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:19:25.650260 30793 raft_consensus.cc:359] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.651211 30793 raft_consensus.cc:740] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:25.652014 30793 consensus_queue.cc:260] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.654161 30793 ts_tablet_manager.cc:1434] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:19:25.655184 30793 tablet_bootstrap.cc:492] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:25.663671 30856 heartbeater.cc:344] Connected to a master server at 127.17.249.254:32831
I20260709 12:19:25.664281 30856 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:25.665391 30856 heartbeater.cc:507] Master 127.17.249.254:32831 requested a full tablet report, sending...
I20260709 12:19:25.671554 30793 tablet_bootstrap.cc:492] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.672626 30370 ts_manager.cc:194] Re-registered known tserver with Master: fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967)
I20260709 12:19:25.672678 30793 tablet_bootstrap.cc:492] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap complete.
I20260709 12:19:25.673266 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e"
dest_uuid: "5116278a04214646817d79ecd9e626d8"
mode: GRACEFUL
new_leader_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:19:25.674141 30793 ts_tablet_manager.cc:1403] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:19:25.674216 30548 raft_consensus.cc:606] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Received request to transfer leadership to TS bc523387ced844c1beb7d8ce3bc03900
I20260709 12:19:25.677140 30793 raft_consensus.cc:359] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.677834 30793 raft_consensus.cc:740] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:25.678625 30793 consensus_queue.cc:260] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.678803 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a17b29e162e4760bc83b9cca1c54f3d"
dest_uuid: "5116278a04214646817d79ecd9e626d8"
mode: GRACEFUL
new_leader_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:19:25.679919 30548 raft_consensus.cc:606] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Received request to transfer leadership to TS bc523387ced844c1beb7d8ce3bc03900
I20260709 12:19:25.680472 30793 ts_tablet_manager.cc:1434] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:25.681412 30793 tablet_bootstrap.cc:492] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:25.681897 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:25.683059 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:25.684072 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:25.686182 30370 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57014
I20260709 12:19:25.691807 30856 heartbeater.cc:499] Master 127.17.249.254:32831 was elected leader, sending a full tablet report...
I20260709 12:19:25.695130 30793 tablet_bootstrap.cc:492] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.696112 30793 tablet_bootstrap.cc:492] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap complete.
I20260709 12:19:25.696792 30793 ts_tablet_manager.cc:1403] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:19:25.699630 30793 raft_consensus.cc:359] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.700346 30793 raft_consensus.cc:740] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:25.701076 30793 consensus_queue.cc:260] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.702580 30793 ts_tablet_manager.cc:1434] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:25.703344 30793 tablet_bootstrap.cc:492] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:25.716842 30793 tablet_bootstrap.cc:492] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.717677 30793 tablet_bootstrap.cc:492] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90: Bootstrap complete.
I20260709 12:19:25.718362 30793 ts_tablet_manager.cc:1403] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:19:25.720345 30793 raft_consensus.cc:359] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.720821 30793 raft_consensus.cc:740] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:25.721390 30793 consensus_queue.cc:260] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.723248 30793 ts_tablet_manager.cc:1434] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 12:19:25.724239 30793 tablet_bootstrap.cc:492] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap starting.
I20260709 12:19:25.737507 30775 raft_consensus.cc:993] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8: : Instructing follower bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:25.738236 30770 raft_consensus.cc:1081] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Signalling peer bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:25.739346 30793 tablet_bootstrap.cc:492] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:25.740389 30793 tablet_bootstrap.cc:492] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90: Bootstrap complete.
I20260709 12:19:25.740653 30622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a17b29e162e4760bc83b9cca1c54f3d"
dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:39806
I20260709 12:19:25.740967 30793 ts_tablet_manager.cc:1403] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 12:19:25.741375 30622 raft_consensus.cc:493] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:25.741796 30622 raft_consensus.cc:3060] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.743340 30793 raft_consensus.cc:359] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.743952 30793 raft_consensus.cc:740] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21b1e7fa9948b584063d07e890ba90, State: Initialized, Role: FOLLOWER
I20260709 12:19:25.744673 30793 consensus_queue.cc:260] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.748472 30793 ts_tablet_manager.cc:1434] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:19:25.752717 30622 raft_consensus.cc:515] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.755348 30622 leader_election.cc:290] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:25.756986 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a17b29e162e4760bc83b9cca1c54f3d" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:25.757972 30548 raft_consensus.cc:3055] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:25.758349 30548 raft_consensus.cc:740] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:25.759443 30548 consensus_queue.cc:260] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.760766 30548 raft_consensus.cc:3060] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.770975 30548 raft_consensus.cc:2468] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 2.
I20260709 12:19:25.772684 30587 leader_election.cc:304] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: 
I20260709 12:19:25.773711 30766 raft_consensus.cc:2804] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:25.775368 30766 raft_consensus.cc:697] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Becoming Leader. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:25.775276 30830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a17b29e162e4760bc83b9cca1c54f3d" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:25.776366 30830 raft_consensus.cc:3060] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.776912 30766 consensus_queue.cc:237] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:25.787554 30830 raft_consensus.cc:2468] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 2.
I20260709 12:19:25.787871 30370 catalog_manager.cc:5697] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 reported cstate change: term changed from 1 to 2, leader changed from 5116278a04214646817d79ecd9e626d8 (127.17.249.194) to bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "bc523387ced844c1beb7d8ce3bc03900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:25.836607 30829 raft_consensus.cc:3060] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.839421 30830 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.845983 30830 pending_rounds.cc:85] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Aborting all ops after (but not including) 0
I20260709 12:19:25.846295 30830 pending_rounds.cc:107] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:19:25.846652 30830 raft_consensus.cc:2889] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:25.856319 30829 raft_consensus.cc:3060] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:25.865413 30829 pending_rounds.cc:85] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Aborting all ops after (but not including) 0
I20260709 12:19:25.865782 30829 pending_rounds.cc:107] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:19:25.866075 30829 raft_consensus.cc:2889] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:25.982070 30829 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.028744 30829 raft_consensus.cc:3060] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:26.056773 30775 raft_consensus.cc:993] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8: : Instructing follower bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:26.057322 30770 raft_consensus.cc:1081] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Signalling peer bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:26.059262 30622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e"
dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:39806
I20260709 12:19:26.059778 30622 raft_consensus.cc:493] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:26.060040 30622 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:26.067256 30622 raft_consensus.cc:515] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:26.068857 30622 leader_election.cc:290] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 3 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:26.070113 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:26.070127 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:26.070866 30548 raft_consensus.cc:3055] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:26.071079 30829 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:26.071255 30548 raft_consensus.cc:740] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:26.072284 30548 consensus_queue.cc:260] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:26.073563 30548 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:26.077031 30829 raft_consensus.cc:2468] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 3.
I20260709 12:19:26.078338 30586 leader_election.cc:304] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:26.079212 30766 raft_consensus.cc:2804] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:26.079634 30766 raft_consensus.cc:697] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 3 LEADER]: Becoming Leader. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:26.080399 30548 raft_consensus.cc:2468] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 3.
I20260709 12:19:26.080525 30766 consensus_queue.cc:237] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:26.088857 30368 catalog_manager.cc:5697] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 reported cstate change: term changed from 2 to 3, leader changed from 5116278a04214646817d79ecd9e626d8 (127.17.249.194) to bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195). New cstate: current_term: 3 leader_uuid: "bc523387ced844c1beb7d8ce3bc03900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:26.123404 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:19:26.195087 30548 raft_consensus.cc:1275] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:26.196874 30766 consensus_queue.cc:1048] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:26.213466 30829 raft_consensus.cc:1275] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:26.215449 30886 consensus_queue.cc:1048] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:26.464922 30548 raft_consensus.cc:1275] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 3 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:26.466565 30766 consensus_queue.cc:1048] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:26.478686 30829 raft_consensus.cc:1275] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 3 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:26.480638 30868 consensus_queue.cc:1048] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:26.695880 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:26.717367 30622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e"
dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
mode: GRACEFUL
new_leader_uuid: "5116278a04214646817d79ecd9e626d8"
 from {username='slave'} at 127.0.0.1:50020
I20260709 12:19:26.718130 30622 raft_consensus.cc:606] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 3 LEADER]: Received request to transfer leadership to TS 5116278a04214646817d79ecd9e626d8
I20260709 12:19:26.721535 30622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9"
dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
mode: GRACEFUL
new_leader_uuid: "5116278a04214646817d79ecd9e626d8"
 from {username='slave'} at 127.0.0.1:50020
I20260709 12:19:26.722189 30622 raft_consensus.cc:606] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Received request to transfer leadership to TS 5116278a04214646817d79ecd9e626d8
I20260709 12:19:26.723596 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:26.724720 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:26.725715 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:27.094866 30868 raft_consensus.cc:993] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900: : Instructing follower 5116278a04214646817d79ecd9e626d8 to start an election
I20260709 12:19:27.095419 30766 raft_consensus.cc:1081] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 3 LEADER]: Signalling peer 5116278a04214646817d79ecd9e626d8 to start an election
I20260709 12:19:27.097666 30766 raft_consensus.cc:993] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900: : Instructing follower 5116278a04214646817d79ecd9e626d8 to start an election
I20260709 12:19:27.097637 30548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e"
dest_uuid: "5116278a04214646817d79ecd9e626d8"
 from {username='slave'} at 127.0.0.1:52282
I20260709 12:19:27.098383 30766 raft_consensus.cc:1081] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Signalling peer 5116278a04214646817d79ecd9e626d8 to start an election
I20260709 12:19:27.098387 30548 raft_consensus.cc:493] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:27.098994 30548 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:27.100592 30547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9"
dest_uuid: "5116278a04214646817d79ecd9e626d8"
 from {username='slave'} at 127.0.0.1:52282
I20260709 12:19:27.101264 30547 raft_consensus.cc:493] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:27.101640 30547 raft_consensus.cc:3060] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.107170 30548 raft_consensus.cc:515] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:27.109627 30548 leader_election.cc:290] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 4 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:27.110297 30547 raft_consensus.cc:515] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:27.111111 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:27.111984 30622 raft_consensus.cc:3055] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:27.112322 30622 raft_consensus.cc:740] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:27.112454 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:27.113137 30829 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:27.113435 30830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:27.113369 30622 consensus_queue.cc:260] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:27.114168 30830 raft_consensus.cc:3060] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.114852 30622 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:27.119514 30547 leader_election.cc:290] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 3 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:27.119990 30830 raft_consensus.cc:2468] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 3.
I20260709 12:19:27.121061 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9ef2c236474d5e9f324f7b298e26f9" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:27.121291 30512 leader_election.cc:304] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:27.121803 30621 raft_consensus.cc:3055] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:27.122179 30621 raft_consensus.cc:740] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:27.122340 30890 raft_consensus.cc:2804] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:27.123183 30890 raft_consensus.cc:697] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 3 LEADER]: Becoming Leader. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:27.123258 30829 raft_consensus.cc:2468] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 4.
I20260709 12:19:27.124200 30890 consensus_queue.cc:237] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:27.125383 30622 raft_consensus.cc:2468] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 4.
W20260709 12:19:27.125651 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:19:27.123266 30621 consensus_queue.cc:260] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:27.126978 30513 leader_election.cc:304] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, bc523387ced844c1beb7d8ce3bc03900; no voters: 
I20260709 12:19:27.127403 30621 raft_consensus.cc:3060] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.128778 30889 raft_consensus.cc:2804] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:27.129379 30889 raft_consensus.cc:697] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 4 LEADER]: Becoming Leader. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:27.130403 30889 consensus_queue.cc:237] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:27.135839 30370 catalog_manager.cc:5697] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 reported cstate change: term changed from 2 to 3, leader changed from bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195) to 5116278a04214646817d79ecd9e626d8 (127.17.249.194). New cstate: current_term: 3 leader_uuid: "5116278a04214646817d79ecd9e626d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:27.137610 30621 raft_consensus.cc:2468] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 3.
I20260709 12:19:27.153630 30370 catalog_manager.cc:5697] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 reported cstate change: term changed from 3 to 4, leader changed from bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195) to 5116278a04214646817d79ecd9e626d8 (127.17.249.194). New cstate: current_term: 4 leader_uuid: "5116278a04214646817d79ecd9e626d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:27.523631 30830 raft_consensus.cc:1275] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 3 FOLLOWER]: Refusing update from remote peer 5116278a04214646817d79ecd9e626d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:27.525164 30889 consensus_queue.cc:1048] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:27.538674 30621 raft_consensus.cc:1275] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 FOLLOWER]: Refusing update from remote peer 5116278a04214646817d79ecd9e626d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:27.541575 30770 consensus_queue.cc:1048] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:27.565344 30621 raft_consensus.cc:1275] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 4 FOLLOWER]: Refusing update from remote peer 5116278a04214646817d79ecd9e626d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:27.567032 30770 consensus_queue.cc:1048] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:27.580454 30830 raft_consensus.cc:1275] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 4 FOLLOWER]: Refusing update from remote peer 5116278a04214646817d79ecd9e626d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:27.582233 30890 consensus_queue.cc:1048] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:27.733394 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:27.742813 30547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e"
dest_uuid: "5116278a04214646817d79ecd9e626d8"
mode: GRACEFUL
new_leader_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:19:27.743532 30547 raft_consensus.cc:606] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 4 LEADER]: Received request to transfer leadership to TS bc523387ced844c1beb7d8ce3bc03900
I20260709 12:19:27.746547 30547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9"
dest_uuid: "5116278a04214646817d79ecd9e626d8"
mode: GRACEFUL
new_leader_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:19:27.747442 30547 raft_consensus.cc:606] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Received request to transfer leadership to TS bc523387ced844c1beb7d8ce3bc03900
I20260709 12:19:27.748865 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:27.749522 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:27.750254 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:28.059373 30889 raft_consensus.cc:993] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8: : Instructing follower bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:28.059949 30889 raft_consensus.cc:1081] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Signalling peer bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:28.062186 30621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9"
dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:39806
I20260709 12:19:28.062911 30621 raft_consensus.cc:493] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:28.063265 30621 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:28.071789 30621 raft_consensus.cc:515] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:28.073975 30621 leader_election.cc:290] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 3 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:28.074769 30830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:28.075255 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:28.075645 30830 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:28.076083 30547 raft_consensus.cc:3055] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:28.076531 30547 raft_consensus.cc:740] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:28.077539 30547 consensus_queue.cc:260] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:28.078879 30547 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:28.082041 30830 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 3.
I20260709 12:19:28.083415 30586 leader_election.cc:304] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:28.084357 30766 raft_consensus.cc:2804] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:28.084860 30766 raft_consensus.cc:697] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 LEADER]: Becoming Leader. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:28.085747 30766 consensus_queue.cc:237] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:28.086501 30547 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 3.
I20260709 12:19:28.094599 30368 catalog_manager.cc:5697] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 reported cstate change: term changed from 2 to 3, leader changed from 5116278a04214646817d79ecd9e626d8 (127.17.249.194) to bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195). New cstate: current_term: 3 leader_uuid: "bc523387ced844c1beb7d8ce3bc03900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:28.127048 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:19:28.173800 30890 raft_consensus.cc:993] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8: : Instructing follower bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:28.174476 30889 raft_consensus.cc:1081] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 4 LEADER]: Signalling peer bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:28.176445 30621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e"
dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:39806
I20260709 12:19:28.177181 30621 raft_consensus.cc:493] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:28.177525 30621 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:28.184270 30621 raft_consensus.cc:515] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:28.186247 30621 leader_election.cc:290] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 5 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:28.187563 30830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:28.187760 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "159722b4e9d5438ebb8db37486c9546e" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:28.188410 30830 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:28.188488 30547 raft_consensus.cc:3055] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:28.188902 30547 raft_consensus.cc:740] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:28.189651 30547 consensus_queue.cc:260] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:28.190594 30547 raft_consensus.cc:3060] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:28.195119 30830 raft_consensus.cc:2468] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 5.
I20260709 12:19:28.196416 30547 raft_consensus.cc:2468] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 5.
I20260709 12:19:28.197033 30586 leader_election.cc:304] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:28.198199 30766 raft_consensus.cc:2804] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:28.198843 30766 raft_consensus.cc:697] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 5 LEADER]: Becoming Leader. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:28.199642 30766 consensus_queue.cc:237] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:28.207229 30368 catalog_manager.cc:5697] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 reported cstate change: term changed from 4 to 5, leader changed from 5116278a04214646817d79ecd9e626d8 (127.17.249.194) to bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195). New cstate: current_term: 5 leader_uuid: "bc523387ced844c1beb7d8ce3bc03900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:28.514003 30829 raft_consensus.cc:1275] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 3 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:28.515874 30766 consensus_queue.cc:1048] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:28.530408 30547 raft_consensus.cc:1275] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 3 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:28.532651 30915 consensus_queue.cc:1048] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:28.622551 30829 raft_consensus.cc:1275] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 5 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:28.624063 30766 consensus_queue.cc:1048] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:28.635840 30547 raft_consensus.cc:1275] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 5 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:28.637635 30920 consensus_queue.cc:1048] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:28.756986 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:28.766472 30621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9"
dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
mode: GRACEFUL
new_leader_uuid: "5116278a04214646817d79ecd9e626d8"
 from {username='slave'} at 127.0.0.1:50020
I20260709 12:19:28.767316 30621 raft_consensus.cc:606] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 LEADER]: Received request to transfer leadership to TS 5116278a04214646817d79ecd9e626d8
I20260709 12:19:28.770215 30621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cc62116945f494d83fd7480db664b41"
dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
mode: GRACEFUL
new_leader_uuid: "5116278a04214646817d79ecd9e626d8"
 from {username='slave'} at 127.0.0.1:50020
I20260709 12:19:28.770768 30621 raft_consensus.cc:606] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 1 LEADER]: Received request to transfer leadership to TS 5116278a04214646817d79ecd9e626d8
I20260709 12:19:28.772071 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:28.772801 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:28.773445 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:29.094373 30766 raft_consensus.cc:993] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900: : Instructing follower 5116278a04214646817d79ecd9e626d8 to start an election
I20260709 12:19:29.094951 30915 raft_consensus.cc:1081] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 LEADER]: Signalling peer 5116278a04214646817d79ecd9e626d8 to start an election
I20260709 12:19:29.097034 30547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9"
dest_uuid: "5116278a04214646817d79ecd9e626d8"
 from {username='slave'} at 127.0.0.1:52282
I20260709 12:19:29.097712 30547 raft_consensus.cc:493] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:29.098162 30547 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:29.103716 30547 raft_consensus.cc:515] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:29.105510 30547 leader_election.cc:290] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 4 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:29.106869 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:29.106913 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:29.107663 30829 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:29.107761 30621 raft_consensus.cc:3055] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:29.108253 30621 raft_consensus.cc:740] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:29.108969 30621 consensus_queue.cc:260] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:29.110008 30621 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:29.115648 30829 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 4.
I20260709 12:19:29.116873 30621 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 4.
I20260709 12:19:29.117039 30512 leader_election.cc:304] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:29.117916 30889 raft_consensus.cc:2804] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:29.118984 30889 raft_consensus.cc:697] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 4 LEADER]: Becoming Leader. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:29.119967 30889 consensus_queue.cc:237] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:29.126477 30368 catalog_manager.cc:5697] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 reported cstate change: term changed from 3 to 4, leader changed from bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195) to 5116278a04214646817d79ecd9e626d8 (127.17.249.194). New cstate: current_term: 4 leader_uuid: "5116278a04214646817d79ecd9e626d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:29.127996 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:19:29.148618 30766 raft_consensus.cc:993] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900: : Instructing follower 5116278a04214646817d79ecd9e626d8 to start an election
I20260709 12:19:29.149327 30915 raft_consensus.cc:1081] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 1 LEADER]: Signalling peer 5116278a04214646817d79ecd9e626d8 to start an election
I20260709 12:19:29.151363 30547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cc62116945f494d83fd7480db664b41"
dest_uuid: "5116278a04214646817d79ecd9e626d8"
 from {username='slave'} at 127.0.0.1:52282
I20260709 12:19:29.152045 30547 raft_consensus.cc:493] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:29.152387 30547 raft_consensus.cc:3060] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:29.158650 30547 raft_consensus.cc:515] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:29.160709 30547 leader_election.cc:290] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195:35199)
I20260709 12:19:29.162057 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc62116945f494d83fd7480db664b41" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
I20260709 12:19:29.161901 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc62116945f494d83fd7480db664b41" candidate_uuid: "5116278a04214646817d79ecd9e626d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:29.162968 30621 raft_consensus.cc:3055] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:29.162968 30829 raft_consensus.cc:3060] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:29.163604 30621 raft_consensus.cc:740] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:29.164657 30621 consensus_queue.cc:260] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:29.166085 30621 raft_consensus.cc:3060] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:29.171651 30829 raft_consensus.cc:2468] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 2.
I20260709 12:19:29.173226 30512 leader_election.cc:304] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5116278a04214646817d79ecd9e626d8, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:29.174154 30621 raft_consensus.cc:2468] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5116278a04214646817d79ecd9e626d8 in term 2.
I20260709 12:19:29.174240 30889 raft_consensus.cc:2804] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:29.176407 30889 raft_consensus.cc:697] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Becoming Leader. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:29.177349 30889 consensus_queue.cc:237] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:29.185842 30368 catalog_manager.cc:5697] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 reported cstate change: term changed from 1 to 2, leader changed from bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195) to 5116278a04214646817d79ecd9e626d8 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "5116278a04214646817d79ecd9e626d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:29.689699 30829 raft_consensus.cc:1275] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Refusing update from remote peer 5116278a04214646817d79ecd9e626d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:29.691493 30889 consensus_queue.cc:1048] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:29.692669 30621 raft_consensus.cc:1275] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Refusing update from remote peer 5116278a04214646817d79ecd9e626d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:29.694264 30889 consensus_queue.cc:1048] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:29.722772 30621 raft_consensus.cc:1275] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 4 FOLLOWER]: Refusing update from remote peer 5116278a04214646817d79ecd9e626d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:29.724375 30932 consensus_queue.cc:1048] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:29.736320 30829 raft_consensus.cc:1275] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 4 FOLLOWER]: Refusing update from remote peer 5116278a04214646817d79ecd9e626d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:29.737815 30937 consensus_queue.cc:1048] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:29.779989 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:29.788838 30547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9"
dest_uuid: "5116278a04214646817d79ecd9e626d8"
mode: GRACEFUL
new_leader_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:19:29.789433 30547 raft_consensus.cc:606] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 4 LEADER]: Received request to transfer leadership to TS bc523387ced844c1beb7d8ce3bc03900
I20260709 12:19:29.792235 30547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6574f545d074bf0a8fe4425bbc9361e"
dest_uuid: "5116278a04214646817d79ecd9e626d8"
mode: GRACEFUL
new_leader_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:53864
I20260709 12:19:29.792744 30547 raft_consensus.cc:606] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Received request to transfer leadership to TS bc523387ced844c1beb7d8ce3bc03900
I20260709 12:19:29.794026 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:29.794713 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:29.795528 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:30.067998 30931 raft_consensus.cc:993] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8: : Instructing follower bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:30.068744 30931 raft_consensus.cc:1081] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Signalling peer bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:30.070644 30621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6574f545d074bf0a8fe4425bbc9361e"
dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:39806
I20260709 12:19:30.071240 30621 raft_consensus.cc:493] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:30.071532 30621 raft_consensus.cc:3060] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:30.077464 30621 raft_consensus.cc:515] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:30.078998 30621 leader_election.cc:290] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:30.080113 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6574f545d074bf0a8fe4425bbc9361e" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:30.080422 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6574f545d074bf0a8fe4425bbc9361e" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:30.080670 30547 raft_consensus.cc:3055] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:30.081235 30547 raft_consensus.cc:740] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:30.081272 30829 raft_consensus.cc:3060] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:30.082320 30547 consensus_queue.cc:260] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:30.083416 30547 raft_consensus.cc:3060] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:30.087988 30829 raft_consensus.cc:2468] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 2.
I20260709 12:19:30.088713 30547 raft_consensus.cc:2468] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 2.
I20260709 12:19:30.089478 30586 leader_election.cc:304] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:30.090512 30766 raft_consensus.cc:2804] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:30.091418 30766 raft_consensus.cc:697] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Becoming Leader. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:30.092208 30766 consensus_queue.cc:237] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:30.099668 30368 catalog_manager.cc:5697] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 reported cstate change: term changed from 1 to 2, leader changed from 5116278a04214646817d79ecd9e626d8 (127.17.249.194) to bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195). New cstate: current_term: 2 leader_uuid: "bc523387ced844c1beb7d8ce3bc03900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:30.129299 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:19:30.223901 30937 raft_consensus.cc:993] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8: : Instructing follower bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:30.224601 30931 raft_consensus.cc:1081] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 4 LEADER]: Signalling peer bc523387ced844c1beb7d8ce3bc03900 to start an election
I20260709 12:19:30.226733 30622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9"
dest_uuid: "bc523387ced844c1beb7d8ce3bc03900"
 from {username='slave'} at 127.0.0.1:39806
I20260709 12:19:30.227783 30622 raft_consensus.cc:493] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:30.228341 30622 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:30.235599 30622 raft_consensus.cc:515] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:30.237414 30622 leader_election.cc:290] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 5 election: Requested vote from peers fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967), 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775)
I20260709 12:19:30.238018 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "fa21b1e7fa9948b584063d07e890ba90"
I20260709 12:19:30.238602 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528787a1f4894df08e46c6466f5d90d9" candidate_uuid: "bc523387ced844c1beb7d8ce3bc03900" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5116278a04214646817d79ecd9e626d8"
I20260709 12:19:30.238731 30829 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:30.239332 30547 raft_consensus.cc:3055] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:30.239647 30547 raft_consensus.cc:740] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5116278a04214646817d79ecd9e626d8, State: Running, Role: LEADER
I20260709 12:19:30.240314 30547 consensus_queue.cc:260] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:30.241199 30547 raft_consensus.cc:3060] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:30.244928 30829 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 5.
I20260709 12:19:30.246227 30586 leader_election.cc:304] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc523387ced844c1beb7d8ce3bc03900, fa21b1e7fa9948b584063d07e890ba90; no voters: 
I20260709 12:19:30.246634 30547 raft_consensus.cc:2468] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc523387ced844c1beb7d8ce3bc03900 in term 5.
I20260709 12:19:30.247113 30766 raft_consensus.cc:2804] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:30.247640 30766 raft_consensus.cc:697] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 5 LEADER]: Becoming Leader. State: Replica: bc523387ced844c1beb7d8ce3bc03900, State: Running, Role: LEADER
I20260709 12:19:30.248436 30766 consensus_queue.cc:237] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } }
I20260709 12:19:30.255666 30368 catalog_manager.cc:5697] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 reported cstate change: term changed from 4 to 5, leader changed from 5116278a04214646817d79ecd9e626d8 (127.17.249.194) to bc523387ced844c1beb7d8ce3bc03900 (127.17.249.195). New cstate: current_term: 5 leader_uuid: "bc523387ced844c1beb7d8ce3bc03900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc523387ced844c1beb7d8ce3bc03900" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:30.638691 30829 raft_consensus.cc:1275] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:30.640198 30766 consensus_queue.cc:1048] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:30.650871 30548 raft_consensus.cc:1275] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:30.653119 30766 consensus_queue.cc:1048] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:30.663475 30829 raft_consensus.cc:1275] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 5 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:30.664921 30766 consensus_queue.cc:1048] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa21b1e7fa9948b584063d07e890ba90" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:30.675655 30548 raft_consensus.cc:1275] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 5 FOLLOWER]: Refusing update from remote peer bc523387ced844c1beb7d8ce3bc03900: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:30.676960 30940 consensus_queue.cc:1048] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5116278a04214646817d79ecd9e626d8" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:30.803267 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:30.837349 18407 tablet_server.cc:179] TabletServer@127.17.249.193:41967 shutting down...
I20260709 12:19:30.862974 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:30.863893 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:30.864678 18407 raft_consensus.cc:2243] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.865226 18407 raft_consensus.cc:2272] T 4a17b29e162e4760bc83b9cca1c54f3d P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.867707 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:30.868533 18407 raft_consensus.cc:2243] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.869105 18407 raft_consensus.cc:2272] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:30.871021 30512 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 12:19:30.871790 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:30.872583 18407 raft_consensus.cc:2243] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.873124 18407 raft_consensus.cc:2272] T d6574f545d074bf0a8fe4425bbc9361e P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:30.874665 30512 consensus_peers.cc:597] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:30.876612 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:30.877573 18407 raft_consensus.cc:2243] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.878086 18407 raft_consensus.cc:2272] T 257789f1397f490198e7b402b8406ccb P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.880252 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:30.880771 18407 raft_consensus.cc:2243] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.881207 18407 raft_consensus.cc:2272] T 528787a1f4894df08e46c6466f5d90d9 P fa21b1e7fa9948b584063d07e890ba90 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.883863 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:30.884438 18407 raft_consensus.cc:2243] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.884779 18407 raft_consensus.cc:2272] T 38ca05e3138b4065902af82e9d0f6d5b P fa21b1e7fa9948b584063d07e890ba90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.886866 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:30.887445 18407 raft_consensus.cc:2243] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.887830 18407 raft_consensus.cc:2272] T daed3c44d1a242bfa9c852c047babec4 P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.889730 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:30.890213 18407 raft_consensus.cc:2243] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.890627 18407 raft_consensus.cc:2272] T 159722b4e9d5438ebb8db37486c9546e P fa21b1e7fa9948b584063d07e890ba90 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.892648 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:30.893213 18407 raft_consensus.cc:2243] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.893666 18407 raft_consensus.cc:2272] T 8cc62116945f494d83fd7480db664b41 P fa21b1e7fa9948b584063d07e890ba90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.895972 18407 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:30.896607 18407 raft_consensus.cc:2243] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.897215 18407 raft_consensus.cc:2272] T bf9ef2c236474d5e9f324f7b298e26f9 P fa21b1e7fa9948b584063d07e890ba90 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:30.899013 30586 consensus_peers.cc:597] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:30.930004 18407 tablet_server.cc:196] TabletServer@127.17.249.193:41967 shutdown complete.
I20260709 12:19:30.955880 18407 tablet_server.cc:179] TabletServer@127.17.249.194:0 shutting down...
W20260709 12:19:30.986296 30586 consensus_peers.cc:597] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:30.990278 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:30.991276 18407 tablet_replica.cc:333] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8: stopping tablet replica
I20260709 12:19:30.992044 18407 raft_consensus.cc:2243] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:30.992990 18407 raft_consensus.cc:2272] T 8cc62116945f494d83fd7480db664b41 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.995715 18407 tablet_replica.cc:333] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8: stopping tablet replica
I20260709 12:19:30.996460 18407 raft_consensus.cc:2243] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.996973 18407 raft_consensus.cc:2272] T 159722b4e9d5438ebb8db37486c9546e P 5116278a04214646817d79ecd9e626d8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.999845 18407 tablet_replica.cc:333] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8: stopping tablet replica
I20260709 12:19:31.000705 18407 raft_consensus.cc:2243] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:31.001636 18407 raft_consensus.cc:2272] T daed3c44d1a242bfa9c852c047babec4 P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.004961 18407 tablet_replica.cc:333] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8: stopping tablet replica
I20260709 12:19:31.005844 18407 raft_consensus.cc:2243] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:31.005745 30512 consensus_peers.cc:597] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:31.006706 18407 raft_consensus.cc:2272] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.009364 18407 tablet_replica.cc:333] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8: stopping tablet replica
I20260709 12:19:31.009931 18407 raft_consensus.cc:2243] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:31.010350 18407 raft_consensus.cc:2272] T 528787a1f4894df08e46c6466f5d90d9 P 5116278a04214646817d79ecd9e626d8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.013859 18407 tablet_replica.cc:333] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8: stopping tablet replica
I20260709 12:19:31.014437 18407 raft_consensus.cc:2243] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:31.015301 18407 raft_consensus.cc:2272] T 38ca05e3138b4065902af82e9d0f6d5b P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.017397 18407 tablet_replica.cc:333] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8: stopping tablet replica
I20260709 12:19:31.017877 18407 raft_consensus.cc:2243] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:31.018250 18407 raft_consensus.cc:2272] T d6574f545d074bf0a8fe4425bbc9361e P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.021268 18407 tablet_replica.cc:333] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8: stopping tablet replica
I20260709 12:19:31.022037 18407 raft_consensus.cc:2243] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:31.023027 18407 raft_consensus.cc:2272] T 257789f1397f490198e7b402b8406ccb P 5116278a04214646817d79ecd9e626d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.025691 18407 tablet_replica.cc:333] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8: stopping tablet replica
W20260709 12:19:31.026046 30587 consensus_peers.cc:597] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 -> Peer 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775): Couldn't send request to peer 5116278a04214646817d79ecd9e626d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:31.026278 18407 raft_consensus.cc:2243] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:31.027501 18407 raft_consensus.cc:2272] T bf9ef2c236474d5e9f324f7b298e26f9 P 5116278a04214646817d79ecd9e626d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.029994 18407 tablet_replica.cc:333] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8: stopping tablet replica
I20260709 12:19:31.030601 18407 raft_consensus.cc:2243] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:31.031225 18407 raft_consensus.cc:2272] T 4a17b29e162e4760bc83b9cca1c54f3d P 5116278a04214646817d79ecd9e626d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.066924 18407 tablet_server.cc:196] TabletServer@127.17.249.194:0 shutdown complete.
I20260709 12:19:31.100083 18407 tablet_server.cc:179] TabletServer@127.17.249.195:0 shutting down...
W20260709 12:19:31.110546 30586 consensus_peers.cc:597] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:31.118714 30587 consensus_peers.cc:597] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 -> Peer 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775): Couldn't send request to peer 5116278a04214646817d79ecd9e626d8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:31.131081 30419 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:19:31.144164 30587 consensus_peers.cc:597] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 -> Peer 5116278a04214646817d79ecd9e626d8 (127.17.249.194:36775): Couldn't send request to peer 5116278a04214646817d79ecd9e626d8. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:31.153772 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:31.155109 18407 tablet_replica.cc:333] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900: stopping tablet replica
I20260709 12:19:31.156069 18407 raft_consensus.cc:2243] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:31.157122 18407 raft_consensus.cc:2272] T 0c5d8b6d4c8a495e81eac9f3e5094a9e P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.160048 18407 tablet_replica.cc:333] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900: stopping tablet replica
I20260709 12:19:31.160847 18407 raft_consensus.cc:2243] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:31.161805 18407 raft_consensus.cc:2272] T 4a17b29e162e4760bc83b9cca1c54f3d P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.164389 18407 tablet_replica.cc:333] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900: stopping tablet replica
I20260709 12:19:31.165102 18407 raft_consensus.cc:2243] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:31.165601 18407 raft_consensus.cc:2272] T bf9ef2c236474d5e9f324f7b298e26f9 P bc523387ced844c1beb7d8ce3bc03900 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.168089 18407 tablet_replica.cc:333] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900: stopping tablet replica
I20260709 12:19:31.169641 18407 raft_consensus.cc:2243] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:31.170589 18407 raft_consensus.cc:2272] T daed3c44d1a242bfa9c852c047babec4 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.173280 18407 tablet_replica.cc:333] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900: stopping tablet replica
I20260709 12:19:31.174243 18407 raft_consensus.cc:2243] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:31.174928 18407 raft_consensus.cc:2272] T 8cc62116945f494d83fd7480db664b41 P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.177970 18407 tablet_replica.cc:333] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900: stopping tablet replica
I20260709 12:19:31.178555 18407 raft_consensus.cc:2243] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:19:31.179507 18407 raft_consensus.cc:2272] T 159722b4e9d5438ebb8db37486c9546e P bc523387ced844c1beb7d8ce3bc03900 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.181885 18407 tablet_replica.cc:333] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900: stopping tablet replica
I20260709 12:19:31.182914 18407 raft_consensus.cc:2243] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:19:31.183843 18407 raft_consensus.cc:2272] T 528787a1f4894df08e46c6466f5d90d9 P bc523387ced844c1beb7d8ce3bc03900 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.188108 18407 tablet_replica.cc:333] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900: stopping tablet replica
I20260709 12:19:31.188830 18407 raft_consensus.cc:2243] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:31.189395 18407 raft_consensus.cc:2272] T 38ca05e3138b4065902af82e9d0f6d5b P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:31.189478 30586 consensus_peers.cc:597] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 -> Peer fa21b1e7fa9948b584063d07e890ba90 (127.17.249.193:41967): Couldn't send request to peer fa21b1e7fa9948b584063d07e890ba90. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:31.191928 18407 tablet_replica.cc:333] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900: stopping tablet replica
I20260709 12:19:31.192770 18407 raft_consensus.cc:2243] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:31.193773 18407 raft_consensus.cc:2272] T d6574f545d074bf0a8fe4425bbc9361e P bc523387ced844c1beb7d8ce3bc03900 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.196898 18407 tablet_replica.cc:333] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900: stopping tablet replica
I20260709 12:19:31.197499 18407 raft_consensus.cc:2243] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:31.198088 18407 raft_consensus.cc:2272] T 257789f1397f490198e7b402b8406ccb P bc523387ced844c1beb7d8ce3bc03900 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.231065 18407 tablet_server.cc:196] TabletServer@127.17.249.195:0 shutdown complete.
I20260709 12:19:31.263162 18407 master.cc:562] Master@127.17.249.254:32831 shutting down...
I20260709 12:19:31.298707 18407 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:31.299396 18407 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.299741 18407 tablet_replica.cc:333] T 00000000000000000000000000000000 P 200c4f2a3ee0413a982a75d88fb91f26: stopping tablet replica
I20260709 12:19:31.323632 18407 master.cc:584] Master@127.17.249.254:32831 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13424 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:19:31.373804 18407 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.249.254:40305
I20260709 12:19:31.375174 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:31.381323 30960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:31.381454 30961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:31.382630 30963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:31.385404 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:31.386668 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:31.387449 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:31.387679 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599571387659 us; error 0 us; skew 500 ppm
I20260709 12:19:31.388592 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:31.392429 18407 webserver.cc:533] Webserver started at http://127.17.249.254:35311/ using document root <none> and password file <none>
I20260709 12:19:31.393088 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:31.393307 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:31.393675 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:31.395403 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/master-0-root/instance:
uuid: "e6f64955b3044333b857df16cb54cea2"
format_stamp: "Formatted at 2026-07-09 12:19:31 on dist-test-slave-7mcn"
I20260709 12:19:31.401471 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:19:31.405725 30968 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:31.406723 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:19:31.407183 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/master-0-root
uuid: "e6f64955b3044333b857df16cb54cea2"
format_stamp: "Formatted at 2026-07-09 12:19:31 on dist-test-slave-7mcn"
I20260709 12:19:31.407523 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:31.428361 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:31.429634 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:31.474321 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.254:40305
I20260709 12:19:31.474550 31019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.254:40305 every 8 connection(s)
I20260709 12:19:31.478852 31020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:31.493115 31020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2: Bootstrap starting.
I20260709 12:19:31.499063 31020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.504499 31020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2: No bootstrap required, opened a new log
I20260709 12:19:31.507229 31020 raft_consensus.cc:359] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f64955b3044333b857df16cb54cea2" member_type: VOTER }
I20260709 12:19:31.507719 31020 raft_consensus.cc:385] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.507939 31020 raft_consensus.cc:740] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f64955b3044333b857df16cb54cea2, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.508627 31020 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f64955b3044333b857df16cb54cea2" member_type: VOTER }
I20260709 12:19:31.509249 31020 raft_consensus.cc:399] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:31.509517 31020 raft_consensus.cc:493] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:31.509840 31020 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.516340 31020 raft_consensus.cc:515] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f64955b3044333b857df16cb54cea2" member_type: VOTER }
I20260709 12:19:31.517055 31020 leader_election.cc:304] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6f64955b3044333b857df16cb54cea2; no voters: 
I20260709 12:19:31.518406 31020 leader_election.cc:290] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:31.519070 31023 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:31.520606 31023 raft_consensus.cc:697] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [term 1 LEADER]: Becoming Leader. State: Replica: e6f64955b3044333b857df16cb54cea2, State: Running, Role: LEADER
I20260709 12:19:31.521342 31023 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f64955b3044333b857df16cb54cea2" member_type: VOTER }
I20260709 12:19:31.521759 31020 sys_catalog.cc:565] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:31.528040 31024 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6f64955b3044333b857df16cb54cea2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f64955b3044333b857df16cb54cea2" member_type: VOTER } }
I20260709 12:19:31.529002 31024 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:31.528496 31025 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6f64955b3044333b857df16cb54cea2. Latest consensus state: current_term: 1 leader_uuid: "e6f64955b3044333b857df16cb54cea2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f64955b3044333b857df16cb54cea2" member_type: VOTER } }
I20260709 12:19:31.529698 31025 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:31.535981 31031 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:31.541462 31031 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:31.543349 18407 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:31.551935 31031 catalog_manager.cc:1383] Generated new cluster ID: f6733d9e177c458f95d6d2fe8827edfa
I20260709 12:19:31.552278 31031 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:31.569391 31031 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:31.570714 31031 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:31.590338 31031 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2: Generated new TSK 0
I20260709 12:19:31.591068 31031 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:31.611375 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:31.618712 31041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:31.620136 31042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:31.621912 31044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:31.622125 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:31.623572 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:31.623783 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:31.623914 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599571623902 us; error 0 us; skew 500 ppm
I20260709 12:19:31.624434 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:31.627293 18407 webserver.cc:533] Webserver started at http://127.17.249.193:34013/ using document root <none> and password file <none>
I20260709 12:19:31.627879 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:31.628060 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:31.628305 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:31.629541 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-0-root/instance:
uuid: "94215d68137e4a34b530bd9261cfeb1f"
format_stamp: "Formatted at 2026-07-09 12:19:31 on dist-test-slave-7mcn"
I20260709 12:19:31.635169 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 12:19:31.639621 31049 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:31.640628 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:19:31.640976 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-0-root
uuid: "94215d68137e4a34b530bd9261cfeb1f"
format_stamp: "Formatted at 2026-07-09 12:19:31 on dist-test-slave-7mcn"
I20260709 12:19:31.641374 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:31.664178 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:31.665485 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:31.667140 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:31.670007 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:31.670230 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:31.670555 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:31.670722 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:31.721807 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.193:46793
I20260709 12:19:31.722067 31111 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.193:46793 every 8 connection(s)
I20260709 12:19:31.727938 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:31.735916 31116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:31.737713 31117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:31.740082 31120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:31.740288 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:31.741030 31112 heartbeater.cc:344] Connected to a master server at 127.17.249.254:40305
I20260709 12:19:31.741458 31112 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:31.741597 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:31.741937 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:31.742120 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599571742098 us; error 0 us; skew 500 ppm
I20260709 12:19:31.742444 31112 heartbeater.cc:507] Master 127.17.249.254:40305 requested a full tablet report, sending...
I20260709 12:19:31.742851 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:31.744987 30985 ts_manager.cc:194] Registered new tserver with Master: 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193:46793)
I20260709 12:19:31.746107 18407 webserver.cc:533] Webserver started at http://127.17.249.194:44949/ using document root <none> and password file <none>
I20260709 12:19:31.746876 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:31.747128 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:31.747426 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:31.747578 30985 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40786
I20260709 12:19:31.748950 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-1-root/instance:
uuid: "9bc898d2eca3414fbc73d8cf1cf19e55"
format_stamp: "Formatted at 2026-07-09 12:19:31 on dist-test-slave-7mcn"
I20260709 12:19:31.754063 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:19:31.757758 31124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:31.758883 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:19:31.759239 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-1-root
uuid: "9bc898d2eca3414fbc73d8cf1cf19e55"
format_stamp: "Formatted at 2026-07-09 12:19:31 on dist-test-slave-7mcn"
I20260709 12:19:31.759519 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:31.776340 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:31.777915 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:31.779657 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:31.782284 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:31.782477 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:31.782845 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:31.782994 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:31.833510 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.194:33369
I20260709 12:19:31.833663 31186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.194:33369 every 8 connection(s)
I20260709 12:19:31.839421 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:31.847555 31190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:31.848712 31191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:31.851320 31193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:31.851485 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:31.852511 31187 heartbeater.cc:344] Connected to a master server at 127.17.249.254:40305
I20260709 12:19:31.853019 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:19:31.853039 31187 heartbeater.cc:461] Registering TS with master...
W20260709 12:19:31.853392 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:31.853690 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599571853673 us; error 0 us; skew 500 ppm
I20260709 12:19:31.854266 31187 heartbeater.cc:507] Master 127.17.249.254:40305 requested a full tablet report, sending...
I20260709 12:19:31.854358 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:31.857045 30985 ts_manager.cc:194] Registered new tserver with Master: 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369)
I20260709 12:19:31.858167 18407 webserver.cc:533] Webserver started at http://127.17.249.195:38199/ using document root <none> and password file <none>
I20260709 12:19:31.858687 30985 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40792
I20260709 12:19:31.858891 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:31.859294 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:31.859624 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:31.861454 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-2-root/instance:
uuid: "4fdd6cb30d724c43a0e61149fc88df53"
format_stamp: "Formatted at 2026-07-09 12:19:31 on dist-test-slave-7mcn"
I20260709 12:19:31.866721 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:19:31.870586 31198 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:31.871743 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:19:31.872241 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-2-root
uuid: "4fdd6cb30d724c43a0e61149fc88df53"
format_stamp: "Formatted at 2026-07-09 12:19:31 on dist-test-slave-7mcn"
I20260709 12:19:31.872597 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599138854584-18407-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:31.887952 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:31.889374 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:31.891121 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:31.893738 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:31.893980 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:31.894263 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:31.894447 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:31.945710 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.195:45527
I20260709 12:19:31.945827 31260 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.195:45527 every 8 connection(s)
I20260709 12:19:31.962946 31261 heartbeater.cc:344] Connected to a master server at 127.17.249.254:40305
I20260709 12:19:31.963464 31261 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:31.964501 31261 heartbeater.cc:507] Master 127.17.249.254:40305 requested a full tablet report, sending...
I20260709 12:19:31.967581 30985 ts_manager.cc:194] Registered new tserver with Master: 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195:45527)
I20260709 12:19:31.968022 18407 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018445927s
I20260709 12:19:31.969359 30985 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40802
I20260709 12:19:31.997367 30985 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40816:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:31.999684 30985 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:32.051102 31077 tablet_service.cc:1511] Processing CreateTablet for tablet 3845dc9d230741ac9257cb2ac2a37f9c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5ed5afd55ec648b28ff58a99ed334077]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:19:32.052114 31076 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd8705cec4c463fa161ce79be4459f3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5ed5afd55ec648b28ff58a99ed334077]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:19:32.052635 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3845dc9d230741ac9257cb2ac2a37f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.056427 31076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd8705cec4c463fa161ce79be4459f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.060634 31226 tablet_service.cc:1511] Processing CreateTablet for tablet 3845dc9d230741ac9257cb2ac2a37f9c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5ed5afd55ec648b28ff58a99ed334077]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:19:32.062397 31226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3845dc9d230741ac9257cb2ac2a37f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.065035 31152 tablet_service.cc:1511] Processing CreateTablet for tablet 3845dc9d230741ac9257cb2ac2a37f9c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5ed5afd55ec648b28ff58a99ed334077]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:19:32.065410 31151 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd8705cec4c463fa161ce79be4459f3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5ed5afd55ec648b28ff58a99ed334077]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:19:32.066617 31152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3845dc9d230741ac9257cb2ac2a37f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.067277 31151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd8705cec4c463fa161ce79be4459f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.068266 31225 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd8705cec4c463fa161ce79be4459f3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5ed5afd55ec648b28ff58a99ed334077]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:19:32.069816 31225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd8705cec4c463fa161ce79be4459f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.088907 31276 tablet_bootstrap.cc:492] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f: Bootstrap starting.
I20260709 12:19:32.098999 31276 tablet_bootstrap.cc:654] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.110559 31278 tablet_bootstrap.cc:492] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53: Bootstrap starting.
I20260709 12:19:32.111059 31277 tablet_bootstrap.cc:492] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55: Bootstrap starting.
I20260709 12:19:32.117537 31277 tablet_bootstrap.cc:654] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.123998 31278 tablet_bootstrap.cc:654] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.127029 31277 tablet_bootstrap.cc:492] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55: No bootstrap required, opened a new log
I20260709 12:19:32.127744 31277 ts_tablet_manager.cc:1403] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:19:32.129840 31276 tablet_bootstrap.cc:492] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f: No bootstrap required, opened a new log
I20260709 12:19:32.130081 31278 tablet_bootstrap.cc:492] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53: No bootstrap required, opened a new log
I20260709 12:19:32.130713 31276 ts_tablet_manager.cc:1403] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.018s
I20260709 12:19:32.130833 31278 ts_tablet_manager.cc:1403] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53: Time spent bootstrapping tablet: real 0.021s	user 0.002s	sys 0.013s
I20260709 12:19:32.130869 31277 raft_consensus.cc:359] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } }
I20260709 12:19:32.131911 31277 raft_consensus.cc:385] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.132237 31277 raft_consensus.cc:740] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc898d2eca3414fbc73d8cf1cf19e55, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.133082 31277 consensus_queue.cc:260] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } }
I20260709 12:19:32.133955 31276 raft_consensus.cc:359] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.134673 31276 raft_consensus.cc:385] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.135079 31276 raft_consensus.cc:740] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94215d68137e4a34b530bd9261cfeb1f, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.134673 31278 raft_consensus.cc:359] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.136036 31187 heartbeater.cc:499] Master 127.17.249.254:40305 was elected leader, sending a full tablet report...
I20260709 12:19:32.136355 31278 raft_consensus.cc:385] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.136523 31276 consensus_queue.cc:260] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.136824 31278 raft_consensus.cc:740] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fdd6cb30d724c43a0e61149fc88df53, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.138056 31278 consensus_queue.cc:260] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.143782 31282 raft_consensus.cc:493] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.144865 31282 raft_consensus.cc:515] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } }
I20260709 12:19:32.136795 31277 ts_tablet_manager.cc:1434] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:19:32.160089 31282 leader_election.cc:290] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193:46793), 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195:45527)
I20260709 12:19:32.161178 31112 heartbeater.cc:499] Master 127.17.249.254:40305 was elected leader, sending a full tablet report...
I20260709 12:19:32.163846 31278 ts_tablet_manager.cc:1434] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.022s
I20260709 12:19:32.164507 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3845dc9d230741ac9257cb2ac2a37f9c" candidate_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94215d68137e4a34b530bd9261cfeb1f" is_pre_election: true
I20260709 12:19:32.164848 31277 tablet_bootstrap.cc:492] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55: Bootstrap starting.
I20260709 12:19:32.166446 31261 heartbeater.cc:499] Master 127.17.249.254:40305 was elected leader, sending a full tablet report...
W20260709 12:19:32.167114 31126 leader_election.cc:343] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193:46793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.169409 31278 tablet_bootstrap.cc:492] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53: Bootstrap starting.
I20260709 12:19:32.177680 31278 tablet_bootstrap.cc:654] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.180822 31276 ts_tablet_manager.cc:1434] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.008s
I20260709 12:19:32.182096 31276 tablet_bootstrap.cc:492] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f: Bootstrap starting.
I20260709 12:19:32.187726 31278 tablet_bootstrap.cc:492] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53: No bootstrap required, opened a new log
I20260709 12:19:32.187458 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3845dc9d230741ac9257cb2ac2a37f9c" candidate_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fdd6cb30d724c43a0e61149fc88df53" is_pre_election: true
I20260709 12:19:32.188453 31278 ts_tablet_manager.cc:1403] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.006s
W20260709 12:19:32.189682 31125 leader_election.cc:343] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195:45527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.190266 31125 leader_election.cc:304] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc898d2eca3414fbc73d8cf1cf19e55; no voters: 4fdd6cb30d724c43a0e61149fc88df53, 94215d68137e4a34b530bd9261cfeb1f
I20260709 12:19:32.191610 31282 raft_consensus.cc:2749] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.192224 31277 tablet_bootstrap.cc:654] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.198885 31277 tablet_bootstrap.cc:492] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55: No bootstrap required, opened a new log
I20260709 12:19:32.198923 31276 tablet_bootstrap.cc:654] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.191867 31278 raft_consensus.cc:359] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } }
I20260709 12:19:32.200085 31277 ts_tablet_manager.cc:1403] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.002s
I20260709 12:19:32.201359 31278 raft_consensus.cc:385] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.201764 31278 raft_consensus.cc:740] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fdd6cb30d724c43a0e61149fc88df53, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.202839 31278 consensus_queue.cc:260] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } }
I20260709 12:19:32.204885 31277 raft_consensus.cc:359] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.205518 31278 ts_tablet_manager.cc:1434] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 12:19:32.205813 31277 raft_consensus.cc:385] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.206147 31276 tablet_bootstrap.cc:492] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f: No bootstrap required, opened a new log
I20260709 12:19:32.206332 31277 raft_consensus.cc:740] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc898d2eca3414fbc73d8cf1cf19e55, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.206966 31276 ts_tablet_manager.cc:1403] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.008s
I20260709 12:19:32.207480 31277 consensus_queue.cc:260] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.211138 31276 raft_consensus.cc:359] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } }
I20260709 12:19:32.212015 31277 ts_tablet_manager.cc:1434] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:19:32.212152 31276 raft_consensus.cc:385] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.212630 31276 raft_consensus.cc:740] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94215d68137e4a34b530bd9261cfeb1f, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.213584 31276 consensus_queue.cc:260] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } }
I20260709 12:19:32.216029 31283 raft_consensus.cc:493] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.216668 31276 ts_tablet_manager.cc:1434] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:19:32.216615 31283 raft_consensus.cc:515] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } }
I20260709 12:19:32.222925 31283 leader_election.cc:290] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195:45527), 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369)
I20260709 12:19:32.235190 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3845dc9d230741ac9257cb2ac2a37f9c" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" is_pre_election: true
I20260709 12:19:32.235294 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3845dc9d230741ac9257cb2ac2a37f9c" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fdd6cb30d724c43a0e61149fc88df53" is_pre_election: true
I20260709 12:19:32.235860 31162 raft_consensus.cc:2468] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94215d68137e4a34b530bd9261cfeb1f in term 0.
I20260709 12:19:32.236251 31236 raft_consensus.cc:2468] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94215d68137e4a34b530bd9261cfeb1f in term 0.
I20260709 12:19:32.237430 31051 leader_election.cc:304] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94215d68137e4a34b530bd9261cfeb1f, 9bc898d2eca3414fbc73d8cf1cf19e55; no voters: 
I20260709 12:19:32.238492 31283 raft_consensus.cc:2804] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.238988 31283 raft_consensus.cc:493] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.239250 31283 raft_consensus.cc:3060] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.244621 31283 raft_consensus.cc:515] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } }
I20260709 12:19:32.246258 31283 leader_election.cc:290] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 election: Requested vote from peers 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195:45527), 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369)
I20260709 12:19:32.247525 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3845dc9d230741ac9257cb2ac2a37f9c" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55"
I20260709 12:19:32.247591 31236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3845dc9d230741ac9257cb2ac2a37f9c" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fdd6cb30d724c43a0e61149fc88df53"
I20260709 12:19:32.248277 31162 raft_consensus.cc:3060] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.248596 31236 raft_consensus.cc:3060] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.254731 31236 raft_consensus.cc:2468] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94215d68137e4a34b530bd9261cfeb1f in term 1.
I20260709 12:19:32.255419 31162 raft_consensus.cc:2468] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94215d68137e4a34b530bd9261cfeb1f in term 1.
I20260709 12:19:32.256158 31050 leader_election.cc:304] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdd6cb30d724c43a0e61149fc88df53, 94215d68137e4a34b530bd9261cfeb1f; no voters: 
I20260709 12:19:32.257311 31283 raft_consensus.cc:2804] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.258303 31283 raft_consensus.cc:697] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 1 LEADER]: Becoming Leader. State: Replica: 94215d68137e4a34b530bd9261cfeb1f, State: Running, Role: LEADER
I20260709 12:19:32.259289 31283 consensus_queue.cc:237] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } }
I20260709 12:19:32.267287 30982 catalog_manager.cc:5697] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193). New cstate: current_term: 1 leader_uuid: "94215d68137e4a34b530bd9261cfeb1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:32.395548 31284 raft_consensus.cc:493] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.396266 31284 raft_consensus.cc:515] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.398481 31284 leader_election.cc:290] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193:46793), 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369)
I20260709 12:19:32.408465 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd8705cec4c463fa161ce79be4459f3" candidate_uuid: "4fdd6cb30d724c43a0e61149fc88df53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94215d68137e4a34b530bd9261cfeb1f" is_pre_election: true
I20260709 12:19:32.409359 31087 raft_consensus.cc:2468] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fdd6cb30d724c43a0e61149fc88df53 in term 0.
I20260709 12:19:32.409801 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd8705cec4c463fa161ce79be4459f3" candidate_uuid: "4fdd6cb30d724c43a0e61149fc88df53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" is_pre_election: true
I20260709 12:19:32.410537 31162 raft_consensus.cc:2468] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fdd6cb30d724c43a0e61149fc88df53 in term 0.
I20260709 12:19:32.411118 31200 leader_election.cc:304] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdd6cb30d724c43a0e61149fc88df53, 94215d68137e4a34b530bd9261cfeb1f; no voters: 
I20260709 12:19:32.412134 31284 raft_consensus.cc:2804] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.412545 31284 raft_consensus.cc:493] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.412869 31284 raft_consensus.cc:3060] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.418895 31284 raft_consensus.cc:515] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.420704 31284 leader_election.cc:290] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [CANDIDATE]: Term 1 election: Requested vote from peers 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193:46793), 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369)
I20260709 12:19:32.421844 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd8705cec4c463fa161ce79be4459f3" candidate_uuid: "4fdd6cb30d724c43a0e61149fc88df53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94215d68137e4a34b530bd9261cfeb1f"
I20260709 12:19:32.421991 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd8705cec4c463fa161ce79be4459f3" candidate_uuid: "4fdd6cb30d724c43a0e61149fc88df53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55"
I20260709 12:19:32.422451 31087 raft_consensus.cc:3060] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.422847 31162 raft_consensus.cc:3060] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.428370 31087 raft_consensus.cc:2468] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fdd6cb30d724c43a0e61149fc88df53 in term 1.
I20260709 12:19:32.428961 31162 raft_consensus.cc:2468] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fdd6cb30d724c43a0e61149fc88df53 in term 1.
I20260709 12:19:32.429726 31200 leader_election.cc:304] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdd6cb30d724c43a0e61149fc88df53, 94215d68137e4a34b530bd9261cfeb1f; no voters: 
I20260709 12:19:32.430667 31284 raft_consensus.cc:2804] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.431931 31284 raft_consensus.cc:697] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 LEADER]: Becoming Leader. State: Replica: 4fdd6cb30d724c43a0e61149fc88df53, State: Running, Role: LEADER
I20260709 12:19:32.432827 31284 consensus_queue.cc:237] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.441025 30982 catalog_manager.cc:5697] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "4fdd6cb30d724c43a0e61149fc88df53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:32.574383 30982 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40832:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:32.577629 30982 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:32.609262 31077 tablet_service.cc:1511] Processing CreateTablet for tablet 49b7afce0c0b4eaea36554d5c572ef2b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8ca9df7093bb48f9b08e634664fd63c1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:19:32.610713 31077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b7afce0c0b4eaea36554d5c572ef2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.610858 31151 tablet_service.cc:1511] Processing CreateTablet for tablet 49b7afce0c0b4eaea36554d5c572ef2b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8ca9df7093bb48f9b08e634664fd63c1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:19:32.612866 31151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b7afce0c0b4eaea36554d5c572ef2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.612821 31226 tablet_service.cc:1511] Processing CreateTablet for tablet 49b7afce0c0b4eaea36554d5c572ef2b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8ca9df7093bb48f9b08e634664fd63c1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:19:32.614667 31226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b7afce0c0b4eaea36554d5c572ef2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.618088 31076 tablet_service.cc:1511] Processing CreateTablet for tablet df5a51a75ba34b449c9426618a03edfa (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8ca9df7093bb48f9b08e634664fd63c1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:19:32.619666 31076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5a51a75ba34b449c9426618a03edfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.624022 31225 tablet_service.cc:1511] Processing CreateTablet for tablet df5a51a75ba34b449c9426618a03edfa (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8ca9df7093bb48f9b08e634664fd63c1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:19:32.624648 31152 tablet_service.cc:1511] Processing CreateTablet for tablet df5a51a75ba34b449c9426618a03edfa (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8ca9df7093bb48f9b08e634664fd63c1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:19:32.626113 31225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5a51a75ba34b449c9426618a03edfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.626366 31152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5a51a75ba34b449c9426618a03edfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:32.630728 31276 tablet_bootstrap.cc:492] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f: Bootstrap starting.
I20260709 12:19:32.638293 31276 tablet_bootstrap.cc:654] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.649055 31283 consensus_queue.cc:1048] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:32.652647 31276 tablet_bootstrap.cc:492] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f: No bootstrap required, opened a new log
I20260709 12:19:32.653301 31276 ts_tablet_manager.cc:1403] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 12:19:32.654045 31283 consensus_queue.cc:1048] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:32.657137 31276 raft_consensus.cc:359] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.658290 31276 raft_consensus.cc:385] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.658600 31276 raft_consensus.cc:740] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94215d68137e4a34b530bd9261cfeb1f, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.659528 31276 consensus_queue.cc:260] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.662011 31276 ts_tablet_manager.cc:1434] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:19:32.663518 31276 tablet_bootstrap.cc:492] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f: Bootstrap starting.
I20260709 12:19:32.670620 31276 tablet_bootstrap.cc:654] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.698233 31277 tablet_bootstrap.cc:492] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55: Bootstrap starting.
I20260709 12:19:32.717192 31276 tablet_bootstrap.cc:492] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f: No bootstrap required, opened a new log
I20260709 12:19:32.717903 31276 ts_tablet_manager.cc:1403] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.035s
I20260709 12:19:32.720561 31277 tablet_bootstrap.cc:654] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.721525 31276 raft_consensus.cc:359] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.722463 31276 raft_consensus.cc:385] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.722848 31276 raft_consensus.cc:740] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94215d68137e4a34b530bd9261cfeb1f, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.724826 31308 tablet_bootstrap.cc:492] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53: Bootstrap starting.
I20260709 12:19:32.727142 31276 consensus_queue.cc:260] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.732488 31276 ts_tablet_manager.cc:1434] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 12:19:32.736279 31308 tablet_bootstrap.cc:654] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.740011 31277 tablet_bootstrap.cc:492] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55: No bootstrap required, opened a new log
I20260709 12:19:32.740067 31290 raft_consensus.cc:493] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.740829 31277 ts_tablet_manager.cc:1403] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.003s
I20260709 12:19:32.740836 31290 raft_consensus.cc:515] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.744419 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5a51a75ba34b449c9426618a03edfa" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" is_pre_election: true
I20260709 12:19:32.745452 31290 leader_election.cc:290] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369), 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195:45527)
W20260709 12:19:32.745934 31051 leader_election.cc:343] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.747299 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5a51a75ba34b449c9426618a03edfa" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fdd6cb30d724c43a0e61149fc88df53" is_pre_election: true
I20260709 12:19:32.747673 31277 raft_consensus.cc:359] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.748512 31277 raft_consensus.cc:385] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.748862 31277 raft_consensus.cc:740] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc898d2eca3414fbc73d8cf1cf19e55, State: Initialized, Role: FOLLOWER
W20260709 12:19:32.749207 31050 leader_election.cc:343] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195:45527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.749737 31050 leader_election.cc:304] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94215d68137e4a34b530bd9261cfeb1f; no voters: 4fdd6cb30d724c43a0e61149fc88df53, 9bc898d2eca3414fbc73d8cf1cf19e55
I20260709 12:19:32.749755 31277 consensus_queue.cc:260] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.750962 31290 raft_consensus.cc:2749] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.753849 31308 tablet_bootstrap.cc:492] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53: No bootstrap required, opened a new log
I20260709 12:19:32.754380 31277 ts_tablet_manager.cc:1434] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:19:32.754411 31308 ts_tablet_manager.cc:1403] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.003s
I20260709 12:19:32.755920 31277 tablet_bootstrap.cc:492] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55: Bootstrap starting.
I20260709 12:19:32.757227 31308 raft_consensus.cc:359] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.757867 31308 raft_consensus.cc:385] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.758237 31308 raft_consensus.cc:740] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fdd6cb30d724c43a0e61149fc88df53, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.759198 31290 raft_consensus.cc:493] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.759065 31308 consensus_queue.cc:260] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.759711 31290 raft_consensus.cc:515] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.762042 31290 leader_election.cc:290] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369), 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195:45527)
I20260709 12:19:32.763262 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b7afce0c0b4eaea36554d5c572ef2b" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" is_pre_election: true
I20260709 12:19:32.763973 31161 raft_consensus.cc:2468] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94215d68137e4a34b530bd9261cfeb1f in term 0.
I20260709 12:19:32.764178 31277 tablet_bootstrap.cc:654] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.764324 31308 ts_tablet_manager.cc:1434] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:19:32.765640 31308 tablet_bootstrap.cc:492] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53: Bootstrap starting.
I20260709 12:19:32.766471 31051 leader_election.cc:304] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94215d68137e4a34b530bd9261cfeb1f, 9bc898d2eca3414fbc73d8cf1cf19e55; no voters: 
I20260709 12:19:32.768510 31290 raft_consensus.cc:2804] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.769255 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b7afce0c0b4eaea36554d5c572ef2b" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fdd6cb30d724c43a0e61149fc88df53" is_pre_election: true
I20260709 12:19:32.770536 31235 raft_consensus.cc:2468] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94215d68137e4a34b530bd9261cfeb1f in term 0.
I20260709 12:19:32.769449 31290 raft_consensus.cc:493] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.771541 31290 raft_consensus.cc:3060] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.777954 31308 tablet_bootstrap.cc:654] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.780637 31290 raft_consensus.cc:515] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.784050 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b7afce0c0b4eaea36554d5c572ef2b" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55"
I20260709 12:19:32.784286 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b7afce0c0b4eaea36554d5c572ef2b" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fdd6cb30d724c43a0e61149fc88df53"
I20260709 12:19:32.784726 31161 raft_consensus.cc:3060] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.784852 31235 raft_consensus.cc:3060] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.786363 31277 tablet_bootstrap.cc:492] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55: No bootstrap required, opened a new log
I20260709 12:19:32.787438 31277 ts_tablet_manager.cc:1403] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.012s
I20260709 12:19:32.791329 31308 tablet_bootstrap.cc:492] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53: No bootstrap required, opened a new log
I20260709 12:19:32.791327 31277 raft_consensus.cc:359] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.792122 31308 ts_tablet_manager.cc:1403] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.009s
I20260709 12:19:32.792315 31277 raft_consensus.cc:385] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.792658 31235 raft_consensus.cc:2468] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94215d68137e4a34b530bd9261cfeb1f in term 1.
I20260709 12:19:32.792658 31161 raft_consensus.cc:2468] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94215d68137e4a34b530bd9261cfeb1f in term 1.
I20260709 12:19:32.793085 31290 leader_election.cc:290] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 election: Requested vote from peers 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369), 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195:45527)
I20260709 12:19:32.792775 31277 raft_consensus.cc:740] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc898d2eca3414fbc73d8cf1cf19e55, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.794559 31051 leader_election.cc:304] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94215d68137e4a34b530bd9261cfeb1f, 9bc898d2eca3414fbc73d8cf1cf19e55; no voters: 
I20260709 12:19:32.795001 31277 consensus_queue.cc:260] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.795754 31290 raft_consensus.cc:2804] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.795833 31308 raft_consensus.cc:359] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.796501 31290 raft_consensus.cc:697] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 1 LEADER]: Becoming Leader. State: Replica: 94215d68137e4a34b530bd9261cfeb1f, State: Running, Role: LEADER
I20260709 12:19:32.796749 31308 raft_consensus.cc:385] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.797057 31308 raft_consensus.cc:740] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fdd6cb30d724c43a0e61149fc88df53, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.797545 31277 ts_tablet_manager.cc:1434] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:19:32.797452 31290 consensus_queue.cc:237] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.797889 31308 consensus_queue.cc:260] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.800423 31308 ts_tablet_manager.cc:1434] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:32.808426 30982 catalog_manager.cc:5697] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193). New cstate: current_term: 1 leader_uuid: "94215d68137e4a34b530bd9261cfeb1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:32.857299 31284 raft_consensus.cc:493] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.857894 31284 raft_consensus.cc:515] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.859793 31284 leader_election.cc:290] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193:46793), 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369)
I20260709 12:19:32.861157 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5a51a75ba34b449c9426618a03edfa" candidate_uuid: "4fdd6cb30d724c43a0e61149fc88df53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94215d68137e4a34b530bd9261cfeb1f" is_pre_election: true
I20260709 12:19:32.861300 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5a51a75ba34b449c9426618a03edfa" candidate_uuid: "4fdd6cb30d724c43a0e61149fc88df53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" is_pre_election: true
I20260709 12:19:32.862145 31161 raft_consensus.cc:2468] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fdd6cb30d724c43a0e61149fc88df53 in term 0.
I20260709 12:19:32.862134 31087 raft_consensus.cc:2468] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fdd6cb30d724c43a0e61149fc88df53 in term 0.
I20260709 12:19:32.863658 31200 leader_election.cc:304] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdd6cb30d724c43a0e61149fc88df53, 9bc898d2eca3414fbc73d8cf1cf19e55; no voters: 
I20260709 12:19:32.864396 31284 raft_consensus.cc:2804] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.864771 31284 raft_consensus.cc:493] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.865059 31284 raft_consensus.cc:3060] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.870075 31284 raft_consensus.cc:515] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.871898 31284 leader_election.cc:290] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [CANDIDATE]: Term 1 election: Requested vote from peers 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193:46793), 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369)
I20260709 12:19:32.872952 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5a51a75ba34b449c9426618a03edfa" candidate_uuid: "4fdd6cb30d724c43a0e61149fc88df53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94215d68137e4a34b530bd9261cfeb1f"
I20260709 12:19:32.873574 31087 raft_consensus.cc:3060] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.873428 31161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5a51a75ba34b449c9426618a03edfa" candidate_uuid: "4fdd6cb30d724c43a0e61149fc88df53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55"
I20260709 12:19:32.874235 31161 raft_consensus.cc:3060] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.879387 31087 raft_consensus.cc:2468] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fdd6cb30d724c43a0e61149fc88df53 in term 1.
I20260709 12:19:32.880322 31161 raft_consensus.cc:2468] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fdd6cb30d724c43a0e61149fc88df53 in term 1.
I20260709 12:19:32.880671 31200 leader_election.cc:304] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdd6cb30d724c43a0e61149fc88df53, 94215d68137e4a34b530bd9261cfeb1f; no voters: 
I20260709 12:19:32.881628 31284 raft_consensus.cc:2804] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.882261 31284 raft_consensus.cc:697] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 LEADER]: Becoming Leader. State: Replica: 4fdd6cb30d724c43a0e61149fc88df53, State: Running, Role: LEADER
I20260709 12:19:32.883240 31284 consensus_queue.cc:237] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:32.891544 30982 catalog_manager.cc:5697] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195). New cstate: current_term: 1 leader_uuid: "4fdd6cb30d724c43a0e61149fc88df53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:32.981148 31235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df5a51a75ba34b449c9426618a03edfa"
dest_uuid: "4fdd6cb30d724c43a0e61149fc88df53"
mode: GRACEFUL
new_leader_uuid: "94215d68137e4a34b530bd9261cfeb1f"
 from {username='slave'} at 127.0.0.1:41096
I20260709 12:19:32.981837 31235 raft_consensus.cc:606] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 LEADER]: Received request to transfer leadership to TS 94215d68137e4a34b530bd9261cfeb1f
I20260709 12:19:32.997715 31284 consensus_queue.cc:1048] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.018280 31318 consensus_queue.cc:1048] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:33.191354 31290 consensus_queue.cc:1048] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.206947 31322 consensus_queue.cc:1048] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:33.279475 31318 consensus_queue.cc:1048] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.291603 31318 consensus_queue.cc:1048] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.300395 31293 raft_consensus.cc:993] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53: : Instructing follower 94215d68137e4a34b530bd9261cfeb1f to start an election
I20260709 12:19:33.300966 31318 raft_consensus.cc:1081] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 LEADER]: Signalling peer 94215d68137e4a34b530bd9261cfeb1f to start an election
I20260709 12:19:33.303064 31087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df5a51a75ba34b449c9426618a03edfa"
dest_uuid: "94215d68137e4a34b530bd9261cfeb1f"
 from {username='slave'} at 127.0.0.1:56448
I20260709 12:19:33.303638 31087 raft_consensus.cc:493] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.304031 31087 raft_consensus.cc:3060] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.310667 31087 raft_consensus.cc:515] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:33.312707 31087 leader_election.cc:290] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 2 election: Requested vote from peers 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369), 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195:45527)
I20260709 12:19:33.313881 31162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5a51a75ba34b449c9426618a03edfa" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55"
I20260709 12:19:33.314049 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5a51a75ba34b449c9426618a03edfa" candidate_uuid: "94215d68137e4a34b530bd9261cfeb1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4fdd6cb30d724c43a0e61149fc88df53"
I20260709 12:19:33.315109 31235 raft_consensus.cc:3055] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:33.315521 31235 raft_consensus.cc:740] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4fdd6cb30d724c43a0e61149fc88df53, State: Running, Role: LEADER
I20260709 12:19:33.315639 31162 raft_consensus.cc:3060] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.316687 31235 consensus_queue.cc:260] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:33.318305 31235 raft_consensus.cc:3060] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.326164 31162 raft_consensus.cc:2468] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94215d68137e4a34b530bd9261cfeb1f in term 2.
I20260709 12:19:33.327436 31235 raft_consensus.cc:2468] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94215d68137e4a34b530bd9261cfeb1f in term 2.
I20260709 12:19:33.327801 31051 leader_election.cc:304] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94215d68137e4a34b530bd9261cfeb1f, 9bc898d2eca3414fbc73d8cf1cf19e55; no voters: 
I20260709 12:19:33.329368 31283 raft_consensus.cc:2804] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:33.329880 31283 raft_consensus.cc:697] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 2 LEADER]: Becoming Leader. State: Replica: 94215d68137e4a34b530bd9261cfeb1f, State: Running, Role: LEADER
I20260709 12:19:33.330865 31283 consensus_queue.cc:237] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:33.338690 30984 catalog_manager.cc:5697] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f reported cstate change: term changed from 1 to 2, leader changed from 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195) to 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193). New cstate: current_term: 2 leader_uuid: "94215d68137e4a34b530bd9261cfeb1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.482124 18407 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:19:33.484038 18407 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:19:33.484441 18407 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:19:33.497596 31087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49b7afce0c0b4eaea36554d5c572ef2b"
dest_uuid: "94215d68137e4a34b530bd9261cfeb1f"
mode: GRACEFUL
new_leader_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55"
 from {username='slave'} at 127.0.0.1:56458
I20260709 12:19:33.498278 31087 raft_consensus.cc:606] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 1 LEADER]: Received request to transfer leadership to TS 9bc898d2eca3414fbc73d8cf1cf19e55
I20260709 12:19:33.499635 18407 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:19:33.650729 31322 raft_consensus.cc:993] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f: : Instructing follower 9bc898d2eca3414fbc73d8cf1cf19e55 to start an election
I20260709 12:19:33.651412 31322 raft_consensus.cc:1081] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 1 LEADER]: Signalling peer 9bc898d2eca3414fbc73d8cf1cf19e55 to start an election
I20260709 12:19:33.653275 31162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49b7afce0c0b4eaea36554d5c572ef2b"
dest_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55"
 from {username='slave'} at 127.0.0.1:34018
I20260709 12:19:33.653854 31162 raft_consensus.cc:493] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.654225 31162 raft_consensus.cc:3060] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.660288 31162 raft_consensus.cc:515] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:33.662192 31162 leader_election.cc:290] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [CANDIDATE]: Term 2 election: Requested vote from peers 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193:46793), 4fdd6cb30d724c43a0e61149fc88df53 (127.17.249.195:45527)
I20260709 12:19:33.663592 31087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b7afce0c0b4eaea36554d5c572ef2b" candidate_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94215d68137e4a34b530bd9261cfeb1f"
I20260709 12:19:33.663722 31235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b7afce0c0b4eaea36554d5c572ef2b" candidate_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4fdd6cb30d724c43a0e61149fc88df53"
I20260709 12:19:33.664258 31087 raft_consensus.cc:3055] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:33.664551 31235 raft_consensus.cc:3060] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.664702 31087 raft_consensus.cc:740] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94215d68137e4a34b530bd9261cfeb1f, State: Running, Role: LEADER
I20260709 12:19:33.665650 31087 consensus_queue.cc:260] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:33.666688 31087 raft_consensus.cc:3060] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.671669 31235 raft_consensus.cc:2468] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc898d2eca3414fbc73d8cf1cf19e55 in term 2.
I20260709 12:19:33.671932 31087 raft_consensus.cc:2468] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc898d2eca3414fbc73d8cf1cf19e55 in term 2.
I20260709 12:19:33.673441 31125 leader_election.cc:304] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4fdd6cb30d724c43a0e61149fc88df53, 94215d68137e4a34b530bd9261cfeb1f, 9bc898d2eca3414fbc73d8cf1cf19e55; no voters: 
I20260709 12:19:33.674387 31282 raft_consensus.cc:2804] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:33.675581 31282 raft_consensus.cc:697] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 2 LEADER]: Becoming Leader. State: Replica: 9bc898d2eca3414fbc73d8cf1cf19e55, State: Running, Role: LEADER
I20260709 12:19:33.676462 31282 consensus_queue.cc:237] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } }
I20260709 12:19:33.683933 30982 catalog_manager.cc:5697] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 reported cstate change: term changed from 1 to 2, leader changed from 94215d68137e4a34b530bd9261cfeb1f (127.17.249.193) to 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94215d68137e4a34b530bd9261cfeb1f" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc898d2eca3414fbc73d8cf1cf19e55" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 33369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4fdd6cb30d724c43a0e61149fc88df53" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45527 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.733805 18407 tablet_server.cc:179] TabletServer@127.17.249.193:0 shutting down...
I20260709 12:19:33.758332 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:33.759119 18407 tablet_replica.cc:333] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f: stopping tablet replica
I20260709 12:19:33.759791 18407 raft_consensus.cc:2243] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:33.760474 18407 pending_rounds.cc:70] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f: Trying to abort 1 pending ops.
I20260709 12:19:33.760658 18407 pending_rounds.cc:77] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305623852373733376 op_type: NO_OP noop_request { }
I20260709 12:19:33.761044 18407 raft_consensus.cc:2889] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:19:33.761359 18407 raft_consensus.cc:2272] T df5a51a75ba34b449c9426618a03edfa P 94215d68137e4a34b530bd9261cfeb1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.763932 18407 tablet_replica.cc:333] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f: stopping tablet replica
I20260709 12:19:33.764499 18407 raft_consensus.cc:2243] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:33.764896 18407 raft_consensus.cc:2272] T 49b7afce0c0b4eaea36554d5c572ef2b P 94215d68137e4a34b530bd9261cfeb1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.767406 18407 tablet_replica.cc:333] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f: stopping tablet replica
I20260709 12:19:33.767959 18407 raft_consensus.cc:2243] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:33.768774 18407 raft_consensus.cc:2272] T 3845dc9d230741ac9257cb2ac2a37f9c P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.770841 18407 tablet_replica.cc:333] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f: stopping tablet replica
I20260709 12:19:33.771458 18407 raft_consensus.cc:2243] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:33.771907 18407 raft_consensus.cc:2272] T 3fd8705cec4c463fa161ce79be4459f3 P 94215d68137e4a34b530bd9261cfeb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.796834 18407 tablet_server.cc:196] TabletServer@127.17.249.193:0 shutdown complete.
I20260709 12:19:33.809618 18407 tablet_server.cc:179] TabletServer@127.17.249.194:0 shutting down...
I20260709 12:19:33.834100 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:33.834864 18407 tablet_replica.cc:333] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55: stopping tablet replica
I20260709 12:19:33.835517 18407 raft_consensus.cc:2243] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:33.836010 18407 raft_consensus.cc:2272] T df5a51a75ba34b449c9426618a03edfa P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.838742 18407 tablet_replica.cc:333] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55: stopping tablet replica
I20260709 12:19:33.839382 18407 raft_consensus.cc:2243] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:33.840046 18407 pending_rounds.cc:70] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55: Trying to abort 1 pending ops.
I20260709 12:19:33.840219 18407 pending_rounds.cc:77] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305623853787246592 op_type: NO_OP noop_request { }
I20260709 12:19:33.840546 18407 raft_consensus.cc:2889] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:19:33.840843 18407 raft_consensus.cc:2272] T 49b7afce0c0b4eaea36554d5c572ef2b P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.843649 18407 tablet_replica.cc:333] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55: stopping tablet replica
I20260709 12:19:33.844192 18407 raft_consensus.cc:2243] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:33.844620 18407 raft_consensus.cc:2272] T 3fd8705cec4c463fa161ce79be4459f3 P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.847349 18407 tablet_replica.cc:333] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55: stopping tablet replica
I20260709 12:19:33.847903 18407 raft_consensus.cc:2243] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:33.848371 18407 raft_consensus.cc:2272] T 3845dc9d230741ac9257cb2ac2a37f9c P 9bc898d2eca3414fbc73d8cf1cf19e55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.872427 18407 tablet_server.cc:196] TabletServer@127.17.249.194:0 shutdown complete.
I20260709 12:19:33.888639 18407 tablet_server.cc:179] TabletServer@127.17.249.195:0 shutting down...
W20260709 12:19:33.913892 31200 consensus_peers.cc:597] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 -> Peer 9bc898d2eca3414fbc73d8cf1cf19e55 (127.17.249.194:33369): Couldn't send request to peer 9bc898d2eca3414fbc73d8cf1cf19e55. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:33369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:33.916332 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:33.917121 18407 tablet_replica.cc:333] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53: stopping tablet replica
I20260709 12:19:33.917706 18407 raft_consensus.cc:2243] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:33.918133 18407 raft_consensus.cc:2272] T df5a51a75ba34b449c9426618a03edfa P 4fdd6cb30d724c43a0e61149fc88df53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.920463 18407 tablet_replica.cc:333] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53: stopping tablet replica
I20260709 12:19:33.920974 18407 raft_consensus.cc:2243] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:33.921358 18407 raft_consensus.cc:2272] T 49b7afce0c0b4eaea36554d5c572ef2b P 4fdd6cb30d724c43a0e61149fc88df53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.924149 18407 tablet_replica.cc:333] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53: stopping tablet replica
I20260709 12:19:33.924640 18407 raft_consensus.cc:2243] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:33.925024 18407 raft_consensus.cc:2272] T 3845dc9d230741ac9257cb2ac2a37f9c P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.927265 18407 tablet_replica.cc:333] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53: stopping tablet replica
I20260709 12:19:33.927726 18407 raft_consensus.cc:2243] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:33.928524 18407 raft_consensus.cc:2272] T 3fd8705cec4c463fa161ce79be4459f3 P 4fdd6cb30d724c43a0e61149fc88df53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.953887 18407 tablet_server.cc:196] TabletServer@127.17.249.195:0 shutdown complete.
I20260709 12:19:33.971141 18407 master.cc:562] Master@127.17.249.254:40305 shutting down...
I20260709 12:19:33.993031 18407 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:33.993579 18407 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:33.993849 18407 tablet_replica.cc:333] T 00000000000000000000000000000000 P e6f64955b3044333b857df16cb54cea2: stopping tablet replica
I20260709 12:19:34.016033 18407 master.cc:584] Master@127.17.249.254:40305 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2672 ms)
[----------] 6 tests from LeaderRebalancerTest (435010 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:19:34.045905 18407 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.249.254:36521
I20260709 12:19:34.047079 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:34.052878 31331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:34.053447 31332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:34.054544 31334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:34.057229 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:34.058460 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:34.058682 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:34.058974 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599574058952 us; error 0 us; skew 500 ppm
I20260709 12:19:34.059887 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:34.062923 18407 webserver.cc:533] Webserver started at http://127.17.249.254:44667/ using document root <none> and password file <none>
I20260709 12:19:34.063532 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:34.063736 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:34.064117 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:34.065455 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/master-0-root/instance:
uuid: "fbe46d4e1dc749eb9e5eda30f948787e"
format_stamp: "Formatted at 2026-07-09 12:19:34 on dist-test-slave-7mcn"
I20260709 12:19:34.071177 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.007s
I20260709 12:19:34.075548 31339 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:34.076536 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:19:34.076925 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/master-0-root
uuid: "fbe46d4e1dc749eb9e5eda30f948787e"
format_stamp: "Formatted at 2026-07-09 12:19:34 on dist-test-slave-7mcn"
I20260709 12:19:34.077318 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:34.121217 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:34.122563 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:34.169420 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.254:36521
I20260709 12:19:34.169523 31390 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.254:36521 every 8 connection(s)
I20260709 12:19:34.174079 31391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.186542 31391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e: Bootstrap starting.
I20260709 12:19:34.191449 31391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.196393 31391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e: No bootstrap required, opened a new log
I20260709 12:19:34.198757 31391 raft_consensus.cc:359] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe46d4e1dc749eb9e5eda30f948787e" member_type: VOTER }
I20260709 12:19:34.199312 31391 raft_consensus.cc:385] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.199565 31391 raft_consensus.cc:740] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe46d4e1dc749eb9e5eda30f948787e, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.200333 31391 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe46d4e1dc749eb9e5eda30f948787e" member_type: VOTER }
I20260709 12:19:34.200868 31391 raft_consensus.cc:399] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:34.201097 31391 raft_consensus.cc:493] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:34.201442 31391 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.206878 31391 raft_consensus.cc:515] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe46d4e1dc749eb9e5eda30f948787e" member_type: VOTER }
I20260709 12:19:34.207512 31391 leader_election.cc:304] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbe46d4e1dc749eb9e5eda30f948787e; no voters: 
I20260709 12:19:34.208897 31391 leader_election.cc:290] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:34.209585 31394 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:34.211475 31394 raft_consensus.cc:697] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [term 1 LEADER]: Becoming Leader. State: Replica: fbe46d4e1dc749eb9e5eda30f948787e, State: Running, Role: LEADER
I20260709 12:19:34.212387 31394 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe46d4e1dc749eb9e5eda30f948787e" member_type: VOTER }
I20260709 12:19:34.212644 31391 sys_catalog.cc:565] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:34.216055 31395 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbe46d4e1dc749eb9e5eda30f948787e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe46d4e1dc749eb9e5eda30f948787e" member_type: VOTER } }
I20260709 12:19:34.216058 31396 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbe46d4e1dc749eb9e5eda30f948787e. Latest consensus state: current_term: 1 leader_uuid: "fbe46d4e1dc749eb9e5eda30f948787e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe46d4e1dc749eb9e5eda30f948787e" member_type: VOTER } }
I20260709 12:19:34.216897 31396 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:34.216964 31395 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:34.221849 31399 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:34.230644 31399 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:34.231851 18407 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:34.241528 31399 catalog_manager.cc:1383] Generated new cluster ID: 92a32852be194ffd8d21995daa29ac9a
I20260709 12:19:34.241930 31399 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:34.295049 31399 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:34.296685 31399 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:34.314117 31399 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e: Generated new TSK 0
I20260709 12:19:34.315044 31399 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:34.363240 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:34.369841 31412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:34.370796 31413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:34.373171 31415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:34.373217 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:34.374446 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:34.374677 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:34.374939 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599574374918 us; error 0 us; skew 500 ppm
I20260709 12:19:34.375566 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:34.378317 18407 webserver.cc:533] Webserver started at http://127.17.249.193:44697/ using document root <none> and password file <none>
I20260709 12:19:34.378923 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:34.379158 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:34.379539 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:34.380661 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-0-root/instance:
uuid: "d5c321be97454a16b1a645db2c91b5f9"
format_stamp: "Formatted at 2026-07-09 12:19:34 on dist-test-slave-7mcn"
I20260709 12:19:34.385659 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:19:34.389489 31420 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:34.390352 18407 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:19:34.390715 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-0-root
uuid: "d5c321be97454a16b1a645db2c91b5f9"
format_stamp: "Formatted at 2026-07-09 12:19:34 on dist-test-slave-7mcn"
I20260709 12:19:34.391067 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:34.413322 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:34.414594 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:34.416572 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:34.419365 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:34.419618 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:34.419893 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:34.420082 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:34.468268 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.193:37369
I20260709 12:19:34.468416 31482 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.193:37369 every 8 connection(s)
I20260709 12:19:34.474232 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:34.482406 31487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:34.484030 31488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:34.487705 31490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:34.488286 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:34.488327 31483 heartbeater.cc:344] Connected to a master server at 127.17.249.254:36521
I20260709 12:19:34.489079 31483 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:34.489732 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:34.490079 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:34.490130 31483 heartbeater.cc:507] Master 127.17.249.254:36521 requested a full tablet report, sending...
I20260709 12:19:34.490387 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599574490366 us; error 0 us; skew 500 ppm
I20260709 12:19:34.491354 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:34.493347 31356 ts_manager.cc:194] Registered new tserver with Master: d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369)
I20260709 12:19:34.494720 18407 webserver.cc:533] Webserver started at http://127.17.249.194:36989/ using document root <none> and password file <none>
I20260709 12:19:34.495664 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:34.495925 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:34.496275 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:34.496183 31356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45804
I20260709 12:19:34.497983 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-1-root/instance:
uuid: "d24002ed5d7e47d498f01f7d15c34007"
format_stamp: "Formatted at 2026-07-09 12:19:34 on dist-test-slave-7mcn"
I20260709 12:19:34.503582 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:19:34.507395 31495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:34.508450 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:19:34.508811 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-1-root
uuid: "d24002ed5d7e47d498f01f7d15c34007"
format_stamp: "Formatted at 2026-07-09 12:19:34 on dist-test-slave-7mcn"
I20260709 12:19:34.509182 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:34.534380 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:34.535624 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:34.537365 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:34.539933 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:34.540170 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:34.540431 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:34.540607 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:34.585503 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.194:37543
I20260709 12:19:34.585695 31557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.194:37543 every 8 connection(s)
I20260709 12:19:34.590523 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:34.599043 31562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:34.599167 31561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:34.603618 18407 server_base.cc:1061] running on GCE node
W20260709 12:19:34.603807 31564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:34.604406 31558 heartbeater.cc:344] Connected to a master server at 127.17.249.254:36521
I20260709 12:19:34.604997 31558 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:34.605415 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:34.605753 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:34.605930 31558 heartbeater.cc:507] Master 127.17.249.254:36521 requested a full tablet report, sending...
I20260709 12:19:34.605957 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599574605940 us; error 0 us; skew 500 ppm
I20260709 12:19:34.607019 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:34.609056 31356 ts_manager.cc:194] Registered new tserver with Master: d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:34.611161 31356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45814
I20260709 12:19:34.611606 18407 webserver.cc:533] Webserver started at http://127.17.249.195:32891/ using document root <none> and password file <none>
I20260709 12:19:34.612306 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:34.612550 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:34.612902 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:34.613973 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-2-root/instance:
uuid: "41bee83366d7449fa414de406cd2714b"
format_stamp: "Formatted at 2026-07-09 12:19:34 on dist-test-slave-7mcn"
I20260709 12:19:34.618665 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:19:34.622691 31569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:34.623759 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:19:34.624215 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-2-root
uuid: "41bee83366d7449fa414de406cd2714b"
format_stamp: "Formatted at 2026-07-09 12:19:34 on dist-test-slave-7mcn"
I20260709 12:19:34.624475 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599138854584-18407-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:34.648192 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:34.649380 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:34.651100 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:34.653700 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:34.653957 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:34.654222 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:34.654417 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:34.698902 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.195:42907
I20260709 12:19:34.699316 31631 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.195:42907 every 8 connection(s)
I20260709 12:19:34.715487 31632 heartbeater.cc:344] Connected to a master server at 127.17.249.254:36521
I20260709 12:19:34.716183 31632 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:34.717151 31632 heartbeater.cc:507] Master 127.17.249.254:36521 requested a full tablet report, sending...
I20260709 12:19:34.719717 31356 ts_manager.cc:194] Registered new tserver with Master: 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:34.720845 18407 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01855499s
I20260709 12:19:34.721495 31356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45828
I20260709 12:19:34.751917 31356 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45836:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:34.754501 31356 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:34.838563 31448 tablet_service.cc:1511] Processing CreateTablet for tablet d5d572e70349474483450f8afd3ea6d7 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:34.840372 31448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d572e70349474483450f8afd3ea6d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.844205 31597 tablet_service.cc:1511] Processing CreateTablet for tablet d5d572e70349474483450f8afd3ea6d7 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:34.846031 31597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d572e70349474483450f8afd3ea6d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.846343 31592 tablet_service.cc:1511] Processing CreateTablet for tablet c5df8666a6eb42998bcf6aa80adc1a9a (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:34.848031 31592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5df8666a6eb42998bcf6aa80adc1a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.848066 31596 tablet_service.cc:1511] Processing CreateTablet for tablet c28b35ac0f9e4ad6889d412a35979832 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:34.848640 31590 tablet_service.cc:1511] Processing CreateTablet for tablet c83b606a9e0744748b2ef0457101ab51 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:34.848913 31593 tablet_service.cc:1511] Processing CreateTablet for tablet b6c8611b4cc24bfda382338c8d1f762b (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:34.849887 31596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28b35ac0f9e4ad6889d412a35979832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.850660 31593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c8611b4cc24bfda382338c8d1f762b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.852034 31595 tablet_service.cc:1511] Processing CreateTablet for tablet 5114b9a6cecc468397e1f2cbda4f9f83 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:34.853431 31595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5114b9a6cecc468397e1f2cbda4f9f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.854079 31589 tablet_service.cc:1511] Processing CreateTablet for tablet 91034dfa1be34cb19793a644d5e06a30 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:34.854714 31590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83b606a9e0744748b2ef0457101ab51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.855782 31589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91034dfa1be34cb19793a644d5e06a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.855912 31594 tablet_service.cc:1511] Processing CreateTablet for tablet 26628f85884b4cf4a2d8acd4be9bd240 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:34.857333 31594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26628f85884b4cf4a2d8acd4be9bd240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.850761 31591 tablet_service.cc:1511] Processing CreateTablet for tablet f36cd13528284344aec85786a144eeb4 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:34.860939 31591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36cd13528284344aec85786a144eeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.882740 31647 tablet_bootstrap.cc:492] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:34.893663 31447 tablet_service.cc:1511] Processing CreateTablet for tablet c28b35ac0f9e4ad6889d412a35979832 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:34.896250 31446 tablet_service.cc:1511] Processing CreateTablet for tablet 5114b9a6cecc468397e1f2cbda4f9f83 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:34.898638 31445 tablet_service.cc:1511] Processing CreateTablet for tablet 26628f85884b4cf4a2d8acd4be9bd240 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:34.900866 31444 tablet_service.cc:1511] Processing CreateTablet for tablet b6c8611b4cc24bfda382338c8d1f762b (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:34.904024 31442 tablet_service.cc:1511] Processing CreateTablet for tablet f36cd13528284344aec85786a144eeb4 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:34.904649 31441 tablet_service.cc:1511] Processing CreateTablet for tablet c83b606a9e0744748b2ef0457101ab51 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:34.905496 31443 tablet_service.cc:1511] Processing CreateTablet for tablet c5df8666a6eb42998bcf6aa80adc1a9a (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:34.908039 31440 tablet_service.cc:1511] Processing CreateTablet for tablet 91034dfa1be34cb19793a644d5e06a30 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:34.911443 31447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28b35ac0f9e4ad6889d412a35979832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.914484 31446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5114b9a6cecc468397e1f2cbda4f9f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.916371 31442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36cd13528284344aec85786a144eeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.920065 31522 tablet_service.cc:1511] Processing CreateTablet for tablet c28b35ac0f9e4ad6889d412a35979832 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:34.928028 31522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28b35ac0f9e4ad6889d412a35979832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.904067 31647 tablet_bootstrap.cc:654] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.928987 31517 tablet_service.cc:1511] Processing CreateTablet for tablet f36cd13528284344aec85786a144eeb4 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:34.930610 31517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36cd13528284344aec85786a144eeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.921066 31520 tablet_service.cc:1511] Processing CreateTablet for tablet 26628f85884b4cf4a2d8acd4be9bd240 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:34.932243 31520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26628f85884b4cf4a2d8acd4be9bd240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.922113 31521 tablet_service.cc:1511] Processing CreateTablet for tablet 5114b9a6cecc468397e1f2cbda4f9f83 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:34.936342 31521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5114b9a6cecc468397e1f2cbda4f9f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.923364 31523 tablet_service.cc:1511] Processing CreateTablet for tablet d5d572e70349474483450f8afd3ea6d7 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:34.940331 31523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d572e70349474483450f8afd3ea6d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.923668 31519 tablet_service.cc:1511] Processing CreateTablet for tablet b6c8611b4cc24bfda382338c8d1f762b (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:34.942595 31519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c8611b4cc24bfda382338c8d1f762b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.943440 31440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91034dfa1be34cb19793a644d5e06a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.926393 31518 tablet_service.cc:1511] Processing CreateTablet for tablet c5df8666a6eb42998bcf6aa80adc1a9a (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:34.945856 31518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5df8666a6eb42998bcf6aa80adc1a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.947324 31441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83b606a9e0744748b2ef0457101ab51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.951314 31443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5df8666a6eb42998bcf6aa80adc1a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.953382 31445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26628f85884b4cf4a2d8acd4be9bd240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.955235 31444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c8611b4cc24bfda382338c8d1f762b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.956982 31516 tablet_service.cc:1511] Processing CreateTablet for tablet c83b606a9e0744748b2ef0457101ab51 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:34.958660 31516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83b606a9e0744748b2ef0457101ab51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.969112 31515 tablet_service.cc:1511] Processing CreateTablet for tablet 91034dfa1be34cb19793a644d5e06a30 (DEFAULT_TABLE table=test-workload [id=7fe01cbc23dc4200b7cf1a7b38bc0066]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:34.974534 31515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91034dfa1be34cb19793a644d5e06a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:35.053615 31650 tablet_bootstrap.cc:492] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:35.077236 31647 tablet_bootstrap.cc:492] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:35.079124 31647 ts_tablet_manager.cc:1403] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.197s	user 0.052s	sys 0.081s
I20260709 12:19:35.079754 31649 tablet_bootstrap.cc:492] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:35.082330 31647 raft_consensus.cc:359] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.083169 31647 raft_consensus.cc:385] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.083504 31647 raft_consensus.cc:740] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.084527 31647 consensus_queue.cc:260] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.086305 31649 tablet_bootstrap.cc:654] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.095944 31650 tablet_bootstrap.cc:654] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.099887 31632 heartbeater.cc:499] Master 127.17.249.254:36521 was elected leader, sending a full tablet report...
I20260709 12:19:35.100920 31647 ts_tablet_manager.cc:1434] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:19:35.102074 31647 tablet_bootstrap.cc:492] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:35.105139 31649 tablet_bootstrap.cc:492] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:35.105727 31649 ts_tablet_manager.cc:1403] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.009s
I20260709 12:19:35.109103 31647 tablet_bootstrap.cc:654] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.108937 31649 raft_consensus.cc:359] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.109722 31649 raft_consensus.cc:385] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.110059 31649 raft_consensus.cc:740] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.111017 31649 consensus_queue.cc:260] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.119906 31483 heartbeater.cc:499] Master 127.17.249.254:36521 was elected leader, sending a full tablet report...
I20260709 12:19:35.121771 31647 tablet_bootstrap.cc:492] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:35.122408 31647 ts_tablet_manager.cc:1403] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 12:19:35.125623 31649 ts_tablet_manager.cc:1434] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.017s
I20260709 12:19:35.125519 31647 raft_consensus.cc:359] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.126379 31647 raft_consensus.cc:385] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.126703 31647 raft_consensus.cc:740] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.126959 31649 tablet_bootstrap.cc:492] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:35.127676 31647 consensus_queue.cc:260] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.132417 31647 ts_tablet_manager.cc:1434] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:35.133569 31647 tablet_bootstrap.cc:492] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:35.133817 31649 tablet_bootstrap.cc:654] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.140898 31647 tablet_bootstrap.cc:654] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.145857 31650 tablet_bootstrap.cc:492] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:35.146536 31650 ts_tablet_manager.cc:1403] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.032s
I20260709 12:19:35.146584 31649 tablet_bootstrap.cc:492] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:35.147552 31649 ts_tablet_manager.cc:1403] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:19:35.150216 31650 raft_consensus.cc:359] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.151232 31650 raft_consensus.cc:385] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.151683 31650 raft_consensus.cc:740] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.151412 31649 raft_consensus.cc:359] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.152508 31649 raft_consensus.cc:385] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.152876 31649 raft_consensus.cc:740] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.153546 31647 tablet_bootstrap.cc:492] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:35.153031 31650 consensus_queue.cc:260] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.154132 31647 ts_tablet_manager.cc:1403] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:19:35.153983 31649 consensus_queue.cc:260] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.156222 31649 ts_tablet_manager.cc:1434] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:19:35.157191 31649 tablet_bootstrap.cc:492] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:35.157593 31647 raft_consensus.cc:359] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.158354 31647 raft_consensus.cc:385] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.158658 31647 raft_consensus.cc:740] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.159669 31647 consensus_queue.cc:260] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.162652 31558 heartbeater.cc:499] Master 127.17.249.254:36521 was elected leader, sending a full tablet report...
I20260709 12:19:35.163894 31649 tablet_bootstrap.cc:654] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.164075 31650 ts_tablet_manager.cc:1434] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 12:19:35.165056 31647 ts_tablet_manager.cc:1434] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:19:35.165496 31650 tablet_bootstrap.cc:492] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:35.166251 31647 tablet_bootstrap.cc:492] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:35.172695 31650 tablet_bootstrap.cc:654] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.175797 31647 tablet_bootstrap.cc:654] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.184173 31651 raft_consensus.cc:493] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.185082 31651 raft_consensus.cc:515] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.187220 31650 tablet_bootstrap.cc:492] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:35.188815 31650 ts_tablet_manager.cc:1403] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 12:19:35.192210 31650 raft_consensus.cc:359] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.192881 31651 leader_election.cc:290] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:35.200174 31650 raft_consensus.cc:385] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.200472 31651 raft_consensus.cc:493] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.200760 31650 raft_consensus.cc:740] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.201669 31651 raft_consensus.cc:515] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.202207 31650 consensus_queue.cc:260] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.205156 31650 ts_tablet_manager.cc:1434] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:19:35.208341 31650 tablet_bootstrap.cc:492] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:35.209102 31651 leader_election.cc:290] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:35.214567 31647 tablet_bootstrap.cc:492] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:35.215409 31647 ts_tablet_manager.cc:1403] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.000s
I20260709 12:19:35.216064 31650 tablet_bootstrap.cc:654] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.218698 31658 raft_consensus.cc:493] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.219338 31658 raft_consensus.cc:515] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.220630 31647 raft_consensus.cc:359] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.221522 31647 raft_consensus.cc:385] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.221922 31647 raft_consensus.cc:740] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.222963 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91034dfa1be34cb19793a644d5e06a30" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:35.224089 31658 leader_election.cc:290] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
W20260709 12:19:35.224635 31404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:35.225593 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cd13528284344aec85786a144eeb4" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:35.225350 31647 consensus_queue.cc:260] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.228010 31647 ts_tablet_manager.cc:1434] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:19:35.229560 31647 tablet_bootstrap.cc:492] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
W20260709 12:19:35.231624 31573 leader_election.cc:343] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:35.232533 31573 leader_election.cc:343] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.237187 31647 tablet_bootstrap.cc:654] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.240892 31649 tablet_bootstrap.cc:492] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:35.245581 31650 tablet_bootstrap.cc:492] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:35.241544 31649 ts_tablet_manager.cc:1403] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.013s
I20260709 12:19:35.252398 31650 ts_tablet_manager.cc:1403] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.006s
I20260709 12:19:35.255168 31649 raft_consensus.cc:359] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:35.256065 31649 raft_consensus.cc:385] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.256397 31649 raft_consensus.cc:740] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.259730 31649 consensus_queue.cc:260] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:35.259153 31650 raft_consensus.cc:359] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.261334 31650 raft_consensus.cc:385] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.293082 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cd13528284344aec85786a144eeb4" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:35.304276 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cd13528284344aec85786a144eeb4" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:35.295789 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91034dfa1be34cb19793a644d5e06a30" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:35.306669 31649 ts_tablet_manager.cc:1434] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 12:19:35.307166 31533 raft_consensus.cc:2468] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 0.
I20260709 12:19:35.309592 31649 tablet_bootstrap.cc:492] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:35.310272 31647 tablet_bootstrap.cc:492] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:35.310503 31573 leader_election.cc:304] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:35.311585 31647 ts_tablet_manager.cc:1403] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.000s
I20260709 12:19:35.313387 31662 raft_consensus.cc:2804] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.314399 31662 raft_consensus.cc:493] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.314908 31662 raft_consensus.cc:3060] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.304589 31532 raft_consensus.cc:2468] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 0.
I20260709 12:19:35.261699 31650 raft_consensus.cc:740] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.323689 31651 raft_consensus.cc:493] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.324771 31651 raft_consensus.cc:515] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
W20260709 12:19:35.320418 31499 leader_election.cc:343] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.328145 31651 leader_election.cc:290] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:35.328018 31573 leader_election.cc:304] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:35.325177 31650 consensus_queue.cc:260] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.334371 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83b606a9e0744748b2ef0457101ab51" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:35.332657 31651 raft_consensus.cc:2804] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.336546 31651 raft_consensus.cc:493] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.336637 31655 raft_consensus.cc:493] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.337047 31651 raft_consensus.cc:3060] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.337379 31655 raft_consensus.cc:515] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:35.340601 31650 ts_tablet_manager.cc:1434] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.006s
I20260709 12:19:35.341455 31662 raft_consensus.cc:515] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.342993 31650 tablet_bootstrap.cc:492] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:35.344476 31662 leader_election.cc:290] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:35.346987 31655 leader_election.cc:290] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:35.351558 31649 tablet_bootstrap.cc:654] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.353533 31650 tablet_bootstrap.cc:654] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.360270 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83b606a9e0744748b2ef0457101ab51" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:35.361248 31532 raft_consensus.cc:2468] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 0.
I20260709 12:19:35.361873 31650 tablet_bootstrap.cc:492] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:35.362901 31650 ts_tablet_manager.cc:1403] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:19:35.361831 31651 raft_consensus.cc:515] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.370465 31650 raft_consensus.cc:359] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.371615 31650 raft_consensus.cc:385] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.372076 31650 raft_consensus.cc:740] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.372622 31651 leader_election.cc:290] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:35.370525 31649 tablet_bootstrap.cc:492] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:35.373441 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91034dfa1be34cb19793a644d5e06a30" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:35.373318 31650 consensus_queue.cc:260] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.374594 31649 ts_tablet_manager.cc:1403] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.005s
I20260709 12:19:35.376959 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91034dfa1be34cb19793a644d5e06a30" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:35.377815 31532 raft_consensus.cc:3060] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.379503 31650 ts_tablet_manager.cc:1434] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.002s
I20260709 12:19:35.379866 31649 raft_consensus.cc:359] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.381181 31649 raft_consensus.cc:385] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.381667 31649 raft_consensus.cc:740] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.383400 31650 tablet_bootstrap.cc:492] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:35.383052 31649 consensus_queue.cc:260] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.387135 31649 ts_tablet_manager.cc:1434] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:19:35.389073 31649 tablet_bootstrap.cc:492] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:35.393710 31650 tablet_bootstrap.cc:654] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.397877 31649 tablet_bootstrap.cc:654] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.399035 31573 leader_election.cc:304] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:35.409341 31655 raft_consensus.cc:493] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.411562 31655 raft_consensus.cc:515] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.416088 31655 leader_election.cc:290] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.416589 31649 tablet_bootstrap.cc:492] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:35.417395 31649 ts_tablet_manager.cc:1403] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.007s
I20260709 12:19:35.417801 31651 raft_consensus.cc:2804] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.418500 31651 raft_consensus.cc:493] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.419212 31651 raft_consensus.cc:3060] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.421056 31649 raft_consensus.cc:359] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.421725 31649 raft_consensus.cc:385] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.421947 31649 raft_consensus.cc:740] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.370661 31647 raft_consensus.cc:359] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:35.422755 31649 consensus_queue.cc:260] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
W20260709 12:19:35.423861 31573 leader_election.cc:343] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:35.425061 31573 leader_election.cc:343] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.425621 31649 ts_tablet_manager.cc:1434] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 12:19:35.428342 31649 tablet_bootstrap.cc:492] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:35.423218 31647 raft_consensus.cc:385] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.430917 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cd13528284344aec85786a144eeb4" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:35.431746 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cd13528284344aec85786a144eeb4" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:35.432432 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cd13528284344aec85786a144eeb4" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:35.432966 31607 raft_consensus.cc:2393] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d24002ed5d7e47d498f01f7d15c34007 in current term 1: Already voted for candidate 41bee83366d7449fa414de406cd2714b in this term.
I20260709 12:19:35.433238 31458 raft_consensus.cc:3060] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.435053 31496 leader_election.cc:304] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007; no voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:35.435807 31650 tablet_bootstrap.cc:492] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:35.436575 31650 ts_tablet_manager.cc:1403] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.026s
I20260709 12:19:35.437091 31649 tablet_bootstrap.cc:654] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.431816 31533 raft_consensus.cc:3060] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.440863 31650 raft_consensus.cc:359] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.441872 31650 raft_consensus.cc:385] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.442189 31650 raft_consensus.cc:740] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.443388 31650 consensus_queue.cc:260] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.447840 31532 raft_consensus.cc:2468] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:35.449455 31573 leader_election.cc:304] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:35.450243 31649 tablet_bootstrap.cc:492] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:35.450445 31662 raft_consensus.cc:2804] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:35.450958 31649 ts_tablet_manager.cc:1403] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.016s
I20260709 12:19:35.430970 31647 raft_consensus.cc:740] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.454810 31649 raft_consensus.cc:359] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.456663 31649 raft_consensus.cc:385] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.457058 31649 raft_consensus.cc:740] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.457113 31647 consensus_queue.cc:260] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:35.458385 31649 consensus_queue.cc:260] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.461584 31649 ts_tablet_manager.cc:1434] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:19:35.462644 31650 ts_tablet_manager.cc:1434] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.007s
I20260709 12:19:35.463318 31649 tablet_bootstrap.cc:492] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:35.464463 31650 tablet_bootstrap.cc:492] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:35.472414 31649 tablet_bootstrap.cc:654] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.477092 31678 raft_consensus.cc:493] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.477785 31678 raft_consensus.cc:515] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.481873 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5df8666a6eb42998bcf6aa80adc1a9a" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:35.482800 31457 raft_consensus.cc:2468] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 0.
I20260709 12:19:35.483127 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5df8666a6eb42998bcf6aa80adc1a9a" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:35.484637 31499 leader_election.cc:304] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
W20260709 12:19:35.485520 31496 leader_election.cc:343] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.486931 31678 leader_election.cc:290] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.488042 31678 raft_consensus.cc:2804] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.488431 31678 raft_consensus.cc:493] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.488818 31678 raft_consensus.cc:3060] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.491051 31649 tablet_bootstrap.cc:492] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:35.491750 31649 ts_tablet_manager.cc:1403] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.003s
I20260709 12:19:35.495635 31649 raft_consensus.cc:359] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.496537 31649 raft_consensus.cc:385] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.496868 31649 raft_consensus.cc:740] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.497848 31649 consensus_queue.cc:260] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.499902 31678 raft_consensus.cc:515] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.503258 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5df8666a6eb42998bcf6aa80adc1a9a" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:35.503916 31457 raft_consensus.cc:3060] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.505198 31649 ts_tablet_manager.cc:1434] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:19:35.506165 31662 raft_consensus.cc:697] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:35.507647 31662 consensus_queue.cc:237] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.508709 31649 tablet_bootstrap.cc:492] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:35.511622 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5114b9a6cecc468397e1f2cbda4f9f83" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:35.512876 31606 raft_consensus.cc:2468] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:35.514065 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d572e70349474483450f8afd3ea6d7" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:35.514910 31607 raft_consensus.cc:2468] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:35.516846 31457 raft_consensus.cc:2468] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 1.
I20260709 12:19:35.517774 31421 leader_election.cc:304] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:35.534771 31676 raft_consensus.cc:493] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.535511 31676 raft_consensus.cc:515] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.518632 31649 tablet_bootstrap.cc:654] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.538407 31676 leader_election.cc:290] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.539510 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d572e70349474483450f8afd3ea6d7" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:35.540998 31499 leader_election.cc:304] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:35.541778 31650 tablet_bootstrap.cc:654] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.541679 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5114b9a6cecc468397e1f2cbda4f9f83" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:35.542606 31532 raft_consensus.cc:2468] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
W20260709 12:19:35.542680 31424 leader_election.cc:343] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.543040 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5114b9a6cecc468397e1f2cbda4f9f83" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:35.543736 31606 raft_consensus.cc:2468] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 0.
I20260709 12:19:35.543910 31676 raft_consensus.cc:2804] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:35.545123 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5114b9a6cecc468397e1f2cbda4f9f83" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:35.545496 31496 leader_election.cc:304] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:35.546149 31457 raft_consensus.cc:2468] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 0.
I20260709 12:19:35.551273 31354 catalog_manager.cc:5697] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 0 to 1, leader changed from <none> to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 1 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.556492 31649 tablet_bootstrap.cc:492] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:35.520903 31533 raft_consensus.cc:2468] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:35.523151 31678 leader_election.cc:290] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.557961 31678 raft_consensus.cc:2804] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.558437 31678 raft_consensus.cc:493] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.558848 31678 raft_consensus.cc:3060] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.523963 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5df8666a6eb42998bcf6aa80adc1a9a" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:35.524760 31655 raft_consensus.cc:493] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.565166 31655 raft_consensus.cc:515] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.569360 31655 leader_election.cc:290] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.570066 31655 raft_consensus.cc:2804] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.570494 31655 raft_consensus.cc:493] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.570948 31655 raft_consensus.cc:3060] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.574579 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28b35ac0f9e4ad6889d412a35979832" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
W20260709 12:19:35.576248 31496 leader_election.cc:343] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:35.577737 31424 leader_election.cc:343] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.528153 31647 ts_tablet_manager.cc:1434] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.216s	user 0.017s	sys 0.000s
I20260709 12:19:35.532434 31651 raft_consensus.cc:515] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.557191 31649 ts_tablet_manager.cc:1403] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.007s
I20260709 12:19:35.581248 31647 tablet_bootstrap.cc:492] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:35.582347 31651 leader_election.cc:290] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:35.583197 31649 raft_consensus.cc:359] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.584196 31649 raft_consensus.cc:385] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.584499 31649 raft_consensus.cc:740] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.584900 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83b606a9e0744748b2ef0457101ab51" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:35.585340 31649 consensus_queue.cc:260] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.585937 31532 raft_consensus.cc:3060] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.587982 31649 ts_tablet_manager.cc:1434] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:35.583223 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83b606a9e0744748b2ef0457101ab51" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:35.589290 31457 raft_consensus.cc:3060] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.589517 31649 tablet_bootstrap.cc:492] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:35.557193 31458 raft_consensus.cc:2468] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:35.594038 31658 raft_consensus.cc:2749] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:35.599354 31573 leader_election.cc:304] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:35.600818 31651 raft_consensus.cc:2804] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:35.601643 31651 raft_consensus.cc:697] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:35.605012 31651 consensus_queue.cc:237] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.607420 31649 tablet_bootstrap.cc:654] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.599651 31678 raft_consensus.cc:515] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.635974 31457 raft_consensus.cc:2468] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:35.637318 31650 tablet_bootstrap.cc:492] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:35.639474 31676 raft_consensus.cc:697] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Becoming Leader. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:35.641007 31650 ts_tablet_manager.cc:1403] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.177s	user 0.035s	sys 0.063s
W20260709 12:19:35.621376 31421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.195:42907, user_credentials={real_user=slave}} blocked reactor thread for 103834us
I20260709 12:19:35.642115 31676 consensus_queue.cc:237] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.643702 31421 leader_election.cc:304] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:35.648669 31573 leader_election.cc:304] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:35.651831 31682 raft_consensus.cc:2804] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.652534 31682 raft_consensus.cc:493] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.652982 31682 raft_consensus.cc:3060] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.652834 31655 raft_consensus.cc:515] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.659801 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5114b9a6cecc468397e1f2cbda4f9f83" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:35.656195 31651 raft_consensus.cc:2804] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:35.661998 31651 raft_consensus.cc:697] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:35.662158 31533 raft_consensus.cc:2393] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d5c321be97454a16b1a645db2c91b5f9 in current term 1: Already voted for candidate d24002ed5d7e47d498f01f7d15c34007 in this term.
I20260709 12:19:35.651914 31650 raft_consensus.cc:359] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:35.663434 31532 raft_consensus.cc:2468] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:35.663548 31650 raft_consensus.cc:385] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.664292 31650 raft_consensus.cc:740] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.664558 31655 leader_election.cc:290] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Requested vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.665339 31650 consensus_queue.cc:260] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:35.667568 31651 consensus_queue.cc:237] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.669142 31650 ts_tablet_manager.cc:1434] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:19:35.672518 31650 tablet_bootstrap.cc:492] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:35.673039 31678 leader_election.cc:290] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.676883 31647 tablet_bootstrap.cc:654] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.678117 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28b35ac0f9e4ad6889d412a35979832" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:35.678439 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5114b9a6cecc468397e1f2cbda4f9f83" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:35.681021 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5114b9a6cecc468397e1f2cbda4f9f83" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:35.681674 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5114b9a6cecc468397e1f2cbda4f9f83" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:35.683427 31606 raft_consensus.cc:3060] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.687175 31457 raft_consensus.cc:2393] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d24002ed5d7e47d498f01f7d15c34007 in current term 1: Already voted for candidate d5c321be97454a16b1a645db2c91b5f9 in this term.
I20260709 12:19:35.692730 31650 tablet_bootstrap.cc:654] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.695616 31496 leader_election.cc:304] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007; no voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:35.696656 31649 tablet_bootstrap.cc:492] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
W20260709 12:19:35.696866 31421 leader_election.cc:343] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.697206 31649 ts_tablet_manager.cc:1403] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.108s	user 0.019s	sys 0.012s
I20260709 12:19:35.697350 31421 leader_election.cc:304] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5c321be97454a16b1a645db2c91b5f9; no voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:35.698853 31678 raft_consensus.cc:2749] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:35.699910 31655 raft_consensus.cc:2749] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:35.703805 31682 raft_consensus.cc:515] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:35.707046 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d572e70349474483450f8afd3ea6d7" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:35.707700 31605 raft_consensus.cc:3060] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.702380 31649 raft_consensus.cc:359] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.708429 31649 raft_consensus.cc:385] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.708798 31649 raft_consensus.cc:740] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.709620 31649 consensus_queue.cc:260] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.712206 31649 ts_tablet_manager.cc:1434] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:19:35.726326 31647 tablet_bootstrap.cc:492] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:35.727144 31647 ts_tablet_manager.cc:1403] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.012s
I20260709 12:19:35.727649 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d572e70349474483450f8afd3ea6d7" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:35.728418 31532 raft_consensus.cc:3060] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.730973 31647 raft_consensus.cc:359] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.731956 31647 raft_consensus.cc:385] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.732249 31647 raft_consensus.cc:740] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.733271 31647 consensus_queue.cc:260] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.735126 31605 raft_consensus.cc:2468] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 1.
I20260709 12:19:35.736213 31647 ts_tablet_manager.cc:1434] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:19:35.736665 31421 leader_election.cc:304] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:35.737824 31647 tablet_bootstrap.cc:492] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:35.737887 31655 raft_consensus.cc:2804] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:35.741235 31355 catalog_manager.cc:5697] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 reported cstate change: term changed from 0 to 1, leader changed from <none> to d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "d24002ed5d7e47d498f01f7d15c34007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.742362 31682 leader_election.cc:290] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Requested vote from peers 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:35.751603 31655 raft_consensus.cc:697] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Becoming Leader. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:35.753298 31647 tablet_bootstrap.cc:654] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.754446 31682 raft_consensus.cc:493] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.756369 31682 raft_consensus.cc:515] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.757998 31650 tablet_bootstrap.cc:492] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:35.758608 31650 ts_tablet_manager.cc:1403] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.010s
I20260709 12:19:35.757536 31655 consensus_queue.cc:237] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:35.759282 31606 raft_consensus.cc:2468] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 1.
I20260709 12:19:35.760244 31682 leader_election.cc:290] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.761914 31421 leader_election.cc:304] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:35.759826 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91034dfa1be34cb19793a644d5e06a30" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:35.764498 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91034dfa1be34cb19793a644d5e06a30" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:35.764988 31533 raft_consensus.cc:2393] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d5c321be97454a16b1a645db2c91b5f9 in current term 1: Already voted for candidate 41bee83366d7449fa414de406cd2714b in this term.
I20260709 12:19:35.766922 31650 raft_consensus.cc:359] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.768611 31650 raft_consensus.cc:385] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.770723 31650 raft_consensus.cc:740] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.773967 31650 consensus_queue.cc:260] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.769882 31682 raft_consensus.cc:2804] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:35.775166 31424 leader_election.cc:304] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5c321be97454a16b1a645db2c91b5f9; no voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:35.776502 31532 raft_consensus.cc:2468] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 1.
I20260709 12:19:35.783139 31650 ts_tablet_manager.cc:1434] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:19:35.784809 31650 tablet_bootstrap.cc:492] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:35.785092 31647 tablet_bootstrap.cc:492] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:35.785825 31647 ts_tablet_manager.cc:1403] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.009s
I20260709 12:19:35.790161 31647 raft_consensus.cc:359] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.791100 31647 raft_consensus.cc:385] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.791460 31647 raft_consensus.cc:740] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.792650 31647 consensus_queue.cc:260] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.793277 31650 tablet_bootstrap.cc:654] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.795498 31647 ts_tablet_manager.cc:1434] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:19:35.795920 31353 catalog_manager.cc:5697] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "d5c321be97454a16b1a645db2c91b5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.797500 31647 tablet_bootstrap.cc:492] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:35.775465 31682 raft_consensus.cc:697] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Becoming Leader. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:35.799866 31682 consensus_queue.cc:237] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.803218 31655 raft_consensus.cc:3060] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.809146 31647 tablet_bootstrap.cc:654] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.819268 31655 raft_consensus.cc:2749] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:35.826690 31650 tablet_bootstrap.cc:492] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:35.827582 31650 ts_tablet_manager.cc:1403] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.043s	user 0.027s	sys 0.003s
I20260709 12:19:35.827659 31647 tablet_bootstrap.cc:492] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:35.828302 31647 ts_tablet_manager.cc:1403] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.017s
I20260709 12:19:35.831353 31647 raft_consensus.cc:359] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.832013 31647 raft_consensus.cc:385] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.832589 31647 raft_consensus.cc:740] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.831796 31650 raft_consensus.cc:359] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.833210 31650 raft_consensus.cc:385] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.833717 31650 raft_consensus.cc:740] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.833532 31647 consensus_queue.cc:260] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.834761 31650 consensus_queue.cc:260] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.836571 31647 ts_tablet_manager.cc:1434] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:35.837741 31650 ts_tablet_manager.cc:1434] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:19:35.838835 31647 tablet_bootstrap.cc:492] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:35.840178 31650 tablet_bootstrap.cc:492] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:35.840142 31355 catalog_manager.cc:5697] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 0 to 1, leader changed from <none> to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 1 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.842624 31355 catalog_manager.cc:5697] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 0 to 1, leader changed from <none> to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 1 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.847674 31647 tablet_bootstrap.cc:654] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.848711 31650 tablet_bootstrap.cc:654] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.849756 31676 raft_consensus.cc:493] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.850417 31676 raft_consensus.cc:515] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.854465 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c8611b4cc24bfda382338c8d1f762b" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:35.855154 31605 raft_consensus.cc:2468] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 0.
I20260709 12:19:35.855504 31676 leader_election.cc:290] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.856277 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c8611b4cc24bfda382338c8d1f762b" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:35.856587 31496 leader_election.cc:304] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:35.856976 31457 raft_consensus.cc:2468] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 0.
I20260709 12:19:35.857637 31676 raft_consensus.cc:2804] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.858093 31676 raft_consensus.cc:493] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.858306 31353 catalog_manager.cc:5697] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "d5c321be97454a16b1a645db2c91b5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.858523 31676 raft_consensus.cc:3060] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.868952 31647 tablet_bootstrap.cc:492] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:35.869650 31647 ts_tablet_manager.cc:1403] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.000s
I20260709 12:19:35.869901 31650 tablet_bootstrap.cc:492] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:35.870515 31650 ts_tablet_manager.cc:1403] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
I20260709 12:19:35.870760 31676 raft_consensus.cc:515] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.873538 31650 raft_consensus.cc:359] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.873483 31647 raft_consensus.cc:359] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.874501 31650 raft_consensus.cc:385] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.874614 31647 raft_consensus.cc:385] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.874928 31650 raft_consensus.cc:740] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.875149 31647 raft_consensus.cc:740] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.876164 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c8611b4cc24bfda382338c8d1f762b" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:35.876068 31650 consensus_queue.cc:260] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.876818 31457 raft_consensus.cc:3060] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.878504 31650 ts_tablet_manager.cc:1434] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:19:35.874650 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c8611b4cc24bfda382338c8d1f762b" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:35.883399 31605 raft_consensus.cc:3060] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.886528 31457 raft_consensus.cc:2468] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 1.
I20260709 12:19:35.876080 31647 consensus_queue.cc:260] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.889297 31647 ts_tablet_manager.cc:1434] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:19:35.890744 31499 leader_election.cc:304] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:35.891875 31678 raft_consensus.cc:2804] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:35.892444 31678 raft_consensus.cc:697] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Becoming Leader. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:35.893342 31678 consensus_queue.cc:237] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.896178 31605 raft_consensus.cc:2468] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 1.
I20260709 12:19:35.899279 31676 leader_election.cc:290] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.906668 31354 catalog_manager.cc:5697] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 reported cstate change: term changed from 0 to 1, leader changed from <none> to d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "d24002ed5d7e47d498f01f7d15c34007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.934017 31655 raft_consensus.cc:493] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.933740 31651 consensus_queue.cc:1048] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:35.934629 31655 raft_consensus.cc:515] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.936774 31655 leader_election.cc:290] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.937763 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26628f85884b4cf4a2d8acd4be9bd240" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:35.937894 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26628f85884b4cf4a2d8acd4be9bd240" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:35.938963 31532 raft_consensus.cc:2468] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:35.939003 31605 raft_consensus.cc:2468] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:35.940608 31421 leader_election.cc:304] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:35.941658 31682 raft_consensus.cc:2804] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.942013 31682 raft_consensus.cc:493] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.942361 31682 raft_consensus.cc:3060] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.952674 31682 raft_consensus.cc:515] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.957755 31682 leader_election.cc:290] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Requested vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:35.958225 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26628f85884b4cf4a2d8acd4be9bd240" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:35.964910 31605 raft_consensus.cc:3060] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.958303 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26628f85884b4cf4a2d8acd4be9bd240" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:35.966101 31532 raft_consensus.cc:3060] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.963132 31651 consensus_queue.cc:1048] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:35.974155 31605 raft_consensus.cc:2468] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 1.
I20260709 12:19:35.974900 31532 raft_consensus.cc:2468] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 1.
I20260709 12:19:35.976300 31421 leader_election.cc:304] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:35.977752 31682 raft_consensus.cc:2804] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:35.978376 31682 raft_consensus.cc:697] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Becoming Leader. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:35.979346 31682 consensus_queue.cc:237] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:35.989604 31354 catalog_manager.cc:5697] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "d5c321be97454a16b1a645db2c91b5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.000677 31651 consensus_queue.cc:1048] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:36.015241 31651 consensus_queue.cc:1048] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:36.032120 31678 raft_consensus.cc:493] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.032701 31678 raft_consensus.cc:515] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.034847 31678 leader_election.cc:290] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:36.036062 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28b35ac0f9e4ad6889d412a35979832" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:36.036135 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28b35ac0f9e4ad6889d412a35979832" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:36.036877 31605 raft_consensus.cc:2468] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 0.
I20260709 12:19:36.037148 31457 raft_consensus.cc:2468] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 0.
I20260709 12:19:36.038069 31496 leader_election.cc:304] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:36.039192 31678 raft_consensus.cc:2804] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:36.039613 31678 raft_consensus.cc:493] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.039984 31678 raft_consensus.cc:3060] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.045725 31678 raft_consensus.cc:515] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.047550 31678 leader_election.cc:290] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:36.048717 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28b35ac0f9e4ad6889d412a35979832" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:36.048821 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28b35ac0f9e4ad6889d412a35979832" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:36.049314 31605 raft_consensus.cc:3060] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.049592 31457 raft_consensus.cc:3060] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.054994 31605 raft_consensus.cc:2468] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 1.
I20260709 12:19:36.055922 31457 raft_consensus.cc:2468] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 1.
I20260709 12:19:36.056174 31496 leader_election.cc:304] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:36.057124 31678 raft_consensus.cc:2804] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:36.057564 31678 raft_consensus.cc:697] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Becoming Leader. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:36.058375 31678 consensus_queue.cc:237] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.066995 31353 catalog_manager.cc:5697] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 reported cstate change: term changed from 0 to 1, leader changed from <none> to d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "d24002ed5d7e47d498f01f7d15c34007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.073182 31605 raft_consensus.cc:3060] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.081004 31678 consensus_queue.cc:1048] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:36.083421 31677 consensus_queue.cc:1048] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:36.095109 31678 consensus_queue.cc:1048] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:36.099495 31677 consensus_queue.cc:1048] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:36.235455 31682 consensus_queue.cc:1048] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:36.250423 31696 consensus_queue.cc:1048] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:36.268023 31655 consensus_queue.cc:1048] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:36.274006 31532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c28b35ac0f9e4ad6889d412a35979832"
dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
mode: GRACEFUL
new_leader_uuid: "d5c321be97454a16b1a645db2c91b5f9"
 from {username='slave'} at 127.0.0.1:46064
I20260709 12:19:36.274768 31532 raft_consensus.cc:606] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Received request to transfer leadership to TS d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:36.285564 31655 consensus_queue.cc:1048] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:36.313184 31605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f36cd13528284344aec85786a144eeb4"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
mode: GRACEFUL
new_leader_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:60010
I20260709 12:19:36.313949 31605 raft_consensus.cc:606] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Received request to transfer leadership to TS d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:36.321123 31605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c83b606a9e0744748b2ef0457101ab51"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
mode: GRACEFUL
new_leader_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:60010
I20260709 12:19:36.321834 31605 raft_consensus.cc:606] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Received request to transfer leadership to TS d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:36.369911 31678 consensus_queue.cc:1048] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:36.370712 31676 consensus_queue.cc:1048] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:36.470583 31677 raft_consensus.cc:993] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b: : Instructing follower d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:36.470764 31676 consensus_queue.cc:1048] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:36.471266 31662 raft_consensus.cc:1081] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Signalling peer d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:36.473531 31533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f36cd13528284344aec85786a144eeb4"
dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:46046
I20260709 12:19:36.474191 31533 raft_consensus.cc:493] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.474543 31533 raft_consensus.cc:3060] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.482574 31533 raft_consensus.cc:515] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.485857 31533 leader_election.cc:290] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:36.488343 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cd13528284344aec85786a144eeb4" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:36.489121 31606 raft_consensus.cc:3055] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:36.489459 31606 raft_consensus.cc:740] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:36.490404 31606 consensus_queue.cc:260] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.491724 31606 raft_consensus.cc:3060] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.492695 31678 consensus_queue.cc:1048] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:36.494958 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36cd13528284344aec85786a144eeb4" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:36.496074 31457 raft_consensus.cc:3060] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.500774 31606 raft_consensus.cc:2468] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 2.
I20260709 12:19:36.502518 31496 leader_election.cc:304] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:36.503638 31655 consensus_queue.cc:1048] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:36.503739 31678 raft_consensus.cc:2804] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:36.505882 31678 raft_consensus.cc:697] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Becoming Leader. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:36.506896 31678 consensus_queue.cc:237] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.510468 31684 raft_consensus.cc:993] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007: : Instructing follower d5c321be97454a16b1a645db2c91b5f9 to start an election
I20260709 12:19:36.511194 31684 raft_consensus.cc:1081] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Signalling peer d5c321be97454a16b1a645db2c91b5f9 to start an election
I20260709 12:19:36.510433 31457 raft_consensus.cc:2468] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 2.
I20260709 12:19:36.513130 31458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c28b35ac0f9e4ad6889d412a35979832"
dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
 from {username='slave'} at 127.0.0.1:34248
I20260709 12:19:36.513813 31458 raft_consensus.cc:493] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.514235 31458 raft_consensus.cc:3060] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.520377 31354 catalog_manager.cc:5697] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 reported cstate change: term changed from 1 to 2, leader changed from 41bee83366d7449fa414de406cd2714b (127.17.249.195) to d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "d24002ed5d7e47d498f01f7d15c34007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.526973 31458 raft_consensus.cc:515] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.528439 31682 consensus_queue.cc:1048] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:36.530750 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28b35ac0f9e4ad6889d412a35979832" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:36.531292 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28b35ac0f9e4ad6889d412a35979832" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:36.531622 31533 raft_consensus.cc:3055] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:36.534741 31533 raft_consensus.cc:740] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:36.535903 31533 consensus_queue.cc:260] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.537647 31533 raft_consensus.cc:3060] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.530906 31458 leader_election.cc:290] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 2 election: Requested vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:36.544912 31605 raft_consensus.cc:3060] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.553431 31533 raft_consensus.cc:2468] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 2.
I20260709 12:19:36.553778 31605 raft_consensus.cc:2468] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 2.
I20260709 12:19:36.555351 31421 leader_election.cc:304] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:36.556434 31682 raft_consensus.cc:2804] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:36.557042 31682 raft_consensus.cc:697] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Becoming Leader. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:36.557992 31682 consensus_queue.cc:237] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.566744 31356 catalog_manager.cc:5697] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 reported cstate change: term changed from 1 to 2, leader changed from d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194) to d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "d5c321be97454a16b1a645db2c91b5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.627432 31677 raft_consensus.cc:993] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b: : Instructing follower d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:36.628316 31677 raft_consensus.cc:1081] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Signalling peer d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:36.630370 31532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c83b606a9e0744748b2ef0457101ab51"
dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:46046
I20260709 12:19:36.630966 31532 raft_consensus.cc:493] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.631374 31532 raft_consensus.cc:3060] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.639384 31532 raft_consensus.cc:515] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.641521 31532 leader_election.cc:290] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:36.642720 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83b606a9e0744748b2ef0457101ab51" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:36.642830 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83b606a9e0744748b2ef0457101ab51" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:36.643580 31458 raft_consensus.cc:3060] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.643716 31605 raft_consensus.cc:3055] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:36.644263 31605 raft_consensus.cc:740] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:36.645116 31605 consensus_queue.cc:260] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.646144 31605 raft_consensus.cc:3060] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.650488 31458 raft_consensus.cc:2468] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 2.
I20260709 12:19:36.651535 31605 raft_consensus.cc:2468] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 2.
I20260709 12:19:36.652197 31499 leader_election.cc:304] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:36.653203 31676 raft_consensus.cc:2804] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:36.653750 31676 raft_consensus.cc:697] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Becoming Leader. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:36.654661 31676 consensus_queue.cc:237] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:36.662711 31356 catalog_manager.cc:5697] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 reported cstate change: term changed from 1 to 2, leader changed from 41bee83366d7449fa414de406cd2714b (127.17.249.195) to d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "d24002ed5d7e47d498f01f7d15c34007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.951152 31605 raft_consensus.cc:1275] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:36.952656 31676 consensus_queue.cc:1048] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:36.962580 31458 raft_consensus.cc:1275] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:36.964789 31684 consensus_queue.cc:1048] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:37.113788 31532 raft_consensus.cc:1275] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Refusing update from remote peer d5c321be97454a16b1a645db2c91b5f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:37.115536 31682 consensus_queue.cc:1048] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:37.121822 31458 raft_consensus.cc:1275] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:37.125519 31605 raft_consensus.cc:1275] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Refusing update from remote peer d5c321be97454a16b1a645db2c91b5f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:37.127554 31695 consensus_queue.cc:1048] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:37.127434 31684 consensus_queue.cc:1048] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:37.148964 31605 raft_consensus.cc:1275] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:37.150686 31676 consensus_queue.cc:1048] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:39.360124 31354 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45844:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:39.362637 31354 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:39.420349 31444 tablet_service.cc:1511] Processing CreateTablet for tablet 1b434179a27a4ef5ab51c993cc5267dc (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:39.421319 31520 tablet_service.cc:1511] Processing CreateTablet for tablet 1b434179a27a4ef5ab51c993cc5267dc (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:39.422174 31444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b434179a27a4ef5ab51c993cc5267dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.425621 31591 tablet_service.cc:1511] Processing CreateTablet for tablet 1b434179a27a4ef5ab51c993cc5267dc (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:39.427497 31591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b434179a27a4ef5ab51c993cc5267dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.428375 31519 tablet_service.cc:1511] Processing CreateTablet for tablet fa8a5387ba6a4f6cbfcf7169a60b68a4 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:39.431766 31441 tablet_service.cc:1511] Processing CreateTablet for tablet fa8a5387ba6a4f6cbfcf7169a60b68a4 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:39.433439 31441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8a5387ba6a4f6cbfcf7169a60b68a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.433512 31522 tablet_service.cc:1511] Processing CreateTablet for tablet e5b3000b5d5b4587bdc86d4f21e36269 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:39.440806 31520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b434179a27a4ef5ab51c993cc5267dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.440631 31440 tablet_service.cc:1511] Processing CreateTablet for tablet e5b3000b5d5b4587bdc86d4f21e36269 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:39.442235 31440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b3000b5d5b4587bdc86d4f21e36269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.441946 31592 tablet_service.cc:1511] Processing CreateTablet for tablet fa8a5387ba6a4f6cbfcf7169a60b68a4 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:39.443622 31592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8a5387ba6a4f6cbfcf7169a60b68a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.444434 31445 tablet_service.cc:1511] Processing CreateTablet for tablet 1dd87099dbf84d21be39416e40569b59 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:39.446066 31445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd87099dbf84d21be39416e40569b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.447428 31522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b3000b5d5b4587bdc86d4f21e36269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.453282 31593 tablet_service.cc:1511] Processing CreateTablet for tablet e5b3000b5d5b4587bdc86d4f21e36269 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:39.455083 31593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b3000b5d5b4587bdc86d4f21e36269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.455276 31519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8a5387ba6a4f6cbfcf7169a60b68a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.460287 31596 tablet_service.cc:1511] Processing CreateTablet for tablet 1dd87099dbf84d21be39416e40569b59 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:39.461985 31596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd87099dbf84d21be39416e40569b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.468276 31523 tablet_service.cc:1511] Processing CreateTablet for tablet 1dd87099dbf84d21be39416e40569b59 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:39.469969 31523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd87099dbf84d21be39416e40569b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.473300 31521 tablet_service.cc:1511] Processing CreateTablet for tablet 11bd02081d134bcab4a1bf885c5f4842 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:39.473491 31597 tablet_service.cc:1511] Processing CreateTablet for tablet 11bd02081d134bcab4a1bf885c5f4842 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:39.475271 31597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bd02081d134bcab4a1bf885c5f4842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.476382 31518 tablet_service.cc:1511] Processing CreateTablet for tablet fa81d1582b2642e48bfc1888ed6a575c (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:39.479712 31515 tablet_service.cc:1511] Processing CreateTablet for tablet 31ef86959a85473494a6d0519a5b03ad (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:39.481315 31595 tablet_service.cc:1511] Processing CreateTablet for tablet fa81d1582b2642e48bfc1888ed6a575c (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:39.483235 31521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bd02081d134bcab4a1bf885c5f4842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.483003 31517 tablet_service.cc:1511] Processing CreateTablet for tablet fb3eee9e931b463f8eb7e31b1c6f7a7f (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:39.483580 31595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa81d1582b2642e48bfc1888ed6a575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.484565 31517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3eee9e931b463f8eb7e31b1c6f7a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.486253 31516 tablet_service.cc:1511] Processing CreateTablet for tablet 996707b67f2248fabc8a65fcbc145b1c (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:39.489069 31443 tablet_service.cc:1511] Processing CreateTablet for tablet fa81d1582b2642e48bfc1888ed6a575c (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:39.489250 31594 tablet_service.cc:1511] Processing CreateTablet for tablet 31ef86959a85473494a6d0519a5b03ad (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:39.492340 31442 tablet_service.cc:1511] Processing CreateTablet for tablet 31ef86959a85473494a6d0519a5b03ad (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:39.493620 31590 tablet_service.cc:1511] Processing CreateTablet for tablet fb3eee9e931b463f8eb7e31b1c6f7a7f (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:39.495173 31448 tablet_service.cc:1511] Processing CreateTablet for tablet fb3eee9e931b463f8eb7e31b1c6f7a7f (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:39.496502 31590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3eee9e931b463f8eb7e31b1c6f7a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.497985 31447 tablet_service.cc:1511] Processing CreateTablet for tablet 996707b67f2248fabc8a65fcbc145b1c (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:39.499367 31594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ef86959a85473494a6d0519a5b03ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.500259 31446 tablet_service.cc:1511] Processing CreateTablet for tablet 11bd02081d134bcab4a1bf885c5f4842 (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:39.503224 31515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ef86959a85473494a6d0519a5b03ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.504896 31589 tablet_service.cc:1511] Processing CreateTablet for tablet 996707b67f2248fabc8a65fcbc145b1c (DEFAULT_TABLE table=soft_deleted_table [id=78da975978c7459296339d0fa9a1a875]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:39.506892 31516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 996707b67f2248fabc8a65fcbc145b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.507946 31589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 996707b67f2248fabc8a65fcbc145b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.511216 31518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa81d1582b2642e48bfc1888ed6a575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.490658 31443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa81d1582b2642e48bfc1888ed6a575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.516198 31446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bd02081d134bcab4a1bf885c5f4842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.523175 31448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3eee9e931b463f8eb7e31b1c6f7a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.526209 31447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 996707b67f2248fabc8a65fcbc145b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.528359 31442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ef86959a85473494a6d0519a5b03ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:39.631706 31750 tablet_bootstrap.cc:492] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:39.642302 31750 tablet_bootstrap.cc:654] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.726382 31750 tablet_bootstrap.cc:492] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:39.740000 31754 tablet_bootstrap.cc:492] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:39.750392 31750 ts_tablet_manager.cc:1403] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.119s	user 0.030s	sys 0.029s
I20260709 12:19:39.753825 31750 raft_consensus.cc:359] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.754604 31750 raft_consensus.cc:385] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.762751 31754 tablet_bootstrap.cc:654] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.758751 31750 raft_consensus.cc:740] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.771545 31752 tablet_bootstrap.cc:492] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:39.772639 31750 consensus_queue.cc:260] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.774257 31754 tablet_bootstrap.cc:492] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:39.774998 31754 ts_tablet_manager.cc:1403] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.002s
I20260709 12:19:39.775328 31750 ts_tablet_manager.cc:1434] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:19:39.776876 31750 tablet_bootstrap.cc:492] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:39.778450 31754 raft_consensus.cc:359] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.779376 31754 raft_consensus.cc:385] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.779686 31754 raft_consensus.cc:740] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.780437 31754 consensus_queue.cc:260] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.782904 31754 ts_tablet_manager.cc:1434] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:39.786369 31754 tablet_bootstrap.cc:492] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:39.786432 31752 tablet_bootstrap.cc:654] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.789800 31750 tablet_bootstrap.cc:654] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.795089 31754 tablet_bootstrap.cc:654] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.797143 31752 tablet_bootstrap.cc:492] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:39.805750 31756 raft_consensus.cc:493] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.806357 31756 raft_consensus.cc:515] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.808604 31750 tablet_bootstrap.cc:492] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:39.808706 31756 leader_election.cc:290] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:39.809332 31750 ts_tablet_manager.cc:1403] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.015s
I20260709 12:19:39.809814 31754 tablet_bootstrap.cc:492] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:39.810113 31752 ts_tablet_manager.cc:1403] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.006s
I20260709 12:19:39.810398 31754 ts_tablet_manager.cc:1403] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.014s
I20260709 12:19:39.811502 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
W20260709 12:19:39.813292 31421 leader_election.cc:343] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:39.813598 31750 raft_consensus.cc:359] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.814426 31750 raft_consensus.cc:385] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.814709 31750 raft_consensus.cc:740] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.815026 31752 raft_consensus.cc:359] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.815963 31752 raft_consensus.cc:385] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.815531 31754 raft_consensus.cc:359] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.815601 31750 consensus_queue.cc:260] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.816484 31754 raft_consensus.cc:385] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.816330 31752 raft_consensus.cc:740] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.816866 31754 raft_consensus.cc:740] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.817643 31754 consensus_queue.cc:260] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.818701 31750 ts_tablet_manager.cc:1434] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:19:39.814922 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:39.820070 31750 tablet_bootstrap.cc:492] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:39.820128 31754 ts_tablet_manager.cc:1434] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:39.820720 31752 consensus_queue.cc:260] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.821552 31754 tablet_bootstrap.cc:492] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:39.823460 31662 raft_consensus.cc:493] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.824026 31662 raft_consensus.cc:515] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.826179 31662 leader_election.cc:290] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:39.829252 31750 tablet_bootstrap.cc:654] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.829720 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b434179a27a4ef5ab51c993cc5267dc" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:39.833328 31676 raft_consensus.cc:493] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.834201 31676 raft_consensus.cc:515] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.836012 31752 ts_tablet_manager.cc:1434] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.007s
I20260709 12:19:39.836791 31676 leader_election.cc:290] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:39.837205 31752 tablet_bootstrap.cc:492] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
W20260709 12:19:39.837926 31424 leader_election.cc:343] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:39.838891 31424 leader_election.cc:304] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5c321be97454a16b1a645db2c91b5f9; no voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007
W20260709 12:19:39.839680 31573 leader_election.cc:343] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:39.840554 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd02081d134bcab4a1bf885c5f4842" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:39.838485 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b434179a27a4ef5ab51c993cc5267dc" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
W20260709 12:19:39.844379 31573 leader_election.cc:343] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:39.845204 31573 leader_election.cc:304] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41bee83366d7449fa414de406cd2714b; no voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9
W20260709 12:19:39.846908 31496 leader_election.cc:343] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:39.851107 31752 tablet_bootstrap.cc:654] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.852316 31754 tablet_bootstrap.cc:654] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.853567 31756 raft_consensus.cc:2749] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:39.859716 31662 raft_consensus.cc:2749] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:39.867920 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd02081d134bcab4a1bf885c5f4842" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
W20260709 12:19:39.870538 31499 leader_election.cc:343] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:39.871421 31499 leader_election.cc:304] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007; no voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:39.873400 31676 raft_consensus.cc:2749] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:39.874423 31754 tablet_bootstrap.cc:492] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:39.874507 31752 tablet_bootstrap.cc:492] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:39.875161 31754 ts_tablet_manager.cc:1403] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.005s
I20260709 12:19:39.878942 31752 ts_tablet_manager.cc:1403] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.042s	user 0.002s	sys 0.027s
I20260709 12:19:39.883168 31754 raft_consensus.cc:359] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.883996 31754 raft_consensus.cc:385] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.884373 31754 raft_consensus.cc:740] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.884064 31752 raft_consensus.cc:359] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.885044 31752 raft_consensus.cc:385] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.885412 31752 raft_consensus.cc:740] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.885226 31754 consensus_queue.cc:260] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.886667 31752 consensus_queue.cc:260] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.887681 31754 ts_tablet_manager.cc:1434] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 12:19:39.888840 31754 tablet_bootstrap.cc:492] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:39.889319 31752 ts_tablet_manager.cc:1434] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:19:39.890372 31752 tablet_bootstrap.cc:492] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:39.895738 31754 tablet_bootstrap.cc:654] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.897457 31752 tablet_bootstrap.cc:654] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.908516 31754 tablet_bootstrap.cc:492] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:39.909065 31754 ts_tablet_manager.cc:1403] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 12:19:39.910601 31752 tablet_bootstrap.cc:492] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:39.912176 31754 raft_consensus.cc:359] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.912988 31754 raft_consensus.cc:385] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.913300 31754 raft_consensus.cc:740] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.914158 31754 consensus_queue.cc:260] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.917382 31754 ts_tablet_manager.cc:1434] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.006s
I20260709 12:19:39.918586 31754 tablet_bootstrap.cc:492] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:39.919986 31750 tablet_bootstrap.cc:492] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:39.920729 31750 ts_tablet_manager.cc:1403] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.101s	user 0.040s	sys 0.055s
I20260709 12:19:39.923159 31752 ts_tablet_manager.cc:1403] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.002s
I20260709 12:19:39.925622 31754 tablet_bootstrap.cc:654] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.925591 31750 raft_consensus.cc:359] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.926736 31750 raft_consensus.cc:385] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.927135 31750 raft_consensus.cc:740] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.928133 31750 consensus_queue.cc:260] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.930766 31750 ts_tablet_manager.cc:1434] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:19:39.932116 31754 tablet_bootstrap.cc:492] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:39.932791 31754 ts_tablet_manager.cc:1403] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:19:39.933164 31752 raft_consensus.cc:359] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.934103 31752 raft_consensus.cc:385] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.934445 31752 raft_consensus.cc:740] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.932193 31750 tablet_bootstrap.cc:492] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:39.935420 31752 consensus_queue.cc:260] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.935947 31754 raft_consensus.cc:359] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.936827 31754 raft_consensus.cc:385] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.937135 31754 raft_consensus.cc:740] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.937922 31754 consensus_queue.cc:260] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.938392 31752 ts_tablet_manager.cc:1434] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:19:39.940385 31754 ts_tablet_manager.cc:1434] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:19:39.941538 31754 tablet_bootstrap.cc:492] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:39.944811 31750 tablet_bootstrap.cc:654] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.949113 31760 raft_consensus.cc:493] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.949354 31754 tablet_bootstrap.cc:654] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.949793 31760 raft_consensus.cc:515] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.952328 31760 leader_election.cc:290] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:39.940950 31752 tablet_bootstrap.cc:492] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:39.957795 31750 tablet_bootstrap.cc:492] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:39.958585 31750 ts_tablet_manager.cc:1403] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.004s
I20260709 12:19:39.969990 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b3000b5d5b4587bdc86d4f21e36269" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:39.970929 31533 raft_consensus.cc:2468] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 0.
I20260709 12:19:39.971541 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b3000b5d5b4587bdc86d4f21e36269" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:39.972448 31760 raft_consensus.cc:493] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.973744 31760 raft_consensus.cc:515] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.975915 31760 leader_election.cc:290] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:39.968245 31750 raft_consensus.cc:359] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.972484 31458 raft_consensus.cc:2468] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 0.
I20260709 12:19:39.973133 31573 leader_election.cc:304] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:39.977803 31752 tablet_bootstrap.cc:654] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:39.978564 31760 raft_consensus.cc:2804] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:39.980486 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8a5387ba6a4f6cbfcf7169a60b68a4" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:39.981186 31754 tablet_bootstrap.cc:492] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:39.981442 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8a5387ba6a4f6cbfcf7169a60b68a4" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:39.982435 31754 ts_tablet_manager.cc:1403] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.015s
I20260709 12:19:39.982908 31458 raft_consensus.cc:2468] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 0.
I20260709 12:19:39.979071 31760 raft_consensus.cc:493] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.984715 31752 tablet_bootstrap.cc:492] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:39.984941 31760 raft_consensus.cc:3060] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:39.985405 31752 ts_tablet_manager.cc:1403] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.006s
I20260709 12:19:39.985756 31573 leader_election.cc:304] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:39.985854 31754 raft_consensus.cc:359] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.986740 31754 raft_consensus.cc:385] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.987152 31754 raft_consensus.cc:740] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.987967 31754 consensus_queue.cc:260] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.988647 31662 raft_consensus.cc:2804] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:39.989187 31662 raft_consensus.cc:493] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.989703 31662 raft_consensus.cc:3060] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:39.989225 31752 raft_consensus.cc:359] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.990131 31752 raft_consensus.cc:385] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.990437 31752 raft_consensus.cc:740] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.993134 31752 consensus_queue.cc:260] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:39.995802 31752 ts_tablet_manager.cc:1434] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:19:39.995858 31754 ts_tablet_manager.cc:1434] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.007s
I20260709 12:19:39.997381 31754 tablet_bootstrap.cc:492] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:39.976953 31750 raft_consensus.cc:385] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:39.999367 31752 tablet_bootstrap.cc:492] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:40.003161 31750 raft_consensus.cc:740] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.006562 31754 tablet_bootstrap.cc:654] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.007412 31750 consensus_queue.cc:260] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.004320 31662 raft_consensus.cc:515] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.013370 31662 leader_election.cc:290] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:40.014426 31752 tablet_bootstrap.cc:654] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:40.014317 31573 leader_election.cc:343] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.016796 31760 raft_consensus.cc:515] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.019928 31760 leader_election.cc:290] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:40.023344 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b3000b5d5b4587bdc86d4f21e36269" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:40.023986 31750 ts_tablet_manager.cc:1434] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.006s
I20260709 12:19:40.024189 31754 tablet_bootstrap.cc:492] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:40.024914 31754 ts_tablet_manager.cc:1403] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.002s
I20260709 12:19:40.024852 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8a5387ba6a4f6cbfcf7169a60b68a4" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:40.025424 31750 tablet_bootstrap.cc:492] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:40.025792 31458 raft_consensus.cc:3060] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.028162 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8a5387ba6a4f6cbfcf7169a60b68a4" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:40.028494 31754 raft_consensus.cc:359] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.029397 31754 raft_consensus.cc:385] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.024183 31457 raft_consensus.cc:3060] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.029721 31754 raft_consensus.cc:740] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.030906 31754 consensus_queue.cc:260] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.033313 31750 tablet_bootstrap.cc:654] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.033427 31754 ts_tablet_manager.cc:1434] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:19:40.035130 31754 tablet_bootstrap.cc:492] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:40.029610 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b3000b5d5b4587bdc86d4f21e36269" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:40.039525 31532 raft_consensus.cc:3060] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.044049 31754 tablet_bootstrap.cc:654] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:40.051730 31573 leader_election.cc:343] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.056196 31754 tablet_bootstrap.cc:492] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:40.057237 31750 tablet_bootstrap.cc:492] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:40.060881 31750 ts_tablet_manager.cc:1403] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.016s
I20260709 12:19:40.062117 31457 raft_consensus.cc:2468] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:40.064196 31573 leader_election.cc:304] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.065166 31770 raft_consensus.cc:2804] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:40.065748 31770 raft_consensus.cc:697] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:40.066426 31754 ts_tablet_manager.cc:1403] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.005s
I20260709 12:19:40.066612 31770 consensus_queue.cc:237] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.070287 31754 raft_consensus.cc:359] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.071165 31754 raft_consensus.cc:385] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.071485 31754 raft_consensus.cc:740] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.072243 31754 consensus_queue.cc:260] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.074442 31754 ts_tablet_manager.cc:1434] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 12:19:40.075516 31754 tablet_bootstrap.cc:492] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9: Bootstrap starting.
I20260709 12:19:40.064330 31750 raft_consensus.cc:359] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.075963 31750 raft_consensus.cc:385] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.076256 31750 raft_consensus.cc:740] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.070338 31458 raft_consensus.cc:2468] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:40.080325 31532 raft_consensus.cc:2468] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:40.081630 31754 tablet_bootstrap.cc:654] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.083251 31573 leader_election.cc:304] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:40.085366 31770 raft_consensus.cc:2804] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:40.086030 31770 raft_consensus.cc:697] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:40.087132 31770 consensus_queue.cc:237] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.092181 31354 catalog_manager.cc:5697] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 0 to 1, leader changed from <none> to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 1 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:40.093552 31754 tablet_bootstrap.cc:492] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9: No bootstrap required, opened a new log
I20260709 12:19:40.094074 31754 ts_tablet_manager.cc:1403] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 12:19:40.077013 31750 consensus_queue.cc:260] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.097276 31754 raft_consensus.cc:359] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.097990 31754 raft_consensus.cc:385] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.098264 31754 raft_consensus.cc:740] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.099133 31754 consensus_queue.cc:260] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.099874 31750 ts_tablet_manager.cc:1434] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 12:19:40.101018 31750 tablet_bootstrap.cc:492] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:40.101197 31754 ts_tablet_manager.cc:1434] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:19:40.115674 31750 tablet_bootstrap.cc:654] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.118734 31752 tablet_bootstrap.cc:492] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:40.119473 31752 ts_tablet_manager.cc:1403] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.120s	user 0.025s	sys 0.021s
I20260709 12:19:40.121622 31354 catalog_manager.cc:5697] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 0 to 1, leader changed from <none> to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 1 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:40.123871 31752 raft_consensus.cc:359] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.125053 31752 raft_consensus.cc:385] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.125380 31752 raft_consensus.cc:740] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.126665 31752 consensus_queue.cc:260] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.127851 31750 tablet_bootstrap.cc:492] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:40.129338 31752 ts_tablet_manager.cc:1434] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:40.130592 31752 tablet_bootstrap.cc:492] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:40.131436 31750 ts_tablet_manager.cc:1403] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.012s
I20260709 12:19:40.135341 31750 raft_consensus.cc:359] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.136206 31750 raft_consensus.cc:385] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.136523 31750 raft_consensus.cc:740] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.137495 31750 consensus_queue.cc:260] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.138247 31752 tablet_bootstrap.cc:654] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.140430 31750 ts_tablet_manager.cc:1434] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:40.141763 31750 tablet_bootstrap.cc:492] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:40.146142 31752 tablet_bootstrap.cc:492] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:40.147011 31752 ts_tablet_manager.cc:1403] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 12:19:40.149724 31750 tablet_bootstrap.cc:654] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.150424 31752 raft_consensus.cc:359] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.151371 31752 raft_consensus.cc:385] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.151695 31752 raft_consensus.cc:740] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.152591 31752 consensus_queue.cc:260] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.155298 31752 ts_tablet_manager.cc:1434] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:19:40.155962 31750 tablet_bootstrap.cc:492] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:40.156560 31750 ts_tablet_manager.cc:1403] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:19:40.156653 31752 tablet_bootstrap.cc:492] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:40.159682 31750 raft_consensus.cc:359] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.160466 31750 raft_consensus.cc:385] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.160753 31750 raft_consensus.cc:740] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.161533 31750 consensus_queue.cc:260] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.163796 31750 ts_tablet_manager.cc:1434] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:40.163791 31752 tablet_bootstrap.cc:654] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.165134 31750 tablet_bootstrap.cc:492] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:40.172418 31750 tablet_bootstrap.cc:654] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.177587 31676 raft_consensus.cc:493] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.178404 31676 raft_consensus.cc:515] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.181648 31676 leader_election.cc:290] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.183425 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b434179a27a4ef5ab51c993cc5267dc" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:40.184825 31458 raft_consensus.cc:2468] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 0.
I20260709 12:19:40.185783 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b434179a27a4ef5ab51c993cc5267dc" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:40.186511 31605 raft_consensus.cc:2468] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 0.
I20260709 12:19:40.187431 31752 tablet_bootstrap.cc:492] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:40.187773 31750 tablet_bootstrap.cc:492] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:40.187479 31499 leader_election.cc:304] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.188288 31752 ts_tablet_manager.cc:1403] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.007s
I20260709 12:19:40.188531 31750 ts_tablet_manager.cc:1403] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 12:19:40.189363 31751 raft_consensus.cc:2804] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:40.189833 31751 raft_consensus.cc:493] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.190186 31751 raft_consensus.cc:3060] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.191558 31750 raft_consensus.cc:359] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.191728 31752 raft_consensus.cc:359] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.192364 31750 raft_consensus.cc:385] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.192677 31752 raft_consensus.cc:385] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.192698 31750 raft_consensus.cc:740] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.193167 31752 raft_consensus.cc:740] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.193712 31750 consensus_queue.cc:260] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.194123 31752 consensus_queue.cc:260] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.198475 31750 ts_tablet_manager.cc:1434] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:19:40.200193 31750 tablet_bootstrap.cc:492] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b: Bootstrap starting.
I20260709 12:19:40.208843 31750 tablet_bootstrap.cc:654] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.204494 31751 raft_consensus.cc:515] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.218230 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b434179a27a4ef5ab51c993cc5267dc" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:40.219247 31457 raft_consensus.cc:3060] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.221057 31751 leader_election.cc:290] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.222775 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b434179a27a4ef5ab51c993cc5267dc" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:40.223568 31605 raft_consensus.cc:3060] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.224557 31750 tablet_bootstrap.cc:492] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b: No bootstrap required, opened a new log
I20260709 12:19:40.224687 31752 ts_tablet_manager.cc:1434] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.022s
I20260709 12:19:40.225296 31750 ts_tablet_manager.cc:1403] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.000s
I20260709 12:19:40.226212 31752 tablet_bootstrap.cc:492] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:40.228387 31750 raft_consensus.cc:359] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.232722 31605 raft_consensus.cc:2468] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 1.
I20260709 12:19:40.233522 31752 tablet_bootstrap.cc:654] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.229161 31750 raft_consensus.cc:385] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.234367 31750 raft_consensus.cc:740] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.234560 31496 leader_election.cc:304] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:40.235277 31750 consensus_queue.cc:260] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.238358 31750 ts_tablet_manager.cc:1434] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:19:40.239755 31786 raft_consensus.cc:2804] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:40.236320 31457 raft_consensus.cc:2468] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 1.
I20260709 12:19:40.241499 31786 raft_consensus.cc:697] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Becoming Leader. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:40.243070 31786 consensus_queue.cc:237] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.243950 31752 tablet_bootstrap.cc:492] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:40.244625 31752 ts_tablet_manager.cc:1403] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.006s
I20260709 12:19:40.248378 31752 raft_consensus.cc:359] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.249126 31752 raft_consensus.cc:385] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.249437 31752 raft_consensus.cc:740] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.250087 31752 consensus_queue.cc:260] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.252506 31752 ts_tablet_manager.cc:1434] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:19:40.253858 31752 tablet_bootstrap.cc:492] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007: Bootstrap starting.
I20260709 12:19:40.254757 31356 catalog_manager.cc:5697] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 reported cstate change: term changed from 0 to 1, leader changed from <none> to d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "d24002ed5d7e47d498f01f7d15c34007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.258767 31752 tablet_bootstrap.cc:654] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:40.264498 31752 tablet_bootstrap.cc:492] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007: No bootstrap required, opened a new log
I20260709 12:19:40.264992 31752 ts_tablet_manager.cc:1403] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:19:40.267339 31752 raft_consensus.cc:359] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.267881 31752 raft_consensus.cc:385] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:40.268138 31752 raft_consensus.cc:740] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.268852 31752 consensus_queue.cc:260] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.271047 31752 ts_tablet_manager.cc:1434] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:19:40.275933 31756 raft_consensus.cc:493] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.276546 31756 raft_consensus.cc:515] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.278923 31756 leader_election.cc:290] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.280107 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:40.280476 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:40.280880 31532 raft_consensus.cc:2468] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:40.281378 31606 raft_consensus.cc:2468] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:40.282186 31424 leader_election.cc:304] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.283232 31756 raft_consensus.cc:2804] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:40.283628 31756 raft_consensus.cc:493] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.283927 31756 raft_consensus.cc:3060] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:40.284404 31404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:40.285574 31737 raft_consensus.cc:493] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.286103 31737 raft_consensus.cc:515] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.288048 31737 leader_election.cc:290] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.288938 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:40.289350 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:40.289741 31532 raft_consensus.cc:2468] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:40.289899 31770 raft_consensus.cc:493] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.290406 31770 raft_consensus.cc:515] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.291157 31424 leader_election.cc:304] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.291121 31756 raft_consensus.cc:515] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.291488 31606 raft_consensus.cc:2468] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:40.292285 31737 raft_consensus.cc:2804] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:40.292762 31770 leader_election.cc:290] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:40.292717 31737 raft_consensus.cc:493] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.293494 31737 raft_consensus.cc:3060] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.294049 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:40.294241 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:40.294566 31532 raft_consensus.cc:2468] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 0.
I20260709 12:19:40.295578 31573 leader_election.cc:304] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:40.296420 31770 raft_consensus.cc:2804] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:40.296775 31770 raft_consensus.cc:493] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.297075 31770 raft_consensus.cc:3060] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.298530 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:40.299041 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:40.299234 31532 raft_consensus.cc:3060] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.299783 31606 raft_consensus.cc:3060] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.305847 31756 leader_election.cc:290] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Requested vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.306699 31770 raft_consensus.cc:515] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.309402 31760 raft_consensus.cc:493] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.310026 31760 raft_consensus.cc:515] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.316612 31760 leader_election.cc:290] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:40.317683 31770 leader_election.cc:290] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:40.320779 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd02081d134bcab4a1bf885c5f4842" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:40.321743 31533 raft_consensus.cc:2468] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 0.
I20260709 12:19:40.321549 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:40.323113 31531 raft_consensus.cc:3060] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.323370 31573 leader_election.cc:304] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:40.324733 31770 raft_consensus.cc:2804] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:40.325203 31770 raft_consensus.cc:493] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.325609 31770 raft_consensus.cc:3060] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.329161 31760 raft_consensus.cc:493] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.329880 31760 raft_consensus.cc:515] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.330058 31737 raft_consensus.cc:515] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.331707 31457 raft_consensus.cc:2393] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41bee83366d7449fa414de406cd2714b in current term 1: Already voted for candidate d5c321be97454a16b1a645db2c91b5f9 in this term.
I20260709 12:19:40.334478 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:40.335269 31737 leader_election.cc:290] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Requested vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.336568 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:40.334710 31530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:40.334322 31532 raft_consensus.cc:2468] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 1.
I20260709 12:19:40.339062 31424 leader_election.cc:304] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.339309 31606 raft_consensus.cc:2468] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 1.
I20260709 12:19:40.340054 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:40.341114 31458 raft_consensus.cc:2393] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 41bee83366d7449fa414de406cd2714b in current term 1: Already voted for candidate d5c321be97454a16b1a645db2c91b5f9 in this term.
I20260709 12:19:40.341914 31791 raft_consensus.cc:2804] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:40.342348 31791 raft_consensus.cc:697] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Becoming Leader. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:40.342854 31770 raft_consensus.cc:515] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.343204 31791 consensus_queue.cc:237] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.343806 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd02081d134bcab4a1bf885c5f4842" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:40.344277 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:40.337544 31531 raft_consensus.cc:2468] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:40.337635 31530 raft_consensus.cc:2468] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 0.
I20260709 12:19:40.337702 31605 raft_consensus.cc:2393] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d5c321be97454a16b1a645db2c91b5f9 in current term 1: Already voted for candidate 41bee83366d7449fa414de406cd2714b in this term.
I20260709 12:19:40.345068 31457 raft_consensus.cc:2468] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 0.
I20260709 12:19:40.345824 31573 leader_election.cc:304] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:40.337649 31760 leader_election.cc:290] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:40.346904 31421 leader_election.cc:304] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5c321be97454a16b1a645db2c91b5f9; no voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:40.347458 31662 raft_consensus.cc:2804] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:40.348047 31662 raft_consensus.cc:697] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:40.348628 31737 raft_consensus.cc:2749] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:40.349035 31770 leader_election.cc:290] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:40.348800 31662 consensus_queue.cc:237] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.344959 31458 raft_consensus.cc:2468] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 0.
I20260709 12:19:40.347193 31573 leader_election.cc:304] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.351725 31770 raft_consensus.cc:2804] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:40.352037 31770 raft_consensus.cc:493] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.352290 31770 raft_consensus.cc:3060] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.353724 31530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd02081d134bcab4a1bf885c5f4842" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:40.354422 31530 raft_consensus.cc:3060] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.361281 31530 raft_consensus.cc:2468] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:40.361431 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd02081d134bcab4a1bf885c5f4842" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:40.362185 31458 raft_consensus.cc:3060] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.362679 31573 leader_election.cc:304] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:40.363721 31662 raft_consensus.cc:2804] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:40.364269 31662 raft_consensus.cc:697] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:40.364305 31356 catalog_manager.cc:5697] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 0 to 1, leader changed from <none> to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 1 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:40.365711 31662 consensus_queue.cc:237] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.359757 31770 raft_consensus.cc:515] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.373943 31737 raft_consensus.cc:493] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.375911 31737 raft_consensus.cc:515] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.376925 31760 raft_consensus.cc:493] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.377660 31760 raft_consensus.cc:515] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.375082 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:40.380030 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996707b67f2248fabc8a65fcbc145b1c" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:40.380328 31760 leader_election.cc:290] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:40.380797 31605 raft_consensus.cc:2468] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:40.381219 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996707b67f2248fabc8a65fcbc145b1c" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:40.381990 31531 raft_consensus.cc:2468] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:40.380630 31737 leader_election.cc:290] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.382339 31421 leader_election.cc:304] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.382969 31457 raft_consensus.cc:3060] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.377718 31770 leader_election.cc:290] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:40.387580 31737 raft_consensus.cc:2804] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:40.388326 31737 raft_consensus.cc:493] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.390940 31737 raft_consensus.cc:3060] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.401644 31791 raft_consensus.cc:493] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.370718 31458 raft_consensus.cc:2468] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:40.402356 31791 raft_consensus.cc:515] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.404769 31356 catalog_manager.cc:5697] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "d5c321be97454a16b1a645db2c91b5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.408697 31457 raft_consensus.cc:2468] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:40.412899 31530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:40.413709 31530 raft_consensus.cc:3060] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.417363 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa81d1582b2642e48bfc1888ed6a575c" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b" is_pre_election: true
I20260709 12:19:40.417080 31737 raft_consensus.cc:515] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.418150 31605 raft_consensus.cc:2468] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:40.419577 31421 leader_election.cc:304] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.420176 31737 leader_election.cc:290] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Requested vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.421010 31737 raft_consensus.cc:2804] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:40.421464 31737 raft_consensus.cc:493] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.421864 31737 raft_consensus.cc:3060] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.422245 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996707b67f2248fabc8a65fcbc145b1c" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:40.422439 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa81d1582b2642e48bfc1888ed6a575c" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:40.423051 31532 raft_consensus.cc:3060] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.422866 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996707b67f2248fabc8a65fcbc145b1c" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:40.423861 31605 raft_consensus.cc:3060] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.423310 31531 raft_consensus.cc:2468] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 0.
I20260709 12:19:40.429656 31530 raft_consensus.cc:2468] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 1.
I20260709 12:19:40.431196 31791 leader_election.cc:290] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.432503 31737 raft_consensus.cc:515] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.433799 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa81d1582b2642e48bfc1888ed6a575c" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5c321be97454a16b1a645db2c91b5f9" is_pre_election: true
I20260709 12:19:40.434754 31457 raft_consensus.cc:2393] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41bee83366d7449fa414de406cd2714b in current term 1: Already voted for candidate d5c321be97454a16b1a645db2c91b5f9 in this term.
I20260709 12:19:40.436738 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa81d1582b2642e48bfc1888ed6a575c" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:40.433004 31605 raft_consensus.cc:2468] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 1.
I20260709 12:19:40.437036 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa81d1582b2642e48bfc1888ed6a575c" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24002ed5d7e47d498f01f7d15c34007" is_pre_election: true
I20260709 12:19:40.437366 31531 raft_consensus.cc:3060] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.438354 31421 leader_election.cc:304] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.439425 31791 raft_consensus.cc:2804] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:40.437343 31573 leader_election.cc:304] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.441062 31662 raft_consensus.cc:2804] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:40.439999 31791 raft_consensus.cc:697] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Becoming Leader. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:40.441584 31662 raft_consensus.cc:697] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:40.442675 31791 consensus_queue.cc:237] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.443073 31662 consensus_queue.cc:237] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.445117 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa81d1582b2642e48bfc1888ed6a575c" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:40.445958 31737 leader_election.cc:290] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Requested vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.445816 31532 raft_consensus.cc:2468] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 1.
I20260709 12:19:40.444550 31356 catalog_manager.cc:5697] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 0 to 1, leader changed from <none> to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 1 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:40.447749 31531 raft_consensus.cc:2468] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 1.
I20260709 12:19:40.449599 31424 leader_election.cc:304] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.445844 31605 raft_consensus.cc:3060] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.451058 31737 raft_consensus.cc:2804] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:40.451774 31737 raft_consensus.cc:697] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Becoming Leader. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:40.452977 31737 consensus_queue.cc:237] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.456670 31573 leader_election.cc:304] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41bee83366d7449fa414de406cd2714b; no voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:40.465862 31605 raft_consensus.cc:2468] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 1.
I20260709 12:19:40.467432 31760 raft_consensus.cc:2749] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:40.473543 31532 raft_consensus.cc:3060] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:40.474480 31356 catalog_manager.cc:5697] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 0 to 1, leader changed from <none> to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 1 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:40.482877 31760 consensus_queue.cc:1048] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.484027 31353 catalog_manager.cc:5697] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "d5c321be97454a16b1a645db2c91b5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.501722 31770 consensus_queue.cc:1048] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.506108 31353 catalog_manager.cc:5697] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "d5c321be97454a16b1a645db2c91b5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.578341 31770 consensus_queue.cc:1048] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.594287 31760 consensus_queue.cc:1048] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:40.690106 31751 consensus_queue.cc:1048] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:40.703369 31786 consensus_queue.cc:1048] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.713189 31532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b434179a27a4ef5ab51c993cc5267dc"
dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
mode: GRACEFUL
new_leader_uuid: "d5c321be97454a16b1a645db2c91b5f9"
 from {username='slave'} at 127.0.0.1:46064
I20260709 12:19:40.713881 31532 raft_consensus.cc:606] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Received request to transfer leadership to TS d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:40.720845 31605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa8a5387ba6a4f6cbfcf7169a60b68a4"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
mode: GRACEFUL
new_leader_uuid: "d5c321be97454a16b1a645db2c91b5f9"
 from {username='slave'} at 127.0.0.1:60010
I20260709 12:19:40.721398 31605 raft_consensus.cc:606] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Received request to transfer leadership to TS d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:40.728933 31605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5b3000b5d5b4587bdc86d4f21e36269"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
mode: GRACEFUL
new_leader_uuid: "d5c321be97454a16b1a645db2c91b5f9"
 from {username='slave'} at 127.0.0.1:60010
I20260709 12:19:40.729624 31605 raft_consensus.cc:606] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Received request to transfer leadership to TS d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:40.736486 31605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
mode: GRACEFUL
new_leader_uuid: "d5c321be97454a16b1a645db2c91b5f9"
 from {username='slave'} at 127.0.0.1:60010
I20260709 12:19:40.737202 31605 raft_consensus.cc:606] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Received request to transfer leadership to TS d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:40.743992 31605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11bd02081d134bcab4a1bf885c5f4842"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
mode: GRACEFUL
new_leader_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:60010
I20260709 12:19:40.744679 31605 raft_consensus.cc:606] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Received request to transfer leadership to TS d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:40.761278 31457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa81d1582b2642e48bfc1888ed6a575c"
dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
mode: GRACEFUL
new_leader_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:49400
I20260709 12:19:40.761996 31457 raft_consensus.cc:606] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Received request to transfer leadership to TS d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:40.764984 31737 consensus_queue.cc:1048] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:40.769642 31457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad"
dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
mode: GRACEFUL
new_leader_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:49400
I20260709 12:19:40.770277 31457 raft_consensus.cc:606] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Received request to transfer leadership to TS d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:40.773481 31791 raft_consensus.cc:993] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9: : Instructing follower d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:40.774050 31791 raft_consensus.cc:1081] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Signalling peer d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:40.779634 31531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad"
dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:46052
I20260709 12:19:40.780666 31791 consensus_queue.cc:1048] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.782634 31605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
mode: GRACEFUL
new_leader_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:60010
I20260709 12:19:40.783308 31605 raft_consensus.cc:606] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Received request to transfer leadership to TS d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:40.784320 31531 raft_consensus.cc:493] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:40.784940 31531 raft_consensus.cc:3060] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.793583 31531 raft_consensus.cc:515] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.795218 31457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "996707b67f2248fabc8a65fcbc145b1c"
dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
mode: GRACEFUL
new_leader_uuid: "41bee83366d7449fa414de406cd2714b"
 from {username='slave'} at 127.0.0.1:49400
I20260709 12:19:40.796264 31457 raft_consensus.cc:606] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Received request to transfer leadership to TS 41bee83366d7449fa414de406cd2714b
I20260709 12:19:40.800221 31760 consensus_queue.cc:1048] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:40.800416 31531 leader_election.cc:290] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.800333 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:40.801436 31457 raft_consensus.cc:3055] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:40.801838 31457 raft_consensus.cc:740] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:40.802042 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:40.802873 31606 raft_consensus.cc:3060] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.802908 31457 consensus_queue.cc:260] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.804513 31457 raft_consensus.cc:3060] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.810140 31606 raft_consensus.cc:2468] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 2.
I20260709 12:19:40.812832 31457 raft_consensus.cc:2468] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 2.
I20260709 12:19:40.814651 31496 leader_election.cc:304] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:40.815845 31786 raft_consensus.cc:2804] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.816428 31786 raft_consensus.cc:697] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Becoming Leader. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:40.817456 31786 consensus_queue.cc:237] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.819334 31770 raft_consensus.cc:993] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b: : Instructing follower d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:40.819957 31770 raft_consensus.cc:1081] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Signalling peer d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:40.822171 31532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11bd02081d134bcab4a1bf885c5f4842"
dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:46046
I20260709 12:19:40.823000 31532 raft_consensus.cc:493] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:40.824194 31532 raft_consensus.cc:3060] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.828164 31760 consensus_queue.cc:1048] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.836187 31532 raft_consensus.cc:515] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.837500 31531 raft_consensus.cc:1240] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Rejecting Update request from peer 41bee83366d7449fa414de406cd2714b for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:40.835193 31356 catalog_manager.cc:5697] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 reported cstate change: term changed from 1 to 2, leader changed from d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193) to d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "d24002ed5d7e47d498f01f7d15c34007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.841523 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd02081d134bcab4a1bf885c5f4842" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:40.842283 31457 raft_consensus.cc:3060] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.842023 31760 consensus_queue.cc:1059] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.843117 31770 raft_consensus.cc:3055] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:40.843565 31770 raft_consensus.cc:740] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:40.844516 31770 consensus_queue.cc:260] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.845772 31770 raft_consensus.cc:3060] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.846921 31532 leader_election.cc:290] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.850337 31457 raft_consensus.cc:2468] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 2.
I20260709 12:19:40.850422 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd02081d134bcab4a1bf885c5f4842" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:40.854974 31499 leader_election.cc:304] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.856235 31786 raft_consensus.cc:2804] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.856791 31786 raft_consensus.cc:697] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Becoming Leader. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:40.857667 31786 consensus_queue.cc:237] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.864848 31606 raft_consensus.cc:2468] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 2.
I20260709 12:19:40.866405 31356 catalog_manager.cc:5697] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 reported cstate change: term changed from 1 to 2, leader changed from 41bee83366d7449fa414de406cd2714b (127.17.249.195) to d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "d24002ed5d7e47d498f01f7d15c34007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.875582 31770 consensus_queue.cc:1048] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.881938 31791 consensus_queue.cc:1048] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:40.884176 31760 raft_consensus.cc:993] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b: : Instructing follower d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:40.884720 31760 raft_consensus.cc:1081] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Signalling peer d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:40.886744 31531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f"
dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:46046
I20260709 12:19:40.888038 31531 raft_consensus.cc:493] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:40.888430 31531 raft_consensus.cc:3060] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.891057 31795 consensus_queue.cc:1048] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.897039 31531 raft_consensus.cc:515] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.897622 31737 raft_consensus.cc:993] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9: : Instructing follower 41bee83366d7449fa414de406cd2714b to start an election
I20260709 12:19:40.900000 31531 leader_election.cc:290] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.898497 31737 raft_consensus.cc:1081] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Signalling peer 41bee83366d7449fa414de406cd2714b to start an election
I20260709 12:19:40.902504 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:40.903267 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3eee9e931b463f8eb7e31b1c6f7a7f" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:40.903872 31605 raft_consensus.cc:3055] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:40.904152 31605 raft_consensus.cc:740] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:40.904904 31605 consensus_queue.cc:260] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.905947 31605 raft_consensus.cc:3060] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.906145 31607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "996707b67f2248fabc8a65fcbc145b1c"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
 from {username='slave'} at 127.0.0.1:60006
I20260709 12:19:40.906976 31607 raft_consensus.cc:493] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:40.907388 31607 raft_consensus.cc:3060] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.911664 31756 consensus_queue.cc:1048] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.913726 31770 consensus_queue.cc:1048] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.916255 31605 raft_consensus.cc:2468] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 2.
I20260709 12:19:40.917409 31496 leader_election.cc:304] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: d5c321be97454a16b1a645db2c91b5f9
I20260709 12:19:40.918756 31751 raft_consensus.cc:2804] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.919258 31751 raft_consensus.cc:697] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Becoming Leader. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:40.920226 31751 consensus_queue.cc:237] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.917212 31607 raft_consensus.cc:515] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.923648 31606 raft_consensus.cc:1240] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Rejecting Update request from peer d5c321be97454a16b1a645db2c91b5f9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:40.924821 31607 leader_election.cc:290] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 2 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:40.929280 31456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996707b67f2248fabc8a65fcbc145b1c" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:40.930227 31456 raft_consensus.cc:3055] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:40.930677 31456 raft_consensus.cc:740] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:40.930743 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996707b67f2248fabc8a65fcbc145b1c" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:40.932145 31456 consensus_queue.cc:260] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.933835 31456 raft_consensus.cc:3060] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.949427 31770 consensus_queue.cc:1048] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:40.951303 31355 catalog_manager.cc:5697] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 reported cstate change: term changed from 1 to 2, leader changed from 41bee83366d7449fa414de406cd2714b (127.17.249.195) to d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "d24002ed5d7e47d498f01f7d15c34007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.955736 31456 raft_consensus.cc:2468] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 2.
I20260709 12:19:40.958062 31573 leader_election.cc:304] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: d24002ed5d7e47d498f01f7d15c34007
I20260709 12:19:40.958954 31770 raft_consensus.cc:2804] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.959503 31770 raft_consensus.cc:697] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 2 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:40.960193 31770 consensus_queue.cc:237] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.965870 31662 raft_consensus.cc:993] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b: : Instructing follower d5c321be97454a16b1a645db2c91b5f9 to start an election
I20260709 12:19:40.966439 31770 raft_consensus.cc:1081] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Signalling peer d5c321be97454a16b1a645db2c91b5f9 to start an election
I20260709 12:19:40.969784 31458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59"
dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
 from {username='slave'} at 127.0.0.1:34238
I20260709 12:19:40.970531 31458 raft_consensus.cc:493] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:40.971025 31458 raft_consensus.cc:3060] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.977064 31356 catalog_manager.cc:5697] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 1 to 2, leader changed from d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193) to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 2 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:40.979159 31458 raft_consensus.cc:515] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.981633 31458 leader_election.cc:290] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 2 election: Requested vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:40.982458 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:40.982963 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:40.983210 31531 raft_consensus.cc:3060] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.985746 31606 raft_consensus.cc:3055] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:40.986160 31606 raft_consensus.cc:740] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:40.987242 31606 consensus_queue.cc:260] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:40.988513 31606 raft_consensus.cc:3060] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.991611 31531 raft_consensus.cc:2468] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 2.
I20260709 12:19:40.993271 31424 leader_election.cc:304] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:40.994129 31737 raft_consensus.cc:2804] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.994907 31737 raft_consensus.cc:697] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Becoming Leader. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:40.995913 31737 consensus_queue.cc:237] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.001295 31606 raft_consensus.cc:2468] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 2.
I20260709 12:19:41.006966 31770 raft_consensus.cc:993] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b: : Instructing follower d5c321be97454a16b1a645db2c91b5f9 to start an election
I20260709 12:19:41.007534 31662 raft_consensus.cc:1081] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Signalling peer d5c321be97454a16b1a645db2c91b5f9 to start an election
I20260709 12:19:41.008095 31355 catalog_manager.cc:5697] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 reported cstate change: term changed from 1 to 2, leader changed from 41bee83366d7449fa414de406cd2714b (127.17.249.195) to d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "d5c321be97454a16b1a645db2c91b5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.009068 31458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa8a5387ba6a4f6cbfcf7169a60b68a4"
dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
 from {username='slave'} at 127.0.0.1:34238
I20260709 12:19:41.009847 31458 raft_consensus.cc:493] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:41.010329 31458 raft_consensus.cc:3060] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.012921 31791 consensus_queue.cc:1048] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:41.018157 31458 raft_consensus.cc:515] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.021574 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8a5387ba6a4f6cbfcf7169a60b68a4" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:41.022462 31531 raft_consensus.cc:3060] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.023099 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8a5387ba6a4f6cbfcf7169a60b68a4" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:41.024251 31607 raft_consensus.cc:3055] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:41.024609 31607 raft_consensus.cc:740] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:41.025847 31607 consensus_queue.cc:260] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.026970 31607 raft_consensus.cc:3060] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.032891 31796 consensus_queue.cc:1048] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:41.036298 31531 raft_consensus.cc:2468] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 2.
I20260709 12:19:41.038398 31424 leader_election.cc:304] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:41.039289 31791 raft_consensus.cc:2804] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:41.045933 31458 leader_election.cc:290] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 2 election: Requested vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:41.048288 31756 raft_consensus.cc:993] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9: : Instructing follower d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:41.048955 31756 raft_consensus.cc:1081] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Signalling peer d24002ed5d7e47d498f01f7d15c34007 to start an election
I20260709 12:19:41.050272 31607 raft_consensus.cc:2468] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 2.
I20260709 12:19:41.050472 31791 raft_consensus.cc:697] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Becoming Leader. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:41.052094 31530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa81d1582b2642e48bfc1888ed6a575c"
dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
 from {username='slave'} at 127.0.0.1:46052
I20260709 12:19:41.052603 31530 raft_consensus.cc:493] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:41.052894 31530 raft_consensus.cc:3060] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.055060 31791 consensus_queue.cc:237] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.061007 31530 raft_consensus.cc:515] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.063582 31530 leader_election.cc:290] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:41.064041 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa81d1582b2642e48bfc1888ed6a575c" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:41.064721 31458 raft_consensus.cc:3055] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:41.065061 31458 raft_consensus.cc:740] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:41.065480 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa81d1582b2642e48bfc1888ed6a575c" candidate_uuid: "d24002ed5d7e47d498f01f7d15c34007" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:41.065795 31458 consensus_queue.cc:260] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.067003 31607 raft_consensus.cc:3060] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.067160 31458 raft_consensus.cc:3060] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.068074 31356 catalog_manager.cc:5697] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 reported cstate change: term changed from 1 to 2, leader changed from 41bee83366d7449fa414de406cd2714b (127.17.249.195) to d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "d5c321be97454a16b1a645db2c91b5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.074445 31607 raft_consensus.cc:2468] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 2.
I20260709 12:19:41.074445 31458 raft_consensus.cc:2468] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d24002ed5d7e47d498f01f7d15c34007 in term 2.
I20260709 12:19:41.076256 31496 leader_election.cc:304] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:41.077557 31751 raft_consensus.cc:2804] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:41.078059 31751 raft_consensus.cc:697] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Becoming Leader. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:41.078924 31751 consensus_queue.cc:237] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.087216 31356 catalog_manager.cc:5697] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 reported cstate change: term changed from 1 to 2, leader changed from d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193) to d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "d24002ed5d7e47d498f01f7d15c34007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.119366 31676 raft_consensus.cc:993] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007: : Instructing follower d5c321be97454a16b1a645db2c91b5f9 to start an election
I20260709 12:19:41.119903 31676 raft_consensus.cc:1081] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Signalling peer d5c321be97454a16b1a645db2c91b5f9 to start an election
I20260709 12:19:41.120886 31760 raft_consensus.cc:993] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b: : Instructing follower d5c321be97454a16b1a645db2c91b5f9 to start an election
I20260709 12:19:41.121544 31662 raft_consensus.cc:1081] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Signalling peer d5c321be97454a16b1a645db2c91b5f9 to start an election
I20260709 12:19:41.122102 31458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b434179a27a4ef5ab51c993cc5267dc"
dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
 from {username='slave'} at 127.0.0.1:34248
I20260709 12:19:41.122961 31458 raft_consensus.cc:493] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:41.123324 31456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5b3000b5d5b4587bdc86d4f21e36269"
dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
 from {username='slave'} at 127.0.0.1:34238
I20260709 12:19:41.123412 31458 raft_consensus.cc:3060] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.124074 31456 raft_consensus.cc:493] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:41.124477 31456 raft_consensus.cc:3060] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.131947 31456 raft_consensus.cc:515] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.132129 31458 raft_consensus.cc:515] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.134142 31456 leader_election.cc:290] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 2 election: Requested vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:41.134387 31458 leader_election.cc:290] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 2 election: Requested vote from peers d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543), 41bee83366d7449fa414de406cd2714b (127.17.249.195:42907)
I20260709 12:19:41.136081 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b434179a27a4ef5ab51c993cc5267dc" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:41.136276 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b434179a27a4ef5ab51c993cc5267dc" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:41.136305 31530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b3000b5d5b4587bdc86d4f21e36269" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:41.136731 31531 raft_consensus.cc:3055] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:41.136693 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b3000b5d5b4587bdc86d4f21e36269" candidate_uuid: "d5c321be97454a16b1a645db2c91b5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41bee83366d7449fa414de406cd2714b"
I20260709 12:19:41.137447 31606 raft_consensus.cc:3060] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.137486 31530 raft_consensus.cc:3060] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.137667 31531 raft_consensus.cc:740] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:41.137872 31607 raft_consensus.cc:3055] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:41.138725 31607 raft_consensus.cc:740] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:41.139328 31531 consensus_queue.cc:260] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.139858 31607 consensus_queue.cc:260] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.140755 31531 raft_consensus.cc:3060] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.141407 31607 raft_consensus.cc:3060] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.146180 31530 raft_consensus.cc:2468] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 2.
I20260709 12:19:41.148043 31424 leader_election.cc:304] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d24002ed5d7e47d498f01f7d15c34007, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:41.147186 31606 raft_consensus.cc:2468] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 2.
I20260709 12:19:41.149169 31791 raft_consensus.cc:2804] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:41.149857 31607 raft_consensus.cc:2468] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 2.
I20260709 12:19:41.149811 31791 raft_consensus.cc:697] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Becoming Leader. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:41.150266 31421 leader_election.cc:304] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:41.149103 31531 raft_consensus.cc:2468] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5c321be97454a16b1a645db2c91b5f9 in term 2.
I20260709 12:19:41.151162 31791 consensus_queue.cc:237] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.151300 31796 raft_consensus.cc:2804] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:41.152982 31796 raft_consensus.cc:697] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Becoming Leader. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:41.153811 31796 consensus_queue.cc:237] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:41.160859 31356 catalog_manager.cc:5697] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 reported cstate change: term changed from 1 to 2, leader changed from 41bee83366d7449fa414de406cd2714b (127.17.249.195) to d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "d5c321be97454a16b1a645db2c91b5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.175707 31356 catalog_manager.cc:5697] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 reported cstate change: term changed from 1 to 2, leader changed from d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194) to d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "d5c321be97454a16b1a645db2c91b5f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.306067 31458 raft_consensus.cc:1275] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.307808 31676 consensus_queue.cc:1048] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.316841 31607 raft_consensus.cc:1275] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.318987 31786 consensus_queue.cc:1048] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.321681 31458 raft_consensus.cc:3060] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.329870 31458 raft_consensus.cc:1275] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.331285 31786 consensus_queue.cc:1048] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.342626 31607 raft_consensus.cc:1275] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.344697 31823 consensus_queue.cc:1048] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.366528 31531 raft_consensus.cc:3060] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.372649 31531 raft_consensus.cc:1275] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Refusing update from remote peer 41bee83366d7449fa414de406cd2714b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.374496 31662 consensus_queue.cc:1048] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.384439 31458 raft_consensus.cc:1275] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Refusing update from remote peer 41bee83366d7449fa414de406cd2714b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.390221 31662 consensus_queue.cc:1048] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.461410 31607 raft_consensus.cc:1275] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.462764 31786 consensus_queue.cc:1048] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.473905 31458 raft_consensus.cc:1275] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.475705 31786 consensus_queue.cc:1048] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.493640 31531 raft_consensus.cc:1275] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Refusing update from remote peer d5c321be97454a16b1a645db2c91b5f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.495268 31796 consensus_queue.cc:1048] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.505110 31607 raft_consensus.cc:1275] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Refusing update from remote peer d5c321be97454a16b1a645db2c91b5f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.506695 31737 consensus_queue.cc:1048] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.564668 31607 raft_consensus.cc:1275] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.566213 31786 consensus_queue.cc:1048] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.575580 31458 raft_consensus.cc:1275] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Refusing update from remote peer d24002ed5d7e47d498f01f7d15c34007: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.577260 31786 consensus_queue.cc:1048] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.605804 31607 raft_consensus.cc:1275] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Refusing update from remote peer d5c321be97454a16b1a645db2c91b5f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.607380 31737 consensus_queue.cc:1048] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.617197 31531 raft_consensus.cc:1275] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Refusing update from remote peer d5c321be97454a16b1a645db2c91b5f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.620324 31825 consensus_queue.cc:1048] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.661378 31531 raft_consensus.cc:1275] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Refusing update from remote peer d5c321be97454a16b1a645db2c91b5f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.663152 31825 consensus_queue.cc:1048] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.673712 31607 raft_consensus.cc:1275] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Refusing update from remote peer d5c321be97454a16b1a645db2c91b5f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.675824 31796 consensus_queue.cc:1048] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.709931 31607 raft_consensus.cc:1275] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Refusing update from remote peer d5c321be97454a16b1a645db2c91b5f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.711735 31796 consensus_queue.cc:1048] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.723363 31531 raft_consensus.cc:1275] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Refusing update from remote peer d5c321be97454a16b1a645db2c91b5f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.726228 31825 consensus_queue.cc:1048] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:43.801182 31355 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45844:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:19:43.824545 31355 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45844:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:19:43.885748 18407 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:44.165128 31888 tablet.cc:1724] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:44.182397 31869 log.cc:927] Time spent T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9: Append to log took a long time: real 0.104s	user 0.002s	sys 0.002s
W20260709 12:19:44.188742 31484 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:1dd87099dbf84d21be39416e40569b59)
W20260709 12:19:44.223511 31484 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:1dd87099dbf84d21be39416e40569b59)
W20260709 12:19:44.225675 31484 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:1dd87099dbf84d21be39416e40569b59)
I20260709 12:19:44.281924 31457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59"
dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
mode: GRACEFUL
new_leader_uuid: "41bee83366d7449fa414de406cd2714b"
 from {username='slave'} at 127.0.0.1:49410
I20260709 12:19:44.282835 31457 raft_consensus.cc:606] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Received request to transfer leadership to TS 41bee83366d7449fa414de406cd2714b
I20260709 12:19:44.291198 31905 tablet.cc:1724] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.295019 31897 tablet.cc:1724] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.296038 31863 raft_consensus.cc:993] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9: : Instructing follower 41bee83366d7449fa414de406cd2714b to start an election
I20260709 12:19:44.296597 31863 raft_consensus.cc:1081] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Signalling peer 41bee83366d7449fa414de406cd2714b to start an election
I20260709 12:19:44.321894 31898 tablet.cc:1724] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.307191 31895 tablet.cc:1724] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.298007 31904 tablet.cc:1724] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.326627 31896 tablet.cc:1724] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.332825 31900 tablet.cc:1724] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.339864 31906 tablet.cc:1724] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.359290 31903 tablet.cc:1724] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.340226 31888 tablet.cc:1724] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.364482 31897 tablet.cc:1724] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.366148 31902 tablet.cc:1724] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.367832 31901 tablet.cc:1724] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.377651 31903 tablet.cc:1724] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.390405 31903 tablet.cc:1724] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.394277 31603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
 from {username='slave'} at 127.0.0.1:60006
I20260709 12:19:44.411252 31603 raft_consensus.cc:493] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:44.411760 31603 raft_consensus.cc:3060] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:44.414387 31903 tablet.cc:1724] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.418073 31905 tablet.cc:1724] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.423385 31898 tablet.cc:1724] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.427234 31903 tablet.cc:1724] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.432853 31897 tablet.cc:1724] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.427518 31900 tablet.cc:1724] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.438827 31888 tablet.cc:1724] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.456462 31529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad"
dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
mode: GRACEFUL
new_leader_uuid: "41bee83366d7449fa414de406cd2714b"
 from {username='slave'} at 127.0.0.1:53560
I20260709 12:19:44.457227 31529 raft_consensus.cc:606] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Received request to transfer leadership to TS 41bee83366d7449fa414de406cd2714b
I20260709 12:19:44.458820 18407 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:19:44.459906 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:44.469135 31529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5df8666a6eb42998bcf6aa80adc1a9a"
dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
mode: GRACEFUL
new_leader_uuid: "41bee83366d7449fa414de406cd2714b"
 from {username='slave'} at 127.0.0.1:53560
I20260709 12:19:44.468783 31895 tablet.cc:1724] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.469890 31529 raft_consensus.cc:606] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Received request to transfer leadership to TS 41bee83366d7449fa414de406cd2714b
I20260709 12:19:44.474152 31453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5d572e70349474483450f8afd3ea6d7"
dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
mode: GRACEFUL
new_leader_uuid: "41bee83366d7449fa414de406cd2714b"
 from {username='slave'} at 127.0.0.1:49410
I20260709 12:19:44.474959 31453 raft_consensus.cc:606] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Received request to transfer leadership to TS 41bee83366d7449fa414de406cd2714b
I20260709 12:19:44.476838 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:44.477573 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:44.483119 31896 tablet.cc:1724] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.484175 31603 raft_consensus.cc:515] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:44.486757 31603 leader_election.cc:290] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 3 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:44.487952 31453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:44.488214 31529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd87099dbf84d21be39416e40569b59" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:44.488665 31453 raft_consensus.cc:3055] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:44.488758 31529 raft_consensus.cc:3060] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:44.489058 31453 raft_consensus.cc:740] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:44.489902 31453 consensus_queue.cc:260] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:44.491580 31453 raft_consensus.cc:3060] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:44.499357 31453 raft_consensus.cc:2468] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 3.
I20260709 12:19:44.502110 31529 raft_consensus.cc:2468] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 3.
I20260709 12:19:44.505008 31573 leader_election.cc:304] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:44.506484 31909 raft_consensus.cc:2804] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:44.505981 31905 tablet.cc:1724] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.507067 31909 raft_consensus.cc:697] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 3 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:44.507992 31909 consensus_queue.cc:237] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:44.513651 31906 tablet.cc:1724] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:44.529651 31353 catalog_manager.cc:6242] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e: soft_deleted_table [id=78da975978c7459296339d0fa9a1a875] alter complete (version 1)
I20260709 12:19:44.537731 31355 catalog_manager.cc:5697] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 2 to 3, leader changed from d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193) to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 3 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:44.673389 31870 raft_consensus.cc:993] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9: : Instructing follower 41bee83366d7449fa414de406cd2714b to start an election
I20260709 12:19:44.673982 31870 raft_consensus.cc:1081] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Signalling peer 41bee83366d7449fa414de406cd2714b to start an election
I20260709 12:19:44.676015 31603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5d572e70349474483450f8afd3ea6d7"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
 from {username='slave'} at 127.0.0.1:60006
I20260709 12:19:44.676643 31603 raft_consensus.cc:493] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:44.677044 31603 raft_consensus.cc:3060] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.683328 31603 raft_consensus.cc:515] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:44.685457 31603 leader_election.cc:290] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 2 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:44.686545 31455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d572e70349474483450f8afd3ea6d7" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:44.686875 31529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d572e70349474483450f8afd3ea6d7" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:44.687331 31455 raft_consensus.cc:3055] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:44.687565 31529 raft_consensus.cc:3060] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.687729 31455 raft_consensus.cc:740] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5c321be97454a16b1a645db2c91b5f9, State: Running, Role: LEADER
I20260709 12:19:44.688676 31455 consensus_queue.cc:260] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:44.690043 31455 raft_consensus.cc:3060] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.695617 31529 raft_consensus.cc:2468] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 2.
I20260709 12:19:44.697057 31573 leader_election.cc:304] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d24002ed5d7e47d498f01f7d15c34007; no voters: 
I20260709 12:19:44.697563 31455 raft_consensus.cc:2468] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 2.
I20260709 12:19:44.697877 31909 raft_consensus.cc:2804] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:44.698592 31909 raft_consensus.cc:697] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 2 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:44.699590 31909 consensus_queue.cc:237] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } }
I20260709 12:19:44.709988 31353 catalog_manager.cc:5697] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 1 to 2, leader changed from d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193) to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 2 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.781502 31865 raft_consensus.cc:993] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007: : Instructing follower 41bee83366d7449fa414de406cd2714b to start an election
I20260709 12:19:44.782253 31866 raft_consensus.cc:1081] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Signalling peer 41bee83366d7449fa414de406cd2714b to start an election
I20260709 12:19:44.784089 31603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
 from {username='slave'} at 127.0.0.1:60004
I20260709 12:19:44.784585 31603 raft_consensus.cc:493] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:44.784860 31603 raft_consensus.cc:3060] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:44.791000 31603 raft_consensus.cc:515] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:44.792990 31603 leader_election.cc:290] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 3 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:44.793861 31455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:44.794041 31529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ef86959a85473494a6d0519a5b03ad" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:44.794690 31455 raft_consensus.cc:3060] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:44.794761 31529 raft_consensus.cc:3055] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:44.795311 31529 raft_consensus.cc:740] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:44.796058 31529 consensus_queue.cc:260] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:44.797140 31529 raft_consensus.cc:3060] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:44.803226 31455 raft_consensus.cc:2468] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 3.
I20260709 12:19:44.804651 31573 leader_election.cc:304] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:44.805123 31529 raft_consensus.cc:2468] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 3.
I20260709 12:19:44.805560 31909 raft_consensus.cc:2804] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:44.806255 31909 raft_consensus.cc:697] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 3 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:44.807204 31909 consensus_queue.cc:237] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:44.819944 31353 catalog_manager.cc:5697] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 2 to 3, leader changed from d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194) to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 3 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:44.920965 31529 raft_consensus.cc:1275] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 3 FOLLOWER]: Refusing update from remote peer 41bee83366d7449fa414de406cd2714b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:44.922531 31909 consensus_queue.cc:1048] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:44.934435 31455 raft_consensus.cc:1275] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 3 FOLLOWER]: Refusing update from remote peer 41bee83366d7449fa414de406cd2714b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:44.940261 31891 consensus_queue.cc:1048] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:44.955003 31865 raft_consensus.cc:993] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007: : Instructing follower 41bee83366d7449fa414de406cd2714b to start an election
I20260709 12:19:44.955742 31866 raft_consensus.cc:1081] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Signalling peer 41bee83366d7449fa414de406cd2714b to start an election
I20260709 12:19:44.957971 31603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5df8666a6eb42998bcf6aa80adc1a9a"
dest_uuid: "41bee83366d7449fa414de406cd2714b"
 from {username='slave'} at 127.0.0.1:60004
I20260709 12:19:44.958674 31603 raft_consensus.cc:493] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:44.959196 31603 raft_consensus.cc:3060] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.967020 31603 raft_consensus.cc:515] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:44.969772 31603 leader_election.cc:290] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 2 election: Requested vote from peers d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369), d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543)
I20260709 12:19:44.970757 31455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5df8666a6eb42998bcf6aa80adc1a9a" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5c321be97454a16b1a645db2c91b5f9"
I20260709 12:19:44.971029 31529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5df8666a6eb42998bcf6aa80adc1a9a" candidate_uuid: "41bee83366d7449fa414de406cd2714b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d24002ed5d7e47d498f01f7d15c34007"
I20260709 12:19:44.971706 31455 raft_consensus.cc:3060] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.972647 31529 raft_consensus.cc:3055] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:44.973127 31529 raft_consensus.cc:740] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d24002ed5d7e47d498f01f7d15c34007, State: Running, Role: LEADER
I20260709 12:19:44.973990 31529 consensus_queue.cc:260] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:44.975528 31529 raft_consensus.cc:3060] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.980253 31455 raft_consensus.cc:2468] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 2.
I20260709 12:19:44.981832 31529 raft_consensus.cc:2468] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41bee83366d7449fa414de406cd2714b in term 2.
I20260709 12:19:44.981860 31573 leader_election.cc:304] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41bee83366d7449fa414de406cd2714b, d5c321be97454a16b1a645db2c91b5f9; no voters: 
I20260709 12:19:44.983165 31909 raft_consensus.cc:2804] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:44.983628 31909 raft_consensus.cc:697] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [term 2 LEADER]: Becoming Leader. State: Replica: 41bee83366d7449fa414de406cd2714b, State: Running, Role: LEADER
I20260709 12:19:44.984505 31909 consensus_queue.cc:237] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } }
I20260709 12:19:44.992861 31353 catalog_manager.cc:5697] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b reported cstate change: term changed from 1 to 2, leader changed from d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194) to 41bee83366d7449fa414de406cd2714b (127.17.249.195). New cstate: current_term: 2 leader_uuid: "41bee83366d7449fa414de406cd2714b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41bee83366d7449fa414de406cd2714b" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 42907 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:45.215628 31455 raft_consensus.cc:1275] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 3 FOLLOWER]: Refusing update from remote peer 41bee83366d7449fa414de406cd2714b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:45.217207 31909 consensus_queue.cc:1048] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:45.228948 31529 raft_consensus.cc:1275] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 3 FOLLOWER]: Refusing update from remote peer 41bee83366d7449fa414de406cd2714b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:45.230598 31918 consensus_queue.cc:1048] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:45.271539 31455 raft_consensus.cc:1275] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Refusing update from remote peer 41bee83366d7449fa414de406cd2714b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:45.273133 31918 consensus_queue.cc:1048] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:45.285059 31529 raft_consensus.cc:1275] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Refusing update from remote peer 41bee83366d7449fa414de406cd2714b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:45.287214 31909 consensus_queue.cc:1048] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:45.479319 18407 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:45.487187 18407 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:45.487794 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:45.491731 31529 raft_consensus.cc:1275] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Refusing update from remote peer 41bee83366d7449fa414de406cd2714b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:45.494197 31909 consensus_queue.cc:1048] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24002ed5d7e47d498f01f7d15c34007" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:45.495460 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:45.496140 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:45.510846 31453 raft_consensus.cc:1275] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Refusing update from remote peer 41bee83366d7449fa414de406cd2714b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:45.514006 31918 consensus_queue.cc:1048] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5c321be97454a16b1a645db2c91b5f9" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 37369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:46.497841 18407 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:46.503686 18407 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:46.504297 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:46.509588 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:46.510118 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:47.511433 18407 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:47.518688 18407 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:47.519291 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:47.524753 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:47.525262 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:48.526480 18407 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:48.532994 18407 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:48.533643 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:48.538919 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:48.539460 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:49.540910 18407 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:49.547680 18407 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:49.548538 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:49.556156 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:49.556679 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:50.558157 18407 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:50.565703 18407 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:50.566742 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:50.574839 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:50.575613 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:51.576996 18407 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:51.583793 18407 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:51.584299 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:51.589236 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:51.589661 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:52.590852 18407 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:52.596477 18407 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:52.597061 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:52.601938 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:52.602399 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:53.603569 18407 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:53.609527 18407 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:53.610185 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:53.617136 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:53.617595 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:54.688436 18407 tablet_server.cc:179] TabletServer@127.17.249.193:0 shutting down...
W20260709 12:19:54.707628 31499 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 12:19:54.719264 31499 consensus_peers.cc:597] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 -> Peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Couldn't send request to peer d5c321be97454a16b1a645db2c91b5f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.747695 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:54.748631 18407 tablet_replica.cc:333] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.749588 18407 raft_consensus.cc:2243] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.750156 18407 raft_consensus.cc:2272] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.753000 18407 tablet_replica.cc:333] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.753677 18407 raft_consensus.cc:2243] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.754299 18407 raft_consensus.cc:2272] T 31ef86959a85473494a6d0519a5b03ad P d5c321be97454a16b1a645db2c91b5f9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.757882 18407 tablet_replica.cc:333] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.758898 18407 raft_consensus.cc:2243] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.759943 18407 raft_consensus.cc:2272] T 996707b67f2248fabc8a65fcbc145b1c P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.762650 18407 tablet_replica.cc:333] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.763375 18407 raft_consensus.cc:2243] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.764386 18407 raft_consensus.cc:2272] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.767087 18407 tablet_replica.cc:333] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.767724 18407 raft_consensus.cc:2243] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.768607 18407 raft_consensus.cc:2272] T 1b434179a27a4ef5ab51c993cc5267dc P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.771217 18407 tablet_replica.cc:333] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.771894 18407 raft_consensus.cc:2243] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.772848 18407 raft_consensus.cc:2272] T e5b3000b5d5b4587bdc86d4f21e36269 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.775440 18407 tablet_replica.cc:333] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.776103 18407 raft_consensus.cc:2243] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.776600 18407 raft_consensus.cc:2272] T 91034dfa1be34cb19793a644d5e06a30 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.779524 18407 tablet_replica.cc:333] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.780113 18407 raft_consensus.cc:2243] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.780828 18407 raft_consensus.cc:2272] T 1dd87099dbf84d21be39416e40569b59 P d5c321be97454a16b1a645db2c91b5f9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.783385 18407 tablet_replica.cc:333] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.783972 18407 raft_consensus.cc:2243] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.784627 18407 raft_consensus.cc:2272] T fa81d1582b2642e48bfc1888ed6a575c P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.787339 18407 tablet_replica.cc:333] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.787954 18407 raft_consensus.cc:2243] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.788479 18407 raft_consensus.cc:2272] T c83b606a9e0744748b2ef0457101ab51 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.790931 18407 tablet_replica.cc:333] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.791501 18407 raft_consensus.cc:2243] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.791981 18407 raft_consensus.cc:2272] T b6c8611b4cc24bfda382338c8d1f762b P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.794486 18407 tablet_replica.cc:333] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.795142 18407 raft_consensus.cc:2243] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.796094 18407 raft_consensus.cc:2272] T 26628f85884b4cf4a2d8acd4be9bd240 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.798494 18407 tablet_replica.cc:333] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.799152 18407 raft_consensus.cc:2243] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.799677 18407 raft_consensus.cc:2272] T f36cd13528284344aec85786a144eeb4 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.801965 18407 tablet_replica.cc:333] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.802462 18407 raft_consensus.cc:2243] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.803455 18407 raft_consensus.cc:2272] T c28b35ac0f9e4ad6889d412a35979832 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.805889 18407 tablet_replica.cc:333] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.806463 18407 raft_consensus.cc:2243] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.807040 18407 raft_consensus.cc:2272] T 11bd02081d134bcab4a1bf885c5f4842 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.809365 18407 tablet_replica.cc:333] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.809916 18407 raft_consensus.cc:2243] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.810389 18407 raft_consensus.cc:2272] T c5df8666a6eb42998bcf6aa80adc1a9a P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.812884 18407 tablet_replica.cc:333] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.813390 18407 raft_consensus.cc:2243] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.813921 18407 raft_consensus.cc:2272] T d5d572e70349474483450f8afd3ea6d7 P d5c321be97454a16b1a645db2c91b5f9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.816291 18407 tablet_replica.cc:333] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9: stopping tablet replica
I20260709 12:19:54.816973 18407 raft_consensus.cc:2243] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.818145 18407 raft_consensus.cc:2272] T 5114b9a6cecc468397e1f2cbda4f9f83 P d5c321be97454a16b1a645db2c91b5f9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:54.837164 31573 consensus_peers.cc:597] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b -> Peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Couldn't send request to peer d5c321be97454a16b1a645db2c91b5f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.860093 18407 tablet_server.cc:196] TabletServer@127.17.249.193:0 shutdown complete.
I20260709 12:19:54.916442 18407 tablet_server.cc:179] TabletServer@127.17.249.194:0 shutting down...
W20260709 12:19:54.940021 31573 consensus_peers.cc:597] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b -> Peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Couldn't send request to peer d5c321be97454a16b1a645db2c91b5f9. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:37369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.951853 31573 consensus_peers.cc:597] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b -> Peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Couldn't send request to peer d5c321be97454a16b1a645db2c91b5f9. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:37369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.965261 31499 consensus_peers.cc:597] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 -> Peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Couldn't send request to peer d5c321be97454a16b1a645db2c91b5f9. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:37369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.968762 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:54.969700 18407 tablet_replica.cc:333] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:54.970660 18407 raft_consensus.cc:2243] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.971371 18407 raft_consensus.cc:2272] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.973984 18407 tablet_replica.cc:333] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:54.974627 18407 raft_consensus.cc:2243] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.975641 18407 raft_consensus.cc:2272] T fb3eee9e931b463f8eb7e31b1c6f7a7f P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.978133 18407 tablet_replica.cc:333] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:54.978849 18407 raft_consensus.cc:2243] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.979386 18407 raft_consensus.cc:2272] T 31ef86959a85473494a6d0519a5b03ad P d24002ed5d7e47d498f01f7d15c34007 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.981984 18407 tablet_replica.cc:333] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:54.982745 18407 raft_consensus.cc:2243] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.983383 18407 raft_consensus.cc:2272] T 996707b67f2248fabc8a65fcbc145b1c P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.985828 18407 tablet_replica.cc:333] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:54.986482 18407 raft_consensus.cc:2243] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.987036 18407 raft_consensus.cc:2272] T c5df8666a6eb42998bcf6aa80adc1a9a P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.989238 18407 tablet_replica.cc:333] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:54.989817 18407 raft_consensus.cc:2243] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.990751 18407 raft_consensus.cc:2272] T 11bd02081d134bcab4a1bf885c5f4842 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.993319 18407 tablet_replica.cc:333] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:54.993995 18407 raft_consensus.cc:2243] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.994547 18407 raft_consensus.cc:2272] T 26628f85884b4cf4a2d8acd4be9bd240 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.997565 18407 tablet_replica.cc:333] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:54.998180 18407 raft_consensus.cc:2243] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.999291 18407 raft_consensus.cc:2272] T b6c8611b4cc24bfda382338c8d1f762b P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:54.999390 31573 consensus_peers.cc:597] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b -> Peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Couldn't send request to peer d5c321be97454a16b1a645db2c91b5f9. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:37369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.001885 18407 tablet_replica.cc:333] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:55.002605 18407 raft_consensus.cc:2243] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.003165 18407 raft_consensus.cc:2272] T d5d572e70349474483450f8afd3ea6d7 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.005411 18407 tablet_replica.cc:333] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:55.006023 18407 raft_consensus.cc:2243] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.006491 18407 raft_consensus.cc:2272] T 5114b9a6cecc468397e1f2cbda4f9f83 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.008890 18407 tablet_replica.cc:333] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:55.009482 18407 raft_consensus.cc:2243] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.010015 18407 raft_consensus.cc:2272] T e5b3000b5d5b4587bdc86d4f21e36269 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.012539 18407 tablet_replica.cc:333] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:55.013175 18407 raft_consensus.cc:2243] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.013705 18407 raft_consensus.cc:2272] T 1b434179a27a4ef5ab51c993cc5267dc P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.016763 18407 tablet_replica.cc:333] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:55.017359 18407 raft_consensus.cc:2243] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.018046 18407 raft_consensus.cc:2272] T 1dd87099dbf84d21be39416e40569b59 P d24002ed5d7e47d498f01f7d15c34007 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:55.019979 31573 consensus_peers.cc:597] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b -> Peer d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543): Couldn't send request to peer d24002ed5d7e47d498f01f7d15c34007. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.021111 18407 tablet_replica.cc:333] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:55.021821 18407 raft_consensus.cc:2243] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.022348 18407 raft_consensus.cc:2272] T 91034dfa1be34cb19793a644d5e06a30 P d24002ed5d7e47d498f01f7d15c34007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.024919 18407 tablet_replica.cc:333] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:55.025501 18407 raft_consensus.cc:2243] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:55.026417 18407 raft_consensus.cc:2272] T fa81d1582b2642e48bfc1888ed6a575c P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.028919 18407 tablet_replica.cc:333] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:55.029464 18407 raft_consensus.cc:2243] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:55.030361 18407 raft_consensus.cc:2272] T c83b606a9e0744748b2ef0457101ab51 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.032970 18407 tablet_replica.cc:333] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:55.033506 18407 raft_consensus.cc:2243] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.033988 18407 raft_consensus.cc:2272] T c28b35ac0f9e4ad6889d412a35979832 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.036357 18407 tablet_replica.cc:333] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007: stopping tablet replica
I20260709 12:19:55.036998 18407 raft_consensus.cc:2243] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:55.037989 18407 raft_consensus.cc:2272] T f36cd13528284344aec85786a144eeb4 P d24002ed5d7e47d498f01f7d15c34007 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:55.042346 31573 consensus_peers.cc:597] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b -> Peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Couldn't send request to peer d5c321be97454a16b1a645db2c91b5f9. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:37369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.084894 18407 tablet_server.cc:196] TabletServer@127.17.249.194:0 shutdown complete.
I20260709 12:19:55.136504 18407 tablet_server.cc:179] TabletServer@127.17.249.195:0 shutting down...
W20260709 12:19:55.154194 31573 consensus_peers.cc:597] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b -> Peer d24002ed5d7e47d498f01f7d15c34007 (127.17.249.194:37543): Couldn't send request to peer d24002ed5d7e47d498f01f7d15c34007. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:37543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.176420 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:55.177552 18407 tablet_replica.cc:333] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.178714 18407 raft_consensus.cc:2243] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:55.180204 18407 raft_consensus.cc:2272] T 31ef86959a85473494a6d0519a5b03ad P 41bee83366d7449fa414de406cd2714b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.183871 18407 tablet_replica.cc:333] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
W20260709 12:19:55.184377 31573 consensus_peers.cc:597] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b -> Peer d5c321be97454a16b1a645db2c91b5f9 (127.17.249.193:37369): Couldn't send request to peer d5c321be97454a16b1a645db2c91b5f9. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:37369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.184630 18407 raft_consensus.cc:2243] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:55.185899 18407 raft_consensus.cc:2272] T 996707b67f2248fabc8a65fcbc145b1c P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.188827 18407 tablet_replica.cc:333] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.189594 18407 raft_consensus.cc:2243] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.190244 18407 raft_consensus.cc:2272] T fb3eee9e931b463f8eb7e31b1c6f7a7f P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.193013 18407 tablet_replica.cc:333] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.193677 18407 raft_consensus.cc:2243] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.194195 18407 raft_consensus.cc:2272] T b6c8611b4cc24bfda382338c8d1f762b P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.197005 18407 tablet_replica.cc:333] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.197686 18407 raft_consensus.cc:2243] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.198205 18407 raft_consensus.cc:2272] T 26628f85884b4cf4a2d8acd4be9bd240 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.200783 18407 tablet_replica.cc:333] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.201432 18407 raft_consensus.cc:2243] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.201983 18407 raft_consensus.cc:2272] T fa8a5387ba6a4f6cbfcf7169a60b68a4 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.204680 18407 tablet_replica.cc:333] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.205315 18407 raft_consensus.cc:2243] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.205868 18407 raft_consensus.cc:2272] T c28b35ac0f9e4ad6889d412a35979832 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.208528 18407 tablet_replica.cc:333] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.209239 18407 raft_consensus.cc:2243] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.209836 18407 raft_consensus.cc:2272] T f36cd13528284344aec85786a144eeb4 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.212648 18407 tablet_replica.cc:333] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.213562 18407 raft_consensus.cc:2243] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:55.214887 18407 raft_consensus.cc:2272] T d5d572e70349474483450f8afd3ea6d7 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.217465 18407 tablet_replica.cc:333] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.218154 18407 raft_consensus.cc:2243] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.218693 18407 raft_consensus.cc:2272] T 5114b9a6cecc468397e1f2cbda4f9f83 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.221585 18407 tablet_replica.cc:333] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.222334 18407 raft_consensus.cc:2243] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.222896 18407 raft_consensus.cc:2272] T fa81d1582b2642e48bfc1888ed6a575c P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.225508 18407 tablet_replica.cc:333] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.226162 18407 raft_consensus.cc:2243] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.226898 18407 raft_consensus.cc:2272] T c83b606a9e0744748b2ef0457101ab51 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.229581 18407 tablet_replica.cc:333] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.230216 18407 raft_consensus.cc:2243] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.230868 18407 raft_consensus.cc:2272] T e5b3000b5d5b4587bdc86d4f21e36269 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.233708 18407 tablet_replica.cc:333] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.234301 18407 raft_consensus.cc:2243] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.234930 18407 raft_consensus.cc:2272] T 1b434179a27a4ef5ab51c993cc5267dc P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.237452 18407 tablet_replica.cc:333] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.238062 18407 raft_consensus.cc:2243] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:55.238682 18407 raft_consensus.cc:2272] T 11bd02081d134bcab4a1bf885c5f4842 P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.241127 18407 tablet_replica.cc:333] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.241695 18407 raft_consensus.cc:2243] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:55.242624 18407 raft_consensus.cc:2272] T c5df8666a6eb42998bcf6aa80adc1a9a P 41bee83366d7449fa414de406cd2714b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.245213 18407 tablet_replica.cc:333] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.245820 18407 raft_consensus.cc:2243] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:55.246771 18407 raft_consensus.cc:2272] T 1dd87099dbf84d21be39416e40569b59 P 41bee83366d7449fa414de406cd2714b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.249320 18407 tablet_replica.cc:333] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b: stopping tablet replica
I20260709 12:19:55.249862 18407 raft_consensus.cc:2243] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:55.250900 18407 raft_consensus.cc:2272] T 91034dfa1be34cb19793a644d5e06a30 P 41bee83366d7449fa414de406cd2714b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.297335 18407 tablet_server.cc:196] TabletServer@127.17.249.195:0 shutdown complete.
I20260709 12:19:55.339315 18407 master.cc:562] Master@127.17.249.254:36521 shutting down...
I20260709 12:19:55.368822 18407 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:55.369627 18407 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:55.370019 18407 tablet_replica.cc:333] T 00000000000000000000000000000000 P fbe46d4e1dc749eb9e5eda30f948787e: stopping tablet replica
I20260709 12:19:55.410373 18407 master.cc:584] Master@127.17.249.254:36521 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21449 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:19:55.497871 18407 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.249.254:35153
I20260709 12:19:55.499778 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:55.507159 31957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:55.506650 31956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:55.508052 31959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:55.509584 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:55.510900 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:55.511353 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:55.511559 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599595511532 us; error 0 us; skew 500 ppm
I20260709 12:19:55.512190 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:55.515465 18407 webserver.cc:533] Webserver started at http://127.17.249.254:41107/ using document root <none> and password file <none>
I20260709 12:19:55.516095 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:55.516328 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:55.516634 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:55.518149 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/master-0-root/instance:
uuid: "fe2f412236ab4f67a43364b7b0c1aa60"
format_stamp: "Formatted at 2026-07-09 12:19:55 on dist-test-slave-7mcn"
I20260709 12:19:55.523609 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:55.528129 31964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:55.529243 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:19:55.529572 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/master-0-root
uuid: "fe2f412236ab4f67a43364b7b0c1aa60"
format_stamp: "Formatted at 2026-07-09 12:19:55 on dist-test-slave-7mcn"
I20260709 12:19:55.529856 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:55.582653 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:55.584167 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:55.632401 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.254:35153
I20260709 12:19:55.632576 32015 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.254:35153 every 8 connection(s)
I20260709 12:19:55.637650 32016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:55.657506 32016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60: Bootstrap starting.
I20260709 12:19:55.663812 32016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:55.669816 32016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60: No bootstrap required, opened a new log
I20260709 12:19:55.672883 32016 raft_consensus.cc:359] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f412236ab4f67a43364b7b0c1aa60" member_type: VOTER }
I20260709 12:19:55.673450 32016 raft_consensus.cc:385] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:55.673736 32016 raft_consensus.cc:740] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2f412236ab4f67a43364b7b0c1aa60, State: Initialized, Role: FOLLOWER
I20260709 12:19:55.674458 32016 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f412236ab4f67a43364b7b0c1aa60" member_type: VOTER }
I20260709 12:19:55.675067 32016 raft_consensus.cc:399] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:55.675307 32016 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:55.675635 32016 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:55.682052 32016 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f412236ab4f67a43364b7b0c1aa60" member_type: VOTER }
I20260709 12:19:55.682737 32016 leader_election.cc:304] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe2f412236ab4f67a43364b7b0c1aa60; no voters: 
I20260709 12:19:55.684298 32016 leader_election.cc:290] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:55.684753 32019 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:55.686463 32019 raft_consensus.cc:697] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [term 1 LEADER]: Becoming Leader. State: Replica: fe2f412236ab4f67a43364b7b0c1aa60, State: Running, Role: LEADER
I20260709 12:19:55.687259 32019 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f412236ab4f67a43364b7b0c1aa60" member_type: VOTER }
I20260709 12:19:55.688112 32016 sys_catalog.cc:565] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:55.694432 32020 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe2f412236ab4f67a43364b7b0c1aa60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f412236ab4f67a43364b7b0c1aa60" member_type: VOTER } }
I20260709 12:19:55.695098 32021 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe2f412236ab4f67a43364b7b0c1aa60. Latest consensus state: current_term: 1 leader_uuid: "fe2f412236ab4f67a43364b7b0c1aa60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2f412236ab4f67a43364b7b0c1aa60" member_type: VOTER } }
I20260709 12:19:55.695572 32020 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:55.695973 32021 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:55.698341 32027 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:55.704396 32027 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:55.706308 18407 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:55.717280 32027 catalog_manager.cc:1383] Generated new cluster ID: f0ee6084f75c4b8dabbfea58d4d88767
I20260709 12:19:55.717689 32027 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:55.732059 32027 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:55.733884 32027 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:55.757334 32027 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60: Generated new TSK 0
I20260709 12:19:55.758147 32027 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:55.773545 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:55.781642 32037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:55.782832 32038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:55.784718 32040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:55.787678 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:55.788717 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:55.789039 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:55.789225 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599595789203 us; error 0 us; skew 500 ppm
I20260709 12:19:55.789846 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:55.792562 18407 webserver.cc:533] Webserver started at http://127.17.249.193:41809/ using document root <none> and password file <none>
I20260709 12:19:55.793116 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:55.793324 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:55.793612 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:55.795092 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-0-root/instance:
uuid: "3c3674e1e1dc4b728a64a21109b6c634"
format_stamp: "Formatted at 2026-07-09 12:19:55 on dist-test-slave-7mcn"
I20260709 12:19:55.800194 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:19:55.804095 32045 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:55.805102 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:19:55.805544 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-0-root
uuid: "3c3674e1e1dc4b728a64a21109b6c634"
format_stamp: "Formatted at 2026-07-09 12:19:55 on dist-test-slave-7mcn"
I20260709 12:19:55.805895 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:55.839686 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:55.841094 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:55.842833 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:55.845631 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:55.845903 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:55.846187 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:55.846396 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:55.895491 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.193:41627
I20260709 12:19:55.895650 32107 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.193:41627 every 8 connection(s)
I20260709 12:19:55.901522 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:55.911520 32112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:55.912536 32113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:55.916517 32115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:55.918226 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:55.919068 32108 heartbeater.cc:344] Connected to a master server at 127.17.249.254:35153
I20260709 12:19:55.919574 32108 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:55.920444 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:55.920759 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:55.920708 32108 heartbeater.cc:507] Master 127.17.249.254:35153 requested a full tablet report, sending...
I20260709 12:19:55.921168 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599595921147 us; error 0 us; skew 500 ppm
I20260709 12:19:55.922094 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:55.923990 31981 ts_manager.cc:194] Registered new tserver with Master: 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627)
I20260709 12:19:55.925489 18407 webserver.cc:533] Webserver started at http://127.17.249.194:38485/ using document root <none> and password file <none>
I20260709 12:19:55.926358 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:55.926608 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:55.926967 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:55.927078 31981 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51132
I20260709 12:19:55.929106 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-1-root/instance:
uuid: "55a304e5735842648243cfdf2b64c187"
format_stamp: "Formatted at 2026-07-09 12:19:55 on dist-test-slave-7mcn"
I20260709 12:19:55.935156 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:19:55.939502 32120 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:55.940461 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:19:55.940862 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-1-root
uuid: "55a304e5735842648243cfdf2b64c187"
format_stamp: "Formatted at 2026-07-09 12:19:55 on dist-test-slave-7mcn"
I20260709 12:19:55.941221 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:55.963608 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:55.965457 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:55.967957 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:55.971169 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:55.971391 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:55.971719 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:55.971877 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:56.027392 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.194:38353
I20260709 12:19:56.027448 32182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.194:38353 every 8 connection(s)
I20260709 12:19:56.034389 18407 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:56.043828 32186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:56.045392 32187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:56.049376 18407 server_base.cc:1061] running on GCE node
I20260709 12:19:56.049950 32183 heartbeater.cc:344] Connected to a master server at 127.17.249.254:35153
W20260709 12:19:56.050478 32189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:56.050573 32183 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:56.051878 18407 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:19:56.051915 32183 heartbeater.cc:507] Master 127.17.249.254:35153 requested a full tablet report, sending...
W20260709 12:19:56.052294 18407 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:56.052635 18407 hybrid_clock.cc:648] HybridClock initialized: now 1783599596052613 us; error 0 us; skew 500 ppm
I20260709 12:19:56.053378 18407 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:56.054996 31981 ts_manager.cc:194] Registered new tserver with Master: 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:19:56.056452 18407 webserver.cc:533] Webserver started at http://127.17.249.195:42633/ using document root <none> and password file <none>
I20260709 12:19:56.057116 18407 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:56.057051 31981 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51148
I20260709 12:19:56.057606 18407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:56.057983 18407 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:56.059361 18407 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-2-root/instance:
uuid: "3254653e60684a5789a61046db6f0c5a"
format_stamp: "Formatted at 2026-07-09 12:19:56 on dist-test-slave-7mcn"
I20260709 12:19:56.064627 18407 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:19:56.068989 32194 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:56.070096 18407 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:19:56.070674 18407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-2-root
uuid: "3254653e60684a5789a61046db6f0c5a"
format_stamp: "Formatted at 2026-07-09 12:19:56 on dist-test-slave-7mcn"
I20260709 12:19:56.071187 18407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzetxli/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599138854584-18407-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:56.091440 18407 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:56.092756 18407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:56.094488 18407 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:56.097072 18407 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:56.097318 18407 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:56.097577 18407 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:56.097751 18407 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:56.147562 18407 rpc_server.cc:307] RPC server started. Bound to: 127.17.249.195:45163
I20260709 12:19:56.147716 32256 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.249.195:45163 every 8 connection(s)
I20260709 12:19:56.165691 32257 heartbeater.cc:344] Connected to a master server at 127.17.249.254:35153
I20260709 12:19:56.166332 32257 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:56.167362 32257 heartbeater.cc:507] Master 127.17.249.254:35153 requested a full tablet report, sending...
I20260709 12:19:56.170078 31981 ts_manager.cc:194] Registered new tserver with Master: 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:56.170359 18407 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018901284s
I20260709 12:19:56.171972 31981 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51156
I20260709 12:19:56.202459 31981 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51166:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:56.205866 31981 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:56.291106 32073 tablet_service.cc:1511] Processing CreateTablet for tablet 79337a4361e34cc1bf1c435c68f74ca9 (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:56.293134 32073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79337a4361e34cc1bf1c435c68f74ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.293186 32071 tablet_service.cc:1511] Processing CreateTablet for tablet d0cbe796c8da4a6583e0863c58da762c (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:56.294773 32071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cbe796c8da4a6583e0863c58da762c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.291199 32072 tablet_service.cc:1511] Processing CreateTablet for tablet ada69b307b6e4c6587635392c5983898 (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:56.296974 32070 tablet_service.cc:1511] Processing CreateTablet for tablet b102429c805b4903a194300a419ee47b (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:56.300201 32069 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef788b0311b48cda5e5efbaef940e1b (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:56.303771 32072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada69b307b6e4c6587635392c5983898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.304572 32069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef788b0311b48cda5e5efbaef940e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.307155 32070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b102429c805b4903a194300a419ee47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.326341 32148 tablet_service.cc:1511] Processing CreateTablet for tablet 79337a4361e34cc1bf1c435c68f74ca9 (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:56.327996 32148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79337a4361e34cc1bf1c435c68f74ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.329468 32068 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3189494d3c4528a7777982f4195a5a (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:56.331250 32068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3189494d3c4528a7777982f4195a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.334903 32067 tablet_service.cc:1511] Processing CreateTablet for tablet e538ac6980b14988bdb1ae4b5e602692 (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:56.336549 32067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e538ac6980b14988bdb1ae4b5e602692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.338708 32222 tablet_service.cc:1511] Processing CreateTablet for tablet 79337a4361e34cc1bf1c435c68f74ca9 (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:56.340350 32222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79337a4361e34cc1bf1c435c68f74ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.341279 32066 tablet_service.cc:1511] Processing CreateTablet for tablet 418186b6e8fa454a88b9b5904ca0d3ac (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:56.342816 32066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 418186b6e8fa454a88b9b5904ca0d3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.344110 32221 tablet_service.cc:1511] Processing CreateTablet for tablet ada69b307b6e4c6587635392c5983898 (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:56.345745 32221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada69b307b6e4c6587635392c5983898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.346093 32220 tablet_service.cc:1511] Processing CreateTablet for tablet d0cbe796c8da4a6583e0863c58da762c (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:56.348238 32065 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1a84a9fe7f44509f2bfb122fc77e9d (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:56.350152 32065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1a84a9fe7f44509f2bfb122fc77e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.344321 32219 tablet_service.cc:1511] Processing CreateTablet for tablet b102429c805b4903a194300a419ee47b (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:56.353987 32147 tablet_service.cc:1511] Processing CreateTablet for tablet ada69b307b6e4c6587635392c5983898 (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:56.355506 32147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada69b307b6e4c6587635392c5983898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.360060 32146 tablet_service.cc:1511] Processing CreateTablet for tablet d0cbe796c8da4a6583e0863c58da762c (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:56.361565 32146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cbe796c8da4a6583e0863c58da762c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.365339 32218 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef788b0311b48cda5e5efbaef940e1b (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:56.368203 32217 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3189494d3c4528a7777982f4195a5a (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:56.371523 32216 tablet_service.cc:1511] Processing CreateTablet for tablet e538ac6980b14988bdb1ae4b5e602692 (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:56.375675 32215 tablet_service.cc:1511] Processing CreateTablet for tablet 418186b6e8fa454a88b9b5904ca0d3ac (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:56.378633 32214 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1a84a9fe7f44509f2bfb122fc77e9d (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:56.390034 32220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cbe796c8da4a6583e0863c58da762c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.391145 32214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1a84a9fe7f44509f2bfb122fc77e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.392627 32218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef788b0311b48cda5e5efbaef940e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.394133 32216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e538ac6980b14988bdb1ae4b5e602692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.395622 32217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3189494d3c4528a7777982f4195a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.397095 32215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 418186b6e8fa454a88b9b5904ca0d3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.398553 32219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b102429c805b4903a194300a419ee47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.406499 32145 tablet_service.cc:1511] Processing CreateTablet for tablet b102429c805b4903a194300a419ee47b (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:56.408114 32145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b102429c805b4903a194300a419ee47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.412634 32144 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef788b0311b48cda5e5efbaef940e1b (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:56.414149 32144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef788b0311b48cda5e5efbaef940e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.416527 32143 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3189494d3c4528a7777982f4195a5a (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:56.418047 32143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3189494d3c4528a7777982f4195a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.422202 32142 tablet_service.cc:1511] Processing CreateTablet for tablet e538ac6980b14988bdb1ae4b5e602692 (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:56.424155 32142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e538ac6980b14988bdb1ae4b5e602692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.429231 32141 tablet_service.cc:1511] Processing CreateTablet for tablet 418186b6e8fa454a88b9b5904ca0d3ac (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:56.431315 32141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 418186b6e8fa454a88b9b5904ca0d3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.450510 32273 tablet_bootstrap.cc:492] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:19:56.479842 32273 tablet_bootstrap.cc:654] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.485174 32148 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1a84a9fe7f44509f2bfb122fc77e9d (DEFAULT_TABLE table=test-workload [id=0532dbac9f534fb8ba73aaf8fa4107fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:56.487183 32148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1a84a9fe7f44509f2bfb122fc77e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.493966 32273 tablet_bootstrap.cc:492] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:19:56.494859 32273 ts_tablet_manager.cc:1403] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.008s
I20260709 12:19:56.505686 32273 raft_consensus.cc:359] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.506954 32273 raft_consensus.cc:385] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.507385 32273 raft_consensus.cc:740] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.509058 32273 consensus_queue.cc:260] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.536510 32276 raft_consensus.cc:493] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.536561 32183 heartbeater.cc:499] Master 127.17.249.254:35153 was elected leader, sending a full tablet report...
I20260709 12:19:56.538260 32273 ts_tablet_manager.cc:1434] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.043s	user 0.023s	sys 0.011s
I20260709 12:19:56.540500 32276 raft_consensus.cc:515] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.566599 32276 leader_election.cc:290] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:56.600653 32272 tablet_bootstrap.cc:492] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
W20260709 12:19:56.622958 32121 leader_election.cc:343] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163): Not found: Tablet not found: 79337a4361e34cc1bf1c435c68f74ca9
I20260709 12:19:56.653748 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79337a4361e34cc1bf1c435c68f74ca9" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
W20260709 12:19:56.656248 32122 leader_election.cc:343] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.657055 32122 leader_election.cc:304] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55a304e5735842648243cfdf2b64c187; no voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:19:56.658279 32273 tablet_bootstrap.cc:492] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:19:56.658479 32276 raft_consensus.cc:2749] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.668426 32274 tablet_bootstrap.cc:492] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:19:56.680367 32273 tablet_bootstrap.cc:654] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.696360 32272 tablet_bootstrap.cc:654] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:56.702862 32029 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:56.726612 32274 tablet_bootstrap.cc:654] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.754273 32273 tablet_bootstrap.cc:492] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:19:56.754993 32273 ts_tablet_manager.cc:1403] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.097s	user 0.037s	sys 0.043s
I20260709 12:19:56.757701 32273 raft_consensus.cc:359] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.758307 32273 raft_consensus.cc:385] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.758620 32273 raft_consensus.cc:740] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.759078 32272 tablet_bootstrap.cc:492] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:19:56.759869 32272 ts_tablet_manager.cc:1403] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.160s	user 0.029s	sys 0.027s
I20260709 12:19:56.759682 32273 consensus_queue.cc:260] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.760288 32274 tablet_bootstrap.cc:492] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:19:56.761055 32274 ts_tablet_manager.cc:1403] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.002s
I20260709 12:19:56.762534 32273 ts_tablet_manager.cc:1434] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:19:56.763886 32273 tablet_bootstrap.cc:492] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:19:56.763736 32272 raft_consensus.cc:359] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.764736 32272 raft_consensus.cc:385] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.765216 32272 raft_consensus.cc:740] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.765046 32274 raft_consensus.cc:359] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.765931 32274 raft_consensus.cc:385] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.766407 32274 raft_consensus.cc:740] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.766258 32272 consensus_queue.cc:260] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.767427 32274 consensus_queue.cc:260] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.772294 32273 tablet_bootstrap.cc:654] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.777433 32257 heartbeater.cc:499] Master 127.17.249.254:35153 was elected leader, sending a full tablet report...
I20260709 12:19:56.778623 32274 ts_tablet_manager.cc:1434] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.014s
I20260709 12:19:56.780354 32274 tablet_bootstrap.cc:492] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:19:56.788978 32274 tablet_bootstrap.cc:654] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.789426 32273 tablet_bootstrap.cc:492] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
W20260709 12:19:56.789698 32184 tablet.cc:2406] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:56.790508 32273 ts_tablet_manager.cc:1403] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.009s
I20260709 12:19:56.793174 32108 heartbeater.cc:499] Master 127.17.249.254:35153 was elected leader, sending a full tablet report...
I20260709 12:19:56.794431 32273 raft_consensus.cc:359] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.795298 32273 raft_consensus.cc:385] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.795646 32273 raft_consensus.cc:740] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.796625 32273 consensus_queue.cc:260] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.798210 32277 raft_consensus.cc:493] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.799070 32273 ts_tablet_manager.cc:1434] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:19:56.798849 32277 raft_consensus.cc:515] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.801367 32273 tablet_bootstrap.cc:492] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:19:56.802996 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:19:56.803901 32083 raft_consensus.cc:2468] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:19:56.805559 32122 leader_election.cc:304] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:56.806717 32276 raft_consensus.cc:2804] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:56.807020 32277 leader_election.cc:290] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:56.807200 32276 raft_consensus.cc:493] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.807773 32276 raft_consensus.cc:3060] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.808733 32273 tablet_bootstrap.cc:654] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.812757 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:56.813758 32232 raft_consensus.cc:2468] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:19:56.820307 32273 tablet_bootstrap.cc:492] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:19:56.820982 32273 ts_tablet_manager.cc:1403] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
I20260709 12:19:56.824131 32273 raft_consensus.cc:359] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.825014 32273 raft_consensus.cc:385] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.825361 32273 raft_consensus.cc:740] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.826334 32273 consensus_queue.cc:260] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.829044 32273 ts_tablet_manager.cc:1434] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:56.829718 32285 raft_consensus.cc:493] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.830252 32285 raft_consensus.cc:515] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.837491 32285 leader_election.cc:290] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:56.830224 32273 tablet_bootstrap.cc:492] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:19:56.851913 32272 ts_tablet_manager.cc:1434] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.092s	user 0.035s	sys 0.029s
I20260709 12:19:56.853628 32272 tablet_bootstrap.cc:492] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:19:56.854111 32273 tablet_bootstrap.cc:654] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.840728 32276 raft_consensus.cc:515] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.861392 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:19:56.862016 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:19:56.862803 32272 tablet_bootstrap.cc:654] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.863034 32232 raft_consensus.cc:3060] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.864266 32274 tablet_bootstrap.cc:492] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:19:56.865038 32274 ts_tablet_manager.cc:1403] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.031s
I20260709 12:19:56.862141 32083 raft_consensus.cc:3060] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:56.870422 32273 tablet_bootstrap.cc:492] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:19:56.871024 32273 ts_tablet_manager.cc:1403] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.000s
I20260709 12:19:56.874084 32274 raft_consensus.cc:359] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.876641 32273 raft_consensus.cc:359] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.883522 32274 raft_consensus.cc:385] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.880647 32232 raft_consensus.cc:2468] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:19:56.883680 32273 raft_consensus.cc:385] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.884101 32274 raft_consensus.cc:740] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.884366 32273 raft_consensus.cc:740] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.885152 32274 consensus_queue.cc:260] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.881824 32276 leader_election.cc:290] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:56.881356 32083 raft_consensus.cc:2468] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:19:56.887708 32274 ts_tablet_manager.cc:1434] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 12:19:56.885522 32273 consensus_queue.cc:260] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.890120 32273 ts_tablet_manager.cc:1434] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:19:56.891077 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:19:56.893787 32158 raft_consensus.cc:2393] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c3674e1e1dc4b728a64a21109b6c634 in current term 1: Already voted for candidate 55a304e5735842648243cfdf2b64c187 in this term.
I20260709 12:19:56.894658 32273 tablet_bootstrap.cc:492] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:19:56.896042 32121 leader_election.cc:304] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:56.897442 32274 tablet_bootstrap.cc:492] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:19:56.900952 32276 raft_consensus.cc:2804] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:56.901947 32276 raft_consensus.cc:697] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:19:56.905150 32276 consensus_queue.cc:237] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.907310 32272 tablet_bootstrap.cc:492] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:19:56.908116 32272 ts_tablet_manager.cc:1403] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.022s
I20260709 12:19:56.910310 32274 tablet_bootstrap.cc:654] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.913153 32272 raft_consensus.cc:359] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.914260 32272 raft_consensus.cc:385] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.914633 32272 raft_consensus.cc:740] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.910655 32273 tablet_bootstrap.cc:654] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.915601 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:56.915683 32272 consensus_queue.cc:260] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.916785 32232 raft_consensus.cc:2393] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c3674e1e1dc4b728a64a21109b6c634 in current term 1: Already voted for candidate 55a304e5735842648243cfdf2b64c187 in this term.
I20260709 12:19:56.918610 32046 leader_election.cc:304] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634; no voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187
I20260709 12:19:56.920521 32272 ts_tablet_manager.cc:1434] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:19:56.920619 32283 raft_consensus.cc:2749] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.922498 32272 tablet_bootstrap.cc:492] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:19:56.925078 32274 tablet_bootstrap.cc:492] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:19:56.925917 32274 ts_tablet_manager.cc:1403] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.004s
I20260709 12:19:56.929569 32274 raft_consensus.cc:359] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.930509 32274 raft_consensus.cc:385] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.930929 32274 raft_consensus.cc:740] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.932034 32283 raft_consensus.cc:493] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.932649 32283 raft_consensus.cc:515] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.934147 32272 tablet_bootstrap.cc:654] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.935218 32283 leader_election.cc:290] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:56.936307 32274 consensus_queue.cc:260] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.937278 31979 catalog_manager.cc:5697] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.939983 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef788b0311b48cda5e5efbaef940e1b" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:19:56.942314 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef788b0311b48cda5e5efbaef940e1b" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
W20260709 12:19:56.943380 32046 leader_election.cc:343] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.941337 32274 ts_tablet_manager.cc:1434] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:19:56.945143 32274 tablet_bootstrap.cc:492] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
W20260709 12:19:56.950299 32046 leader_election.cc:343] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:56.951177 32046 leader_election.cc:304] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634; no voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187
I20260709 12:19:56.952726 32283 raft_consensus.cc:2749] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:56.965968 32272 tablet_bootstrap.cc:492] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:19:56.966421 32274 tablet_bootstrap.cc:654] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.966444 32273 tablet_bootstrap.cc:492] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:19:56.966915 32272 ts_tablet_manager.cc:1403] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.003s
I20260709 12:19:56.967255 32273 ts_tablet_manager.cc:1403] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.073s	user 0.029s	sys 0.023s
I20260709 12:19:56.970666 32273 raft_consensus.cc:359] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.971479 32273 raft_consensus.cc:385] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.971961 32273 raft_consensus.cc:740] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.971553 32272 raft_consensus.cc:359] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.972981 32272 raft_consensus.cc:385] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.973317 32272 raft_consensus.cc:740] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.973376 32273 consensus_queue.cc:260] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.974408 32272 consensus_queue.cc:260] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.976218 32273 ts_tablet_manager.cc:1434] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:19:56.977097 32272 ts_tablet_manager.cc:1434] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:56.977519 32273 tablet_bootstrap.cc:492] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:19:56.977967 32274 tablet_bootstrap.cc:492] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:19:56.978312 32272 tablet_bootstrap.cc:492] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:19:56.978524 32274 ts_tablet_manager.cc:1403] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.001s
I20260709 12:19:56.981802 32274 raft_consensus.cc:359] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.982620 32274 raft_consensus.cc:385] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:56.982972 32274 raft_consensus.cc:740] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:19:56.985985 32272 tablet_bootstrap.cc:654] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.986061 32273 tablet_bootstrap.cc:654] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:56.990674 32274 consensus_queue.cc:260] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:56.994261 32274 ts_tablet_manager.cc:1434] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:19:56.995950 32274 tablet_bootstrap.cc:492] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:19:57.002655 32276 raft_consensus.cc:493] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.003319 32276 raft_consensus.cc:515] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.004230 32273 tablet_bootstrap.cc:492] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:19:57.004411 32272 tablet_bootstrap.cc:492] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:19:57.005317 32272 ts_tablet_manager.cc:1403] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.007s
I20260709 12:19:57.005331 32273 ts_tablet_manager.cc:1403] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.013s
I20260709 12:19:57.007153 32276 leader_election.cc:290] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.008841 32272 raft_consensus.cc:359] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.007263 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418186b6e8fa454a88b9b5904ca0d3ac" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:19:57.009147 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418186b6e8fa454a88b9b5904ca0d3ac" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:57.009989 32274 tablet_bootstrap.cc:654] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.009765 32272 raft_consensus.cc:385] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.009756 32273 raft_consensus.cc:359] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.010747 32272 raft_consensus.cc:740] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.011466 32273 raft_consensus.cc:385] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.011906 32273 raft_consensus.cc:740] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
W20260709 12:19:57.012154 32122 leader_election.cc:343] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.012156 32272 consensus_queue.cc:260] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.012989 32273 consensus_queue.cc:260] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.010488 32232 raft_consensus.cc:2468] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:19:57.015182 32121 leader_election.cc:304] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:19:57.015867 32272 ts_tablet_manager.cc:1434] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 12:19:57.016346 32273 ts_tablet_manager.cc:1434] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:19:57.016698 32276 raft_consensus.cc:2804] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.017170 32272 tablet_bootstrap.cc:492] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:19:57.017159 32276 raft_consensus.cc:493] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.017879 32276 raft_consensus.cc:3060] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.017966 32273 tablet_bootstrap.cc:492] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:19:57.027455 32273 tablet_bootstrap.cc:654] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.029631 32274 tablet_bootstrap.cc:492] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:19:57.030287 32274 ts_tablet_manager.cc:1403] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.000s
I20260709 12:19:57.033789 32274 raft_consensus.cc:359] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.034597 32274 raft_consensus.cc:385] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.034934 32274 raft_consensus.cc:740] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.036345 32276 raft_consensus.cc:515] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.036707 32274 consensus_queue.cc:260] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.037662 32277 raft_consensus.cc:493] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.038383 32277 raft_consensus.cc:515] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.038847 32276 leader_election.cc:290] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.040678 32273 tablet_bootstrap.cc:492] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:19:57.041396 32273 ts_tablet_manager.cc:1403] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 12:19:57.043421 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b102429c805b4903a194300a419ee47b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:19:57.044346 32082 raft_consensus.cc:2468] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:19:57.044823 32273 raft_consensus.cc:359] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.045646 32272 tablet_bootstrap.cc:654] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.045915 32274 ts_tablet_manager.cc:1434] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:19:57.046442 32122 leader_election.cc:304] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:57.047227 32274 tablet_bootstrap.cc:492] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:19:57.047515 32276 raft_consensus.cc:2804] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.047749 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418186b6e8fa454a88b9b5904ca0d3ac" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:19:57.047982 32276 raft_consensus.cc:493] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.048359 32276 raft_consensus.cc:3060] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.048410 32232 raft_consensus.cc:3060] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.052457 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b102429c805b4903a194300a419ee47b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:57.053355 32231 raft_consensus.cc:2468] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:19:57.040757 32277 leader_election.cc:290] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.045603 32273 raft_consensus.cc:385] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.056036 32273 raft_consensus.cc:740] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.045626 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418186b6e8fa454a88b9b5904ca0d3ac" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:19:57.057071 32273 consensus_queue.cc:260] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.057444 32274 tablet_bootstrap.cc:654] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:57.057915 32122 leader_election.cc:343] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.059413 32273 ts_tablet_manager.cc:1434] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 12:19:57.061345 32276 raft_consensus.cc:515] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.063987 32273 tablet_bootstrap.cc:492] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:19:57.065831 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b102429c805b4903a194300a419ee47b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:19:57.066614 32083 raft_consensus.cc:3060] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.066740 32274 tablet_bootstrap.cc:492] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:19:57.067523 32274 ts_tablet_manager.cc:1403] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:19:57.067554 32232 raft_consensus.cc:2468] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:19:57.069268 32121 leader_election.cc:304] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:19:57.070153 32277 raft_consensus.cc:2804] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.071754 32273 tablet_bootstrap.cc:654] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.077951 32272 tablet_bootstrap.cc:492] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:19:57.078881 32272 ts_tablet_manager.cc:1403] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.010s
I20260709 12:19:57.071930 32276 leader_election.cc:290] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.083858 32276 raft_consensus.cc:493] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.084507 32276 raft_consensus.cc:515] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.088392 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada69b307b6e4c6587635392c5983898" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
W20260709 12:19:57.091400 32122 leader_election.cc:343] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.096035 32277 raft_consensus.cc:697] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:19:57.097867 32083 raft_consensus.cc:2468] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:19:57.092351 32272 raft_consensus.cc:359] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.101704 32272 raft_consensus.cc:385] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.101769 32122 leader_election.cc:304] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:57.102334 32272 raft_consensus.cc:740] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.102095 32277 consensus_queue.cc:237] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.103350 32272 consensus_queue.cc:260] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.104653 32308 raft_consensus.cc:2804] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.105326 32308 raft_consensus.cc:697] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:19:57.101595 32276 leader_election.cc:290] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.106052 32273 tablet_bootstrap.cc:492] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:19:57.106846 32273 ts_tablet_manager.cc:1403] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.001s
I20260709 12:19:57.098480 32274 raft_consensus.cc:359] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.106321 32308 consensus_queue.cc:237] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.110941 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b102429c805b4903a194300a419ee47b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:19:57.111733 32232 raft_consensus.cc:3060] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.113224 32273 raft_consensus.cc:359] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.114347 32273 raft_consensus.cc:385] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.107833 32274 raft_consensus.cc:385] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.115139 32283 raft_consensus.cc:493] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.115490 32274 raft_consensus.cc:740] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.115818 32283 raft_consensus.cc:515] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.116796 32274 consensus_queue.cc:260] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.121640 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada69b307b6e4c6587635392c5983898" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:19:57.121733 32232 raft_consensus.cc:2468] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:19:57.122633 32158 raft_consensus.cc:2468] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 0.
I20260709 12:19:57.114698 32273 raft_consensus.cc:740] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.123726 32273 consensus_queue.cc:260] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.125419 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada69b307b6e4c6587635392c5983898" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:57.125789 32046 leader_election.cc:304] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:57.126910 32285 raft_consensus.cc:2804] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.127342 32285 raft_consensus.cc:493] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:57.127367 32046 leader_election.cc:343] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.127909 32285 raft_consensus.cc:3060] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.128439 32274 ts_tablet_manager.cc:1434] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.006s
I20260709 12:19:57.129654 32274 tablet_bootstrap.cc:492] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:19:57.132534 32272 ts_tablet_manager.cc:1434] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.004s
I20260709 12:19:57.118439 32283 leader_election.cc:290] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.125840 32273 ts_tablet_manager.cc:1434] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:19:57.139155 32274 tablet_bootstrap.cc:654] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.144058 32272 tablet_bootstrap.cc:492] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:19:57.144924 31981 catalog_manager.cc:5697] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:57.146919 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada69b307b6e4c6587635392c5983898" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:57.147532 31981 catalog_manager.cc:5697] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:57.150967 32121 leader_election.cc:343] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.151579 32121 leader_election.cc:304] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55a304e5735842648243cfdf2b64c187; no voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:19:57.152536 32308 raft_consensus.cc:2749] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:57.153112 32274 tablet_bootstrap.cc:492] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:19:57.153301 32272 tablet_bootstrap.cc:654] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.153860 32274 ts_tablet_manager.cc:1403] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.001s
I20260709 12:19:57.148469 32285 raft_consensus.cc:515] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.157809 32274 raft_consensus.cc:359] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.158931 32274 raft_consensus.cc:385] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.159303 32274 raft_consensus.cc:740] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.160322 32274 consensus_queue.cc:260] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.162058 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada69b307b6e4c6587635392c5983898" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:19:57.163091 32158 raft_consensus.cc:3060] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.163336 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada69b307b6e4c6587635392c5983898" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
W20260709 12:19:57.165035 32046 leader_election.cc:343] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.166138 32285 leader_election.cc:290] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Requested vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.168322 32274 ts_tablet_manager.cc:1434] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 12:19:57.169790 32274 tablet_bootstrap.cc:492] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:19:57.173405 32284 raft_consensus.cc:493] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.174407 32284 raft_consensus.cc:515] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.176805 32274 tablet_bootstrap.cc:654] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.180264 32284 leader_election.cc:290] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:19:57.184103 32272 tablet_bootstrap.cc:492] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:19:57.185046 32272 ts_tablet_manager.cc:1403] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.022s
I20260709 12:19:57.189409 32272 raft_consensus.cc:359] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.190697 32272 raft_consensus.cc:385] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.191192 32272 raft_consensus.cc:740] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.192255 32272 consensus_queue.cc:260] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.195118 32272 ts_tablet_manager.cc:1434] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:19:57.196278 32272 tablet_bootstrap.cc:492] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:19:57.203575 32272 tablet_bootstrap.cc:654] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.204694 32274 tablet_bootstrap.cc:492] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:19:57.205411 32274 ts_tablet_manager.cc:1403] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.004s
I20260709 12:19:57.208993 32274 raft_consensus.cc:359] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.209874 32274 raft_consensus.cc:385] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.210182 32274 raft_consensus.cc:740] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.211452 32274 consensus_queue.cc:260] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.214216 32274 ts_tablet_manager.cc:1434] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:19:57.215436 32274 tablet_bootstrap.cc:492] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:19:57.222386 32274 tablet_bootstrap.cc:654] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.226764 32158 raft_consensus.cc:2468] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 1.
I20260709 12:19:57.229315 32046 leader_election.cc:304] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 3254653e60684a5789a61046db6f0c5a
I20260709 12:19:57.231074 32285 raft_consensus.cc:2804] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.231801 32285 raft_consensus.cc:697] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Becoming Leader. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:19:57.233107 32285 consensus_queue.cc:237] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.235049 32274 tablet_bootstrap.cc:492] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:19:57.235504 32308 raft_consensus.cc:493] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.235821 32274 ts_tablet_manager.cc:1403] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 12:19:57.236423 32308 raft_consensus.cc:515] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.239427 32274 raft_consensus.cc:359] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.240888 32274 raft_consensus.cc:385] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.241282 32274 raft_consensus.cc:740] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.242349 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1a84a9fe7f44509f2bfb122fc77e9d" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
W20260709 12:19:57.244387 32122 leader_election.cc:343] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.242818 32308 leader_election.cc:290] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.245405 32274 consensus_queue.cc:260] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.248788 32274 ts_tablet_manager.cc:1434] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:19:57.249899 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1a84a9fe7f44509f2bfb122fc77e9d" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:57.250721 32232 raft_consensus.cc:2468] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:19:57.252632 32272 tablet_bootstrap.cc:492] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:19:57.252537 32121 leader_election.cc:304] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:19:57.253294 32272 ts_tablet_manager.cc:1403] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.031s
I20260709 12:19:57.254161 32308 raft_consensus.cc:2804] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.254622 32308 raft_consensus.cc:493] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.255050 32308 raft_consensus.cc:3060] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.257453 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e538ac6980b14988bdb1ae4b5e602692" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:19:57.258401 32158 raft_consensus.cc:2468] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 0.
I20260709 12:19:57.256948 32272 raft_consensus.cc:359] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.260311 32195 leader_election.cc:304] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:57.260641 32272 raft_consensus.cc:385] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.261111 32272 raft_consensus.cc:740] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.262079 32272 consensus_queue.cc:260] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.261952 31981 catalog_manager.cc:5697] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:57.263379 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e538ac6980b14988bdb1ae4b5e602692" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:19:57.264153 32083 raft_consensus.cc:2468] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 0.
I20260709 12:19:57.264967 32272 ts_tablet_manager.cc:1434] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:19:57.265581 32284 raft_consensus.cc:2804] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.266100 32284 raft_consensus.cc:493] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.266242 32272 tablet_bootstrap.cc:492] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:19:57.266479 32284 raft_consensus.cc:3060] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.269320 32285 raft_consensus.cc:493] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.269958 32285 raft_consensus.cc:515] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.273602 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:19:57.274338 32158 raft_consensus.cc:2468] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 0.
I20260709 12:19:57.275377 32272 tablet_bootstrap.cc:654] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.275643 32046 leader_election.cc:304] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:57.276665 32283 raft_consensus.cc:2804] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.277180 32283 raft_consensus.cc:493] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.276716 32284 raft_consensus.cc:515] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.277655 32283 raft_consensus.cc:3060] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.279446 32284 leader_election.cc:290] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:19:57.280967 32285 leader_election.cc:290] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.283210 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e538ac6980b14988bdb1ae4b5e602692" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:19:57.284092 32158 raft_consensus.cc:3060] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.285043 32308 raft_consensus.cc:515] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.287639 32308 leader_election.cc:290] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.289121 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1a84a9fe7f44509f2bfb122fc77e9d" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:19:57.291450 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:57.292569 32231 raft_consensus.cc:2468] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 0.
I20260709 12:19:57.291283 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1a84a9fe7f44509f2bfb122fc77e9d" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:19:57.293552 32232 raft_consensus.cc:3060] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.296355 32158 raft_consensus.cc:2468] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 1.
I20260709 12:19:57.297243 32272 tablet_bootstrap.cc:492] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:19:57.297820 32272 ts_tablet_manager.cc:1403] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.022s
I20260709 12:19:57.297951 32195 leader_election.cc:304] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:57.289474 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e538ac6980b14988bdb1ae4b5e602692" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:19:57.299065 32284 raft_consensus.cc:2804] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.299240 32082 raft_consensus.cc:3060] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.300256 32284 raft_consensus.cc:697] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Becoming Leader. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Running, Role: LEADER
I20260709 12:19:57.301389 32272 raft_consensus.cc:359] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.301275 32284 consensus_queue.cc:237] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.302081 32272 raft_consensus.cc:385] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.302450 32272 raft_consensus.cc:740] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
W20260709 12:19:57.303253 32122 leader_election.cc:343] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:57.303578 32272 consensus_queue.cc:260] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.305032 32285 raft_consensus.cc:493] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.307331 32285 raft_consensus.cc:515] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.313174 32082 raft_consensus.cc:2468] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 1.
I20260709 12:19:57.315943 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79337a4361e34cc1bf1c435c68f74ca9" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:19:57.324704 32232 raft_consensus.cc:2468] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:19:57.327234 32158 raft_consensus.cc:2468] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 0.
I20260709 12:19:57.329267 32272 ts_tablet_manager.cc:1434] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.009s
I20260709 12:19:57.330610 32272 tablet_bootstrap.cc:492] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:19:57.331159 32046 leader_election.cc:304] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:57.333411 32284 raft_consensus.cc:493] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.334246 32284 raft_consensus.cc:515] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.336431 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79337a4361e34cc1bf1c435c68f74ca9" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:57.339365 32283 raft_consensus.cc:515] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.340356 32121 leader_election.cc:304] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:19:57.342429 32283 leader_election.cc:290] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Requested vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.343855 32308 raft_consensus.cc:2804] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.344512 32308 raft_consensus.cc:697] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:19:57.327615 32285 leader_election.cc:290] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.345507 32308 consensus_queue.cc:237] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.346586 32231 raft_consensus.cc:2468] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 0.
I20260709 12:19:57.345868 32272 tablet_bootstrap.cc:654] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.355433 32284 leader_election.cc:290] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:19:57.370241 32324 raft_consensus.cc:2804] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:57.371006 32324 raft_consensus.cc:493] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.373795 32324 raft_consensus.cc:3060] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.382344 32324 raft_consensus.cc:515] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.385963 32324 leader_election.cc:290] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Requested vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:57.388211 32272 tablet_bootstrap.cc:492] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:19:57.389019 32272 ts_tablet_manager.cc:1403] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.002s
I20260709 12:19:57.393057 32272 raft_consensus.cc:359] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.394245 32272 raft_consensus.cc:385] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.394644 32272 raft_consensus.cc:740] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.395846 32272 consensus_queue.cc:260] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.398612 32272 ts_tablet_manager.cc:1434] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:19:57.535574 32284 raft_consensus.cc:493] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.536585 32284 raft_consensus.cc:515] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:57.539851 32284 leader_election.cc:290] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
W20260709 12:19:57.932560 32029 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:58.414340 32328 raft_consensus.cc:493] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.415154 32328 raft_consensus.cc:515] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:58.416059 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:19:58.416790 32231 raft_consensus.cc:3060] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.417543 32328 leader_election.cc:290] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:58.419860 32330 raft_consensus.cc:493] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.420501 32330 raft_consensus.cc:515] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:58.422242 32330 leader_election.cc:290] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:58.424559 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79337a4361e34cc1bf1c435c68f74ca9" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:19:58.425195 32232 raft_consensus.cc:3060] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.428395 32231 raft_consensus.cc:2468] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 1.
I20260709 12:19:58.430589 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada69b307b6e4c6587635392c5983898" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:19:58.432598 32232 raft_consensus.cc:2468] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 1.
I20260709 12:19:58.432695 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef788b0311b48cda5e5efbaef940e1b" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:19:58.433954 32082 raft_consensus.cc:2468] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 0.
I20260709 12:19:58.436769 32046 leader_election.cc:304] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 
I20260709 12:19:58.439024 32046 leader_election.cc:304] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 
I20260709 12:19:58.439952 32328 raft_consensus.cc:2804] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.441984 32328 raft_consensus.cc:697] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Becoming Leader. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:19:58.442444 32331 raft_consensus.cc:2804] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.443799 32331 raft_consensus.cc:697] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Becoming Leader. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:19:58.444124 32230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1a84a9fe7f44509f2bfb122fc77e9d" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:58.443092 32328 consensus_queue.cc:237] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:58.445588 32230 raft_consensus.cc:2393] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c3674e1e1dc4b728a64a21109b6c634 in current term 1: Already voted for candidate 55a304e5735842648243cfdf2b64c187 in this term.
I20260709 12:19:58.445787 32331 consensus_queue.cc:237] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:58.448282 32229 raft_consensus.cc:3060] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.456856 31981 catalog_manager.cc:5697] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3254653e60684a5789a61046db6f0c5a (127.17.249.195). New cstate: current_term: 1 leader_uuid: "3254653e60684a5789a61046db6f0c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:58.458447 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada69b307b6e4c6587635392c5983898" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:19:58.459507 32158 raft_consensus.cc:2393] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3254653e60684a5789a61046db6f0c5a in current term 1: Already voted for candidate 3c3674e1e1dc4b728a64a21109b6c634 in this term.
I20260709 12:19:58.462531 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef788b0311b48cda5e5efbaef940e1b" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:19:58.463315 32158 raft_consensus.cc:2468] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 0.
I20260709 12:19:58.463505 32331 consensus_queue.cc:1048] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:58.464972 32330 consensus_queue.cc:1048] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:58.464231 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef788b0311b48cda5e5efbaef940e1b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:58.466226 32232 raft_consensus.cc:2468] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:19:58.468520 32329 consensus_queue.cc:1048] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.469735 32121 leader_election.cc:304] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:58.471275 32329 raft_consensus.cc:2804] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.471688 32329 raft_consensus.cc:493] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.472069 32329 raft_consensus.cc:3060] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.484280 32284 consensus_queue.cc:1048] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:19:58.490113 32324 raft_consensus.cc:493] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.495330 32324 raft_consensus.cc:515] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:58.491547 32195 leader_election.cc:304] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:58.501225 32284 raft_consensus.cc:2804] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.501763 32284 raft_consensus.cc:493] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.502208 32284 raft_consensus.cc:3060] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.505152 32196 leader_election.cc:304] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a; no voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187
I20260709 12:19:58.524551 32324 leader_election.cc:290] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:58.536464 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418186b6e8fa454a88b9b5904ca0d3ac" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:58.537838 32231 raft_consensus.cc:2393] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c3674e1e1dc4b728a64a21109b6c634 in current term 1: Already voted for candidate 55a304e5735842648243cfdf2b64c187 in this term.
I20260709 12:19:58.566898 32342 consensus_queue.cc:1048] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:58.482743 32329 raft_consensus.cc:515] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:58.587788 32324 raft_consensus.cc:493] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.574995 32284 raft_consensus.cc:515] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:58.589126 32324 raft_consensus.cc:515] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:58.594007 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef788b0311b48cda5e5efbaef940e1b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:19:58.594705 32324 leader_election.cc:290] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:58.594967 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef788b0311b48cda5e5efbaef940e1b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:19:58.595914 32083 raft_consensus.cc:2468] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:19:58.592988 32329 leader_election.cc:290] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:58.609007 32081 raft_consensus.cc:3060] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.614841 32228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:19:58.611511 32231 raft_consensus.cc:2393] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 55a304e5735842648243cfdf2b64c187 in current term 1: Already voted for candidate 3254653e60684a5789a61046db6f0c5a in this term.
I20260709 12:19:58.628940 32344 raft_consensus.cc:2749] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.630226 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef788b0311b48cda5e5efbaef940e1b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:19:58.633602 32083 raft_consensus.cc:3060] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.642877 32343 consensus_queue.cc:1048] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:58.649765 32284 leader_election.cc:290] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:19:58.655867 32156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef788b0311b48cda5e5efbaef940e1b" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:19:58.656288 32157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:19:58.655926 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef788b0311b48cda5e5efbaef940e1b" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:19:58.657454 32157 raft_consensus.cc:3060] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.659665 32156 raft_consensus.cc:2393] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3254653e60684a5789a61046db6f0c5a in current term 1: Already voted for candidate 55a304e5735842648243cfdf2b64c187 in this term.
I20260709 12:19:58.665117 32196 leader_election.cc:304] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a; no voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187
I20260709 12:19:58.665825 32156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79337a4361e34cc1bf1c435c68f74ca9" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:19:58.666164 32344 raft_consensus.cc:2749] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.666651 32156 raft_consensus.cc:3060] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.689352 32083 raft_consensus.cc:2468] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:19:58.693907 31979 catalog_manager.cc:5697] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.702912 32157 raft_consensus.cc:2468] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 1.
I20260709 12:19:58.703096 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1a84a9fe7f44509f2bfb122fc77e9d" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:19:58.713279 32046 leader_election.cc:304] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634; no voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187
I20260709 12:19:58.713701 32341 consensus_queue.cc:1048] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:58.715178 32328 raft_consensus.cc:3060] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.716472 32122 leader_election.cc:304] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 3254653e60684a5789a61046db6f0c5a
I20260709 12:19:58.717201 32341 consensus_queue.cc:1048] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.720187 32341 raft_consensus.cc:2804] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.717876 31980 catalog_manager.cc:5697] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.720968 32341 raft_consensus.cc:697] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:19:58.721660 32158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418186b6e8fa454a88b9b5904ca0d3ac" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:19:58.723459 32324 consensus_queue.cc:1048] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:19:58.725808 32157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:19:58.722132 32341 consensus_queue.cc:237] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:58.743407 32046 leader_election.cc:304] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634; no voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187
I20260709 12:19:58.746436 32324 raft_consensus.cc:2749] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.746958 32046 leader_election.cc:304] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634; no voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187
I20260709 12:19:58.748956 32345 consensus_queue.cc:1048] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:19:58.750592 32328 raft_consensus.cc:2749] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.722476 31980 catalog_manager.cc:5697] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.745435 32156 raft_consensus.cc:2468] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 1.
I20260709 12:19:58.778929 32331 raft_consensus.cc:2749] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:58.808712 31980 catalog_manager.cc:5697] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.828816 32343 consensus_queue.cc:1048] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.835873 32331 consensus_queue.cc:1048] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.857254 32329 consensus_queue.cc:1048] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:58.860026 32328 consensus_queue.cc:1048] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:58.902094 32328 consensus_queue.cc:1048] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:58.906093 32155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c"
dest_uuid: "55a304e5735842648243cfdf2b64c187"
mode: GRACEFUL
new_leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
 from {username='slave'} at 127.0.0.1:52020
I20260709 12:19:58.907078 32155 raft_consensus.cc:606] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Received request to transfer leadership to TS 3c3674e1e1dc4b728a64a21109b6c634
W20260709 12:19:58.909082 32179 debug-util.cc:398] Leaking SignalData structure 0x7b08002eada0 after lost signal to thread 18410
W20260709 12:19:58.910722 32179 debug-util.cc:398] Leaking SignalData structure 0x7b0800340ae0 after lost signal to thread 32015
W20260709 12:19:58.912681 32179 debug-util.cc:398] Leaking SignalData structure 0x7b0800335220 after lost signal to thread 32107
W20260709 12:19:58.916433 32179 debug-util.cc:398] Leaking SignalData structure 0x7b08000488a0 after lost signal to thread 32256
I20260709 12:19:58.918190 32156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b102429c805b4903a194300a419ee47b"
dest_uuid: "55a304e5735842648243cfdf2b64c187"
mode: GRACEFUL
new_leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
 from {username='slave'} at 127.0.0.1:52020
I20260709 12:19:58.919029 32156 raft_consensus.cc:606] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Received request to transfer leadership to TS 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:19:58.923590 32328 consensus_queue.cc:1048] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:58.966091 32083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a"
dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
mode: GRACEFUL
new_leader_uuid: "55a304e5735842648243cfdf2b64c187"
 from {username='slave'} at 127.0.0.1:58054
I20260709 12:19:58.966871 32083 raft_consensus.cc:606] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Received request to transfer leadership to TS 55a304e5735842648243cfdf2b64c187
I20260709 12:19:58.987712 32230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e538ac6980b14988bdb1ae4b5e602692"
dest_uuid: "3254653e60684a5789a61046db6f0c5a"
mode: GRACEFUL
new_leader_uuid: "55a304e5735842648243cfdf2b64c187"
 from {username='slave'} at 127.0.0.1:33184
I20260709 12:19:58.988425 32230 raft_consensus.cc:606] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Received request to transfer leadership to TS 55a304e5735842648243cfdf2b64c187
I20260709 12:19:59.000633 32155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e1a84a9fe7f44509f2bfb122fc77e9d"
dest_uuid: "55a304e5735842648243cfdf2b64c187"
mode: GRACEFUL
new_leader_uuid: "3254653e60684a5789a61046db6f0c5a"
 from {username='slave'} at 127.0.0.1:52020
I20260709 12:19:59.001511 32155 raft_consensus.cc:606] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Received request to transfer leadership to TS 3254653e60684a5789a61046db6f0c5a
I20260709 12:19:59.123803 32340 raft_consensus.cc:993] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187: : Instructing follower 3c3674e1e1dc4b728a64a21109b6c634 to start an election
I20260709 12:19:59.124331 32329 raft_consensus.cc:1081] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Signalling peer 3c3674e1e1dc4b728a64a21109b6c634 to start an election
I20260709 12:19:59.126190 32083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c"
dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
 from {username='slave'} at 127.0.0.1:58038
I20260709 12:19:59.126919 32083 raft_consensus.cc:493] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:59.127274 32083 raft_consensus.cc:3060] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.134231 32083 raft_consensus.cc:515] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.136161 32083 leader_election.cc:290] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 2 election: Requested vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:59.137378 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:19:59.137558 32230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cbe796c8da4a6583e0863c58da762c" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:19:59.138420 32155 raft_consensus.cc:3055] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:59.138444 32230 raft_consensus.cc:3060] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.139204 32155 raft_consensus.cc:740] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:19:59.140303 32155 consensus_queue.cc:260] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.141893 32155 raft_consensus.cc:3060] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.145309 32230 raft_consensus.cc:2468] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 2.
I20260709 12:19:59.147348 32046 leader_election.cc:304] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 
I20260709 12:19:59.148146 32328 raft_consensus.cc:2804] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:59.148607 32328 raft_consensus.cc:697] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 LEADER]: Becoming Leader. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:19:59.149514 32328 consensus_queue.cc:237] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.152578 32155 raft_consensus.cc:2468] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 2.
I20260709 12:19:59.158093 31981 catalog_manager.cc:5697] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 reported cstate change: term changed from 1 to 2, leader changed from 55a304e5735842648243cfdf2b64c187 (127.17.249.194) to 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.215423 32329 consensus_queue.cc:1048] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.235821 32343 consensus_queue.cc:1048] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.262290 32379 raft_consensus.cc:993] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a: : Instructing follower 55a304e5735842648243cfdf2b64c187 to start an election
I20260709 12:19:59.262914 32284 raft_consensus.cc:1081] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Signalling peer 55a304e5735842648243cfdf2b64c187 to start an election
I20260709 12:19:59.264964 32155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e538ac6980b14988bdb1ae4b5e602692"
dest_uuid: "55a304e5735842648243cfdf2b64c187"
 from {username='slave'} at 127.0.0.1:52016
I20260709 12:19:59.265561 32155 raft_consensus.cc:493] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:59.265945 32155 raft_consensus.cc:3060] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.272104 32155 raft_consensus.cc:515] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.274009 32155 leader_election.cc:290] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 2 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:59.275300 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e538ac6980b14988bdb1ae4b5e602692" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:19:59.275259 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e538ac6980b14988bdb1ae4b5e602692" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:19:59.276273 32229 raft_consensus.cc:3055] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:59.276399 32083 raft_consensus.cc:3060] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.276690 32229 raft_consensus.cc:740] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Running, Role: LEADER
I20260709 12:19:59.277731 32229 consensus_queue.cc:260] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.279356 32229 raft_consensus.cc:3060] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.284698 32083 raft_consensus.cc:2468] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 2.
I20260709 12:19:59.286269 32122 leader_election.cc:304] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:59.287279 32229 raft_consensus.cc:2468] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 2.
I20260709 12:19:59.287379 32343 raft_consensus.cc:2804] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:59.288285 32343 raft_consensus.cc:697] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 2 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:19:59.289400 32343 consensus_queue.cc:237] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.299737 31979 catalog_manager.cc:5697] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 1 to 2, leader changed from 3254653e60684a5789a61046db6f0c5a (127.17.249.195) to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.301277 32329 raft_consensus.cc:993] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187: : Instructing follower 3c3674e1e1dc4b728a64a21109b6c634 to start an election
I20260709 12:19:59.301893 32329 raft_consensus.cc:1081] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Signalling peer 3c3674e1e1dc4b728a64a21109b6c634 to start an election
I20260709 12:19:59.303978 32083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b102429c805b4903a194300a419ee47b"
dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
 from {username='slave'} at 127.0.0.1:58038
I20260709 12:19:59.304598 32083 raft_consensus.cc:493] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:59.305068 32083 raft_consensus.cc:3060] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.311753 32083 raft_consensus.cc:515] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.313783 32083 leader_election.cc:290] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 2 election: Requested vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:59.315795 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b102429c805b4903a194300a419ee47b" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:19:59.316656 32155 raft_consensus.cc:3055] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:59.316602 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b102429c805b4903a194300a419ee47b" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:19:59.317337 32155 raft_consensus.cc:740] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:19:59.317679 32229 raft_consensus.cc:3060] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.318264 32155 consensus_queue.cc:260] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.319433 32155 raft_consensus.cc:3060] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.325975 32155 raft_consensus.cc:2468] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 2.
I20260709 12:19:59.327630 32046 leader_election.cc:304] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:59.328318 32229 raft_consensus.cc:2468] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 2.
I20260709 12:19:59.328822 32324 raft_consensus.cc:2804] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:59.329581 32324 raft_consensus.cc:697] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 LEADER]: Becoming Leader. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:19:59.330708 32324 consensus_queue.cc:237] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.339291 31979 catalog_manager.cc:5697] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 reported cstate change: term changed from 1 to 2, leader changed from 55a304e5735842648243cfdf2b64c187 (127.17.249.194) to 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.366200 32340 raft_consensus.cc:993] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187: : Instructing follower 3254653e60684a5789a61046db6f0c5a to start an election
I20260709 12:19:59.366737 32343 raft_consensus.cc:1081] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Signalling peer 3254653e60684a5789a61046db6f0c5a to start an election
I20260709 12:19:59.368868 32229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e1a84a9fe7f44509f2bfb122fc77e9d"
dest_uuid: "3254653e60684a5789a61046db6f0c5a"
 from {username='slave'} at 127.0.0.1:33164
I20260709 12:19:59.369854 32229 raft_consensus.cc:493] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:59.370347 32229 raft_consensus.cc:3060] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.382042 32229 raft_consensus.cc:515] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.387200 32229 leader_election.cc:290] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 2 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:19:59.388468 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1a84a9fe7f44509f2bfb122fc77e9d" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:19:59.388762 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1a84a9fe7f44509f2bfb122fc77e9d" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:19:59.389413 32083 raft_consensus.cc:3060] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.389674 32155 raft_consensus.cc:3055] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:59.390187 32155 raft_consensus.cc:740] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:19:59.391325 32155 consensus_queue.cc:260] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.393208 32155 raft_consensus.cc:3060] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.396433 32083 raft_consensus.cc:2468] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 2.
I20260709 12:19:59.397994 32196 leader_election.cc:304] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 
I20260709 12:19:59.398891 32284 raft_consensus.cc:2804] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:59.399422 32284 raft_consensus.cc:697] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 2 LEADER]: Becoming Leader. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Running, Role: LEADER
I20260709 12:19:59.400322 32284 consensus_queue.cc:237] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.403710 32155 raft_consensus.cc:2468] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 2.
I20260709 12:19:59.408565 31979 catalog_manager.cc:5697] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a reported cstate change: term changed from 1 to 2, leader changed from 55a304e5735842648243cfdf2b64c187 (127.17.249.194) to 3254653e60684a5789a61046db6f0c5a (127.17.249.195). New cstate: current_term: 2 leader_uuid: "3254653e60684a5789a61046db6f0c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:59.440496 32331 raft_consensus.cc:993] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634: : Instructing follower 55a304e5735842648243cfdf2b64c187 to start an election
I20260709 12:19:59.441620 32380 raft_consensus.cc:1081] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Signalling peer 55a304e5735842648243cfdf2b64c187 to start an election
I20260709 12:19:59.444249 32156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a"
dest_uuid: "55a304e5735842648243cfdf2b64c187"
 from {username='slave'} at 127.0.0.1:52012
I20260709 12:19:59.444943 32156 raft_consensus.cc:493] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:59.445391 32156 raft_consensus.cc:3060] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.453083 32156 raft_consensus.cc:515] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.456054 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:19:59.456434 32156 leader_election.cc:290] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 2 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:19:59.456750 32083 raft_consensus.cc:3055] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:59.457017 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:19:59.457314 32083 raft_consensus.cc:740] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:19:59.457721 32229 raft_consensus.cc:3060] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.458386 32083 consensus_queue.cc:260] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.460076 32083 raft_consensus.cc:3060] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:59.466318 32229 raft_consensus.cc:2468] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 2.
I20260709 12:19:59.468138 32121 leader_election.cc:304] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:19:59.468346 32083 raft_consensus.cc:2468] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 2.
I20260709 12:19:59.469249 32343 raft_consensus.cc:2804] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:59.469969 32343 raft_consensus.cc:697] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 2 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:19:59.471096 32343 consensus_queue.cc:237] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:19:59.480062 31979 catalog_manager.cc:5697] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 1 to 2, leader changed from 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193) to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.657263 32229 raft_consensus.cc:1275] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Refusing update from remote peer 3c3674e1e1dc4b728a64a21109b6c634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:59.658891 32331 consensus_queue.cc:1048] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:59.670576 32156 raft_consensus.cc:1275] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Refusing update from remote peer 3c3674e1e1dc4b728a64a21109b6c634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:59.672999 32328 consensus_queue.cc:1048] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:59.732239 32083 raft_consensus.cc:1275] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Refusing update from remote peer 55a304e5735842648243cfdf2b64c187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:59.735006 32343 consensus_queue.cc:1048] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:59.741276 32229 raft_consensus.cc:1275] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Refusing update from remote peer 3c3674e1e1dc4b728a64a21109b6c634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:59.742942 32331 consensus_queue.cc:1048] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:59.752159 32230 raft_consensus.cc:1275] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Refusing update from remote peer 55a304e5735842648243cfdf2b64c187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:59.754726 32329 consensus_queue.cc:1048] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:59.771216 32156 raft_consensus.cc:1275] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Refusing update from remote peer 3c3674e1e1dc4b728a64a21109b6c634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:59.773170 32324 consensus_queue.cc:1048] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:59.805341 32156 raft_consensus.cc:1275] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Refusing update from remote peer 3254653e60684a5789a61046db6f0c5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:59.807245 32284 consensus_queue.cc:1048] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:59.817153 32083 raft_consensus.cc:1275] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Refusing update from remote peer 3254653e60684a5789a61046db6f0c5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:59.819133 32387 consensus_queue.cc:1048] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:59.928157 32083 raft_consensus.cc:1275] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Refusing update from remote peer 55a304e5735842648243cfdf2b64c187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:59.930496 32329 consensus_queue.cc:1048] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:59.945355 32230 raft_consensus.cc:1275] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Refusing update from remote peer 55a304e5735842648243cfdf2b64c187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:59.948519 32383 consensus_queue.cc:1048] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:02.055805 31980 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39578:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:02.060520 31980 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:02.140914 32065 tablet_service.cc:1511] Processing CreateTablet for tablet 00cad1e6b6304a218e5bfe0f979d2fc9 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:02.142364 32065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00cad1e6b6304a218e5bfe0f979d2fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.142565 32144 tablet_service.cc:1511] Processing CreateTablet for tablet 00cad1e6b6304a218e5bfe0f979d2fc9 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:02.144520 32144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00cad1e6b6304a218e5bfe0f979d2fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.148968 32221 tablet_service.cc:1511] Processing CreateTablet for tablet 00cad1e6b6304a218e5bfe0f979d2fc9 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:02.148891 32071 tablet_service.cc:1511] Processing CreateTablet for tablet 84b6bf16e2f949e59f227935328382ab (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:02.150846 32221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00cad1e6b6304a218e5bfe0f979d2fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.151330 32071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b6bf16e2f949e59f227935328382ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.157261 32214 tablet_service.cc:1511] Processing CreateTablet for tablet 84b6bf16e2f949e59f227935328382ab (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:02.158735 32214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b6bf16e2f949e59f227935328382ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.158425 32145 tablet_service.cc:1511] Processing CreateTablet for tablet 84b6bf16e2f949e59f227935328382ab (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:02.159304 32142 tablet_service.cc:1511] Processing CreateTablet for tablet d777760c488141f381151f981992ff11 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:02.160060 32145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84b6bf16e2f949e59f227935328382ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.157378 32066 tablet_service.cc:1511] Processing CreateTablet for tablet d777760c488141f381151f981992ff11 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:02.160871 32142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d777760c488141f381151f981992ff11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.161614 32068 tablet_service.cc:1511] Processing CreateTablet for tablet 06eb084c301847d3ad2ce884b3dec10c (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:02.161662 32066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d777760c488141f381151f981992ff11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.164700 32068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06eb084c301847d3ad2ce884b3dec10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.166973 32148 tablet_service.cc:1511] Processing CreateTablet for tablet 06eb084c301847d3ad2ce884b3dec10c (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:02.168424 32148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06eb084c301847d3ad2ce884b3dec10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.168195 32222 tablet_service.cc:1511] Processing CreateTablet for tablet d777760c488141f381151f981992ff11 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:02.169672 32222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d777760c488141f381151f981992ff11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.171762 32067 tablet_service.cc:1511] Processing CreateTablet for tablet d81b7e40e8ca4980b2d01dcada113a3b (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:02.173357 32067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d81b7e40e8ca4980b2d01dcada113a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.173676 32143 tablet_service.cc:1511] Processing CreateTablet for tablet d81b7e40e8ca4980b2d01dcada113a3b (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:02.175408 32143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d81b7e40e8ca4980b2d01dcada113a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.177960 32218 tablet_service.cc:1511] Processing CreateTablet for tablet 06eb084c301847d3ad2ce884b3dec10c (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:02.179853 32218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06eb084c301847d3ad2ce884b3dec10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.185092 32215 tablet_service.cc:1511] Processing CreateTablet for tablet d81b7e40e8ca4980b2d01dcada113a3b (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:02.187460 32215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d81b7e40e8ca4980b2d01dcada113a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.195055 32072 tablet_service.cc:1511] Processing CreateTablet for tablet 003ca858b0d544739d15f84896eb25c9 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:02.196681 32072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 003ca858b0d544739d15f84896eb25c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.201663 32073 tablet_service.cc:1511] Processing CreateTablet for tablet 3431822bf8ae43959e53234e90dc29a2 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:02.203224 32073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3431822bf8ae43959e53234e90dc29a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.203347 32147 tablet_service.cc:1511] Processing CreateTablet for tablet 003ca858b0d544739d15f84896eb25c9 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:02.204705 32147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 003ca858b0d544739d15f84896eb25c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.201485 32219 tablet_service.cc:1511] Processing CreateTablet for tablet 003ca858b0d544739d15f84896eb25c9 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:02.211671 32219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 003ca858b0d544739d15f84896eb25c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.228016 32070 tablet_service.cc:1511] Processing CreateTablet for tablet 95e928a8b7934624b5d460a3a6e6f960 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:02.229748 32070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95e928a8b7934624b5d460a3a6e6f960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.235819 32069 tablet_service.cc:1511] Processing CreateTablet for tablet d94b770e16be4113bba163f7e3bf9995 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:02.237442 32069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94b770e16be4113bba163f7e3bf9995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.244112 32404 tablet_bootstrap.cc:492] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:20:02.247931 32141 tablet_service.cc:1511] Processing CreateTablet for tablet 3431822bf8ae43959e53234e90dc29a2 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:02.248687 32405 tablet_bootstrap.cc:492] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:20:02.249578 32141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3431822bf8ae43959e53234e90dc29a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.252914 32146 tablet_service.cc:1511] Processing CreateTablet for tablet d94b770e16be4113bba163f7e3bf9995 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:02.253424 32145 tablet_service.cc:1511] Processing CreateTablet for tablet 95e928a8b7934624b5d460a3a6e6f960 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:02.254426 32146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94b770e16be4113bba163f7e3bf9995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.260300 32145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95e928a8b7934624b5d460a3a6e6f960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.268405 32216 tablet_service.cc:1511] Processing CreateTablet for tablet 3431822bf8ae43959e53234e90dc29a2 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:02.270279 32216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3431822bf8ae43959e53234e90dc29a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.276598 32220 tablet_service.cc:1511] Processing CreateTablet for tablet 95e928a8b7934624b5d460a3a6e6f960 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:02.277647 32404 tablet_bootstrap.cc:654] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.278120 32220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95e928a8b7934624b5d460a3a6e6f960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.279820 32217 tablet_service.cc:1511] Processing CreateTablet for tablet d94b770e16be4113bba163f7e3bf9995 (DEFAULT_TABLE table=soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:02.281150 32217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d94b770e16be4113bba163f7e3bf9995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:02.281266 32405 tablet_bootstrap.cc:654] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.381747 32404 tablet_bootstrap.cc:492] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:20:02.382526 32404 ts_tablet_manager.cc:1403] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.139s	user 0.009s	sys 0.010s
I20260709 12:20:02.385922 32406 tablet_bootstrap.cc:492] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:20:02.393630 32406 tablet_bootstrap.cc:654] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.409008 32405 tablet_bootstrap.cc:492] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:20:02.409659 32405 ts_tablet_manager.cc:1403] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.161s	user 0.029s	sys 0.000s
I20260709 12:20:02.414645 32405 raft_consensus.cc:359] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.415588 32405 raft_consensus.cc:385] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.415931 32405 raft_consensus.cc:740] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.416831 32405 consensus_queue.cc:260] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.419469 32405 ts_tablet_manager.cc:1434] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:20:02.420758 32405 tablet_bootstrap.cc:492] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:20:02.426908 32404 raft_consensus.cc:359] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.429808 32404 raft_consensus.cc:385] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.430908 32404 raft_consensus.cc:740] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.427980 32405 tablet_bootstrap.cc:654] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.434746 32404 consensus_queue.cc:260] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.437733 32404 ts_tablet_manager.cc:1434] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.004s
I20260709 12:20:02.439419 32404 tablet_bootstrap.cc:492] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:20:02.450160 32404 tablet_bootstrap.cc:654] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.455374 32406 tablet_bootstrap.cc:492] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:20:02.456101 32406 ts_tablet_manager.cc:1403] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.014s
I20260709 12:20:02.459256 32406 raft_consensus.cc:359] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.460019 32406 raft_consensus.cc:385] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.460386 32406 raft_consensus.cc:740] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.461126 32406 consensus_queue.cc:260] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.461700 32405 tablet_bootstrap.cc:492] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:20:02.462769 32405 ts_tablet_manager.cc:1403] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.013s
I20260709 12:20:02.463687 32406 ts_tablet_manager.cc:1434] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:02.464975 32406 tablet_bootstrap.cc:492] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:20:02.472328 32406 tablet_bootstrap.cc:654] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.467581 32405 raft_consensus.cc:359] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.479403 32405 raft_consensus.cc:385] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.479877 32405 raft_consensus.cc:740] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.480908 32405 consensus_queue.cc:260] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.483832 32405 ts_tablet_manager.cc:1434] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 12:20:02.486603 32391 raft_consensus.cc:493] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.487238 32405 tablet_bootstrap.cc:492] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:20:02.487509 32391 raft_consensus.cc:515] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.492113 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003ca858b0d544739d15f84896eb25c9" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
W20260709 12:20:02.494719 32196 leader_election.cc:343] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.496587 32391 leader_election.cc:290] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:20:02.500821 32405 tablet_bootstrap.cc:654] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.522514 32404 tablet_bootstrap.cc:492] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:20:02.523355 32404 ts_tablet_manager.cc:1403] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.084s	user 0.039s	sys 0.026s
I20260709 12:20:02.508136 32156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003ca858b0d544739d15f84896eb25c9" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
W20260709 12:20:02.526610 32195 leader_election.cc:343] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.536049 32195 leader_election.cc:304] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a; no voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187
I20260709 12:20:02.539590 32404 raft_consensus.cc:359] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.540854 32404 raft_consensus.cc:385] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.541247 32404 raft_consensus.cc:740] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.541358 32413 raft_consensus.cc:2749] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:02.542289 32404 consensus_queue.cc:260] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.556380 32404 ts_tablet_manager.cc:1434] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 12:20:02.560555 32406 tablet_bootstrap.cc:492] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:20:02.560822 32405 tablet_bootstrap.cc:492] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:20:02.561190 32406 ts_tablet_manager.cc:1403] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.097s	user 0.035s	sys 0.030s
I20260709 12:20:02.561607 32405 ts_tablet_manager.cc:1403] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.013s
I20260709 12:20:02.561849 32404 tablet_bootstrap.cc:492] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:20:02.564136 32415 raft_consensus.cc:493] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.564759 32415 raft_consensus.cc:515] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.565837 32406 raft_consensus.cc:359] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.566720 32406 raft_consensus.cc:385] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.568813 32406 raft_consensus.cc:740] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.568288 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:20:02.567307 32415 leader_election.cc:290] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
W20260709 12:20:02.572337 32122 leader_election.cc:343] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.572846 32405 raft_consensus.cc:359] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.573937 32405 raft_consensus.cc:385] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.571524 32406 consensus_queue.cc:260] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.574311 32230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:02.576414 32406 ts_tablet_manager.cc:1434] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
W20260709 12:20:02.576802 32121 leader_election.cc:343] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.577397 32121 leader_election.cc:304] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55a304e5735842648243cfdf2b64c187; no voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:20:02.577778 32406 tablet_bootstrap.cc:492] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:20:02.578634 32415 raft_consensus.cc:2749] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:02.574330 32405 raft_consensus.cc:740] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.581271 32405 consensus_queue.cc:260] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.589149 32406 tablet_bootstrap.cc:654] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.589267 32405 ts_tablet_manager.cc:1434] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 12:20:02.590612 32405 tablet_bootstrap.cc:492] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:20:02.595831 32406 tablet_bootstrap.cc:492] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:20:02.596617 32406 ts_tablet_manager.cc:1403] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 12:20:02.597694 32404 tablet_bootstrap.cc:654] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.600346 32406 raft_consensus.cc:359] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.601200 32405 tablet_bootstrap.cc:654] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.601320 32406 raft_consensus.cc:385] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.603057 32406 raft_consensus.cc:740] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.604015 32406 consensus_queue.cc:260] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.611312 32406 ts_tablet_manager.cc:1434] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 12:20:02.613021 32406 tablet_bootstrap.cc:492] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:20:02.615653 32404 tablet_bootstrap.cc:492] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:20:02.616405 32404 ts_tablet_manager.cc:1403] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.001s
I20260709 12:20:02.625216 32404 raft_consensus.cc:359] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.626150 32404 raft_consensus.cc:385] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.626519 32404 raft_consensus.cc:740] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.627557 32404 consensus_queue.cc:260] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.633255 32406 tablet_bootstrap.cc:654] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.643824 32404 ts_tablet_manager.cc:1434] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:20:02.647753 32405 tablet_bootstrap.cc:492] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:20:02.648725 32405 ts_tablet_manager.cc:1403] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.058s	user 0.031s	sys 0.020s
I20260709 12:20:02.653539 32405 raft_consensus.cc:359] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.654708 32405 raft_consensus.cc:385] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.654975 32404 tablet_bootstrap.cc:492] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:20:02.655181 32405 raft_consensus.cc:740] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.657177 32405 consensus_queue.cc:260] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.661401 32405 ts_tablet_manager.cc:1434] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:20:02.663628 32404 tablet_bootstrap.cc:654] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.664721 32406 tablet_bootstrap.cc:492] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:20:02.665381 32406 ts_tablet_manager.cc:1403] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.006s
I20260709 12:20:02.671823 32405 tablet_bootstrap.cc:492] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:20:02.673347 32392 raft_consensus.cc:493] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.673575 32406 raft_consensus.cc:359] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.673982 32392 raft_consensus.cc:515] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.674420 32406 raft_consensus.cc:385] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.674739 32406 raft_consensus.cc:740] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.676462 32392 leader_election.cc:290] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:02.677069 32392 raft_consensus.cc:493] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.677529 32392 raft_consensus.cc:515] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.680720 32230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81b7e40e8ca4980b2d01dcada113a3b" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:02.680866 32156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81b7e40e8ca4980b2d01dcada113a3b" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
W20260709 12:20:02.682709 32046 leader_election.cc:343] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.683475 32405 tablet_bootstrap.cc:654] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:02.683573 32046 leader_election.cc:343] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.684187 32046 leader_election.cc:304] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634; no voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187
I20260709 12:20:02.685344 32392 leader_election.cc:290] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:02.686059 32392 raft_consensus.cc:2749] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:02.680584 32406 consensus_queue.cc:260] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.693189 32230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d777760c488141f381151f981992ff11" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:02.693254 32156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d777760c488141f381151f981992ff11" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:20:02.693984 32230 raft_consensus.cc:2468] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 0.
I20260709 12:20:02.695873 32415 raft_consensus.cc:493] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.696636 32415 raft_consensus.cc:515] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
W20260709 12:20:02.697934 32046 leader_election.cc:343] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.701056 32230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95e928a8b7934624b5d460a3a6e6f960" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:02.701756 32415 leader_election.cc:290] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:02.701869 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95e928a8b7934624b5d460a3a6e6f960" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
W20260709 12:20:02.703476 32121 leader_election.cc:343] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.704322 32406 ts_tablet_manager.cc:1434] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.003s
W20260709 12:20:02.704770 32122 leader_election.cc:343] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.702023 32046 leader_election.cc:304] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 55a304e5735842648243cfdf2b64c187
I20260709 12:20:02.705333 32122 leader_election.cc:304] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55a304e5735842648243cfdf2b64c187; no voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:20:02.703577 32405 tablet_bootstrap.cc:492] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:20:02.706607 32415 raft_consensus.cc:2749] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:02.707085 32405 ts_tablet_manager.cc:1403] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.017s
I20260709 12:20:02.708861 32406 tablet_bootstrap.cc:492] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:20:02.706578 32421 raft_consensus.cc:2804] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:02.711261 32421 raft_consensus.cc:493] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.714741 32421 raft_consensus.cc:3060] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:02.716763 32406 tablet_bootstrap.cc:654] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.711301 32405 raft_consensus.cc:359] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.719667 32405 raft_consensus.cc:385] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.720017 32405 raft_consensus.cc:740] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.720875 32404 tablet_bootstrap.cc:492] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:20:02.721525 32404 ts_tablet_manager.cc:1403] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.007s
I20260709 12:20:02.721124 32405 consensus_queue.cc:260] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.725081 32404 raft_consensus.cc:359] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.725889 32404 raft_consensus.cc:385] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.726244 32404 raft_consensus.cc:740] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.727932 32404 consensus_queue.cc:260] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.731824 32404 ts_tablet_manager.cc:1434] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:20:02.733363 32404 tablet_bootstrap.cc:492] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:20:02.738209 32405 ts_tablet_manager.cc:1434] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:20:02.745239 32391 raft_consensus.cc:493] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.745885 32391 raft_consensus.cc:515] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.748889 32406 tablet_bootstrap.cc:492] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:20:02.750811 32406 ts_tablet_manager.cc:1403] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.009s
I20260709 12:20:02.752350 32405 tablet_bootstrap.cc:492] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:20:02.756106 32406 raft_consensus.cc:359] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.760468 32406 raft_consensus.cc:385] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.761348 32406 raft_consensus.cc:740] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.762665 32406 consensus_queue.cc:260] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.764089 32421 raft_consensus.cc:515] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.767398 32391 leader_election.cc:290] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:20:02.768241 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94b770e16be4113bba163f7e3bf9995" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
W20260709 12:20:02.770186 32196 leader_election.cc:343] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.769018 32156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94b770e16be4113bba163f7e3bf9995" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:20:02.773422 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d777760c488141f381151f981992ff11" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187"
W20260709 12:20:02.776355 32195 leader_election.cc:343] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:02.776679 32046 leader_election.cc:343] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.776973 32195 leader_election.cc:304] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a; no voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187
I20260709 12:20:02.779619 32391 raft_consensus.cc:2749] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:02.779893 32404 tablet_bootstrap.cc:654] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.784935 32421 leader_election.cc:290] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Requested vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:02.786975 32230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d777760c488141f381151f981992ff11" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:20:02.787777 32230 raft_consensus.cc:3060] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:02.788888 32406 ts_tablet_manager.cc:1434] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.003s
I20260709 12:20:02.790158 32406 tablet_bootstrap.cc:492] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:20:02.791141 32405 tablet_bootstrap.cc:654] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.791708 32421 raft_consensus.cc:493] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.792310 32421 raft_consensus.cc:515] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.794850 32421 leader_election.cc:290] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:02.797230 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06eb084c301847d3ad2ce884b3dec10c" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
W20260709 12:20:02.802906 32046 leader_election.cc:343] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.803371 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06eb084c301847d3ad2ce884b3dec10c" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:20:02.803947 32230 raft_consensus.cc:2468] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 1.
W20260709 12:20:02.805539 32046 leader_election.cc:343] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.806025 32046 leader_election.cc:304] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634; no voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187
I20260709 12:20:02.806175 32421 raft_consensus.cc:493] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.807922 32421 raft_consensus.cc:515] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.810820 32421 leader_election.cc:290] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:02.811059 32424 raft_consensus.cc:2749] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:02.811455 32046 leader_election.cc:304] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 55a304e5735842648243cfdf2b64c187
I20260709 12:20:02.813416 32424 raft_consensus.cc:2804] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:02.814006 32424 raft_consensus.cc:697] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Becoming Leader. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:20:02.814343 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00cad1e6b6304a218e5bfe0f979d2fc9" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:20:02.815042 32424 consensus_queue.cc:237] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
W20260709 12:20:02.817876 32046 leader_election.cc:343] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.817772 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00cad1e6b6304a218e5bfe0f979d2fc9" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:02.822311 32229 raft_consensus.cc:2468] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 0.
I20260709 12:20:02.823856 32046 leader_election.cc:304] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 55a304e5735842648243cfdf2b64c187
I20260709 12:20:02.824883 32392 raft_consensus.cc:2804] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:02.825358 32392 raft_consensus.cc:493] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.825738 32392 raft_consensus.cc:3060] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:02.827178 32404 tablet_bootstrap.cc:492] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:20:02.827724 32406 tablet_bootstrap.cc:654] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.827796 32404 ts_tablet_manager.cc:1403] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.005s
I20260709 12:20:02.831739 32404 raft_consensus.cc:359] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.832746 32404 raft_consensus.cc:385] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.833248 32404 raft_consensus.cc:740] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.834368 32404 consensus_queue.cc:260] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.837400 32404 ts_tablet_manager.cc:1434] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:20:02.845667 32404 tablet_bootstrap.cc:492] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:20:02.852519 32405 tablet_bootstrap.cc:492] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:20:02.852294 32392 raft_consensus.cc:515] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.853371 32405 ts_tablet_manager.cc:1403] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.006s
I20260709 12:20:02.857182 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00cad1e6b6304a218e5bfe0f979d2fc9" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:20:02.858563 32404 tablet_bootstrap.cc:654] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:02.859151 32046 leader_election.cc:343] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.863866 32405 raft_consensus.cc:359] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.864852 32405 raft_consensus.cc:385] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.865211 32405 raft_consensus.cc:740] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.866185 32405 consensus_queue.cc:260] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.867221 32406 tablet_bootstrap.cc:492] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:20:02.867802 32406 ts_tablet_manager.cc:1403] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.012s
I20260709 12:20:02.872043 32406 raft_consensus.cc:359] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.873059 32406 raft_consensus.cc:385] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.873441 32406 raft_consensus.cc:740] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.874626 32406 consensus_queue.cc:260] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.875694 31978 catalog_manager.cc:5697] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:02.877573 32406 ts_tablet_manager.cc:1434] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:20:02.878871 32405 ts_tablet_manager.cc:1434] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:20:02.878834 32406 tablet_bootstrap.cc:492] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:20:02.883682 32405 tablet_bootstrap.cc:492] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:20:02.889456 32392 leader_election.cc:290] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Requested vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:02.892105 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00cad1e6b6304a218e5bfe0f979d2fc9" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:20:02.893115 32229 raft_consensus.cc:3060] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:02.894706 32406 tablet_bootstrap.cc:654] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.901577 32404 tablet_bootstrap.cc:492] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:20:02.902165 32404 ts_tablet_manager.cc:1403] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.000s
I20260709 12:20:02.906294 32229 raft_consensus.cc:2468] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 1.
I20260709 12:20:02.907416 32404 raft_consensus.cc:359] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.908319 32404 raft_consensus.cc:385] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.908000 32046 leader_election.cc:304] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 55a304e5735842648243cfdf2b64c187
I20260709 12:20:02.908754 32404 raft_consensus.cc:740] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.909664 32404 consensus_queue.cc:260] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.910818 32430 raft_consensus.cc:2804] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:02.911648 32430 raft_consensus.cc:697] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Becoming Leader. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:20:02.912947 32430 consensus_queue.cc:237] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.922866 32405 tablet_bootstrap.cc:654] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:02.924235 32391 raft_consensus.cc:493] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.925069 32391 raft_consensus.cc:515] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.931808 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:20:02.932994 32155 raft_consensus.cc:2468] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 0.
I20260709 12:20:02.934440 32415 raft_consensus.cc:493] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.935312 32415 raft_consensus.cc:515] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.939186 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
W20260709 12:20:02.941608 32196 leader_election.cc:343] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.942924 32195 leader_election.cc:304] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:20:02.943903 32415 leader_election.cc:290] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:02.930030 32391 leader_election.cc:290] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:20:02.944449 32413 raft_consensus.cc:2804] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:02.944977 32413 raft_consensus.cc:493] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.945339 32413 raft_consensus.cc:3060] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:02.916813 32404 ts_tablet_manager.cc:1434] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:20:02.917742 32392 raft_consensus.cc:493] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.947198 32392 raft_consensus.cc:515] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.949257 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003ca858b0d544739d15f84896eb25c9" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:20:02.947216 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003ca858b0d544739d15f84896eb25c9" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:02.949884 32392 leader_election.cc:290] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:02.951869 32230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:02.952772 32229 raft_consensus.cc:2468] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:20:02.950135 32083 raft_consensus.cc:2468] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
W20260709 12:20:02.954663 32046 leader_election.cc:343] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.955008 32121 leader_election.cc:304] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:02.956248 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
W20260709 12:20:02.958024 32046 leader_election.cc:343] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.958518 32046 leader_election.cc:304] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634; no voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187
I20260709 12:20:02.959554 32392 raft_consensus.cc:2749] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:02.959846 32383 raft_consensus.cc:493] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.960548 32383 raft_consensus.cc:515] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.961002 32413 raft_consensus.cc:515] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.963945 32383 leader_election.cc:290] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:02.964640 32383 raft_consensus.cc:2804] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:02.964995 32383 raft_consensus.cc:493] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.965308 32383 raft_consensus.cc:3060] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:02.965848 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
W20260709 12:20:02.967470 32196 leader_election.cc:343] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:02.968359 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81b7e40e8ca4980b2d01dcada113a3b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:02.969262 32229 raft_consensus.cc:2468] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:20:02.971035 32413 leader_election.cc:290] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:20:02.972675 32121 leader_election.cc:304] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:02.974156 32405 tablet_bootstrap.cc:492] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:20:02.975360 32405 ts_tablet_manager.cc:1403] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.011s
I20260709 12:20:02.979995 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:20:02.980656 32155 raft_consensus.cc:3060] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:02.983151 32405 raft_consensus.cc:359] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.983951 32405 raft_consensus.cc:385] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.984261 32405 raft_consensus.cc:740] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.985029 32405 consensus_queue.cc:260] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.986979 32415 raft_consensus.cc:2804] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:02.987429 32415 raft_consensus.cc:493] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.987775 32415 raft_consensus.cc:3060] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:02.990921 32406 tablet_bootstrap.cc:492] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:20:02.989594 31978 catalog_manager.cc:5697] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:02.991545 32406 ts_tablet_manager.cc:1403] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.113s	user 0.026s	sys 0.049s
I20260709 12:20:02.994851 32406 raft_consensus.cc:359] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:02.995606 32406 raft_consensus.cc:385] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:02.995890 32406 raft_consensus.cc:740] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:20:02.996649 32406 consensus_queue.cc:260] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.005577 32405 ts_tablet_manager.cc:1434] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:20:03.006938 32406 ts_tablet_manager.cc:1434] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:20:03.015213 32406 tablet_bootstrap.cc:492] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:20:03.016209 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81b7e40e8ca4980b2d01dcada113a3b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:20:03.017040 32083 raft_consensus.cc:2468] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:20:03.022236 32404 tablet_bootstrap.cc:492] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:20:03.023451 32406 tablet_bootstrap.cc:654] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:03.007067 32405 tablet_bootstrap.cc:492] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
W20260709 12:20:03.027588 32029 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:03.032555 32383 raft_consensus.cc:515] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.034886 32155 raft_consensus.cc:2468] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 1.
I20260709 12:20:03.035179 32406 tablet_bootstrap.cc:492] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:20:03.035816 32406 ts_tablet_manager.cc:1403] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 12:20:03.036434 32195 leader_election.cc:304] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:20:03.037341 32413 raft_consensus.cc:2804] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:03.037814 32413 raft_consensus.cc:697] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Becoming Leader. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Running, Role: LEADER
I20260709 12:20:03.038614 32413 consensus_queue.cc:237] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.045011 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003ca858b0d544739d15f84896eb25c9" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:20:03.045647 32383 leader_election.cc:290] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.045974 32083 raft_consensus.cc:3060] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.047071 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "003ca858b0d544739d15f84896eb25c9" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:20:03.047488 32405 tablet_bootstrap.cc:654] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:03.050293 32229 raft_consensus.cc:3060] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.056912 31978 catalog_manager.cc:5697] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3254653e60684a5789a61046db6f0c5a (127.17.249.195). New cstate: current_term: 1 leader_uuid: "3254653e60684a5789a61046db6f0c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:03.058013 32229 raft_consensus.cc:2468] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:20:03.042986 32415 raft_consensus.cc:515] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.058627 32083 raft_consensus.cc:2468] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:20:03.062088 32122 leader_election.cc:304] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:03.064144 32404 tablet_bootstrap.cc:654] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:03.066427 32383 raft_consensus.cc:2804] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:03.067019 32383 raft_consensus.cc:697] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:20:03.067869 32383 consensus_queue.cc:237] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.068356 32415 leader_election.cc:290] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.071210 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81b7e40e8ca4980b2d01dcada113a3b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:20:03.072001 32083 raft_consensus.cc:3060] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.075790 32406 raft_consensus.cc:359] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.076628 32406 raft_consensus.cc:385] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:03.076911 32406 raft_consensus.cc:740] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:20:03.077674 32406 consensus_queue.cc:260] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.080343 32406 ts_tablet_manager.cc:1434] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:20:03.082420 32405 tablet_bootstrap.cc:492] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:20:03.082199 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81b7e40e8ca4980b2d01dcada113a3b" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:20:03.082976 32405 ts_tablet_manager.cc:1403] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.001s
I20260709 12:20:03.082952 32404 tablet_bootstrap.cc:492] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:20:03.083949 32404 ts_tablet_manager.cc:1403] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.062s	user 0.006s	sys 0.009s
I20260709 12:20:03.082932 32229 raft_consensus.cc:3060] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.086010 32405 raft_consensus.cc:359] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.086723 32405 raft_consensus.cc:385] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:03.086998 32405 raft_consensus.cc:740] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:20:03.088614 32405 consensus_queue.cc:260] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.090672 32405 ts_tablet_manager.cc:1434] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:03.081621 32406 tablet_bootstrap.cc:492] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a: Bootstrap starting.
I20260709 12:20:03.091715 32405 tablet_bootstrap.cc:492] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634: Bootstrap starting.
I20260709 12:20:03.099771 32406 tablet_bootstrap.cc:654] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:03.099913 32083 raft_consensus.cc:2468] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:20:03.101271 32122 leader_election.cc:304] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:03.102325 32415 raft_consensus.cc:2804] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:03.102875 32415 raft_consensus.cc:697] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:20:03.103942 32415 consensus_queue.cc:237] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.133957 32405 tablet_bootstrap.cc:654] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:03.136670 32406 tablet_bootstrap.cc:492] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a: No bootstrap required, opened a new log
I20260709 12:20:03.137369 32406 ts_tablet_manager.cc:1403] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.012s
I20260709 12:20:03.140297 32406 raft_consensus.cc:359] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.140976 32406 raft_consensus.cc:385] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:03.141223 32406 raft_consensus.cc:740] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Initialized, Role: FOLLOWER
I20260709 12:20:03.141815 32406 consensus_queue.cc:260] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.143879 32406 ts_tablet_manager.cc:1434] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:20:03.145125 32421 raft_consensus.cc:493] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.146191 32421 raft_consensus.cc:515] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.148980 32421 leader_election.cc:290] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.149098 32405 tablet_bootstrap.cc:492] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634: No bootstrap required, opened a new log
I20260709 12:20:03.161398 32405 ts_tablet_manager.cc:1403] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.001s
I20260709 12:20:03.163519 32404 raft_consensus.cc:359] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.164538 32404 raft_consensus.cc:385] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:03.164875 32404 raft_consensus.cc:740] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:20:03.165078 32405 raft_consensus.cc:359] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.166010 32405 raft_consensus.cc:385] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:03.166347 32405 raft_consensus.cc:740] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Initialized, Role: FOLLOWER
I20260709 12:20:03.165728 32404 consensus_queue.cc:260] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.167495 32405 consensus_queue.cc:260] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.170110 32405 ts_tablet_manager.cc:1434] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:03.150030 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95e928a8b7934624b5d460a3a6e6f960" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:20:03.170861 32155 raft_consensus.cc:2468] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 0.
I20260709 12:20:03.154199 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95e928a8b7934624b5d460a3a6e6f960" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:03.171582 32231 raft_consensus.cc:2468] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 0.
I20260709 12:20:03.172454 32046 leader_election.cc:304] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:03.173916 32421 raft_consensus.cc:2804] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:03.174156 32229 raft_consensus.cc:2468] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:20:03.174361 32421 raft_consensus.cc:493] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.175263 32421 raft_consensus.cc:3060] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.179405 32404 ts_tablet_manager.cc:1434] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.002s
I20260709 12:20:03.180902 32404 tablet_bootstrap.cc:492] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:20:03.188117 32404 tablet_bootstrap.cc:654] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:03.190042 32421 raft_consensus.cc:515] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.190279 31978 catalog_manager.cc:5697] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.193662 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95e928a8b7934624b5d460a3a6e6f960" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:20:03.194335 32155 raft_consensus.cc:3060] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.198134 32383 raft_consensus.cc:493] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.199361 32392 raft_consensus.cc:493] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.202540 32392 raft_consensus.cc:515] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.204893 32392 leader_election.cc:290] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.201783 32413 raft_consensus.cc:493] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.205753 32413 raft_consensus.cc:515] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.209292 32413 leader_election.cc:290] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:20:03.209362 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:20:03.210196 32083 raft_consensus.cc:2468] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 0.
I20260709 12:20:03.212177 32156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:20:03.211987 32383 raft_consensus.cc:515] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.212260 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94b770e16be4113bba163f7e3bf9995" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:03.213330 32229 raft_consensus.cc:2468] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 0.
I20260709 12:20:03.214037 32196 leader_election.cc:304] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 
I20260709 12:20:03.215081 32413 raft_consensus.cc:2804] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:03.215541 32413 raft_consensus.cc:493] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.215940 32156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94b770e16be4113bba163f7e3bf9995" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:20:03.215973 32413 raft_consensus.cc:3060] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.216787 32156 raft_consensus.cc:2468] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 0.
I20260709 12:20:03.218011 32415 raft_consensus.cc:493] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.218552 32415 raft_consensus.cc:515] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.229607 32046 leader_election.cc:304] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:03.231953 32430 raft_consensus.cc:2804] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:03.232393 32430 raft_consensus.cc:493] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.233816 32430 raft_consensus.cc:3060] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.232378 32421 leader_election.cc:290] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Requested vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.265277 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06eb084c301847d3ad2ce884b3dec10c" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:20:03.266222 32083 raft_consensus.cc:2468] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:20:03.267627 32122 leader_election.cc:304] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:03.268720 32437 raft_consensus.cc:2804] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:03.269112 32437 raft_consensus.cc:493] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.269464 32437 raft_consensus.cc:3060] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.269968 32156 raft_consensus.cc:3060] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.271682 32383 leader_election.cc:290] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.271819 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d777760c488141f381151f981992ff11" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:20:03.287611 32392 consensus_queue.cc:1048] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.289196 32155 raft_consensus.cc:2468] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 1.
I20260709 12:20:03.292302 32437 raft_consensus.cc:515] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
W20260709 12:20:03.290766 32195 leader_election.cc:343] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:03.300184 32046 leader_election.cc:304] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:03.296664 31978 catalog_manager.cc:5697] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.301347 32415 leader_election.cc:290] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.308223 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d777760c488141f381151f981992ff11" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:03.308650 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06eb084c301847d3ad2ce884b3dec10c" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:03.309247 32229 raft_consensus.cc:2393] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55a304e5735842648243cfdf2b64c187 in current term 1: Already voted for candidate 3c3674e1e1dc4b728a64a21109b6c634 in this term.
I20260709 12:20:03.309538 32231 raft_consensus.cc:2468] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 0.
I20260709 12:20:03.310838 32230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95e928a8b7934624b5d460a3a6e6f960" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:20:03.311101 32413 raft_consensus.cc:515] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.311563 32230 raft_consensus.cc:3060] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.311488 32121 leader_election.cc:304] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55a304e5735842648243cfdf2b64c187; no voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:20:03.314625 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:20:03.315287 32083 raft_consensus.cc:3060] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.315991 32415 raft_consensus.cc:2749] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:03.320917 32392 raft_consensus.cc:2804] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:03.321609 32392 raft_consensus.cc:697] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Becoming Leader. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:20:03.322541 32392 consensus_queue.cc:237] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.324116 32083 raft_consensus.cc:2468] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 1.
I20260709 12:20:03.325693 32196 leader_election.cc:304] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 
I20260709 12:20:03.327657 32391 raft_consensus.cc:2804] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:03.328181 32391 raft_consensus.cc:697] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Becoming Leader. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Running, Role: LEADER
I20260709 12:20:03.329103 32391 consensus_queue.cc:237] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.333089 32082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06eb084c301847d3ad2ce884b3dec10c" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:20:03.333411 32437 leader_election.cc:290] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.334025 32082 raft_consensus.cc:3060] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.336450 32232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06eb084c301847d3ad2ce884b3dec10c" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:20:03.337316 32232 raft_consensus.cc:3060] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.348788 32082 raft_consensus.cc:2468] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:20:03.304862 32430 raft_consensus.cc:515] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
W20260709 12:20:03.350136 32046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.194:38353, user_credentials={real_user=slave}} blocked reactor thread for 50060.8us
I20260709 12:20:03.350957 32413 leader_election.cc:290] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:20:03.355657 32157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:20:03.359424 32230 raft_consensus.cc:2468] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 1.
I20260709 12:20:03.364799 32232 raft_consensus.cc:2468] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 1.
I20260709 12:20:03.373812 32424 consensus_queue.cc:1048] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:03.380982 32195 leader_election.cc:343] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:03.391131 32121 leader_election.cc:304] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:03.397200 32437 raft_consensus.cc:2804] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:03.399250 32437 raft_consensus.cc:697] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:20:03.400422 32437 consensus_queue.cc:237] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.403649 32430 leader_election.cc:290] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Requested vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.407289 32230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94b770e16be4113bba163f7e3bf9995" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:20:03.408051 32230 raft_consensus.cc:3060] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:03.413980 32196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.249.193:41627, user_credentials={real_user=slave}} blocked reactor thread for 72430.1us
I20260709 12:20:03.416999 31978 catalog_manager.cc:5697] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.421748 32230 raft_consensus.cc:2468] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 1.
W20260709 12:20:03.445827 32046 consensus_peers.cc:597] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 -> Peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Couldn't send request to peer 55a304e5735842648243cfdf2b64c187. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:03.451359 32046 leader_election.cc:304] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 
I20260709 12:20:03.451766 32452 raft_consensus.cc:493] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.452483 32452 raft_consensus.cc:515] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.417742 31980 catalog_manager.cc:5697] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3254653e60684a5789a61046db6f0c5a (127.17.249.195). New cstate: current_term: 1 leader_uuid: "3254653e60684a5789a61046db6f0c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:03.446556 32157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94b770e16be4113bba163f7e3bf9995" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:20:03.457896 32157 raft_consensus.cc:3060] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.447732 32404 tablet_bootstrap.cc:492] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:20:03.460791 32430 raft_consensus.cc:2804] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:03.464425 32404 ts_tablet_manager.cc:1403] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.284s	user 0.059s	sys 0.087s
I20260709 12:20:03.469892 32430 raft_consensus.cc:697] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Becoming Leader. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:20:03.473747 32430 consensus_queue.cc:237] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.478220 31978 catalog_manager.cc:5697] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 1 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.481498 32404 raft_consensus.cc:359] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.482518 32404 raft_consensus.cc:385] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:03.482705 32404 raft_consensus.cc:740] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:20:03.484738 32404 consensus_queue.cc:260] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.487278 32404 ts_tablet_manager.cc:1434] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:20:03.488399 32404 tablet_bootstrap.cc:492] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187: Bootstrap starting.
I20260709 12:20:03.494261 32404 tablet_bootstrap.cc:654] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:03.499071 32452 leader_election.cc:290] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.499749 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a304e5735842648243cfdf2b64c187" is_pre_election: true
I20260709 12:20:03.500671 32155 raft_consensus.cc:2393] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c3674e1e1dc4b728a64a21109b6c634 in current term 1: Already voted for candidate 3254653e60684a5789a61046db6f0c5a in this term.
I20260709 12:20:03.503741 32230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:03.506112 32046 leader_election.cc:304] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634; no voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187
I20260709 12:20:03.514264 32391 consensus_queue.cc:1048] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.515017 32457 consensus_queue.cc:1048] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.513815 32421 raft_consensus.cc:3060] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.544763 32157 raft_consensus.cc:2468] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 1.
I20260709 12:20:03.545135 31978 catalog_manager.cc:5697] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193). New cstate: current_term: 1 leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.547248 32437 consensus_queue.cc:1048] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.564271 32404 tablet_bootstrap.cc:492] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187: No bootstrap required, opened a new log
I20260709 12:20:03.565121 32404 ts_tablet_manager.cc:1403] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.019s
I20260709 12:20:03.569079 32404 raft_consensus.cc:359] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.570101 32404 raft_consensus.cc:385] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:03.570489 32404 raft_consensus.cc:740] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Initialized, Role: FOLLOWER
I20260709 12:20:03.588819 32404 consensus_queue.cc:260] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.604346 32421 raft_consensus.cc:2749] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:03.611778 32415 consensus_queue.cc:1048] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.619318 32448 consensus_queue.cc:1048] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.619943 32437 consensus_queue.cc:1048] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.620563 32404 ts_tablet_manager.cc:1434] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.002s
I20260709 12:20:03.679011 32232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab"
dest_uuid: "3254653e60684a5789a61046db6f0c5a"
mode: GRACEFUL
new_leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
 from {username='slave'} at 127.0.0.1:33184
I20260709 12:20:03.679741 32232 raft_consensus.cc:606] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Received request to transfer leadership to TS 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:20:03.680111 32437 consensus_queue.cc:1048] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:03.700505 32155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06eb084c301847d3ad2ce884b3dec10c"
dest_uuid: "55a304e5735842648243cfdf2b64c187"
mode: GRACEFUL
new_leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
 from {username='slave'} at 127.0.0.1:52020
I20260709 12:20:03.701267 32155 raft_consensus.cc:606] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Received request to transfer leadership to TS 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:20:03.726230 32448 raft_consensus.cc:993] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a: : Instructing follower 3c3674e1e1dc4b728a64a21109b6c634 to start an election
I20260709 12:20:03.726854 32448 raft_consensus.cc:1081] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Signalling peer 3c3674e1e1dc4b728a64a21109b6c634 to start an election
I20260709 12:20:03.729220 32083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab"
dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
 from {username='slave'} at 127.0.0.1:58052
I20260709 12:20:03.730047 32083 raft_consensus.cc:493] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.730497 32083 raft_consensus.cc:3060] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.734267 32231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2"
dest_uuid: "3254653e60684a5789a61046db6f0c5a"
mode: GRACEFUL
new_leader_uuid: "55a304e5735842648243cfdf2b64c187"
 from {username='slave'} at 127.0.0.1:33184
I20260709 12:20:03.735190 32231 raft_consensus.cc:606] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Received request to transfer leadership to TS 55a304e5735842648243cfdf2b64c187
I20260709 12:20:03.740408 32083 raft_consensus.cc:515] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.743580 32155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:20:03.744287 32155 raft_consensus.cc:3060] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.749359 32082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95e928a8b7934624b5d460a3a6e6f960"
dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
mode: GRACEFUL
new_leader_uuid: "55a304e5735842648243cfdf2b64c187"
 from {username='slave'} at 127.0.0.1:58054
I20260709 12:20:03.750264 32082 raft_consensus.cc:606] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Received request to transfer leadership to TS 55a304e5735842648243cfdf2b64c187
I20260709 12:20:03.758883 32155 raft_consensus.cc:2468] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 2.
I20260709 12:20:03.763345 32046 leader_election.cc:304] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:03.761638 32083 leader_election.cc:290] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 2 election: Requested vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.764222 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84b6bf16e2f949e59f227935328382ab" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:20:03.765129 32231 raft_consensus.cc:3055] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:03.765498 32231 raft_consensus.cc:740] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Running, Role: LEADER
I20260709 12:20:03.767045 32421 raft_consensus.cc:2804] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:03.767721 32421 raft_consensus.cc:697] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 LEADER]: Becoming Leader. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:20:03.768775 32421 consensus_queue.cc:237] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.766548 32231 consensus_queue.cc:260] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.774520 32231 raft_consensus.cc:3060] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.776355 32430 consensus_queue.cc:1048] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.786096 32083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d94b770e16be4113bba163f7e3bf9995"
dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
mode: GRACEFUL
new_leader_uuid: "3254653e60684a5789a61046db6f0c5a"
 from {username='slave'} at 127.0.0.1:58054
I20260709 12:20:03.786933 32083 raft_consensus.cc:606] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Received request to transfer leadership to TS 3254653e60684a5789a61046db6f0c5a
I20260709 12:20:03.787001 32383 raft_consensus.cc:493] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.787786 32383 raft_consensus.cc:515] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.790470 31980 catalog_manager.cc:5697] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 reported cstate change: term changed from 1 to 2, leader changed from 3254653e60684a5789a61046db6f0c5a (127.17.249.195) to 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.791378 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634" is_pre_election: true
I20260709 12:20:03.793047 32083 raft_consensus.cc:2393] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55a304e5735842648243cfdf2b64c187 in current term 1: Already voted for candidate 3254653e60684a5789a61046db6f0c5a in this term.
I20260709 12:20:03.796036 32231 raft_consensus.cc:2468] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 2.
I20260709 12:20:03.799988 32383 leader_election.cc:290] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.804009 32430 consensus_queue.cc:1048] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.804518 32229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3254653e60684a5789a61046db6f0c5a" is_pre_election: true
I20260709 12:20:03.806881 32121 leader_election.cc:304] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55a304e5735842648243cfdf2b64c187; no voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634
I20260709 12:20:03.808645 32383 raft_consensus.cc:3060] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.830190 32383 raft_consensus.cc:2749] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:03.830873 32458 raft_consensus.cc:993] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634: : Instructing follower 55a304e5735842648243cfdf2b64c187 to start an election
I20260709 12:20:03.831597 32421 raft_consensus.cc:1081] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Signalling peer 55a304e5735842648243cfdf2b64c187 to start an election
I20260709 12:20:03.834060 32155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95e928a8b7934624b5d460a3a6e6f960"
dest_uuid: "55a304e5735842648243cfdf2b64c187"
 from {username='slave'} at 127.0.0.1:52012
I20260709 12:20:03.835855 32155 raft_consensus.cc:493] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.836378 32155 raft_consensus.cc:3060] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.845219 32155 raft_consensus.cc:515] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.849454 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95e928a8b7934624b5d460a3a6e6f960" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:20:03.850266 32083 raft_consensus.cc:3055] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:03.850615 32083 raft_consensus.cc:740] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:20:03.850647 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95e928a8b7934624b5d460a3a6e6f960" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:20:03.851528 32231 raft_consensus.cc:3060] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.851454 32083 consensus_queue.cc:260] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.852699 32083 raft_consensus.cc:3060] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.858772 32155 leader_election.cc:290] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 2 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.860077 32157 raft_consensus.cc:3060] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:03.864028 32083 raft_consensus.cc:2468] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 2.
I20260709 12:20:03.864763 32231 raft_consensus.cc:2468] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 2.
I20260709 12:20:03.866389 32122 leader_election.cc:304] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:03.867288 32383 raft_consensus.cc:2804] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:03.867890 32383 raft_consensus.cc:697] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 2 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:20:03.868690 32383 consensus_queue.cc:237] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.877946 31978 catalog_manager.cc:5697] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 1 to 2, leader changed from 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193) to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.881891 32391 consensus_queue.cc:1048] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.908366 32448 consensus_queue.cc:1048] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:03.917726 32391 raft_consensus.cc:993] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a: : Instructing follower 55a304e5735842648243cfdf2b64c187 to start an election
I20260709 12:20:03.918282 32391 raft_consensus.cc:1081] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Signalling peer 55a304e5735842648243cfdf2b64c187 to start an election
I20260709 12:20:03.920805 32157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2"
dest_uuid: "55a304e5735842648243cfdf2b64c187"
 from {username='slave'} at 127.0.0.1:52016
I20260709 12:20:03.921372 32157 raft_consensus.cc:493] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.921708 32157 raft_consensus.cc:3060] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.928308 32157 raft_consensus.cc:515] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.930568 32157 leader_election.cc:290] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 2 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.931551 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:20:03.932370 32083 raft_consensus.cc:3060] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.936378 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3431822bf8ae43959e53234e90dc29a2" candidate_uuid: "55a304e5735842648243cfdf2b64c187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:20:03.937150 32231 raft_consensus.cc:3055] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:03.937501 32231 raft_consensus.cc:740] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Running, Role: LEADER
I20260709 12:20:03.938506 32231 consensus_queue.cc:260] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.939996 32231 raft_consensus.cc:3060] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.940091 32083 raft_consensus.cc:2468] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 2.
I20260709 12:20:03.942297 32122 leader_election.cc:304] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:03.943231 32383 raft_consensus.cc:2804] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:03.943823 32383 raft_consensus.cc:697] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 2 LEADER]: Becoming Leader. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:20:03.944718 32383 consensus_queue.cc:237] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.950619 32231 raft_consensus.cc:2468] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a304e5735842648243cfdf2b64c187 in term 2.
I20260709 12:20:03.953238 31980 catalog_manager.cc:5697] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 reported cstate change: term changed from 1 to 2, leader changed from 3254653e60684a5789a61046db6f0c5a (127.17.249.195) to 55a304e5735842648243cfdf2b64c187 (127.17.249.194). New cstate: current_term: 2 leader_uuid: "55a304e5735842648243cfdf2b64c187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.968581 32383 consensus_queue.cc:1048] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.977681 32415 raft_consensus.cc:993] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187: : Instructing follower 3c3674e1e1dc4b728a64a21109b6c634 to start an election
I20260709 12:20:03.978169 32415 raft_consensus.cc:1081] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Signalling peer 3c3674e1e1dc4b728a64a21109b6c634 to start an election
I20260709 12:20:03.982934 32082 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06eb084c301847d3ad2ce884b3dec10c"
dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
 from {username='slave'} at 127.0.0.1:58038
I20260709 12:20:03.983660 32082 raft_consensus.cc:493] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.984112 32082 raft_consensus.cc:3060] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.983745 32383 consensus_queue.cc:1048] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:03.994334 32082 raft_consensus.cc:515] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:03.995555 32083 raft_consensus.cc:1240] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Rejecting Update request from peer 55a304e5735842648243cfdf2b64c187 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:03.996688 32082 leader_election.cc:290] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 2 election: Requested vote from peers 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353), 3254653e60684a5789a61046db6f0c5a (127.17.249.195:45163)
I20260709 12:20:03.998092 32157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06eb084c301847d3ad2ce884b3dec10c" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:20:03.998611 32157 raft_consensus.cc:3055] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:03.998878 32231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06eb084c301847d3ad2ce884b3dec10c" candidate_uuid: "3c3674e1e1dc4b728a64a21109b6c634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3254653e60684a5789a61046db6f0c5a"
I20260709 12:20:03.998914 32157 raft_consensus.cc:740] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:20:04.002107 32430 consensus_queue.cc:1048] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:04.002419 32383 consensus_queue.cc:1059] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:04.004972 32157 consensus_queue.cc:260] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:04.006297 32157 raft_consensus.cc:3060] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.014864 32157 raft_consensus.cc:2468] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3674e1e1dc4b728a64a21109b6c634 in term 2.
W20260709 12:20:04.015501 32437 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:20:04.020886 32046 leader_election.cc:304] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c3674e1e1dc4b728a64a21109b6c634, 55a304e5735842648243cfdf2b64c187; no voters: 3254653e60684a5789a61046db6f0c5a
I20260709 12:20:04.021024 32458 consensus_queue.cc:1048] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:04.022907 32430 raft_consensus.cc:2804] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:04.023514 32430 raft_consensus.cc:697] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 LEADER]: Becoming Leader. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:20:04.024304 32430 consensus_queue.cc:237] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:04.039884 31978 catalog_manager.cc:5697] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 reported cstate change: term changed from 1 to 2, leader changed from 55a304e5735842648243cfdf2b64c187 (127.17.249.194) to 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193). New cstate: current_term: 2 leader_uuid: "3c3674e1e1dc4b728a64a21109b6c634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:04.048803 32458 raft_consensus.cc:993] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634: : Instructing follower 3254653e60684a5789a61046db6f0c5a to start an election
I20260709 12:20:04.049437 32458 raft_consensus.cc:1081] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Signalling peer 3254653e60684a5789a61046db6f0c5a to start an election
I20260709 12:20:04.051802 32229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d94b770e16be4113bba163f7e3bf9995"
dest_uuid: "3254653e60684a5789a61046db6f0c5a"
 from {username='slave'} at 127.0.0.1:33170
I20260709 12:20:04.052966 32229 raft_consensus.cc:493] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:04.053422 32229 raft_consensus.cc:3060] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.062389 32229 raft_consensus.cc:515] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:04.064805 32229 leader_election.cc:290] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 2 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:20:04.066054 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94b770e16be4113bba163f7e3bf9995" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:20:04.066227 32157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d94b770e16be4113bba163f7e3bf9995" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:20:04.067027 32083 raft_consensus.cc:3055] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:04.067348 32157 raft_consensus.cc:3060] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.067407 32083 raft_consensus.cc:740] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:20:04.068394 32083 consensus_queue.cc:260] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:04.069835 32083 raft_consensus.cc:3060] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.076918 32157 raft_consensus.cc:2468] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 2.
I20260709 12:20:04.077966 32083 raft_consensus.cc:2468] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 2.
I20260709 12:20:04.078624 32195 leader_election.cc:304] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:04.079636 32391 raft_consensus.cc:2804] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:04.080238 32391 raft_consensus.cc:697] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 2 LEADER]: Becoming Leader. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Running, Role: LEADER
I20260709 12:20:04.081110 32391 consensus_queue.cc:237] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:04.088933 31978 catalog_manager.cc:5697] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a reported cstate change: term changed from 1 to 2, leader changed from 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193) to 3254653e60684a5789a61046db6f0c5a (127.17.249.195). New cstate: current_term: 2 leader_uuid: "3254653e60684a5789a61046db6f0c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:04.330721 32229 raft_consensus.cc:1275] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Refusing update from remote peer 55a304e5735842648243cfdf2b64c187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.332406 32437 consensus_queue.cc:1048] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:04.335318 32157 raft_consensus.cc:1275] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Refusing update from remote peer 3c3674e1e1dc4b728a64a21109b6c634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.337165 32458 consensus_queue.cc:1048] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.342942 32231 raft_consensus.cc:1275] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Refusing update from remote peer 3c3674e1e1dc4b728a64a21109b6c634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.344583 32458 consensus_queue.cc:1048] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.344728 32083 raft_consensus.cc:1275] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Refusing update from remote peer 55a304e5735842648243cfdf2b64c187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.347025 32437 consensus_queue.cc:1048] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.372300 32083 raft_consensus.cc:1275] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Refusing update from remote peer 55a304e5735842648243cfdf2b64c187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.375501 32383 consensus_queue.cc:1048] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.389633 32231 raft_consensus.cc:1275] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Refusing update from remote peer 55a304e5735842648243cfdf2b64c187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.391125 32383 consensus_queue.cc:1048] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:04.535523 32157 raft_consensus.cc:1275] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Refusing update from remote peer 3c3674e1e1dc4b728a64a21109b6c634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.537407 32421 consensus_queue.cc:1048] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.546540 32231 raft_consensus.cc:3060] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.554129 32231 raft_consensus.cc:1275] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Refusing update from remote peer 3c3674e1e1dc4b728a64a21109b6c634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.555680 32421 consensus_queue.cc:1048] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.651064 32083 raft_consensus.cc:1275] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Refusing update from remote peer 3254653e60684a5789a61046db6f0c5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.652614 32391 consensus_queue.cc:1048] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.661967 32157 raft_consensus.cc:1275] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Refusing update from remote peer 3254653e60684a5789a61046db6f0c5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.664790 32413 consensus_queue.cc:1048] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:06.792038 31980 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39578:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:20:06.823144 31980 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39578:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:20:07.020047 32530 tablet.cc:1724] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.017580 32531 tablet.cc:1724] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:06.978552 32524 tablet.cc:1724] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.046744 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:07.067997 32536 tablet.cc:1724] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.078855 32523 tablet.cc:1724] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:07.082370 32509 log.cc:927] Time spent T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
W20260709 12:20:07.077255 32506 log.cc:927] Time spent T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
W20260709 12:20:07.190392 32529 log.cc:927] Time spent T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:20:07.232431 32548 tablet.cc:1724] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.236610 32544 tablet.cc:1724] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.277297 32549 tablet.cc:1724] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.318580 32524 tablet.cc:1724] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.313549 32536 tablet.cc:1724] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.372187 32562 tablet.cc:1724] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.347752 32554 tablet.cc:1724] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.369639 32531 tablet.cc:1724] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.377080 32559 tablet.cc:1724] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.382458 32561 tablet.cc:1724] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.384232 32523 tablet.cc:1724] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.391062 32548 tablet.cc:1724] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.399330 32156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a"
dest_uuid: "55a304e5735842648243cfdf2b64c187"
mode: GRACEFUL
new_leader_uuid: "3254653e60684a5789a61046db6f0c5a"
 from {username='slave'} at 127.0.0.1:50970
I20260709 12:20:07.400489 32156 raft_consensus.cc:606] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 2 LEADER]: Received request to transfer leadership to TS 3254653e60684a5789a61046db6f0c5a
I20260709 12:20:07.400162 32530 tablet.cc:1724] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.410519 32548 tablet.cc:1724] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.412344 31977 catalog_manager.cc:5789] TS 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627) does not have the latest schema for tablet 84b6bf16e2f949e59f227935328382ab (table soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]). Expected version 1 got 0
I20260709 12:20:07.413468 31977 catalog_manager.cc:5789] TS 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627) does not have the latest schema for tablet 00cad1e6b6304a218e5bfe0f979d2fc9 (table soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]). Expected version 1 got 0
I20260709 12:20:07.419710 31977 catalog_manager.cc:5789] TS 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627) does not have the latest schema for tablet 06eb084c301847d3ad2ce884b3dec10c (table soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]). Expected version 1 got 0
I20260709 12:20:07.370952 32544 tablet.cc:1724] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.437577 31980 catalog_manager.cc:5789] TS 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353) does not have the latest schema for tablet 3431822bf8ae43959e53234e90dc29a2 (table soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]). Expected version 1 got 0
I20260709 12:20:07.421964 32549 tablet.cc:1724] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.437747 32548 tablet.cc:1724] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.442920 32524 tablet.cc:1724] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.463047 32559 tablet.cc:1724] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.472514 32082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b102429c805b4903a194300a419ee47b"
dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
mode: GRACEFUL
new_leader_uuid: "3254653e60684a5789a61046db6f0c5a"
 from {username='slave'} at 127.0.0.1:34866
I20260709 12:20:07.470116 32549 tablet.cc:1724] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.473428 32082 raft_consensus.cc:606] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 LEADER]: Received request to transfer leadership to TS 3254653e60684a5789a61046db6f0c5a
I20260709 12:20:07.475461 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:07.445504 32554 tablet.cc:1724] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.476188 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:07.479461 32562 tablet.cc:1724] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:07.439396 31980 catalog_manager.cc:5789] TS 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353) does not have the latest schema for tablet 95e928a8b7934624b5d460a3a6e6f960 (table soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b]). Expected version 1 got 0
I20260709 12:20:07.529536 31980 catalog_manager.cc:6242] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60: soft_deleted_table [id=390fe6bb2a324db2ad10213731c9d92b] alter complete (version 1)
I20260709 12:20:07.638723 32537 raft_consensus.cc:993] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187: : Instructing follower 3254653e60684a5789a61046db6f0c5a to start an election
I20260709 12:20:07.639549 32535 raft_consensus.cc:1081] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 2 LEADER]: Signalling peer 3254653e60684a5789a61046db6f0c5a to start an election
I20260709 12:20:07.641499 32229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a"
dest_uuid: "3254653e60684a5789a61046db6f0c5a"
 from {username='slave'} at 127.0.0.1:33164
I20260709 12:20:07.641986 32229 raft_consensus.cc:493] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.642268 32229 raft_consensus.cc:3060] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.648138 32229 raft_consensus.cc:515] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:07.650025 32229 leader_election.cc:290] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 3 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:20:07.651376 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:20:07.651427 32156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3189494d3c4528a7777982f4195a5a" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:20:07.652446 32083 raft_consensus.cc:3060] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.652606 32156 raft_consensus.cc:3055] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:07.653088 32156 raft_consensus.cc:740] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 55a304e5735842648243cfdf2b64c187, State: Running, Role: LEADER
I20260709 12:20:07.653978 32156 consensus_queue.cc:260] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:07.655210 32156 raft_consensus.cc:3060] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.659806 32083 raft_consensus.cc:2468] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 3.
I20260709 12:20:07.661530 32156 raft_consensus.cc:2468] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 3.
I20260709 12:20:07.661578 32196 leader_election.cc:304] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 3c3674e1e1dc4b728a64a21109b6c634; no voters: 
I20260709 12:20:07.663092 32413 raft_consensus.cc:2804] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:07.663738 32413 raft_consensus.cc:697] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 3 LEADER]: Becoming Leader. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Running, Role: LEADER
I20260709 12:20:07.664716 32413 consensus_queue.cc:237] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:07.676149 31977 catalog_manager.cc:5697] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a reported cstate change: term changed from 2 to 3, leader changed from 55a304e5735842648243cfdf2b64c187 (127.17.249.194) to 3254653e60684a5789a61046db6f0c5a (127.17.249.195). New cstate: current_term: 3 leader_uuid: "3254653e60684a5789a61046db6f0c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:07.805384 32484 raft_consensus.cc:993] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634: : Instructing follower 3254653e60684a5789a61046db6f0c5a to start an election
I20260709 12:20:07.806085 32512 raft_consensus.cc:1081] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 LEADER]: Signalling peer 3254653e60684a5789a61046db6f0c5a to start an election
I20260709 12:20:07.808091 32229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b102429c805b4903a194300a419ee47b"
dest_uuid: "3254653e60684a5789a61046db6f0c5a"
 from {username='slave'} at 127.0.0.1:33170
I20260709 12:20:07.808681 32229 raft_consensus.cc:493] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.809038 32229 raft_consensus.cc:3060] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.815119 32229 raft_consensus.cc:515] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:07.817015 32229 leader_election.cc:290] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 3 election: Requested vote from peers 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627), 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353)
I20260709 12:20:07.818118 32083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b102429c805b4903a194300a419ee47b" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c3674e1e1dc4b728a64a21109b6c634"
I20260709 12:20:07.818473 32156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b102429c805b4903a194300a419ee47b" candidate_uuid: "3254653e60684a5789a61046db6f0c5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "55a304e5735842648243cfdf2b64c187"
I20260709 12:20:07.819036 32083 raft_consensus.cc:3055] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:07.819098 32156 raft_consensus.cc:3060] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.819512 32083 raft_consensus.cc:740] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c3674e1e1dc4b728a64a21109b6c634, State: Running, Role: LEADER
I20260709 12:20:07.820649 32083 consensus_queue.cc:260] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:07.822273 32083 raft_consensus.cc:3060] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.829025 32156 raft_consensus.cc:2468] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 3.
I20260709 12:20:07.830730 32195 leader_election.cc:304] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3254653e60684a5789a61046db6f0c5a, 55a304e5735842648243cfdf2b64c187; no voters: 
I20260709 12:20:07.830976 32083 raft_consensus.cc:2468] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3254653e60684a5789a61046db6f0c5a in term 3.
I20260709 12:20:07.831972 32413 raft_consensus.cc:2804] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:07.832724 32413 raft_consensus.cc:697] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 3 LEADER]: Becoming Leader. State: Replica: 3254653e60684a5789a61046db6f0c5a, State: Running, Role: LEADER
I20260709 12:20:07.833716 32413 consensus_queue.cc:237] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } }
I20260709 12:20:07.844491 31977 catalog_manager.cc:5697] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a reported cstate change: term changed from 2 to 3, leader changed from 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193) to 3254653e60684a5789a61046db6f0c5a (127.17.249.195). New cstate: current_term: 3 leader_uuid: "3254653e60684a5789a61046db6f0c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3254653e60684a5789a61046db6f0c5a" member_type: VOTER last_known_addr { host: "127.17.249.195" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.059000 32156 raft_consensus.cc:1275] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 3 FOLLOWER]: Refusing update from remote peer 3254653e60684a5789a61046db6f0c5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:08.060629 32413 consensus_queue.cc:1048] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:08.075989 32083 raft_consensus.cc:1275] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 3 FOLLOWER]: Refusing update from remote peer 3254653e60684a5789a61046db6f0c5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:08.078627 32413 consensus_queue.cc:1048] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:08.349153 32082 raft_consensus.cc:1275] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 3 FOLLOWER]: Refusing update from remote peer 3254653e60684a5789a61046db6f0c5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:08.350577 32413 consensus_queue.cc:1048] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3674e1e1dc4b728a64a21109b6c634" member_type: VOTER last_known_addr { host: "127.17.249.193" port: 41627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:08.365175 32156 raft_consensus.cc:1275] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 3 FOLLOWER]: Refusing update from remote peer 3254653e60684a5789a61046db6f0c5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:08.366711 32570 consensus_queue.cc:1048] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a304e5735842648243cfdf2b64c187" member_type: VOTER last_known_addr { host: "127.17.249.194" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:08.477548 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.484820 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:08.485267 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:09.486513 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:09.492518 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:09.493084 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:10.665664 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:10.673838 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:10.674571 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:20:10.935315 32104 debug-util.cc:398] Leaking SignalData structure 0x7b0800218d20 after lost signal to thread 18410
W20260709 12:20:10.936707 32104 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6480 after lost signal to thread 32015
W20260709 12:20:10.938042 32104 debug-util.cc:398] Leaking SignalData structure 0x7b0800170b40 after lost signal to thread 32107
W20260709 12:20:10.939142 32104 debug-util.cc:398] Leaking SignalData structure 0x7b08000fc780 after lost signal to thread 32182
W20260709 12:20:10.940070 32104 debug-util.cc:398] Leaking SignalData structure 0x7b080009b160 after lost signal to thread 32256
I20260709 12:20:11.675776 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:11.681218 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:11.681725 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:12.683058 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:12.688299 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:12.688885 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:13.690019 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:13.697067 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:13.697585 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:14.698732 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:14.705470 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:14.706110 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:15.707950 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:15.722041 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:15.722936 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:16.724578 18407 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:16.729960 18407 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:16.730455 18407 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:17.802175 18407 tablet_server.cc:179] TabletServer@127.17.249.193:0 shutting down...
W20260709 12:20:17.837956 32122 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 12:20:17.845873 32122 consensus_peers.cc:597] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 -> Peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Couldn't send request to peer 3c3674e1e1dc4b728a64a21109b6c634. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:17.854424 32122 consensus_peers.cc:597] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 -> Peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Couldn't send request to peer 3c3674e1e1dc4b728a64a21109b6c634. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:17.868810 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:17.869894 18407 tablet_replica.cc:333] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.871033 18407 raft_consensus.cc:2243] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.871845 18407 raft_consensus.cc:2272] T d94b770e16be4113bba163f7e3bf9995 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.875270 18407 tablet_replica.cc:333] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.875937 18407 raft_consensus.cc:2243] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.876922 18407 raft_consensus.cc:2272] T 84b6bf16e2f949e59f227935328382ab P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.880194 18407 tablet_replica.cc:333] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.881072 18407 raft_consensus.cc:2243] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.881881 18407 raft_consensus.cc:2272] T 95e928a8b7934624b5d460a3a6e6f960 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.885179 18407 tablet_replica.cc:333] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.885842 18407 raft_consensus.cc:2243] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.886467 18407 raft_consensus.cc:2272] T 003ca858b0d544739d15f84896eb25c9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.889103 18407 tablet_replica.cc:333] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.889894 18407 raft_consensus.cc:2243] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.891290 18407 raft_consensus.cc:2272] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.894767 18407 tablet_replica.cc:333] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.895514 18407 raft_consensus.cc:2243] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.896153 18407 raft_consensus.cc:2272] T d81b7e40e8ca4980b2d01dcada113a3b P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.898860 18407 tablet_replica.cc:333] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.899453 18407 raft_consensus.cc:2243] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.900646 18407 raft_consensus.cc:2272] T d777760c488141f381151f981992ff11 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.904635 18407 tablet_replica.cc:333] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.905625 18407 raft_consensus.cc:2243] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.906306 18407 raft_consensus.cc:2272] T 3431822bf8ae43959e53234e90dc29a2 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.909191 18407 tablet_replica.cc:333] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.909788 18407 raft_consensus.cc:2243] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.910286 18407 raft_consensus.cc:2272] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.913231 18407 tablet_replica.cc:333] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.913861 18407 raft_consensus.cc:2243] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.914758 18407 raft_consensus.cc:2272] T 06eb084c301847d3ad2ce884b3dec10c P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.917809 18407 tablet_replica.cc:333] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.918401 18407 raft_consensus.cc:2243] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.918973 18407 raft_consensus.cc:2272] T 5ef788b0311b48cda5e5efbaef940e1b P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.921562 18407 tablet_replica.cc:333] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.922348 18407 raft_consensus.cc:2243] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.922909 18407 raft_consensus.cc:2272] T 418186b6e8fa454a88b9b5904ca0d3ac P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.925676 18407 tablet_replica.cc:333] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.926283 18407 raft_consensus.cc:2243] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.927357 18407 raft_consensus.cc:2272] T ada69b307b6e4c6587635392c5983898 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.930114 18407 tablet_replica.cc:333] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.930750 18407 raft_consensus.cc:2243] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.931304 18407 raft_consensus.cc:2272] T b102429c805b4903a194300a419ee47b P 3c3674e1e1dc4b728a64a21109b6c634 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.934036 18407 tablet_replica.cc:333] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.934645 18407 raft_consensus.cc:2243] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.935319 18407 raft_consensus.cc:2272] T 6a3189494d3c4528a7777982f4195a5a P 3c3674e1e1dc4b728a64a21109b6c634 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.938318 18407 tablet_replica.cc:333] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.939004 18407 raft_consensus.cc:2243] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.940043 18407 raft_consensus.cc:2272] T d0cbe796c8da4a6583e0863c58da762c P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.942984 18407 tablet_replica.cc:333] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.943573 18407 raft_consensus.cc:2243] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.944103 18407 raft_consensus.cc:2272] T e538ac6980b14988bdb1ae4b5e602692 P 3c3674e1e1dc4b728a64a21109b6c634 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.946663 18407 tablet_replica.cc:333] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634: stopping tablet replica
I20260709 12:20:17.947228 18407 raft_consensus.cc:2243] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.948287 18407 raft_consensus.cc:2272] T 79337a4361e34cc1bf1c435c68f74ca9 P 3c3674e1e1dc4b728a64a21109b6c634 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:18.013170 32196 consensus_peers.cc:597] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a -> Peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Couldn't send request to peer 3c3674e1e1dc4b728a64a21109b6c634. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:18.026916 18407 tablet_server.cc:196] TabletServer@127.17.249.193:0 shutdown complete.
W20260709 12:20:18.036502 32122 consensus_peers.cc:597] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 -> Peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Couldn't send request to peer 3c3674e1e1dc4b728a64a21109b6c634. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:18.095081 18407 tablet_server.cc:179] TabletServer@127.17.249.194:0 shutting down...
W20260709 12:20:18.120889 32122 consensus_peers.cc:597] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 -> Peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Couldn't send request to peer 3c3674e1e1dc4b728a64a21109b6c634. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:18.146696 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:20:18.146924 32122 consensus_peers.cc:597] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 -> Peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Couldn't send request to peer 3c3674e1e1dc4b728a64a21109b6c634. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:18.148453 18407 tablet_replica.cc:333] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.149854 18407 raft_consensus.cc:2243] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.151479 18407 raft_consensus.cc:2272] T 3431822bf8ae43959e53234e90dc29a2 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.155081 18407 tablet_replica.cc:333] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.155952 18407 raft_consensus.cc:2243] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.156648 18407 raft_consensus.cc:2272] T d94b770e16be4113bba163f7e3bf9995 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.159833 18407 tablet_replica.cc:333] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.160558 18407 raft_consensus.cc:2243] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.161386 18407 raft_consensus.cc:2272] T d777760c488141f381151f981992ff11 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.164628 18407 tablet_replica.cc:333] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.165478 18407 raft_consensus.cc:2243] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.166180 18407 raft_consensus.cc:2272] T 06eb084c301847d3ad2ce884b3dec10c P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.169929 18407 tablet_replica.cc:333] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.170943 18407 raft_consensus.cc:2243] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.172390 18407 raft_consensus.cc:2272] T d81b7e40e8ca4980b2d01dcada113a3b P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:18.174230 32196 consensus_peers.cc:597] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a -> Peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Couldn't send request to peer 3c3674e1e1dc4b728a64a21109b6c634. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:18.176172 18407 tablet_replica.cc:333] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.176990 18407 raft_consensus.cc:2243] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.177672 18407 raft_consensus.cc:2272] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.181244 18407 tablet_replica.cc:333] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.182088 18407 raft_consensus.cc:2243] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.183400 18407 raft_consensus.cc:2272] T 003ca858b0d544739d15f84896eb25c9 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.187108 18407 tablet_replica.cc:333] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.187978 18407 raft_consensus.cc:2243] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.188848 18407 raft_consensus.cc:2272] T 84b6bf16e2f949e59f227935328382ab P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.192070 18407 tablet_replica.cc:333] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.192876 18407 raft_consensus.cc:2243] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.193977 18407 raft_consensus.cc:2272] T 95e928a8b7934624b5d460a3a6e6f960 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.196821 18407 tablet_replica.cc:333] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.197521 18407 raft_consensus.cc:2243] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.198614 18407 raft_consensus.cc:2272] T e538ac6980b14988bdb1ae4b5e602692 P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.201633 18407 tablet_replica.cc:333] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.202399 18407 raft_consensus.cc:2243] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.203065 18407 raft_consensus.cc:2272] T 6a3189494d3c4528a7777982f4195a5a P 55a304e5735842648243cfdf2b64c187 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.206161 18407 tablet_replica.cc:333] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.207023 18407 raft_consensus.cc:2243] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.207718 18407 raft_consensus.cc:2272] T d0cbe796c8da4a6583e0863c58da762c P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.210654 18407 tablet_replica.cc:333] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.211364 18407 raft_consensus.cc:2243] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.211948 18407 raft_consensus.cc:2272] T b102429c805b4903a194300a419ee47b P 55a304e5735842648243cfdf2b64c187 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.214934 18407 tablet_replica.cc:333] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.215679 18407 raft_consensus.cc:2243] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.216234 18407 raft_consensus.cc:2272] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 55a304e5735842648243cfdf2b64c187 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.219290 18407 tablet_replica.cc:333] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.220022 18407 raft_consensus.cc:2243] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.220666 18407 raft_consensus.cc:2272] T ada69b307b6e4c6587635392c5983898 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.223637 18407 tablet_replica.cc:333] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.224306 18407 raft_consensus.cc:2243] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.225580 18407 raft_consensus.cc:2272] T 5ef788b0311b48cda5e5efbaef940e1b P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.228817 18407 tablet_replica.cc:333] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.229522 18407 raft_consensus.cc:2243] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.230629 18407 raft_consensus.cc:2272] T 418186b6e8fa454a88b9b5904ca0d3ac P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.233637 18407 tablet_replica.cc:333] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187: stopping tablet replica
I20260709 12:20:18.234223 18407 raft_consensus.cc:2243] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.234810 18407 raft_consensus.cc:2272] T 79337a4361e34cc1bf1c435c68f74ca9 P 55a304e5735842648243cfdf2b64c187 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:18.248760 32195 consensus_peers.cc:597] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a -> Peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Couldn't send request to peer 55a304e5735842648243cfdf2b64c187. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:18.281790 32196 consensus_peers.cc:597] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a -> Peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Couldn't send request to peer 3c3674e1e1dc4b728a64a21109b6c634. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:18.290658 32195 consensus_peers.cc:597] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a -> Peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Couldn't send request to peer 55a304e5735842648243cfdf2b64c187. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:38353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:18.305871 32195 consensus_peers.cc:597] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a -> Peer 55a304e5735842648243cfdf2b64c187 (127.17.249.194:38353): Couldn't send request to peer 55a304e5735842648243cfdf2b64c187. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.194:38353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:18.309882 32196 consensus_peers.cc:597] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a -> Peer 3c3674e1e1dc4b728a64a21109b6c634 (127.17.249.193:41627): Couldn't send request to peer 3c3674e1e1dc4b728a64a21109b6c634. Status: Network error: Client connection negotiation failed: client connection to 127.17.249.193:41627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:18.319988 18407 tablet_server.cc:196] TabletServer@127.17.249.194:0 shutdown complete.
I20260709 12:20:18.364619 18407 tablet_server.cc:179] TabletServer@127.17.249.195:0 shutting down...
I20260709 12:20:18.403317 18407 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:18.404457 18407 tablet_replica.cc:333] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.405512 18407 raft_consensus.cc:2243] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.406301 18407 raft_consensus.cc:2272] T 06eb084c301847d3ad2ce884b3dec10c P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.409898 18407 tablet_replica.cc:333] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.410774 18407 raft_consensus.cc:2243] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.411556 18407 raft_consensus.cc:2272] T 3431822bf8ae43959e53234e90dc29a2 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.414242 18407 tablet_replica.cc:333] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.414880 18407 raft_consensus.cc:2243] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.415364 18407 raft_consensus.cc:2272] T d81b7e40e8ca4980b2d01dcada113a3b P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.417718 18407 tablet_replica.cc:333] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.418316 18407 raft_consensus.cc:2243] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.418924 18407 raft_consensus.cc:2272] T 95e928a8b7934624b5d460a3a6e6f960 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.421820 18407 tablet_replica.cc:333] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.422609 18407 raft_consensus.cc:2243] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.423565 18407 raft_consensus.cc:2272] T 84b6bf16e2f949e59f227935328382ab P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.426982 18407 tablet_replica.cc:333] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.427722 18407 raft_consensus.cc:2243] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.428684 18407 raft_consensus.cc:2272] T d94b770e16be4113bba163f7e3bf9995 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.431416 18407 tablet_replica.cc:333] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.432226 18407 raft_consensus.cc:2243] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.432857 18407 raft_consensus.cc:2272] T d777760c488141f381151f981992ff11 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.435361 18407 tablet_replica.cc:333] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.435985 18407 raft_consensus.cc:2243] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.436921 18407 raft_consensus.cc:2272] T 4e1a84a9fe7f44509f2bfb122fc77e9d P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.439579 18407 tablet_replica.cc:333] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.440201 18407 raft_consensus.cc:2243] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.440690 18407 raft_consensus.cc:2272] T ada69b307b6e4c6587635392c5983898 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.443100 18407 tablet_replica.cc:333] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.443743 18407 raft_consensus.cc:2243] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.444265 18407 raft_consensus.cc:2272] T d0cbe796c8da4a6583e0863c58da762c P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.446636 18407 tablet_replica.cc:333] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.447245 18407 raft_consensus.cc:2243] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.448221 18407 raft_consensus.cc:2272] T 6a3189494d3c4528a7777982f4195a5a P 3254653e60684a5789a61046db6f0c5a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.450527 18407 tablet_replica.cc:333] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.451151 18407 raft_consensus.cc:2243] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.451664 18407 raft_consensus.cc:2272] T e538ac6980b14988bdb1ae4b5e602692 P 3254653e60684a5789a61046db6f0c5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.453956 18407 tablet_replica.cc:333] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.454507 18407 raft_consensus.cc:2243] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.455456 18407 raft_consensus.cc:2272] T b102429c805b4903a194300a419ee47b P 3254653e60684a5789a61046db6f0c5a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.457646 18407 tablet_replica.cc:333] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.458199 18407 raft_consensus.cc:2243] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.458694 18407 raft_consensus.cc:2272] T 79337a4361e34cc1bf1c435c68f74ca9 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.460991 18407 tablet_replica.cc:333] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.461727 18407 raft_consensus.cc:2243] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.462244 18407 raft_consensus.cc:2272] T 00cad1e6b6304a218e5bfe0f979d2fc9 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.464534 18407 tablet_replica.cc:333] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.465090 18407 raft_consensus.cc:2243] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.465643 18407 raft_consensus.cc:2272] T 003ca858b0d544739d15f84896eb25c9 P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.467923 18407 tablet_replica.cc:333] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.468462 18407 raft_consensus.cc:2243] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.468938 18407 raft_consensus.cc:2272] T 418186b6e8fa454a88b9b5904ca0d3ac P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.471097 18407 tablet_replica.cc:333] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a: stopping tablet replica
I20260709 12:20:18.471583 18407 raft_consensus.cc:2243] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.472352 18407 raft_consensus.cc:2272] T 5ef788b0311b48cda5e5efbaef940e1b P 3254653e60684a5789a61046db6f0c5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.522351 18407 tablet_server.cc:196] TabletServer@127.17.249.195:0 shutdown complete.
I20260709 12:20:18.573859 18407 master.cc:562] Master@127.17.249.254:35153 shutting down...
I20260709 12:20:18.603969 18407 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.604645 18407 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.605031 18407 tablet_replica.cc:333] T 00000000000000000000000000000000 P fe2f412236ab4f67a43364b7b0c1aa60: stopping tablet replica
I20260709 12:20:18.628063 18407 master.cc:584] Master@127.17.249.254:35153 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (23193 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44642 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (479654 ms total)
[  PASSED  ] 6 tests.
[  FAILED  ] 2 tests, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver
[  FAILED  ] LeaderRebalancerTest.RestartTserver

 2 FAILED TESTS
I20260709 12:20:18.693015 18407 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2254 messages since previous log ~34 seconds ago
I20260709 12:20:18.693259 18407 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2253 messages since previous log ~34 seconds ago
I20260709 12:20:18.693491 18407 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2252 messages since previous log ~34 seconds ago
I20260709 12:20:18.693773 18407 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:20:18.693969 18407 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:20:18.694223 18407 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~97 seconds ago
I20260709 12:20:18.694541 18407 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 12 messages since previous log ~0 seconds ago
I20260709 12:20:18.694718 18407 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~21 seconds ago
